WO2003034380A2 - Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit - Google Patents

Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit Download PDF

Info

Publication number
WO2003034380A2
WO2003034380A2 PCT/IB2002/004227 IB0204227W WO03034380A2 WO 2003034380 A2 WO2003034380 A2 WO 2003034380A2 IB 0204227 W IB0204227 W IB 0204227W WO 03034380 A2 WO03034380 A2 WO 03034380A2
Authority
WO
WIPO (PCT)
Prior art keywords
sub
image
pixels
color difference
pixel
Prior art date
Application number
PCT/IB2002/004227
Other languages
French (fr)
Other versions
WO2003034380A3 (en
Inventor
Michiel A. Klompenhouwer
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to AU2002341280A priority Critical patent/AU2002341280A1/en
Priority to JP2003537032A priority patent/JP2005505801A/en
Priority to US10/492,665 priority patent/US20040239813A1/en
Priority to EP02775075A priority patent/EP1442450A2/en
Priority to KR10-2004-7005780A priority patent/KR20040052246A/en
Publication of WO2003034380A2 publication Critical patent/WO2003034380A2/en
Publication of WO2003034380A3 publication Critical patent/WO2003034380A3/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G09G5/006Details of the interface to the display terminal
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/30Picture reproducers using solid-state colour display devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/04Structural and physical details of display devices
    • G09G2300/0439Pixel structures
    • G09G2300/0452Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0407Resolution change, inclusive of the use of different resolutions for different screen areas
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0457Improvement of perceived resolution by subpixel rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Video Image Reproduction Devices For Color Tv Systems (AREA)

Abstract

By taking into account the individual positions of the sub-pixels (108-118) on a color matrix display device (100), the apparent resolution can be increased. Sub-pixel sampling to determine samples at the correct position is incorporated in the image scaling filter (502). The filter response is such that the useful resolution inherent in the color matrix display device (100) can be used. In the filter design, a trade-off is made between sharpness and color errors. The scaling (216) is performed on e.g. a YUV signal, thereby saving bandwidth. The luminance signal Y is e.g. sub-sampled at high sub-pixel resolution, and the U and V components at pixel resolution. The sub-pixel positions are then taken into account in the YUV to RGB conversion (218).

Description

Method of and display processing unit for displaying an image and a display apparatus comprising such a display processing unit
The invention relates to a method of displaying an image on a color matrix display device.
The invention further relates to a display processing unit for displaying an image on a color matrix display device. The invention further relates to a display apparatus comprising:
- a receiver for receiving an image;
- a display processing unit for displaying an image on a color matrix display device; and
- the color matrix display device.
Matrix display devices, such as LCDs, PDPs and PolyLEDs, offer the potential of reaching a very high image quality with a very convenient and or fashionable
(lightweight, flat, large) screen. Matrix display devices provide the viewer with an image that is as sharp at the corners as it is in the center. A particular disadvantage of a matrix display device is its fixed resolution, which makes image scaling prior to display a necessity.
EP 0974953 Al discloses that the apparent resolution of a matrix display device can be increased by profiting from one of its characteristics: the fact that each full color pixel actually consists of a number of, spatially displaced, color sub-pixels. When each pixel is used as a group of three sub-pixels, then on the display the red and blue sub-pixels must be shifted relative to the green sub-pixel by 1/3 of a -pixel size. A filter is described that realizes this shift by delaying the color component signals in the image relative to each other. An embodiment of the system according to the prior art aims at profiting from higher resolution by taking into account the actual position of the sub-pixels in the process of converting a high resolution input signal to the display resolution. The image scaling is specifically tuned to the arrangement of sub-pixels on the display. The underlying principle is that a value of a color component that is valid at the position where it is actually displayed is used, in stead of a value of the color component at the position of the corresponding full color pixel. It is a first object of the invention to provide a method of displaying an image, with a relatively high resolution. It is a second object of the invention to provide a display processing unit for displaying an image, with a relatively high resolution.
It is a third object of the invention to provide a display apparatus for displaying an image, with a relatively high resolution.
The first object of the invention is achieved in that the method of displaying an image on a color matrix display device which comprises multiple pixels, each comprising sub-pixels corresponding to predetermined colors, the image being represented by an image signal comprising a luminance component, a first color difference component and a second color difference component, the method comprising:
- a scaling step to scale the image to an intermediate image represented by a further image signal comprising an intermediate luminance component, a first intermediate color difference component and a second intermediate color difference component, with scaling of the luminance component related to a sub-pixel resolution which is related to a number of sub-pixels of the color matrix display device;
- a conversion step to calculate signal values for a particular pixel to be provided to respective sub-pixels of the particular pixel based on samples of the intermediate luminance component, the first intermediate color difference component and the second intermediate color difference component;
- a display step in which the signal values are provided to the respective sub- pixels of the particular pixel. The most important aspect of the invention is that the sub-pixel resolution of the color matrix display device is taken into account in the scaling of the image which is represented by the luminance component, the first color difference component and the second color difference component. After the scaling the conversion to signal values which can be provided to the sub-pixels is performed. For example, with an embodiment of the method according to the invention a scaling step to the appropriate resolution is performed on the YUN components in stead of on the red, green and blue color components (RGB). The conversion from YUN components to RGB components is executed after the scaling step. The result is that the number of operations is less compared with sub-pixel scaling after conversion. The method according to the prior art deals with scaling of RGB components and not of scaling with luminance and color difference components. Processing YUN components of video signals is more common than processing RGB components. Especially for television, video signals are stored using a combination of a luminance and two chrominance components rather than red, green and blue color components. In other words, in the video standards YUN, YIQ or YCBCR components are used instead of RGB components. For example, the YUN signal comprises a luminance component Y and two chrominance or color difference components U and N. The bandwidth of a video signal can be reduced by transmitting the U and N components with reduced bandwidth compared to the Y component, i.e. with less samples. This construction matches relatively well to human perception, since the human vision system is much more sensitive to luminance than to color. Typical formats are called 4:2:2 and 4:2:0 meaning that there are only half as many U and N samples horizontally, and horizontally and vertically, respectively.
It is possible to scale the luminance component, the first color difference component and the second color difference component to the sub-pixel resolution. But in a preferred embodiment of the method of displaying an image according to the invention, the first color difference component and the second color difference component are scaled to the first intermediate color difference component and the second intermediate color difference component respectively, both having a pixel resolution of the color matrix display device, which is related to a number of pixels of the color matrix display device. The advantage is that less computations are required.
In an embodiment of the method of displaying an image according to the invention, a particular signal value of a particular sub-pixel is calculated based on a first sample of the intermediate luminance component and a second sample of the first intermediate color difference component. The information about the actual position of the sub-pixels is used in the conversion step, e.g. YUN to RGB. For example, the Y component is scaled to three times the pixel resolution, i.e. the sub-pixel resolution, and the U and N components are scaled to the pixel resolution. The filtering on Y must make the tradeoff between sharpness and color errors, by choosing the right cut-off frequency, which is typically just above the pixel resolution, i.e. Νyquist frequency. The full resolution on the Y signal after scaling is therefore not necessarily used. For each pixel of the color matrix display device there are three Y samples, one [/ sample and one V sample. The conversion step becomes:
Λ = F1 +1.4 G = Y2 - 0.332U -0.112V B = Y3 +1.1W Where Yx , Y__ and F3 are luminance samples at positions which are in the neighborhood of the red, green and blue sub-pixels, respectively, and where U and V are chrominance samples at a position which is in the neighborhood of the center of the particular pixel. The advantage of this embodiment is that the conversion step is relatively easy. Another advantage of this embodiment is that the scaling step and the conversion step are relatively independent. In the scaling step, samples are calculated and in the conversion step those samples are used which are relatively close to the actual position of the sub-pixels. The RGB to YUN conversion matrix is an example which is related to the video standard and RGB color points. Other matrices are applicable for other standards.
An embodiment of the method of displaying an image according to the invention is characterized in that in the scaling step the first sample of the intermediate luminance component is calculated by taking into account a location of the particular sub- pixel. Preferably, e.g. the Y samples are calculated for the sub-pixel positions, and the U and V samples are calculated for the central sub-pixel position of a pixel. The conversion step becomes:
R = YR +1ΛV G = YG - 0.332(7 -0.112V B = YB + 1.7SU
Where YR , Y_G and Y_B are luminance samples at positions which are substantially at the position of the red, green and blue sub-pixels, respectively, and where U and V are chrominance samples at a position which is substantially at the position of the center of the particular pixel. An advantage of this embodiment is that the image quality is relatively high. In an embodiment of the method of displaying an image according to the invention, the particular signal value of the particular sub-pixel is calculated based on an interpolation of multiple samples of the intermediate luminance component. This means e.g. that in the conversion, not a single Y sample is used, but an average of a number of Y samples. Preferably a weighted average is used. This complicates the conversion, but the scaling step may be simplified, e.g. by taking a lower scaling factor. Also, the U and V_ samples can be interpolated to the correct position. Modifications of the method and variations thereof may correspond to modifications and variations thereof of the display processing unit described.
These and other aspects of the method and display processing unit and of the display apparatus according to the invention will become apparent from and will be elucidated with respect to the implementations and embodiments described hereinafter and with reference to the accompanying drawings, wherein:
Fig. 1 schematically shows an embodiment of a color matrix display device; Fig. 2 schematically shows the processing steps according to the invention;
Fig. 3 A schematically shows the scaling of an input image into Y, U and N samples at sub-pixel resolution;
Fig. 3B schematically shows the scaling of an input image into Y samples at sub-pixel resolution and U and N samples into pixel resolution; Fig. 3C schematically shows the interpolation of Y, U and N samples to calculate the R, G, and B sub-pixel values;
Fig. 4 schematically shows a delta-nabla pixel arrangement; Fig. 5 schematically shows an embodiment of the display processing unit according to the invention; and Fig. 6 schematically shows an embodiment of the display apparatus according to the invention. Corresponding reference numerals have the same meaning in all of the Figs.
Fig. 1 schematically shows an embodiment of a color matrix display device
100. A color matrix display device 100 is a 2-dimensional arrangement of discrete luminous pixels 102-106 that together can display an image. The amount of image detail that can be produced by a matrix display device 100 depends largely on the number of pixels 102-106. To address each pixel in the color matrix display device 100, i.e. control the generated light intensity, a matrix display device 100 contains a matrix of row- and column electrodes to define a co-ordinate system on the color matrix display device 100 in which each pixel 102- 106 is located. The intensity of each pixel 102-106 can then be controlled by applying an appropriate voltage or current to each pixel 102-106 individually via the row and column electrodes. To display a full color image, the color matrix display device 100 needs to be able to generate light of at least three primary colors, usually red, green and blue. By mixing these primary colors with different intensities, a full color gamut, spanned by the primary colors can be generated. Since a matrix display device 100 consists of discrete elements of which only the intensity can be controlled, each pixel 102-106 has to contain a number of sub-pixels 108-118 that can generate these primary colors with an intensity determined by the image signal. When the sub-pixels 108-118 are small enough, the human visual system is not capable of distinguishing the individual sub-pixels 108-118, and consequently the primary colors are blended together to form the intended color at the position of the full color pixel. For the sake of simplicity, it will be assumed that there are equal numbers of each primary sub-pixel on the display. With equal numbers of sub-pixels, the full color pixels 102-106 can be easily defined, and each full color pixel contains exactly three sub-pixels 108-118. There is however a certain degree of freedom in this choice of grouping. Hence also for e.g. a Pentile with 2xG,2xR, 1XB or an RGBW (white) configuration the method according to this invention is applicable. In the color matrix display device 100 shown in Fig. 1 sub-pixels 108-118 have been combined in a red, green and blue order to a full color pixel. But the choice could also have been different, for instance in the order of green, blue and red, which shifts all pixels 1/3 of a pixel distance to the right. This already indicates that it is possible to position a piece of full color information with a higher accuracy than the pixel distance indicates, without introducing color errors, because still a red, green and blue sub-pixel are used to build a full color.
The sub-pixels 108-118 each have a different position, and if the color of the sub-pixels 108-118 could be neglected, the resolution would be three times that of the color matrix display device 100, e.g. in the horizontal direction. However, in principle the color of the sub-pixels 108-118 cannot be neglected. If a matrix display device which does not perform an anti-alias or low pass-filtering, is provided with a black and white signal, i.e. only containing gray levels, at three times the resolution, very annoying color artifacts appear.
The resolution of a color matrix display device 100 is higher than the number of full color pixels indicate, as long as the position of the sub-pixels 108-118 is taken into account. To achieve the higher resolution, the value of the video signal at the sub-pixel position is required in stead of at the full color pixel positions. This procedure is called sub- pixel sampling. Therefore, new samples must be calculated at these positions. The general method to achieve this is sample rate conversion and is explained in EP 0346621 and in "Displaced filtering for patterned displays", by C. Betrisey et al. in SID 2000 Digest, pages 275-277. It is also indicated that polyphase filters are very appropriate for this.
Fig. 2 schematically shows the processing steps 216 and 218 according to the invention. An image 200 comprises a luminance component 204, a first color difference component 206 and a second color difference component 208. These components have Y_, U and N samples, respectively. In general, the positions of these samples do not correspond with the positions of the sub-pixels 108-118 of the color matrix display device 100. First a scaling step is performed to scale the image 200 to an intermediate image 202 comprising an intermediate luminance component 210 having a sub-pixel resolution. The first color difference component 206 is scaled to the first intermediate color difference component 212 having a pixel resolution. The second color difference component 208 is scaled to the second intermediate color difference component 214 having a pixel resolution. After that a conversion step 218 is performed to convert the intermediate image 202 to values of the sub- pixels 108-118. Fig. 3 A schematically shows the scaling of an input image with input Y, U and
N samples 302-316 into intermediate Y, U and N samples 318-331 at sub-pixel resolution. Besides that the conversion of the intermediate Y, U and N samples 318-331 into the R, G, and B sub-pixel values is also shown. The intermediate Y, U and N samples 318-331 are calculated by means of sub-sampling. E.g. intermediate Y sample 331 is based on input Y samples 302-308, intermediate U sample 318 is based on input U samples 310 and 312, and intermediate N sample 320 is based on input N samples 314 and 316. The positions of the intermediate Y, U and N samples 318-331 correspond to the positions of the red, green and blue sub-pixels 108-118. Hence, the values R, G, and B of the sub-pixels can be calculated directly: - R_ = Y + 1 ΛV , with Y sample 328 and N sample 320;
- G^ = Y - 0.332J - 0.712 , with Y sample 326, V sample 324 and U sample 318; and
- Bx= Y + l .1SU , with Y sample 331 and U sample 322.
Fig. 3B schematically shows the scaling of an input image with input Y, U and N samples 302-316 into intermediate Y samples 326,328 and 331 at sub-pixel resolution and U samples 318 and 330 and N samples 332 and 324 into pixel resolution. The intermediate Y, U and N samples 318-331 are calculated by means of sub-sampling. The positions of the intermediate Y samples 326,328 and 331 correspond to the positions of the red, green and blue sub-pixels 108-118, but the intermediate U 318,330 and N samples 332,324 correspond to the central pixel positions of the pixels. Hence, the values R, G, and B of the sub-pixels can be calculated directly:
- R_ = Σ + 1. , with Y sample 328 and V sample 332; - G^ = Y - 0.332(7 - 0.712 , with Y sample 326, V sample 324 and U sample 318; and
- B. = Y + 1.7817 , with Y sample 331 and U sample 330.
Fig. 3C schematically shows the interpolation of Y, U and N samples to calculate R, G, and B sub-pixel values. The values of the intermediate Y, U and N samples are calculated as described in connection with Fig 3 A. The positions of the intermediate Y samples 326,328 and 331 do not correspond to the positions of the red green and blue sub- pixels 108-118. Also the intermediate U samples 318 and 330 and N samples 332 and 324 do not correspond to the central pixel positions. It is possible to calculate the values R, G, and B of the sub-pixels as described in connection with Fig. 3B. That means by taking the intermediate Y, U and N samples which are closest to the red green and blue sub-pixel positions. Another approach is based on interpolation, e.g.
Bλ= aY_ +(\-a)Y2 +l.l&(βUχ (l- β)U2), with Y_ι sample 331, Y sample 333, U sample 330 and with Uj sample 318. a and β are related to the offset between the positions of the intermediate samples and the sub-pixel positions. The simple interpolation in the YUN-RGB conversion will generally have a low- pass effect, for which can be compensated in the scaling filter characteristic such that the response of the scaling-interpolation cascade substantially equals one.
Fig. 4 schematically shows a delta-nabla pixel arrangement 400. Up till now, the general principle has been explained, and where illustrated, a "vertical stripe" arrangement has been used. Of course, this is not the only color sub-pixel arrangement. Next the implications of sub-pixel scaling on the so-called delta-nabla arrangement will be described. Fig. 4 shows the delta-nabla arrangement, and a typical grouping of three sub- pixels 108-118 into full color pixels. The name "delta-nabla" comes from the typical form of this grouping. The sub-pixels are situated on a quincunx, or hexagonal, lattice, while the relative displacement is still 1/3 of the horizontal distance between sub-pixels of the same color. I.e. it is basically the same as the "vertical stripe" arrangement, but where each odd pixel on a row has half a row spacing offset, and the pixel shape is changed accordingly. Many other shapes, e.g. square or diamond are also possible in the delta-nabla arrangement, with the hexagon as the best approximation to a circle. The distribution of sub-pixels 108-118 in this arrangement is truly 2-Dimensional, because any color sub-pixel 108-118 is surrounded by only sub-pixels of the two other colors. Therefore a resolution gain is present in all directions, in stead of only in horizontal direction with the vertical stripe arrangement. However, to scale to such an hexagonal arrangement, is not a trivial task. 2-Dimensional non- separable filtering and co-ordinate transformations are usually involved. Nevertheless, the basic theory of sub-pixel sampling also holds for the delta-nabla arrangement, and as long as the most serious color aliasing is removed, the gain in resolution is also present. It is possible to scale from a rectangular, i.e. conventional row-column lattice to an hexagonal lattice using polyphase filters in a simple way, by recognizing that the hexagonal lattice is created by taking a rectangular lattice, and shifting samples on odd lines by half a pixel distance. Since the sub-pixels are displaced horizontally, first the input signal is scaled to twice the number of rows of the display, using a normal polyphase scaling method. Then the odd and even lines with different horizontal offsets, and of course different phases for RGB, are scaled. Finally, the samples are combined again along the rows as defined by the display electrodes, in order to get the correct values at the correct position when the color matrix display device is addressed using these rows and columns. Due to this "packing" step, the Nyquist frequencies in horizontal and vertical direction are changed. That means vertical samples become horizontal samples, and the filter must be adapted accordingly. This means that the vertical filter should have its cut-off frequency roughly at twice the Nyquist rate, while the horizontal filter cuts off at half the Nyquist rate. Of course these cut-off frequencies can be optimized for sharpness versus color errors. It must be noted that this approach does not result in a completely correct 2-dimensional filter response, because the diagonal frequencies are only suppressed if the corresponding horizontal and vertical frequencies do so, and a truly hexagonal band-limitation cannot be obtained. Nevertheless this does result in a very simple sub-pixel scaling method for delta-nabla displays. When the Y signal is again oversampled compared to the pixel resolution, e.g. by taking twice the horizontal resolution, the interpolation in the YUN-RGB conversion can create a true diagonal bandlimitation. This can be achieved by using a simple 2D filter, e.g. [-1 2 -1; 1 6 1] Fig. 5 schematically shows an embodiment of the display processing unit 500 according to the invention. The display processing unit 500 comprises:
- a filter 502 for scaling an input image to an intermediate image comprising an intermediate luminance component having a sub-pixel resolution which is related to a number of sub-pixels of the color matrix display device; and - a converter 504 for converting the intermediate image to values of the sub- pixels of a color matrix display device.
At the input connectors 508-512 of the display processing unit 500 the luminance component Y, a first color difference component U and a second color difference component N of the video signals are provided. The display processing unit 500 provides a first color component R, a second color component G and a third color component B at the output connectors 514- 518, respectively. The filter 502 and the converter 504 comprise a control interface 506 to control the scaling. Via this control interface 506 data is provided about e.g. the inter-pixel distances and sub-pixel positions. The working of the display processing unit 500 is conform as described in any of the Figs. 3A, 3B or 3C.
For the application of scaling a digital image, polyphase filters are known to be very efficient. The main principle of a polyphase filter is that the input signal is first up- sampled by inserting zeros in between samples. Then a low-pass filter is applied to interpolate the inserted samples and finally the necessary samples at the new resolution are then extracted from this signal by a down-sampling step. Since only the samples at the new resolution are needed, only a part of the samples after low-pass filtering are used, and computations can be saved by not calculating the samples in the first place. Furthermore, since the inserted samples have value zero, they can also be omitted from the calculations. A polyphase filter basically comprises one large low-pass filter, of which only a subset, i.e. a "phase" of the coefficients are used to calculate a new sample. The choice of this phase depends on the position of the sample in the new resolution image, relative to the samples in the input image. Furthermore, a polyphase filter can usually be separated in a horizontal and vertical stage, simplifying calculations even more. There are two different implementations of polyphase filters, the normal form and the transposed form, which are most suitable for up-scaling and downscaling, respectively. They differ from each other because for up- scaling, the signal must be limited to the Nyquist frequency of the input, and for downscaling, the signal must be limited to the Nyquist frequency of the output. In the normal form, an output sample is calculated as a weighted sum of input samples, while the transposed form calculates an output sample by adding each input sample to a number of output samples. In this way, no input samples are "missed", i.e. no aliasing occurs when the downscaling factor is large.
Fig. 6 schematically shows an embodiment of the display apparatus 600 according to the invention. The display apparatus 600 comprises a: - a receiver for receiving video signals representing images. The video signals can be from a broadcast or from a storage medium as DND or video cassette;
- a display processing unit 500 as described in connection with Fig. 5; and
- a color matrix display device as described in connection with Fig. 1. It should be noted that the above-mentioned embodiments illustrate rather than limit the invention and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be constructed as limiting the claim. The word 'comprising' does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitable programmed computer. In the unit claims enumerating several means, several of these means can be embodied by one and the same item of hardware.

Claims

CLAIMS:
1. A method of displaying an image (200) on a color matrix display device (100) which comprises multiple pixels (102-106), each comprising sub-pixels (108-118) corresponding to predetermined colors, the image being represented by an image signal comprising a luminance component (204), a first color difference component (206) and a second color difference component (208), the method comprising:
- a scaling step (216) to scale the image (200) to an intermediate image (202) represented by a further image signal comprising an intermediate luminance component (210), a first intermediate color difference component (212) and a second intermediate color difference component (214), with scaling of the luminance component related to a sub-pixel resolution which is related to a number of sub-pixels (108-118) of the color matrix display device (100);
- a conversion step (218) to calculate signal values for a particular pixel to be provided to respective sub-pixels (108-112) of the particular pixel based on samples of the intermediate luminance component (210), the first intermediate color difference component (212) and the second intermediate color difference component (214);
- a display step in which the signal values are provided to the respective sub- pixels (108-112) of the particular pixel.
2. A method of displaying an image as claimed in claim 1, characterized in that the first color difference component (206) and the second color difference component (208) are scaled to the first intermediate color difference component (212) and the second intermediate color difference component (214) respectively, both having a pixel resolution of the color matrix display device (100), which is related to a number of pixels of the color matrix display device (100).
3. A method of displaying an image as claimed in claim 1, characterized in that a particular signal value for a particular sub-pixel (118) is calculated based on a first sample (331) of the intermediate luminance component (210) and a second sample (330) of the first intermediate color difference component (212).
4. A method of displaying an image as claimed in claim 3, characterized in that in the scaling step (216) the first sample (331) is calculated by taking into account a location of the particular sub-pixel (118).
5. A method of displaying an image as claimed in claim 1, characterized in that the particular signal value of the particular sub-pixel (118) is calculated based on an interpolation of multiple samples (331, 333) of the intermediate luminance component (210).
6. A display processing unit (500) for displaying an image (200) on a color matrix display device (100) which comprises multiple pixels (102-106), each comprising sub- pixels (108-118) corresponding to predetermined colors, the image being represented by an image signal comprising a luminance component (204), a first color difference component (206) and a second color difference component (208), the display processing unit comprising: - a filter (502) for scaling the image (200) to an intermediate image (202) represented by a further image signal comprising an intermediate luminance component (210), a first intermediate color difference component (212) and a second intermediate color difference component (214), with scaling of the luminance component related to a sub-pixel resolution which is related to a number of sub-pixels (108-118) of the color matrix display device (100);
- a converter (504) for calculating signal values for a particular pixel to be provided to respective sub-pixels (108-112) of the particular pixel based on samples of the intermediate luminance component (210), the first intermediate color difference component (212) and the second intermediate color difference component (214); - a display driver for providing the signal values to the respective sub-pixels
(108-112) of the particular pixel.
7. A display processing unit (500) for displaying an image as claimed in claim 6, characterized in that the filter (502) is a polyphase filter.
8. A display apparatus (600) comprising:
- a receiver (602) for receiving an image;
- a display processing unit (500) for displaying an image (200) on a color matrix display device (100) which comprises multiple pixels (102-106), each comprising sub- pixels (108-118) corresponding to predetermined colors, the image being represented by an image signal comprising a luminance component (204), a first color difference component (206) and a second color difference component (208), the display processing unit comprising:
- a filter (502) for scaling the image (200) to an intermediate image (202) represented by a further image signal comprising an intermediate luminance component
(210), a first intermediate color difference component (212) and a second intermediate color difference component (214), with scaling of the luminance component related to a sub-pixel resolution which is related to a number of sub-pixels (108- 118) of the color matrix display device (100); - a converter (504) for calculating signal values for a particular pixel to be provided to respective sub-pixels (108-112) of the particular pixel based on samples of the intermediate luminance component (210), the first intermediate color difference component (212) and the second intermediate color difference component (214);
- a display driver for providing the signal values to the respective sub-pixels (108-112) of the particular pixel; and
- the color matrix display device.
9. A display apparatus (600) as claimed in claim 8, characterized in that it is a
Television.
PCT/IB2002/004227 2001-10-19 2002-10-14 Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit WO2003034380A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
AU2002341280A AU2002341280A1 (en) 2001-10-19 2002-10-14 Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit
JP2003537032A JP2005505801A (en) 2001-10-19 2002-10-14 Method for displaying an image, image processing unit, and display device having the display processing unit
US10/492,665 US20040239813A1 (en) 2001-10-19 2002-10-14 Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit
EP02775075A EP1442450A2 (en) 2001-10-19 2002-10-14 Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit
KR10-2004-7005780A KR20040052246A (en) 2001-10-19 2002-10-14 Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP01204003 2001-10-19
EP01204003.6 2001-10-19

Publications (2)

Publication Number Publication Date
WO2003034380A2 true WO2003034380A2 (en) 2003-04-24
WO2003034380A3 WO2003034380A3 (en) 2003-12-04

Family

ID=8181113

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2002/004227 WO2003034380A2 (en) 2001-10-19 2002-10-14 Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit

Country Status (7)

Country Link
US (1) US20040239813A1 (en)
EP (1) EP1442450A2 (en)
JP (1) JP2005505801A (en)
KR (1) KR20040052246A (en)
CN (1) CN1571990A (en)
AU (1) AU2002341280A1 (en)
WO (1) WO2003034380A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005316392A (en) * 2004-03-30 2005-11-10 Victor Co Of Japan Ltd Sampling rate converting system and filtering method
WO2005124733A1 (en) * 2004-06-09 2005-12-29 Hewlett-Packard Development Company, L.P. Generating and displaying spatially offset sub-frames
KR100636658B1 (en) 2003-05-09 2006-10-19 샤프 가부시키가이샤 System for improving display resolution
US7525526B2 (en) * 2003-10-28 2009-04-28 Samsung Electronics Co., Ltd. System and method for performing image reconstruction and subpixel rendering to effect scaling for multi-mode display
US8035599B2 (en) 2003-06-06 2011-10-11 Samsung Electronics Co., Ltd. Display panel having crossover connections effecting dot inversion
US8134583B2 (en) 2002-01-07 2012-03-13 Samsung Electronics Co., Ltd. To color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with split blue sub-pixels
US8144094B2 (en) 2003-06-06 2012-03-27 Samsung Electronics Co., Ltd. Liquid crystal display backplane layouts and addressing for non-standard subpixel arrangements
CN104410904A (en) * 2014-12-25 2015-03-11 安科智慧城市技术(中国)有限公司 Video playing method and video playing device

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8022969B2 (en) 2001-05-09 2011-09-20 Samsung Electronics Co., Ltd. Rotatable display with sub-pixel rendering
US7123277B2 (en) 2001-05-09 2006-10-17 Clairvoyante, Inc. Conversion of a sub-pixel format data to another sub-pixel data format
US7184066B2 (en) 2001-05-09 2007-02-27 Clairvoyante, Inc Methods and systems for sub-pixel rendering with adaptive filtering
US7221381B2 (en) * 2001-05-09 2007-05-22 Clairvoyante, Inc Methods and systems for sub-pixel rendering with gamma adjustment
WO2003053068A2 (en) 2001-12-14 2003-06-26 Clairvoyante Laboratories, Inc. Improvements to color flat panel display sub-pixel arrangements and layouts with reduced visibility of a blue luminance well
US7583279B2 (en) * 2004-04-09 2009-09-01 Samsung Electronics Co., Ltd. Subpixel layouts and arrangements for high brightness displays
US7755652B2 (en) * 2002-01-07 2010-07-13 Samsung Electronics Co., Ltd. Color flat panel display sub-pixel rendering and driver configuration for sub-pixel arrangements with split sub-pixels
US20040196302A1 (en) 2003-03-04 2004-10-07 Im Moon Hwan Systems and methods for temporal subpixel rendering of image data
US7352374B2 (en) 2003-04-07 2008-04-01 Clairvoyante, Inc Image data set with embedded pre-subpixel rendered image
US20040246280A1 (en) 2003-06-06 2004-12-09 Credelle Thomas Lloyd Image degradation correction in novel liquid crystal displays
US7598961B2 (en) 2003-10-21 2009-10-06 Samsung Electronics Co., Ltd. method and apparatus for converting from a source color space to a target color space
US7084923B2 (en) 2003-10-28 2006-08-01 Clairvoyante, Inc Display system having improved multiple modes for displaying image data from multiple input source formats
US7268758B2 (en) 2004-03-23 2007-09-11 Clairvoyante, Inc Transistor backplanes for liquid crystal displays comprising different sized subpixels
US7248268B2 (en) 2004-04-09 2007-07-24 Clairvoyante, Inc Subpixel rendering filters for high brightness subpixel layouts
US7619637B2 (en) * 2004-04-09 2009-11-17 Samsung Electronics Co., Ltd. Systems and methods for improved gamut mapping from one image data set to another
US7301543B2 (en) * 2004-04-09 2007-11-27 Clairvoyante, Inc. Systems and methods for selecting a white point for image displays
US7825921B2 (en) * 2004-04-09 2010-11-02 Samsung Electronics Co., Ltd. System and method for improving sub-pixel rendering of image data in non-striped display systems
CN1882103B (en) * 2005-04-04 2010-06-23 三星电子株式会社 Systems and methods for implementing improved gamut mapping algorithms
US7705855B2 (en) * 2005-06-15 2010-04-27 Samsung Electronics Co., Ltd. Bichromatic display
US7683913B2 (en) * 2005-08-22 2010-03-23 Semiconductor Energy Laboratory Co., Ltd. Display device and driving method thereof
US7592996B2 (en) 2006-06-02 2009-09-22 Samsung Electronics Co., Ltd. Multiprimary color display with dynamic gamut mapping
US7876341B2 (en) 2006-08-28 2011-01-25 Samsung Electronics Co., Ltd. Subpixel layouts for high brightness displays and systems
US8018476B2 (en) 2006-08-28 2011-09-13 Samsung Electronics Co., Ltd. Subpixel layouts for high brightness displays and systems
CN101146234B (en) * 2006-09-12 2010-12-01 中兴通讯股份有限公司 Stream media image processing method
KR101257370B1 (en) * 2006-09-19 2013-04-23 삼성전자주식회사 Method for transforming image format by interpolation
US8259127B2 (en) 2006-09-30 2012-09-04 Samsung Electronics Co., Ltd. Systems and methods for reducing desaturation of images rendered on high brightness displays
GB2445982A (en) * 2007-01-24 2008-07-30 Sharp Kk Image data processing method and apparatus for a multiview display device
JP2008270936A (en) * 2007-04-17 2008-11-06 Nec Electronics Corp Image output device and image display device
JP5464819B2 (en) * 2008-04-30 2014-04-09 キヤノン株式会社 Moving image processing apparatus and method, and program
US8502758B2 (en) * 2009-12-10 2013-08-06 Young Electric Sign Company Apparatus and method for mapping virtual pixels to physical light elements of a display
JP2011147012A (en) * 2010-01-15 2011-07-28 Olympus Imaging Corp Image display device, and method of displaying image
CN102280096B (en) * 2011-07-15 2013-09-18 杭州米加科技有限公司 Method for combining image scaling and color space switching
CN103903549B (en) 2014-03-25 2016-08-17 京东方科技集团股份有限公司 Display packing
CN104036715B (en) * 2014-06-07 2016-06-01 深圳市华星光电技术有限公司 Display panel and display unit
KR102214028B1 (en) * 2014-09-22 2021-02-09 삼성전자주식회사 Application processor including reconfigurable scaler and device including the same
KR102239895B1 (en) * 2014-10-23 2021-04-13 엘지디스플레이 주식회사 Method and data converter for upscailing of input display data
CN104505015B (en) * 2015-01-13 2017-02-15 京东方科技集团股份有限公司 Display method for a display panel, display panel and display device
US10070098B2 (en) * 2016-10-06 2018-09-04 Intel Corporation Method and system of adjusting video quality based on viewer distance to a display
CN117011134B (en) * 2023-05-09 2024-08-09 苇渡微电子(广东)有限公司 Direct scaling method for display sub-pixel diamond arrangement image

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0346621A2 (en) * 1988-06-13 1989-12-20 International Business Machines Corporation Method of and apparatus for displaying a multicolor image
US5923316A (en) * 1996-10-15 1999-07-13 Ati Technologies Incorporated Optimized color space conversion
EP0974953A1 (en) * 1998-07-21 2000-01-26 British Broadcasting Corporation Improvements in colour displays
US6211917B1 (en) * 1997-06-10 2001-04-03 Rong-Fuh Shyu Method for performing plural matrix multiplication operations using a shared look-up table
WO2001037248A2 (en) * 1999-11-16 2001-05-25 Koninklijke Philips Electronics N.V. Antialiased character reproduction with increased pixel density

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4965745A (en) * 1987-12-18 1990-10-23 General Electric Company YIQ based color cell texture
US5262847A (en) * 1992-10-20 1993-11-16 International Business Machines Corporation Method of converting luminance-color difference video signal to a three color component video signal
US5384582A (en) * 1993-06-16 1995-01-24 Intel Corporation Conversion of image data from subsampled format to clut format
EP1145218B1 (en) * 1998-11-09 2004-05-19 Broadcom Corporation Display system for blending graphics and video data
US6831948B1 (en) * 1999-07-30 2004-12-14 Koninklijke Philips Electronics N.V. System and method for motion compensation of image planes in color sequential displays
US6608632B2 (en) * 2000-06-12 2003-08-19 Sharp Laboratories Of America, Inc. Methods and systems for improving display resolution in images using sub-pixel sampling and visual error filtering

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0346621A2 (en) * 1988-06-13 1989-12-20 International Business Machines Corporation Method of and apparatus for displaying a multicolor image
US5923316A (en) * 1996-10-15 1999-07-13 Ati Technologies Incorporated Optimized color space conversion
US6211917B1 (en) * 1997-06-10 2001-04-03 Rong-Fuh Shyu Method for performing plural matrix multiplication operations using a shared look-up table
EP0974953A1 (en) * 1998-07-21 2000-01-26 British Broadcasting Corporation Improvements in colour displays
WO2001037248A2 (en) * 1999-11-16 2001-05-25 Koninklijke Philips Electronics N.V. Antialiased character reproduction with increased pixel density

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8456496B2 (en) 2002-01-07 2013-06-04 Samsung Display Co., Ltd. Color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with split blue sub-pixels
US8134583B2 (en) 2002-01-07 2012-03-13 Samsung Electronics Co., Ltd. To color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with split blue sub-pixels
KR100636658B1 (en) 2003-05-09 2006-10-19 샤프 가부시키가이샤 System for improving display resolution
US8144094B2 (en) 2003-06-06 2012-03-27 Samsung Electronics Co., Ltd. Liquid crystal display backplane layouts and addressing for non-standard subpixel arrangements
US9001167B2 (en) 2003-06-06 2015-04-07 Samsung Display Co., Ltd. Display panel having crossover connections effecting dot inversion
US8633886B2 (en) 2003-06-06 2014-01-21 Samsung Display Co., Ltd. Display panel having crossover connections effecting dot inversion
US8035599B2 (en) 2003-06-06 2011-10-11 Samsung Electronics Co., Ltd. Display panel having crossover connections effecting dot inversion
US7525526B2 (en) * 2003-10-28 2009-04-28 Samsung Electronics Co., Ltd. System and method for performing image reconstruction and subpixel rendering to effect scaling for multi-mode display
JP2005316392A (en) * 2004-03-30 2005-11-10 Victor Co Of Japan Ltd Sampling rate converting system and filtering method
GB2430576A (en) * 2004-06-09 2007-03-28 Hewlett Packard Development Co Generating and displaying spatially offset sub-frames
GB2430576B (en) * 2004-06-09 2010-05-12 Hewlett Packard Development Co Generating and displaying spatially offset sub-frames
US7657118B2 (en) 2004-06-09 2010-02-02 Hewlett-Packard Development Company, L.P. Generating and displaying spatially offset sub-frames using image data converted from a different color space
WO2005124733A1 (en) * 2004-06-09 2005-12-29 Hewlett-Packard Development Company, L.P. Generating and displaying spatially offset sub-frames
CN104410904A (en) * 2014-12-25 2015-03-11 安科智慧城市技术(中国)有限公司 Video playing method and video playing device

Also Published As

Publication number Publication date
KR20040052246A (en) 2004-06-22
CN1571990A (en) 2005-01-26
US20040239813A1 (en) 2004-12-02
JP2005505801A (en) 2005-02-24
EP1442450A2 (en) 2004-08-04
WO2003034380A3 (en) 2003-12-04
AU2002341280A1 (en) 2003-04-28

Similar Documents

Publication Publication Date Title
US20040239813A1 (en) Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit
JP3961706B2 (en) How to display high-fidelity and high-resolution digital color images on a low-resolution dot matrix display
Messing et al. Improved display resolution of subsampled colour images using subpixel addressing
US6608632B2 (en) Methods and systems for improving display resolution in images using sub-pixel sampling and visual error filtering
US7110012B2 (en) System for improving display resolution
KR101254032B1 (en) Multiprimary color subpixel rendering with metameric filtering
US7471843B2 (en) System for improving an image displayed on a display
KR101073044B1 (en) Image color balance adjustment for display panels with 2d subpixel layouts
US7085412B2 (en) Filtering image data to obtain samples mapped to pixel sub-components of a display device
CN1871851B (en) Display system having improved multiple modes for displaying image data from multiple input source formats
US7643039B2 (en) Method and apparatus for converting a color image
EP1934970B1 (en) Improved memory structures for image processing
US7602401B2 (en) Image display apparatus and method, program therefor, and recording medium having recorded thereon the same
JP2007511789A (en) System and method for performing image reconstruction and sub-pixel rendering to perform scaling for multi-mode displays
WO2002048960A2 (en) Methods and systems for improving display resolution in images using sub-pixel sampling and visual error filtering
US6973210B1 (en) Filtering image data to obtain samples mapped to pixel sub-components of a display device
KR101020324B1 (en) Method for improving the perceived resolution of a colour matrix display
EP1239451B1 (en) Method of and apparatus for remapping subpixels for a color display from quad-subpixel to striped-subpixel format
EP0762749A2 (en) Video signal processing system for a video display system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BY BZ CA CH CN CO CR CU CZ DE DM DZ EC EE ES FI GB GD GE GH HR HU ID IL IN IS JP KE KG KP KR LC LK LR LS LT LU LV MA MD MG MN MW MX MZ NO NZ OM PH PL PT RU SD SE SG SI SK SL TJ TM TN TR TZ UA UG US UZ VC VN YU ZA ZM

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ UG ZM ZW AM AZ BY KG KZ RU TJ TM AT BE BG CH CY CZ DK EE ES FI FR GB GR IE IT LU MC PT SE SK TR BF BJ CF CG CI GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2002775075

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 10492665

Country of ref document: US

Ref document number: 2003537032

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 20028206916

Country of ref document: CN

Ref document number: 1020047005780

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2002775075

Country of ref document: EP