JP5235901B2 - Subpixel layout and subpixel rendering method and system for directional display devices - Google Patents

Description

  The present invention relates to a spatial light modulator, and more particularly to a directional display apparatus or system such as a three-dimensional autostereoscopic display apparatus or a multi-view displey. It relates to the subpixel layout for the spatial light modulator used. This application claims the benefit of US Provisional Application 60 / 889,724, filed February 13, 2007. The entire contents of the provisional application are incorporated herein by reference.

  Hereinafter, the directional display device means a display device that can simultaneously provide at least two or more different images. The directional display device provides at least two or more separate images, each image being viewed at a different location. In one type of directional display device, the two images are provided to appear as clearly separated images. Such display devices may be “multi-viewer display devices”, “multi-view display devices” or “multi-viewer display devices” or “multi-viewer display devices” configured to allow different viewers to view different images. It may also be called a “multi-user display device”. This allows multiple simultaneous use of the display device. On the other hand, the multi-view display device may be configured for use by a single observer.

  The directional display device may also be configured such that at least two or more separated images are mixed into a single image for an observer. The human field of view is three-dimensional so that each eye sees a slightly different world image. The human brain mixes two images (called stereo couples) with each other to get a sense of depth in images observed in the real world. In the three-dimensional display device, the separated images are provided to each eye, and the observer's brain mixes the stereo couples of the images and grasps the depth appearance in the mixed images.

  Three-dimensional display devices are generally classified into stereoscopic display devices (stereoscopic) and autostereoscopic display devices (autosteroscopic). In a three-dimensional stereoscopic image display device, a user wears several types of visual aids to separate the visual fields sent to the left and right eyes. For example, the field of view aid may be synchronized with a color filter in which the image is color-coded (eg, red and green), polarized glasses in which the image is encoded in orthogonal polarization states, or the shutter opening of the glasses. There are shutter glasses that encode the field of view in a temporal sequence. On the other hand, the three-dimensional autostereoscopic image display device does not require an observer to wear a visual field assisting tool. In the autostereoscopic image display device, each field of view can be viewed from a limited area in space.

Outline of Directional Display Device Woodgate et al. U.S. Pat. No. 7,058,252 “Optical Switching Apparatus” relates to a comprehensive examination of technical features and issues of directional display devices, particularly autostereoscopic three-dimensional display devices. is there. The entire contents of the drawings and columns 1-8 referred to in US Pat. No. 7,058,252 are hereby incorporated by reference. In general, autostereoscopic imaging systems include a display panel and an optical steering member or optical steering mechanism that directs light from at least two or more images. The optical steering mechanism may be referred to as an optical director, a parallax optic, or a parallax barrier. The optical steering mechanism transmits light from the left image to a limited area on the front of the display panel. This region is referred to as a first viewing window. When the viewer places the left eye in the first viewing window, the viewer sees an appropriate image across the display panel. Similarly, the optical steering member transmits light from the right image to another second viewing window. When the observer places the right eye in the second viewing window, the right eye image will be visible to the observer throughout the display panel. In general, the light from the two-sided image may be considered to be optically steered (ie, guided) by each directional distribution. The visual field window surface of the display device means a distance having the largest degree of freedom of the side visual field among the distances from the display device.

  FIG. 1 is a plan view showing a flat panel autostereoscopic image display apparatus 10 shown in FIG. 5 of US Pat. No. 7,058,252. Display device 10 is arranged in a backlight, row and column, electrically adjustable pixel array (known as spatial light modulator SLM), and operates as an optical steering mechanism and is mounted on the front of the screen Including a parallax barrier. The term “spatial light modulator” includes light valve devices such as liquid crystal display devices and light emitting devices such as electroluminescent display devices or LED display devices. The backlight 60 provides light 62 incident on the LCD incident polarizer 64. Light is transmitted through the TFT LCD substrate 66 and is incident on a pixel array that is repeatedly arranged in rows and columns in the LCD pixel surface 67. Each of the red pixels (68, 71, 74), the green pixels (69, 72, 75), and the blue pixels (70, 73) includes an individually controllable liquid crystal layer, and is defined by an opaque mask region called a black mask 76. To be separated. Each pixel includes a transmissive region or pixel gap 78. The light passing through the pixel is phase-modulated by the liquid crystal material on the LCD pixel surface 74 and color-modulated by the color filter located on the LCD color filter substrate 80.

  Thereafter, the light passes through the output polarizing plate 82 and proceeds to the parallax barrier 84 and the parallax barrier substrate 86. In FIG. 1, the parallax barrier 84 includes a vertically extending transmissive region array separated by vertically extending opaque regions. The parallax barrier 84 provides light from the alternately arranged pixel columns (69, 71, 73, 75) to the right eye side as indicated by the light ray 88, and intermediate pixels as indicated by the light ray 90. Provide light from the columns (68, 70, 72, 74) to the left eye side (such an overall light path pattern is another example of light direction distribution). The observer sees the pixel light from below through the barrier gap 92. Different types of optical directors or parallax optics such as lenticular screens and birefringent lenses may also be used in the 3D display device.

  Subsequently, referring to FIG. 1, pixel arrays that are repeatedly arranged in rows and columns on the LCD pixel surface 67 are separated by a gap (generally defined as a black mask in an LCD). . The parallax barrier is an array of slits extending in the vertical direction and has a pitch approximately twice the pitch of the pixel columns. The parallax barrier forms a viewing window in an area on the front surface of the screen by limiting the range of angles at which light from each pixel column can be viewed.

  In order to steer the light transmitted from each pixel to the viewing window, the pitch of the parallax barrier is slightly less than twice the pitch of the pixel array. Such a condition is known as “viewpoint correction”. In the display device of the type shown in FIG. 1, the resolution of the image of each stereo couple is half of the horizontal resolution of the basic LCD, and two fields of view are formed. Thus, the light in the odd columns of pixels (68, 70, 72, 74) can be viewed from the left viewing window, and the light from the even columns of pixels (69, 71, 73, 75) It can be viewed from the right viewing window. When left-eye image data is placed in odd-numbered columns on the screen and right-eye image data is placed in even-numbered rows on the screen, an observer in the correct “orthoscopic” position will auto-stereoscopically span the entire screen. The two images will be mixed to see the three-dimensional image.

  Kean et al. US Pat. No. 7,154,653 “Parallax Barrier and Multiple View Display” discloses various embodiments of parallax barriers used in multi-user and three-dimensional display devices. ing. US Pat. No. 7,154,653, columns 1-5 background art review and drawings incorporated herein by reference, guide various images (eg, left eye and right eye) provided by a display device. Discusses the features of the parallax optic that can be changed to control the viewing window or viewing area size, viewing angle. The function of the parallax optic restricts the light passing through the pixel to a fixed emission angle. Thereby, the viewing angle of the pixel behind a particular part of the parallax optic structure (for example, a slit or lenslet, or lenticule) is defined. In the flat panel autostereoscopic image display device, the structure of the visual field region is typically determined by a combination of the pixel structure of the display unit and the light guide optical member or the parallax optic.

  U.S. Pat. No. 7,154,653 discloses the display device 30 shown in FIG. 2A. The display device 30 is an autostereoscopic image three-dimensional display device or a two-view directional display device used as a device that provides two unrelated images to one or many observers. . The display device includes a spatial light modulator in the structure of the LCD 20. The LCD 20 is a pixel structure, and herein represents a display device that includes a sub-pixel group in which at least two or more primary color sub-pixels repeat. The LCD 20 operates in a transmissive mode to modulate light emitted from a backlight (not shown) and passing through the sub-pixels. However, US Pat. No. 7,154,653 discloses another type of display device (in the case of a front parallax barrier arrangement) for modulating light in transmissive mode or reflective mode, or for generating light within the display device. It is disclosed that it may be used. The display device 30 also includes a parallax barrier 21 disposed on the front surface of the LCD 20. That is, it is arranged between the LCD 20 and the observer. As shown in detail in FIG. 2B, the barrier 21 provides areas (22, 23) that do not allow light from the LCD 20 to pass through, and a slit that allows light from the LCD 20 to pass between them. Regions (22, 23) have a limited width and all slits have the same maximum light transmission. The sub-pixel columns of the LCD 20 are formed to have a substantially constant pitch (p) in a direction perpendicular to the major axis direction of the columns, and the direction is a horizontal direction in general use of the display device. The slits of the barrier 21 are arranged in a group of evenly arranged slits that are arranged non-periodically and extend parallel to the major axis direction of the sub-pixel columns and have equally arranged slits. Is done. FIG. 2A also shows in detail the embodiment shown with respect to the size and arrangement of the slits of the parallax barrier 21.

  With continued reference to FIG. 2A, the display device 30 is driven by the display driving unit 25 in such a manner that the image data for the two views to be displayed are arranged so as to intersect in a vertical stripe as much as possible. The display driving unit 25 may be arranged such that each pixel column receives a display image to ensure an accurate vertical image slice and crosses the data. The display driver 25 may be formed in a part of the display device, or part or the whole may be included in another device such as a computer or a microprocessor. The image may be an actual image or a computer generated image. The images can form an autostereoscopic image or form a stereo couple to form images that are not stereoscopically related to each other. The slits of the barrier 21 are aligned at or near the center line of the pixel column. The display driving unit 25 provides the vertical image slice to the group of the four nearest pixel columns as each slit group. The slits of the barrier 21 together form the pixel structure of the LCD 20 to define five viewing areas. In each field of view, each slit group limits the visibility of the pixel column so that only two adjacent pixel columns can be seen by the observer in the pixel region.

  Referring to FIG. 2C, the display driver 25 provides pixel image data to the LCD 20. The first and second image slices are provided in one image, and the third and fourth image slices are provided in the remaining one image. Eventually, the first and second images forming the first and second views are visible in the viewing areas D and B, respectively. When providing an autostereoscopic image, if the viewer's left eye and right eye are located in the viewing regions B and D, respectively, the stereoscopic pair of images provides exactly three-dimensional effects. Conversely, if the observer's eyes are located in the field of view D, one of the images can be seen, but not the other. On the contrary, when both eyes are located in the visual field B, other images can be seen, but the first image is not seen. The field regions B and D actually used on both sides include 50% of each image to reduce the occurrence of crosstalk between adjacent field regions. The display 30 uses 50% of the available light and each image is displayed by 50% subpixels. Accordingly, the horizontal resolution is 50% of the LCD resolution.

  The cited US Pat. No. 7,058,252 also discloses a display type that is fully operable in 3D and 2D modes. Such a display type is referred to as a “2D3D switchable display device”. US Pat. No. 7,058,252 discusses various examples of such a display device, one of which is shown in FIGS. 3A and 3B. FIG. 3A includes a backlight 60 that provides light 62 incident on an LCD entrance polarizer 64, an LCD TFT substrate 66, and an LCD pixel surface 67 that includes an array of pixels arranged in rows and columns. Follow later. It includes a birefringent lens 138 array, followed by an isotropic lens microstructure 134 and a lens substrate 132. The components can be grouped with a directional display 236. Following the directional display 236, the polarization corrector 146 transmits light linearly polarized in the horizontal direction and blocks light polarized vertically. The LCD incident polarizing plate 240 is rotated by horizontal polarization (0 °) 242 according to an ON state of a liquid crystal material of a TN (twisted nematic) layer in the pixel gap 78 at an angle of 90 °. Thereby, a normally white NW mode is provided. In the NW mode ON state, no voltage is applied to the liquid crystal layer. The voltage is approved to change the output to the OFF state or intermediate level. Since the birefringent microlens 138 is index-matched to the polarized light, it does not affect the directivity of light. The output of the polarization corrector 146 is horizontal linearly polarized light 244.

  FIG. 3B shows a configuration for operating in three dimensions according to the direction 238 of the display device of FIG. 3A. In this case, the polarization corrector 146 is arranged to transmit vertically linearly polarized light and blocks horizontally polarized light. The LCD incident polarizing plate 250 has an angle of 90 ° and does not rotate with the horizontally polarized light (0 °) 242 depending on the ON state of the liquid crystal material of the TN layer. Thereby, a normally black (NB) mode is provided. In the ON state of the NB mode, the liquid crystal layer voltage is applied. The reduced voltage is applied to change the output to the OFF state or intermediate level. The polarization state 246 incident on the birefringent microlens 138 has directivity due to the birefringent microlens 138. In this case, the polarization corrector 146 is configured to transmit the horizontal linear polarization state 248. In this manner, the three-dimensional mode light projecting structure is transmitted.

  Additional information on 3D display devices can be found in the optoelectronic handbook chapter 2.6, Dakin and Brown, eds. Published by CRCPress (2006), which is incorporated herein by reference. , Vo1. II, the title “Three-dimensional display system” can be referred to.

  The cited US Pat. No. 7,058,252 also discloses an embodiment of the multi-user display device of FIG. FIG. 4 is a plan view for a birefringent microlens display 406 that provides a viewing window (408, 410, 412, 414). The size of the window is larger than the distance between both eyes of the observer. The display device 406 is suitable for use in, for example, an automobile instrument panel. The driver places his right eye 416 in window 408 and his left eye 418 in the same window 408. Analogously, the passenger places his left eye 422 and right eye 420 in another window 414 as well. Among them, the partial windows (408, 412) in the view display apparatus include the same information as each other, and the other partial windows (410, 414) include the same information as each other. It may be convenient to have an intermediate window (410, 412) between the passenger and the driver for aberration design. When the first image 426 and the second image 428 are input, the image signal interlacer 424, for example, sets the first image 426 to an even-numbered column on the screen and the second image 428 to an odd-numbered column on the screen. Shown in The optical member of the display device guides the first image 426 to the driver window 408 and guides the second image 428 to the passenger window 414. US Pat. No. 7,058,252 except that the viewing windows (408, 410, 412, 414) have made the 2D3D switchable display device larger so that various observers can see each other's windows. A display device that operates in the same manner as a display device that can switch between 2D and 3D is disclosed. U.S. Patent No. 7,058,252 further discloses that such a multi-viewer display device may have two modes of operation. The first mode allows all viewers to see the same image, and the second mode allows multiple viewers to use multiple displays simultaneously, allowing different viewers to see different images. That is.

  Bell et al. US Pat. No. 6,424,323, “Electronic Device Having a Display” also discloses an electronic device having a display device and an image deflection system on the display device. The display device is adjusted to provide at least two or more independent display images that, when displayed via an image deflection system, appear separately depending on the visual position. One embodiment of an image deflection system discloses a lenticular screen that includes a plurality of lenticles (also referred to as lenticles). The lenticule extends across. Then, different images are made visible to the observer obliquely with respect to the screen. In this way, a single user can see different images by tilting the display device from the horizontal direction.

The term field crossing problem “crosstalk” refers to the phenomenon of light leakage between two views. For example, the same applies to the phenomenon that the image of the left eye is visible to the right eye and vice versa. Crosstalk causes visual distortion when viewing a three-dimensional display image. Crosstalk control is one of the important elements in the development of a three-dimensional display device. In reputable autostereoscopic display devices (particularly display devices based on LCD technology), window performance limits are generally determined by pixel shape and aperture ratio and optical member quality. The cited US Pat. No. 7,058,252 discloses that the angle of the output angle of light emitted from the display device is determined by the width and shape of the pixel gap and the alignment and aberration of the parallax optics. US Pat. No. 7,154,653 attempts to reduce the width of the parallax barrier slits and reduce crosstalk (eg, light leakage between images), with one color sub-pixel to the viewer. It is additionally disclosed that a color balance imbalance can be generated that will appear more or change the color balance depending on the viewing angle.

  U.S. Pat. No. 7,154,653 discloses that more than one column of pixels can be placed under each parallax slit to increase the lateral field of view freedom. As an example, four pixel columns can generate four windows with varying visual information for each window. Such a display would give a “look-around” shape due to observer movement. In this way, the vertical freedom is also raised. However, in such a case, the resolution of the display device is limited to a quarter of the resolution of the basic panel. In addition, the parallax barrier relies on the method of blocking light from the display area, resulting in reduced brightness and device efficiency. Generally, it is reduced to 20 to 40% of the original display luminance.

  US Pat. No. 7,154,653 discloses that the LCD 20 illustrated in FIG. 2A is one of the “conventional” display device types in which “white” pixels are divided into repeated groups of color sub-pixels. It is disclosed as one. In particular, each group of pixel columns comprised of three columns is supplied with red, green and blue filter strips. All color subpixels in each column represent the same color, and adjacent couples of columns represent different colors in a pattern in which red (R), green (G), and blue (B) repeat over the screen. U.S. Pat. No. 7,154,653 discloses that even if such an arrangement can obtain accurate color balance from left and right visual information, each visual information on both sides is substantially in a single color spacing. There is a general imbalance. Such uneven spacing will look very good from low resolution display devices. As a result, the quality of the image is degraded. In addition, the order of the color sub-pixels in the visual information on both sides does not follow the pattern in which the three color sub-pixels repeat the same. Such a phenomenon is referred to as “crossing over” with respect to the order of the components of each white pixel, and such crossing over creates an image artifact that cannot be predicted. U.S. Pat. No. 7,154,653 additionally discloses examples of alternative subpixel arrangements or layouts that differ from the typical structure in which RGB subpixels repeat. One embodiment of such a subpixel arrangement is that there is no crossing over in the order of the subpixels of the pixels supplying white to improve the image quality, and the spacing between the individual color subpixels of each visual information on both sides is reduced. Decrease.

  Harroll et al. US Pat. No. 6,023,315, “Spatial light modulator and directional display” discloses a liquid crystal spatial light modulator comprising rows and columns of pixels. The liquid crystal spatial light modulators are arranged in groups of columns. For example, it is disposed under each parallax generating member in the autostereoscopic image three-dimensional display device. The pixels are arranged in a set that forms a color pixel. For example, the pixels of each set are arranged at the corner vertices of a polygon such as a triangle. And it arrange | positions corresponding to the column formed in the group. US Pat. No. 6,023,315 discloses a spatial light modulator having a conventional RGB vertical or horizontal stripe subpixel arrangement, or a known RGGB quad subpixel arrangement, for stereoscopic display for three-dimensional display. It mentions problems that will occur when used to provide images. For example, problems such as color integration. To alleviate such problems, US Pat. No. 6,023,315 discloses various embodiments for subpixel placement and subpixel grouping called “mosaic tessellations”. Mosaic work is designed to cause color accumulation in a substantially wider range of visual distance. One set of several such arrangements uses red, green, blue, and white subpixels.

  Some implementations of three primary colors or multiple primary color sub-pixel repeating groups that are particularly adapted for directional display devices that simultaneously provide at least two or more images, such as autostereoscopic 3D display devices or multi-view display devices Provided are display devices and systems that comprise a display panel that substantially includes one of the forms.

  The present specification describes three primary colors or multiple primary color sub-pixel repeating groups that are particularly adapted for directional display devices that simultaneously provide at least two or more images, such as autostereoscopic 3D display devices or multi-view display devices. A display device and system comprising a display panel that substantially includes one of several embodiments is disclosed. Input image data representing the image is rendered to a device that utilizes one of the illustrated sub-pixel rendering groups using a sub-pixel rendering operation.

1 is a schematic plan view for a first embodiment of a flat panel autostereoscopic image display device having a parallax barrier structure. FIG. It is the schematic with respect to 2nd Embodiment of the flat panel autostereoscopic image display apparatus which has a parallax barrier structure. It is a top view with respect to a part of parallax barrier structure shown to FIG. 2A. FIG. 2B is a schematic view of a viewing window created in the display device shown in FIG. 2A. Fig. 2 shows a diagram of a display device capable of switching between 2D and 3D, and the flow of light passing through the display device when operating in 2D mode. 2D shows a diagram of a display device capable of switching between 2D and 3D, and shows the flow of light passing through the display device when operating in 3D mode. FIG. 6 shows a diagram of a multi-viewer display device that provides at least two images in different viewing windows for viewing by at least two viewers. A typical two-dimensional spatial grid of input image signal data is shown. Fig. 4 shows a matrix arrangement adapted to a display panel of a plurality of subpixel repeating groups including three primary color subpixels. FIG. 7 shows a resample area array for the main color plane of the display panel of FIG. 6 showing reconstruction points and resample areas. FIG. 8 shows the resample area array of FIG. 7 overlaid on the two-dimensional spatial grid of FIG. Fig. 3 shows a subpixel repeating group with three primary color subpixels and a white subpixel. Fig. 3 shows a subpixel repeating group with three primary color subpixels and a white subpixel. FIG. 9B illustrates the subpixel repeat group of FIG. 9A located on the two-dimensional spatial grid of FIG. 5 and further illustrates a portion of the primary color resample region array for the subpixel repeat group of FIG. 9A overlaid thereon. 6 is a diagram illustrating a metamer filtering operation. 6 is a flowchart for one embodiment of a metamer filtering operation. A sub-pixel rendering operation follows the metamer filtering operation. 6 is a flowchart for one embodiment of a metamer filtering operation used in conjunction with a pixel rendering operation. FIG. 6 is a block diagram illustrating functional components of two embodiments of a display device that performs sub-pixel rendering operations. FIG. 6 is a block diagram illustrating functional components of two embodiments of a display device that performs sub-pixel rendering operations. 1 is a block diagram of a display device architecture and a schematic diagram of a simplified driver circuit that sends an image signal to a display panel that includes one of several embodiments of a subpixel repeating group. FIG. 2 illustrates a portion of a display panel that includes a first embodiment of a new multi-primary color subpixel repeating group. FIG. 16B illustrates a subpixel arrangement of first and second images provided by the display panel of FIG. 16A used in a directional display device. FIG. 16B illustrates a subpixel arrangement of first and second images provided by the display panel of FIG. 16A used in a directional display device. FIG. 6 illustrates a portion of a display panel including a second embodiment of a new multi-primary color subpixel repeating group. FIG. 17B shows a sub-pixel arrangement of first and second images provided by the display panel of FIG. 17A used in a directional display device. FIG. FIG. 17B shows a sub-pixel arrangement of first and second images provided by the display panel of FIG. 17A used in a directional display device. FIG. FIG. 6 illustrates a portion of a display panel including a third embodiment of a new multi-primary color subpixel repeating group. FIG. 18B shows a sub-pixel arrangement of first and second images provided by the display panel of FIG. 18A used in a directional display device. FIG. 18B shows a sub-pixel arrangement of first and second images provided by the display panel of FIG. 18A used in a directional display device. FIG. 6 shows a portion of a display panel including a fourth embodiment of a new multi-primary color sub-pixel repeating group. FIG. 19B shows the subpixel arrangement of the first and second images provided by the display panel of FIG. 19A used in the directional display device. FIG. 19B shows the subpixel arrangement of the first and second images provided by the display panel of FIG. 19A used in the directional display device. FIG. 3 shows a portion of a display panel including a first embodiment of a new three primary color sub-pixel repeating group. FIG. 20B illustrates a subpixel arrangement of first and second images provided by the display panel of FIG. 20A used in a directional display device. FIG. 20B illustrates a subpixel arrangement of first and second images provided by the display panel of FIG. 20A used in a directional display device. FIG. 4 shows a portion of a display panel including a second embodiment of a new three primary color sub-pixel repeating group. FIG. 21C shows a subpixel arrangement of first and second images provided by the display panel of FIG. 21A used in a directional display device. FIG. 21C shows a subpixel arrangement of first and second images provided by the display panel of FIG. 21A used in a directional display device. FIG. 6 illustrates a portion of a display panel including a third embodiment of a new three primary color subpixel repeating group. FIG. 22B shows a subpixel arrangement of first and second images provided by the display panel of FIG. 22A used in a directional display device. FIG. 22B shows a subpixel arrangement of first and second images provided by the display panel of FIG. 22A used in a directional display device. FIG. 6 illustrates a portion of a display panel including a fourth embodiment of a new three primary color subpixel repeating group. FIG. 23B shows a subpixel arrangement of first and second images provided by the display panel of FIG. 23A used in a directional display device. FIG. 23B shows a subpixel arrangement of first and second images provided by the display panel of FIG. 23A used in a directional display device. FIG. 6 shows a portion of a display panel including a fifth embodiment of a new three primary color sub-pixel repeating group. FIG. 24B illustrates a subpixel arrangement of first and second images provided by the display panel of FIG. 24A used in a directional display device. FIG. 24B illustrates a subpixel arrangement of first and second images provided by the display panel of FIG. 24A used in a directional display device.

  Hereinafter, the implementation and embodiments will be described in detail with reference to the examples shown in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to describe the same or like parts. The accompanying drawings are incorporated in and constitute a part of this specification and illustrate exemplary implementations and embodiments.

  In the following, some embodiments of subpixel arrangements or layouts adapted to the above mentioned directional display device display panel will be considered. Such subpixel arrangements are distinct from conventional RGB stripe layouts, and some of these arrangements contain more colors than the three primary colors. If the input image data is specified in the conventional three-color “whole pixel” RGB format, the input image data is rendered on a display panel having such a subpixel arrangement, so that subpixel rendering (SPR) ) May be processed by actions. This description first provides an overview of subpixel rendering operations and hardware configurations suitable for display devices that include display panels having one of these subpixel arrangements, and then describes some exemplary embodiments. To do.

Overview of Subpixel Rendering Technology Co-owned Elliott et al. US Pat. No. 7,123,277, “CONVERSION OF A SUB-PIXEL FORMAT DATA TO ANOTHER SUB-PIXEL DATA FORMAT” ” , A method for converting for display on a display panel including a sub-pixel repeating group having a second format of a primary color different from the first format of the input image. The contents disclosed in US Pat. No. 7,123,277 are hereby incorporated by reference. The term “primary color” means each color that appears in a subpixel repeating group. If the subpixel repeating group is repeated over the display panel to configure the display device at the desired matrix resolution, it can be said that the display panel has substantially a subpixel repeating group. In this discussion, the display panel is depicted as having “substantially” subpixel repeating groups. It is understood that due to the size of the display panel, manufacturing factors, or constraints, the subpixel repeating group is incomplete at the edge of one or more panels. In addition, if the display has sub-pixel repeating groups, even if there are symmetry, rotation, reflection, or other slight changes (the sub-pixel repeating group recited in the appended claims is an example implementation) Any display) is “substantially” containing a predetermined group of sub-pixel repeats. For reference, systems and devices that use more than two primary subpixel colors to form a color image are referred to herein as “multi-primary color” display systems. In a display panel comprising a subpixel repeating group having white subpixels, white represents the primary color referred to as white (W) or “clear” and includes a subpixel repeating group having RGBW subpixels The display system using is a multi-primary color display system.

  For example, assuming that the input image is specified as a conventional two-dimensional array of color values specified in red (R), green (G), and blue (B), this is regarded as the first format of the input image data. Each RGB triplet specifies the color of the pixel position in the input image. The display panel substantially includes a plurality of subpixel repeating groups specified in a second format in which input image data is displayed. The sub-pixel repeating group has at least first, second, and third primary color sub-pixels arranged in at least two rows on the display panel, wherein two of the primary colors are sub-pixels. Arranged in a pattern referred to as a “checkerboard pattern”. That is, the second primary color subpixel in the first row of the subpixel repeating group is placed after the first primary color subpixel, and the first primary color subpixel in the second row of subpixel repeating group is the second primary color. It is placed after the subpixel. In US Pat. No. 7,123,277, subpixels are also referred to as “emitters”.

  The operation of subpixel rendering the input image data provides a luminance value for each subpixel on the display panel. An input image specified in the first format is displayed on a display panel including a second format of a different main color subpixel so that the viewer who looks at the image looks beautiful. Subpixel rendering works by using subpixels as independent pixels recognized by the luminance channel, as described in US Pat. No. 7,123,277. This allows the subpixel to be provided as a sample image reconstruction point, as opposed to using the associated subpixel as part of the “real” (or entire) pixel. The use of subpixel rendering increases the spatial reconstruction of the input image, allowing the display device to address independently and providing a luminance value for each subpixel on the display panel.

  Furthermore, another feasible and desirable technical feature of the subpixel rendering operation ensures that the high spatial frequency information in the luminance component of the rendered image does not alias the color subpixel that causes a color error. This means that the color balance is maintained. The arrangement of sub-pixels in a sub-pixel repeating group may be modified with spatial addressability and sub-pixel rendering on the arrangement to reduce phase errors and the horizontal and vertical axes of the display device. Providing an increase in modulation transfer function (MTF) and high spatial frequency resolution can be adapted to sub-pixel rendering. In a subpixel rendering operation, a plurality of subpixels for each primary color on the display panel may be collectively defined to be a primary color plane (eg, a red, green, and blue color plane). , Each may be treated separately.

  In one embodiment, the sub-pixel rendering operation may generally proceed as follows. As shown in FIG. 5 as an example, the color image data value of the input image data may be handled as a two-dimensional space grid 50 representing the input image signal data. Each square input sample area 52 of the grid represents an RGB triplet of color value, meaning the color at that position of the image, which is substantially the same area as the area physically filled by the RGB triplet. A sample point 54 is further illustrated in the center of each square input sample region 52 of the grid.

  FIG. 6 shows an example of the display panel of FIG. 6 of US Pat. No. 7,123,277. A display panel having a plurality of subpixel repeating groups 10 is assumed to have the same dimensions as the input image sample grid 50 of FIG. In FIG. 6 and other drawings illustrating an example of a sub-pixel repeating group, the sub-pixels hatched in the vertical direction are red, the sub-pixels hatched in the diagonal direction are green, and the horizontal direction The subpixels 8 hatched in blue are blue. The position of each primary color subpixel on the display panel 5 is represented by the spatial grid 50 of FIG. 5 located on the display panel 5 of FIG. 6 from what is referred to as a reconstruction point (or resample point). Approximated by a subpixel rendering operation to reconstruct the image. Each reconstruction point is located at the center in the resample region. The plurality of resample areas for one of the primary colors includes a resample area array. FIG. 7 (FIG. 9 of US Pat. No. 7,123,777) shows an example of the resample area array 7 for the blue plane of the display panel 5. A sample region 18 and a rectangular resample region 19 are shown.

  US Pat. No. 7,123,777 describes how the resample region 18 is determined in one embodiment as follows. Each reconstruction point 17 is located at the center of each subpixel (for example, subpixel 8 in FIG. 6), and a boundary grid is formed at the same distance from the center of the reconstruction point. The inner area forms a resample area. Henceforth, a resample region in one embodiment may be defined by an associated reconstruction point closest to that region, and a boundary defined by a set of lines equidistant from other adjacent reconstruction points. Have. The formed grid forms a tile pattern. Other embodiments of the resample area are possible. Examples include, but are not limited to, tile patterns, squares, rectangles, triangles, hexagons, octagons, diamonds, alternating squares, alternating rectangles, alternating triangles, alternating triangles. It may include a diamond shape, a Penrose tile, a rhombus, a distorted rhombus, etc., or a combination of at least one or more of the above shapes.

  As shown in FIG. 8 (FIG. 20 of US Pat. No. 7,123,277), the resample area array 7 overlaps the input image sample grid 50 of FIG. Each resample region (18 or 19) overlies a portion of at least one input image sample region 52 on the input image grid 50 (FIG. 5). A fractional set of each resample region may be formed. In one embodiment, the fractional denominator may be interpreted as a function of the resample region, and the numerator may be interpreted as an area function of each input sample region that overlaps at least a portion of the resample region. A set of fractions collectively represents an image filter, which is referred to as a filter kernel and may be stored as a matrix of coefficients. In one embodiment, the sum of the coefficients is substantially equal to 1. The data value of each input sample area is multiplied by each fraction and all products are summed to obtain the luminance value of the resample area. In effect, the ratio of the area of the input to the output is determined by inspection or calculation and stored as a count in the filter kernel. The filter kernel is a conversion formula, and is generated by determining the overlapping region of the original data set sample region and the target display sample region. The overlap ratio determines the coefficient value used in the filter kernel array. In the case of a square resample region 18, each of these overlaps with four input sample regions 52. Therefore, each input sample area 52 contributes to 1/4 (or 0.25) of the blue data value with respect to the final luminance value of the resample point 17.

  The aforementioned sub-pixel rendering operation is an example of an image processing technique referred to as region resampling. Other types of sub-pixel rendering techniques may include resampling using bicubic filters, sinc filters, windowed-sinc filters, and combinations thereof.

  In the embodiment described herein, the calculation assumes that the resample region arrays for the three color planes match each other and the input image sample grid 50. Further, the resample region arrays can be arranged differently from each other, and can be arranged differently with respect to the input image sample grid 50. The position of the resample area array relative to each other or the position of the resample area array relative to the input image sample grid is referred to as the phase relationship of the resample area array.

  The sub-pixel rendering operation introduces “logical pixels” to render information to the display panel at each sub-pixel level. A logical pixel may have an approximated Gaussian intensity distribution and is overlapped with other logical pixels to produce an overall image. Each logical pixel is a set of adjacent subpixels and has a target subpixel. The target subpixel may be one of the primary color subpixels, and for the target subpixel, an image filter is used to provide a luminance value. As a result, each sub-pixel on the display panel is actually used many times, once as the center or target of the logical pixel and in additional times as the edge of another logical pixel. The A display panel that substantially includes a subpixel layout of the type disclosed in US Pat. No. 7,123,277 and uses the subpixel rendering operations disclosed in US Pat. No. 7,123,277 and previously described is a conventional RGB stripe. Compared to a display device, half the subpixels and half the number of column drivers achieve almost the same resolution and addressability. Logical pixels are further disclosed in co-owned US Patent Application 2005/0104908, “COLOR DISPLAY PIXEL ARRANGEMENTS AND ADDRESSING MEANs” (US Application No. 10/047995). Are hereby incorporated by reference. Also, Credelle et al., Published in the 2002 Eurodisplay 02 digest, which is incorporated herein by reference. "High-resolution PenTile Matrix (registered trademark) display device MTF (MTF of High Resolution PenTile Matrix (registered trademark) Display)", pp1-4.

  Examples of three primary color and multi-primary color sub-pixel repeat groups that include RGBW sub-pixel repeat groups and that are relevant to sub-pixel rendering operations are disclosed in the following commonly owned US patent application publications: (1) U.S. Patent Application Publication No. 2004/0051724 (U.S. Patent Application No. 10/243094), "FOUR COLOR ARRANGEMENTS AND EMITERS FOR SUB-PIXEL RENDERING", (2 ) US Patent Application Publication No. 2003/0128179 (US Patent Application No. 10 / 278,352), “Color Flat Panel Display Layout for Subpixel Rendering and Subpixel Rendering Using Divided Blue Subpixels (COLOR FLAT PANEL DISPLAY SUB- PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH SPLI BLUE SUB-PIXELS), (3) US Patent Application Publication No. 2003/0128225 (US Patent Application No. 10/278353), “Color Flat Panel Display Layout for Subpixel Rendering with Subpixel Arrangement and Increased Modulation Transfer Function Response” (COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH INCREASED MODULATION TRANSFER FUNCTION RESPONSE) No. 4 / US Pat. Subpixel arrangement and its subpixels Rendering arrangement method and system (SUB-PIXEL ARRANGMENTS FOR STRIPED DISPLAYS AND METHODS AND SYSTEMS FOR SUB-PIXEL RENDERINGS SAME), (5) US Patent Application Publication No. 2005/0225575 (US Patent Application No. 2005/0225575) NOVEL SUBPIXEL LAYOUTS AND ARRANGEMENTS FOR HIGH BIGHTNESS DISPLAY ”, and (6) US Patent Application Publication No. 2005/0225563 (US Patent Application No. 10/81388),“ High Brightness Subpixel render for subpixel layout Gfilter (SUBPIXEL RENDERING FILTERS FOR HIGH BRIGHTNESS SUBPIXEL LAYOUT). The disclosure of each of the above referenced US patent application publications is hereby incorporated by reference.

  US Patent Application Publication No. 2005/0225575, “NOVEL SUBPIXEL LAYOUTS AND ARRANGMENTS FOR HIGH BRIGHTTNESS DISPLAY”, which includes at least one white (W) subpixel and a plurality of main A plurality of high brightness display panels and display devices including subpixel repeating groups having color subpixels are disclosed. In various embodiments, the primary color sub-pixels may include red, blue, green, cyan, or magenta. US Patent Application Publication No. 2005/00225563, “SUBPIXEL RENERING FILTERS FOR HIGH BRIGHTNESS SUBPIXEL DISPLAY LAYOUT”, for example, has a sub-pixel with white sub-pixels including RGBW sub-pixel repeating groups. Disclosed is a sub-pixel rendering technique for rendering source (input) image data for display on a display panel that substantially includes pixel repeat groups. FIGS. 9 and 10 of this specification, which duplicate FIGS. 5A and 5B from US Patent Application Publication No. 2005/0225563, illustrate respective RGBW sub-pixel repeating groups (3 and 9). The repeating group may be repeated substantially across the display panel to form a bright display. The RGBW subpixel repeating group 9 is composed of eight subpixels arranged in two rows and four columns, and two red subpixels 2, a green subpixel 4, a blue subpixel 8, and a white (or clear) subpixel. 6 is included. If sub-pixel repeating group 9 has four quadrants of each two sub-pixels, similar to the “checkerboard” pattern, the red and green sub-pixels are on opposite quadrants. Be placed. Other primary colors including cyan, emerald and magenta are also considered. In US Patent Application Publication No. 2005/0225563, the names of such colors are only “substantial” colors described as “red”, “green”, “blue”, “cyan”, “white”. When all subpixels are in the brightest state, the exact color point may be adjusted to obtain the desired white color on the display device.

   US Patent Application Publication No. 2005/0225563 discloses that input image data may be processed as follows. (1) If necessary, define conventional RGB input image data (or data having one of other common formats such as sRGB, YCbCr, etc.) by R, G, B, and W Is converted to a color data value in the color gamut. Such conversion may generate a separate luminance (L) color plane or color channel. (2) A sub-pixel rendering operation is executed for each color plane. (3) Use the “L” (or “luminance”) plane to clarify each color plane.

  Sub-pixel rendering operations for rendering input image data in a conventional RGB format on a display panel that includes RGBW sub-pixel repeating groups of the type illustrated in FIGS. 9A and 9B are generally in the United States with some modifications. In accordance with the principles disclosed and illustrated in US Pat. No. 7,123,277 and described above. The subpixel rendering filter kernel can be constructed using the region resampling principle described in US Pat. No. 7,123,277. In one embodiment, a unity filter is used to map the luminance data input to the white subpixel. That is, the luminance signal from one input conventional image pixel maps directly to the luminance signal of one white subpixel in the subpixel repeating group. The white subpixels reconstruct most of the non-saturated luminance signal of the input image data, and the surrounding main color subpixels provide color signal information.

  US Patent Application Publication No. 2005/0225563 is a sub-pixel rendering operation for RGBW sub-pixel repeating groups having red and green sub-pixels arranged in opposing quadrants or placed on a “checkerboard”. Disclose general information about execution. The red and green color planes may use a Difference of Gaussian (DOG) Wavelet filter followed by an Area Resampling filter. The region resample filter removes the spatial frequencies that cause color aliasing. The DOG wavelet filter is used to sharpen the image using a cross-color component. In other words, the red color plane is used to clarify the green subpixel image, and the green color plane is used to clarify the red subpixel image. US Patent Application Publication 2005/0225563 discloses embodiments of these filters as follows.

The blue color plane may be resampled using one of a plurality of filters, such as a 2 × 2 box filter.
0.25 0.25
0.25 0.25

Alternatively, it may be a box-tent filter placed at the center of the blue subpixel.
0.125 0.25 0.125
0.125 0.25 0.125

  In one embodiment that provides color signal information in the primary color subpixel, each input pixel image data is mapped to two subpixels. Accordingly, there are various methods for arranging the input image pixels in the main color subpixels in order to generate the region resampling filter. FIG. 10 (FIG. 6 of US Patent Application Publication No. 2005/0225563) shows the area resampling mapping of four input image pixels to sub-pixels in the red color plane of the display panel having the sub-pixel repeating group illustrated in FIG. 9A. Indicates. As shown in FIG. 5, the input image data is illustrated as an array or as a grid 52 of squares 52 representing the color data values of the input image pixels. The subpixel repeating group 3 of FIG. 9A, illustrated by the dark outline in FIG. 10, is on the grid 50 in an array where the two subpixels substantially match the color image data of one input image pixel 52 on the grid 50. Overlapping. The black point 15 represents the center of the red subpixel 2 of the subpixel repeating group 3. The resample area array for the red color plane is a red resample area, such as resample areas (14 and 16) having a diamond shape, each center being aligned with the center of the red subpixel 15. including. It can be seen that each of the resample regions (14 and 16) overlaps a portion of several input image pixels. The calculation of the filter coefficients for the area resample filter generates a filter called a “diamond” filter, which is an example of the area resample filter described in Table 1 above.

  FIG. 10 shows a particular arrangement of sub-pixel repeating groups with input image pixel grid and red color plane resampled areas. US Patent Application Publication No. 2005/0225563 describes the arrangement of input image pixel grids with sub-sample repeating groups or re-sample areas for each color plane, the selection of the position of the re-sample points opposite the input grid, and the shape of the re-sample areas. One or more aspects are disclosed and may be modified to simplify the domain resample filter provided. Some examples of such modifications are disclosed in US Patent Application Publication No. 2005/0225563.

  The co-owned international application PCT / US06 / 19657, “Multiprimary Color Sub-Pixel REDNDERING WITH METAMERIC FILTERING” adjusts input image data to sub-pixel output color data values. Disclosed is a system and method for rendering to a multi-primary color display utilizing metamers. International application PCT / US06 / 19657 is published as International Patent Application Publication WO 2006/127555, which is incorporated herein by reference. In multi-primary color displays that include sub-pixels with four or more non-matching color primaries, there are often many combinations for primary values that can give the same color value. In other words, for a given hue, saturation, and brightness, four or more brightness values that can give the viewer the same color impression for the color. There may be one or more sets of (intensity value). Each set of possible brightness values for that color is referred to as a “metamer”. Thus, a metamer on a display device that substantially includes a particular multi-primary color sub-pixel repeating group will have a signal that produces the desired color that is recognized by the human visual system when each group is applied. Or a combination (or set) of at least two or more color subpixel groups. The use of metamers provides the freedom of adjustment of values related to color primaries to achieve a desired goal such as improved image rendering accuracy or perception. The metamer filtering operation may be based on the input image content and may optimize the subpixel data values according to as many desired effects as possible. As a result, the overall result of the sub-pixel rendering operation can be improved.

  For example, in an RGBW system, the W subpixel is a metamer for gray with an adjacent group of R, G, and B subpixels. The subpixels used to create a given color may be adjacent subpixels that are close enough to the human visual system to mix the colors. These degrees of freedom--selecting signal values from similar color pixels together with the degrees of freedom provided by the choice of metamers, and thus the signal values of different sets of color subpixels--are broad ( The luminance component of the given image, while maintaining accurate luminance and color at the perceptual level, allows more faithful display at the sub-pixel level. This freedom of color selection from various metamers creates new possibilities that can result in improved images. For example, the W subpixel value increases when the W subpixel is placed on the bright side of the high frequency edge, and the W subpixel value decreases when the W subpixel is placed on the dark side of the high frequency edge. The display device can be designed to select metamers in a simple manner. The metamer may be selected such that the R and G subpixel values increase when the red and green subpixel couples are placed on the bright side of the high frequency edge in the image. Conversely, the red and green subpixel values may decrease when the red and green subpixel couple is placed on the dark side of the edge.

  International application WO2006 / 127555 discloses at least two embodiments for performing metamer filtering functions. In the first embodiment, the metamer filtering operation precedes the sub-pixel rendering operation in the image processing pipeline, effectively combining both operations. In the international application WO2006 / 127555, this scheme is referred to as “direct metamer filtering”. In the second embodiment, the metamer filtering operation may be accomplished in a separate process beyond the input image pixel data. In the international application WO2006 / 127555, this scheme is referred to as “preconditioning metamer filtering”.

International application WO 2006/127555 further discloses that with respect to the calculation of metamers, it is possible to model a dynamic relationship between metamer subpixel groups and associated signals. For example, it is possible to find a substantially linear relationship between a particular color metamer and the signal-this allows to calculate "immediately adjacent" metamers and signals . Such a model can be used to adjust the lightness values of sub-pixels including metamers to minimize errors such as image artifacts and color errors. From such a model, whenever it is necessary to adjust the image data according to specific data such as luminance data, the brightness adaptation value can be stored and employed in the display system. An example of such adjustment is described below. If one of the primaries in the metamer changes by an amount “a” value, one may change each of the other primaries by a value “a ^* m”. Here, “m” is a different metamer slope for each primary. The slope value “m” can be calculated from a matrix M2X that converts colors from the multi-primary color system to CIE XYZ coordinates. For example, as discussed in US Patent Application Publications 2005/0083341 and 2005/0083352, calculating this transformation matrix from primary chromaticity and luminosity measurements of a multi-primary color system is Known in the technical field. . International Publication WO 2006/127555 provides a procedure for calculating a metamer slope value “m” for a set of primary colors given on a particular display device.

  FIG. 11 (FIG. 11 of International Publication WO 2006/127555) schematically illustrates one embodiment of a metamer filtering operation. The input image data is represented as luminance data 1102 and color data 1104. These data sets are substantially spatially consistent. For example, the luminance data 1102 is luminance data of the image data 1104. The luminance channel 1102 is sampled using the filter kernel 1110 for high frequency information. This filter can be applied to a 3 × 3 region located in the center of a blue-white (BW) pixel couple 1106. The result is a sharpening value “a” that is used to convert the color metamer in box 1112. For each value 1106 of the luminance channel 1102, there are R, G, B, and W corresponding values 1108 shown schematically in the color channel 1104. The RGBW value is changed in metamer in step 1112. The modified metamer 1116 is stored in the output buffer 1114 or passes through the next processing stage. The red-green (RG) subpixel couple is processed in a similar manner (not shown) but uses other filter kernels. The center value of the RG sub-pixel couple is sampled from the luminance channel and convolved with the filter kernel. Consequently, the sharpening value “a” is used to calculate a new metamer from the color channel for the RGBW value. The calculated new metamer is stored in the output buffer or passes through the next processing stage. FIG. 12 (FIG. 15 of International Publication WO2006 / 127555) shows one such embodiment. International Publication WO 2006/127555 is that the filter kernel illustrated and described therein is merely exemplary, and other filter kernels may be employed to obtain different values reflecting different relationships between metamers. (For example, there is a non-linear relationship or different input image data dimensions).

  International Publication WO 2006/127555 further explores the use of metamer filtering operations in conjunction with other sub-pixel rendering (SPR) techniques, such as the sub-pixel rendering operations for high-brightness layout of the aforementioned US application publication 2005/02255563. Yes. Rather than performing a metamer filtering operation as a previous step, the SPR operation can be configured to perform the metamer filtering and sub-pixel rendering directly in one step. In general, using the region resampling principle, a sharpening region filter kernel is computed for each color plane and a region resampling filter for that color plane to generate a metamer sharpening wavelet filter. Excluded from. Further details are mentioned in the international publication WO 2006/127555. FIG. 13 (FIG. 17 of WO 2006/127555) shows one such embodiment.

  International Publication WO 2006/127555 also replaces all or some white sub-pixels with cyan, yellow, gray, or other colors for all drawings showing the sub-pixel repeating groups contained therein. Describes that additional sub-pixel layouts may be formed. Furthermore, the technologies studied there are liquid crystal display (LCD), reflection type liquid crystal display, electroluminescence display (EL), plasma display panel (PDP), field emitter display (FED), electrophoretic. Transmissive and non-transmissive types such as display devices, irident display devices (ID), incandescent display devices, solid state light emitting diode (LED) display devices, and organic light emitting diode (OLED) display devices Covers the full range of display technologies, including display panels.

Overview of Display Device Structures that Perform Subpixel Rendering Techniques FIGS. 14A and 14B are display devices that perform the subpixel rendering operations described above and described in the co-owned patent applications and registered patents cited herein. And functional components of system embodiments. FIG. 14A illustrates the display system 1400 with the data flow of the display device 1400 displayed by a thick arrow line. Display system 1400 includes input gamma operation 1402, color gamut mapping (GMA) operation 1404, line buffer 1406, SPR operation 1408, and output gamma operation 1410.

  The input circuit provides RGB input data or other input data format to the display system 1400. RGB input data may then be input to input gamma operation 1402. The output from operation 1402 then proceeds to color gamut mapping operation 1404. Typically, a gamut mapping operation 1404 accepts image data and performs a necessary or desired gamut mapping operation on the input data. For example, if the image processing system inputs RGB input data for rendering on an RGBW display panel, a mapping operation will be required to use a white (W) primary on the display device. This operation may also be required in a typical multi-primary color display system where input data moves from one color space to another color space having a different number of primaries in the output color space. In addition, GMA can be used in the output display space to handle situations where the input color data is considered “out of gamut”. In a display system that does not perform such color gamut mapping conversion, the GMA operation 1404 is omitted. Additional information on gamut mapping operations adapted for use in multi-primary color displays can be found in co-owned US Patent Application Publications 2005/0083352, 2005/0083341, 2005/0083344, and 2005, which are incorporated herein by reference. Can be found in the U.S. patent application published at / 0225562.

  Subsequently, referring to FIG. 14A, the intermediate image data output from the color gamut mapping operation 1404 is stored in the line buffer 1406. Line buffer 1406 provides image data that requires additional processing along with sub-pixel rendering (SPR) operations 1408 when the data is needed. By way of example, an SPR operation that implements the region resampling principle disclosed and described above is a 3 × 3 matrix of image data surrounding a given image data point that is processed to perform region resampling. May generally be employed. Thus, three data lines are input to SPR 1408 to perform a sub-pixel rendering operation that includes a neighboring filtering stage. After the SPR operation 1408 is finished, the image data may be output to the output gamma operation 1410 before being output from the system to the display device. Note that input gamma operation 1402 and output gamma operation 1410 may be selective. Additional information for embodiments of this display system can be found, for example, in co-owned US Patent Application Publication 2005/0083352. The data flow of the display system 1400 may be referred to as a “color gamut pipeline” or a “gamma pipeline”.

  FIG. 14B illustrates a system level diagram 1420 that is one embodiment of a display system for sub-pixel rendered input image data for a multi-primary color display device 1422 that employs the techniques discussed in the above referenced international publication WO 2006/127555. Show. The functional components operate in a manner similar to that illustrated in FIG. 14A, which has the same reference numbers. The input image data can be composed of three main colors such as RGB or YCbCr that are converted to multi-primary colors by the GMA module 1404. In the display system 1420, the GMA element 1404 can also calculate the luminance channel, L, of the input image data signal (in addition to other multi-primary color signals). In the display system 1420, the metamer calculation may be performed as a filtering operation that includes referencing a plurality of surrounding image data (eg, pixel or subpixel) values. These peripheral values are generally organized by a line buffer 1406, although other embodiments such as multiple frame buffers are possible. The display system 1420 has a metamer filtering module 1412 that performs operations as briefly described above and as described in detail in International Publication WO 2006/127555. In one embodiment of the display system 1420, a metamer filtering operation 1412 can be associated with the subpixel rendering (SPR) module 1408 and share the line buffer 1406. As described above, this embodiment is referred to as “direct metamer filtering”.

  FIG. 15 is an alternative functional block diagram of a display system architecture adapted to implement the below-described techniques and sub-pixel repeating groups associated with directional display devices, not described above. provide. Display system 1550 accepts an input image signal indicative of input image data. The signal is input to an SPR operation 1408 where the input image data is sub-pixel rendered to fit the display device. The SPR operation 1408 is referenced with a drawing reference number similar to the display system illustrated in FIGS. 14A and 14B. However, the SPR operation 1408 is for the purpose of performing sub-pixel rendering techniques on a display panel that includes one of the sub-pixel repeating groups that are particularly adapted for the directional display devices discussed below. It is understood that changes to any of the SPR functions discussed below may be included.

  Subsequently, referring to FIG. 15, the output of the SPR operation 1408 may be input to the timing controller 1560 in the display system architecture. A display device architecture having functional components arranged differently than the functional components illustrated in FIG. 15 is compatible with the directional display devices contemplated herein. For example, in other embodiments, the SPR operation 1408 may be included in the timing controller 1560, incorporated within the display panel 1570 (especially using processing techniques such as LTPS), or, for example, It may be located elsewhere in the display system 1550, such as in a graphic controller. The particular location of the functional block in the representation of the display system 1550 of FIG. 15 is not intended to limit the location in any way.

  In the display system 1550, data and control signals are output from the timing controller 1560 to a driving circuit that sends an image signal to a sub-pixel on the display panel 1570. In particular, FIG. 15 illustrates a row driver (also referred to as a data driver for receiving image signal data transferred to appropriate sub-pixels on the display panel) and a row driver (also referred to as a column driver 1566 and a gate driver). ) Driver 1568 is shown. Display panel 1570 includes sub-pixel repeating group 1720 of FIG. 17A that is substantially 2 rows by 8 columns and has four primary colors including white (clear) sub-pixels. It will be understood that the sub-pixels in the repeat group 1720 are not drawn to scale on the display panel 1570 and are shown enlarged for convenience. As shown in the enlarged view, the display panel 1570 includes other types of sub-pixel repeating groups that are particularly suited to the directional display devices illustrated in the drawings and described in detail below. One possible size for the display panel 1570 is 1920 subpixels in the horizontal direction (red 640, green 640, and blue subpixel 640) and a row of 960 subpixels. Such a display device has as many sub-pixels as necessary for 1280 × 720 and 1280 × 960 input signals to display a VGA. However, it is understood that the display panel 1570 is representative of display panels of any size.

  Various aspects of the hardware implementation of the aforementioned display device are described in co-owned US Patent Application Publication No. 2005/0212741 (US Application 10 / 807,604), incorporated herein by reference. Transistor backplane for liquid crystal display devices (TRANSISTOR BACKPLANES FOR LIQUID CRYSTAL DISPLAYS COMPRISING DIFFERENT SIZE SUBPIXEL), US Patent Application Publication No. 2005/02255548 (US Application 10/821387) SYSTEM AND METHOD FOR IMPROVING SUB-PIXEL RENDERING OF IMAGE DATA IN NON-STRIPED DISPLAY SYSTEM), and US Patent Application Publication No. 2005/0276502 (US Application 10/866447), “INCREASING GAMMA ACCURACY IN QUAD Is being considered. Hardware implementation considerations are described in International Application PCT / US06 / 12768, published in International Publication No. WO 2006/108084, incorporated herein by reference, “Efficient Memory for Display Systems with New Sub-Pixel Structures”. Structure (EFFICENT MEMORY STRUCTURE FOR DISPLAY SYSTEM WITH NOVEL SUBPIXEL STRUCTURE). Hardware implementation considerations can be found in Elliott et al., Which is incorporated herein by reference. Of SID Symposium Digest in May 2002 of SID Symposium Digest. This is further described in “Co-optimization of Color AMLCD Subpixel Architecture and Rendering Algorithm” published at 172-175.

  The technologies and sub-pixel repeating groups discussed above and further discussed below are liquid crystal display (LCD), reflective liquid crystal display, electroluminescent display (EL), plasma display panel (PDP), field emitter display. Such as device (FED), electrophoretic display device, irident display device (ID), incandescent lamp display device, solid state light emitting diode (LED) display device, and organic light emitting diode (OLED) display device It covers the range of all display technologies including transmissive and non-transmissive display panels.

Sub-pixel layout and sub-pixel rendering for directional display devices Below, consider an embodiment of a sub-pixel repeating group that is particularly adapted to display panels used in directional display devices capable of displaying at least two images simultaneously. As discussed in the background art, the directional display device may be configured to display at least two images so that one observer can recognize one three-dimensional image from an optimal viewpoint. The directional display device is at least 2 so that one viewer views each image at the first and second viewpoints, or two viewers view each image at the first and second viewpoints. One image may be displayed. In the various drawings herein that illustrate embodiments of sub-pixel repeat groups, the sub-pixel columns that are part of the display panel are labeled “L” or “R”. This means that some of the columns of the display panel will go to the “left view” (for example, the left eye side of the observer in the 3D display system), and the other columns will go to the “right view”. become. The “L” and “R” labeling is not intended to limit the use of the display panel in the autostereoscopic device in any way. The labeling is intended as shown in the specific drawing, when a display panel including sub-pixel repeating groups is used in a directional display device, the first half of the column (the “R” column) is illuminated. Is designated to provide a first image that can be viewed from the first viewpoint, and light illumination of the second half of the column (the “L” column) results in a second image that can be viewed from the second viewpoint. It is specified to be provided. These first and second images are referred to as fields of view, and the subpixel arrangement that forms the basis of each field of view is shown in a separate drawing. This means that the subpixel arrangement shown in the field of view is a subset of the subpixels that form the original display panel.

  In some of the illustrated embodiments discussed below, the sub-pixel columns in a portion of the display panel are designated “L”, “R”, and “B”. The column designated “B” is intended to be directed to both the left and right view by the optical steering mechanism or optical steering member of the display device. These particular embodiments are compatible with autostereoscopic 3D display devices where the right and left eye fields of view share the color information of the image. These particular embodiments may not be suitable for multi-view directional display devices where the first and second images do not share the same color information.

  In each of the illustrated embodiments described below, a display device that includes a display panel substantially having the sub-pixel repeating group of embodiments is not limited to use with only directional display devices, It can operate in a single image or two-dimensional mode or a 2D3D switchable display device as described above. Sub-pixel rendering (SPR) operations (for example, the display device 1400 of FIG. 14A or the SPR operation 1408 of the display device 1420 of FIG. 14B) are discussed above and published patents and patent applications referenced herein. Using the region resampling and metamer filtering techniques described in the literature review, when operating in two-dimensional mode, the input receives image data and for each subpixel on the display panel It may be configured to generate output image data. In order to produce a suitable filter for those having ordinary skill in the art to perform subpixel rendering operations, the subpixel iteration group described herein is used in accordance with the principles described in the foregoing documents. Is understood to be applicable. Therefore, a detailed description thereof will be omitted in the following examination.

  In the discussion of the subpixel repeating group embodiments below, reference is made to subpixels that are placed in a particular color order and position in rows and columns, and examples are illustrated. It will be appreciated that in some or all of the illustrated arrangements, the row positions of the subpixels can vary, such as when the subpixels in the first and second rows are swapped. Further, in some or all of the illustrated arrangements, reference to a particular order of the color subpixels in the first and second rows of the subpixel repeat group is 90 degrees to the left or right side of the subpixel repeat group. It is understood to cover the rotated arrangement.

1. Multi-Primary Color Subpixel Repeat Group Embodiments As an introduction, each embodiment of the multi-primary color subpixel repeat group shown in FIGS. 16A, 17A, 18A, and 19A includes white (W) as the primary color. In each of the embodiments, it is understood that the white sub-pixel is replaced by another suitable color that functions as the primary color, such as yellow, magenta, gray-blue, or blue-green (cyan). White subpixels may also be replaced with additional red, green, or blue subpixels. In addition, as described in co-owned US Patent Application Publication No. 2005/0225563 considering additional embodiments of these high brightness layouts, the names of these colors are "red", "green", They are simply “substantially” colors such as “blue”, “blue-green (cyan)”, and “white”. The exact color point (color point) can be adjusted to obtain the desired white point on the display device when all sub-pixels are in the brightest state.

  FIG. 16A shows a portion of a display panel that substantially includes a subpixel repeating group 1610. The subpixel repeating group 1610 is arranged in two rows and has 12 red subpixels 1612, 4 green subpixels 1614, 2 blue subpixels 1616, and 2 white (or clear) subpixels 1618. Contains sub-pixels. Blue subpixel 1616 and white subpixel 1618 are arranged in the same column, forming a stripe of blue and white subpixels. Viewing the subpixel repeating group as having four quadrants of each of the three subpixels, the white subpixel 1618 and the blue subpixel 1616 are located in other rows of the opposing quadrant and have low resolution. A checkerboard pattern is formed. Red subpixel 1612 is paired with green subpixel 1614 in each quadrant. In the first row, when the movement across the row is from left to right, the green subpixel 1614 follows the red subpixel 1612, and in the second row, the red subpixel 1612 follows the green subpixel 1614. Such an arrangement of red and green sub-pixels is shown by a higher resolution checkerboard pattern.

  A display device having a display panel that substantially includes the sub-pixel repeating group 1610 as shown in FIG. 16A can also operate as a directional display device. FIG. 16B shows the display 1604 generated by the column 1624 of sub-pixels labeled “R” in FIG. 16A. The image displayed on the display 1604 is arranged in two rows, six subpixels including two red subpixels 1612, two green subpixels 1614, one blue subpixel 1616, and one white subpixel 1618. Is rendered on a sub-pixel iteration group 1630 containing. FIG. 16C shows the display 1602 generated by the column 1622 of sub-pixels labeled “L” in FIG. 16A. The image displayed in the display 1602 is arranged in two rows and includes six sub-pixels including two red sub-pixels 1612, two green sub-pixels 1614, one blue sub-pixel 1616, and one white sub-pixel 1618. Rendered on a subpixel repeating group 1640 containing pixels. These specific subpixel iteration groups 1630 and 1640 are previously disclosed and co-owned U.S. Patent Application Publication 2004/0051724, "FOUR COLOR ARRANGEMENTS AND MITTERS FOR SUB-" PIXEL RENDERING) and International Patent Publication WO 2006/127555, “Multi-Primary Color Subpixel Rendering WITH METAMERIC FILTERING”. Accordingly, different “L” and “R” images generated on the display panel that includes the subpixel repeating group 1610 of FIG. 16A are images formed on the display panel that substantially include the subpixel arrangements 1630 and 1640. Against all the advantages discussed in the above specification.

FIG. 17A shows a portion of a display panel 1700 that substantially includes a subpixel repeating group 1720. Subpixel repeating group 1720 is arranged in two rows, 24 including 8 green subpixels 1744, 8 white (or clear) subpixels 1748, 4 blue subpixels 1476, and 4 red subpixels 1742. Of subpixels. Red subpixels 1742 and blue subpixels 1746 are alternately arranged within the same column to form four columns. The blue and red subpixel columns are arranged between a pair of green and white subpixels in which green and white subpixels are alternately arranged to form a column. Each row includes two red sub-pixels 1742 and two blue sub-pixels 1746 in turn from left to right. In the first row, the blue subpixel 1746 follows the red subpixel 1742 and in the second row the red subpixel 1742 follows the blue subpixel 1746 to form a low resolution checkerboard pattern of red and blue primary colors. . Paired green and white sub-pixels are also alternately arranged in order from left to right in each row to form a high resolution checkerboard pattern horizontally. The repeating pattern of green (G) and white (W) subpixels will be seen more easily in the following example using letters representing the color and position of the subpixels. Here, “x” represents the placeholder of the blue and red sub-pixels in the sub-pixel repeating group 1720.

  FIG. 17A has columns of subpixels 1724, 1722, and 1723 labeled “R”, “L”, and “B”, respectively. When a display device having a display panel that substantially includes a subpixel repeating group 1720 operates as a directional display device, a column 1723 labeled “B” that includes alternating red and blue subpixels is It will go to both the (R) and second (L) images. In the embodiment, the color primaries are divided into two types based on the relative luminance, and the relatively dark primaries, the red and blue primary color sub-pixels in this embodiment, are shared between the left view and the right view. Because the resolution of the color channel is very low to support fine discrimination between two parallax separated images, the resolution of the chromatic channel is very low, and visual depth or distance recognition When making an impression, the color channel is not taken into account, so the human visual system can tolerate this. However, only the luminance channel has the required resolution. Therefore, the brighter primary color sub-pixel is responsible for transmitting the required stereoscopic image information. Furthermore, the left and right views can share the color information of these columns without generating visual artifacts. Accordingly, the embodiment shown in FIG. 17A is particularly suited for autostereoscopic 3D display devices and switchable 2D3D display devices.

  FIG. 17B shows display 1734 generated by column 1724 of subpixels labeled “R” in FIG. 17A and column 1723 of subpixels labeled “B”. The image displayed in display 1734 is arranged in two columns and rendered on a subpixel repeating group 1730 that includes eight subpixels, each including two red, green, blue, and white subpixels. FIG. 17C shows display 1732 generated by column 1722 of subpixels labeled “L” and column 1723 of subpixels labeled “B” in FIG. 17A. The image displayed in display 1732 is also arranged in two columns and rendered on a subpixel repeating group 1740 that includes eight subpixels, each including two red, green, blue, and white subpixels. The first and second display sub-pixel repeating groups 1730, 1740 are co-owned US Patent Application Publication No. 2005/02255575, cited above, “NOVEL SUBPIXEL LAYOUTS. AND ARRANGEMENTS FOR HIGH BRIGHTNESS DISPLAY) ”and international publication WO 2006/127555. Accordingly, the differentiated “L” and “R” images generated on the display panel that includes the subpixel repeating group 1720 of FIG. 17A were generated on the display panel that substantially includes the subpixel arrangements 1730, 1740. It has all the advantages discussed in the above specification for images.

  The subpixel rendering operation used to render the first and second (eg, left and right) views is a subset of subpixels (eg, 1723 columns) on the display panel 1700 shared by the two views. May be changed to account for the fact that The sub-pixel rendering operation can average the contribution to the input image data belonging to two separate displays 1734, 1732 for the color plane corresponding to the color sub-pixels in column 1723 shared by the two-sided views. In the embodiment shown in FIG. 17A, the subpixel rendering operation can determine an average contribution to the input image data belonging to two separate displays 1734, 1732 for the red and blue color planes. Further, it may be desirable to adjust the selected metamer for each of the two views 1734, 1732 so that the column sub-pixels in the columns in the two-sided view are approximately the same. If one should be selected more than the other, it may be desirable to select the metamer so that the red-green color channel overlaps almost in each field of view. This is because the human visual system is more sensitive to color channel errors than yellow-blue color channel errors. In the subpixel arrangement 1720 in FIG. 17A, the red color planes of the respective displays are set to be almost the same.

  FIG. 18A shows a portion of a display panel that substantially includes a subpixel repeating group 1810. The subpixel repeating group 1810 is arranged in two rows, with 16 white (or clear) subpixels 1818, 2 green subpixels 1814, 2 blue subpixels 1816, 2 red subpixels 1812, and 2 It includes 24 sub-pixels, including a matched fifth color primary sub-pixel 1817 such as two blue-green (cyan), emerald, yellow, magenta, or other matched colors. In FIG. 18A, FIG. 18B, and FIG. 18C, the fifth color primary subpixel 1817 represents blue-green (cyan) and is shown with narrowly spaced horizontal hatching. White subpixels 1818 are arranged in two adjacent columns. Red subpixels 1812 are arranged in two columns alternately with blue-green (cyan) subpixels 1817, and green subpixels 1814 are arranged in two columns alternately with blue subpixels 1816.

  FIG. 18A shows columns 1824, 1822 of white sub-pixels 1818 labeled “R” and “L”, respectively. When a display device having a display panel that substantially includes sub-pixel repeating group 1810 operates as a directional display device, column 1824 labeled “R” on the display panel faces the first (R) image and displays Panel row 1822 goes to the second (L) image. A column 1825 labeled “B” containing alternating red and blue-green (cyan) sub-pixels and a column 1823 containing alternating green and blue sub-pixels are sub-pixel repeating groups 1810. When a display device having a display panel that substantially includes is operated as a directional display device, it is directed to both the first (R) and second (L) images.

  FIG. 18B shows display 1804 generated by column 1824 of subpixels labeled “R” and column 1823, 1825 of subpixels labeled “B” in FIG. 18A. FIG. 18C shows a display 1802 generated by the column of subpixels 1822 labeled “L” and the columns of subpixels 1823, 1825 labeled “B” in FIG. 18A. The embodiment illustrated in FIG. 18A is particularly suited to autostereoscopic 3D display devices and switchable 2D3D display devices. As discussed above with respect to the embodiments shown in FIGS. 17A, 17B, and 17C, the resolution required by a human visual system to produce a visual depth or distance perception impression. Because of the luminance channel it has, it is the white subpixels that are preferentially responsible for transmitting stereoscopic image information in the embodiment of FIG. 18A. On the other hand, the saturated primary color subpixel conveys the color information of the image without generating visual artifacts.

  The images displayed in each display 1804, 1806 are arranged in two columns, a sub including eight white sub-pixels 1818 and 16 sub-pixels each including two red, green, blue, and blue-green sub-pixels. Rendered on pixel iteration group 1830. It can be seen that the white sub-pixels are arranged in a square over the display 1804. In other words, a virtual line connecting the centers of four adjacent white subpixels forms a square. If the sub-pixel repeating group 1830 is viewed as having four quadrants composed of four pixels, the saturated color primary pairs are placed on opposite quadrants to form a checkerboard pattern. Sub-pixel repeating groups having a row of white sub-pixels of the type shown in FIGS. 18B and 18C have been previously disclosed and discussed in co-owned US Application Publication No. 2005/025575 and International Publication WO 2006/127555 referenced above. It was done. Accordingly, the differentiated “L” and “R” images generated on the display panel that includes the subpixel repeating group 1810 of FIG. 18A relate to the image generated on the display panel that substantially includes the subpixel arrangement 1830 Has all the advantages discussed in the above specification.

  FIG. 19 illustrates a portion of a display panel that substantially includes a subpixel repeating group 1910. Sub-pixel repeating group 1910 includes eight sub-pixels having a substantially square form and arranged in four rows and two columns, each including two primary color sub-pixels. The red sub-pixel 1912 and the blue sub-pixel 1916 are alternately arranged in the same row between the rows of the green sub-pixel 1914 and the white sub-pixel 1918 which are alternately arranged. Each column in the subpixel repeating group 1910 includes one primary color subpixel. When a display device having a display panel that includes a sub-pixel repeating group 1910 operates in a conventional two-dimensional mode, four sub-pixels (one each of red, green, blue, and white) represent “ Used in the “pixel” mode, the sub-pixel rendering operation can be omitted. When a display device having a display panel including a subpixel repeating group 1910 operates as a directional display device such as a three-dimensional mode, the first and second image data generate a display 1902 as shown in FIG. 19B. The image data of the column 1924 labeled “R” and the image data of the column 1922 labeled “L” to generate the display 1904 as shown in FIG. 19C are broken down into columns and columns. Can.

  The display 1902 of FIG. 19B and the display 1904 of FIG. 19C have some similarities. Each row of data has two subpixel rows. The luminance center would be either the red-green (RG) subpixel pair 1936 or the blue-white (BW) subpixel pair 1938 (FIG. 19B). Each column of image data can generate a full resolution in this mode of operation (eg, 3D) utilizing a sub-pixel rendering operation with the appropriate sharpening algorithm described above. it can. However, the color information should be distributed in two or three sets of rows in order to obtain an accurate color, which limits the vertical resolution. FIG. 19C shows the subpixels required to achieve the proper color. If the input image data pixel from which the color is generated is located in the center of the green-red subpixel pair 1926, four blue and white subpixel pairs 1928, 1930, 1932, 1934 are used for color balance. The A sharpening algorithm can be used to improve the sharpness of the horizon of the output image. In the display panel including the subpixel repeating group 1910, in the displays 1902 and 1904, since the subpixel colors are alternately arranged in columns, in each display 1902 and 1904, the diagonal line of the output image is 2 in the conventional display panel. Can have a modulation transfer function (MTF) like you have when operating in dimensional mode

2. Subpixel Repeat Group Embodiment with Three Color Primarys FIG. 20A shows a portion of a display panel 2000 that substantially includes a subpixel repeat group 2010. The sub-pixel repeating group 2010 includes six sub-pixels of three main colors arranged in two rows. The blue subpixels 2016 are arranged in a row to form a stripe in the vertical direction. Each row includes one red subpixel 2012 and one green subpixel 2014. In the first row, the green subpixel 2014 follows the red subpixel 2012, and in the second row, the red subpixel 2012 follows the green subpixel 2014, forming a checkerboard pattern. Any three consecutive primary color subpixels in a row can be grouped together as a conventional whole pixel 2020. Thus, the display panel can be treated as an array of conventional full color whole pixels 2020 when operating in a two-dimensional mode.

  FIG. 20A has columns of subpixels 2024, 2022 labeled “R” and “L”, respectively. When a display device having a display panel that substantially includes a subpixel repeating group 2010 operates as a directional display device, the column 2024 labeled “R” of the display panel is directed to the first (R) image. Thus, column 2022 labeled “L” on the display panel goes to the second (L) image. FIG. 20B shows a display 2004 generated by a column of subpixels 2024 labeled “R” in FIG. 20A. Images displayed in display 2004 are arranged in two rows and rendered on a subpixel repeating group 2030 that includes six subpixels, each including two red, green, and blue subpixels. The subpixel occupies substantially the same position relative to the subpixel repeating group 2010 and includes a vertical stripe of blue subpixels. FIG. 20C shows the display 2002 generated by the column 2022 of subpixels labeled “L” in FIG. 20A. The image displayed in the display 2002 is also rendered on the subpixel repeating group 2030.

  Various modifications of the subpixel repeating group 2030 with blue vertical stripes have been previously disclosed and discussed in co-owned US Pat. Nos. 7,123,277 and 6,903,754. Accordingly, the differentiated “L” and “R” images generated on the display panel that includes the sub-pixel repeating group 2020 of FIG. 20A are images formed on the display panel that substantially include the sub-pixel arrangement 2030. Having all the advantages discussed in the above specification relating to. In particular, when the display panel 2000 of FIG. 20A displays an image rendered in the whole pixel mode in the conventional two-dimensional mode (that is, the whole pixel 2020 is not used and the sub-pixel rendering technique is not used), the given resolution (R). When operating as a directional display device, the first (R) and second (L) images generated by the same display panel are used when a subpixel rendering operation is used to render the image data for each display. Will have the same resolution (r).

  In contrast, the red subpixel 2012, the green subpixel 2014, and the blue subpixel 2016 of the display panel 2000 of FIG. 20A may be configured to have a narrow aspect ratio. This allows the display panel 2000 to increase the horizontal resolution of the panel when used in a conventional two-dimensional operation mode. This takes advantage of sub-pixel rendering for displaying images in two-dimensional mode and improves image quality.

FIGS. 21A, 22A, 23A, and 24A illustrate a sub-pixel repeating group of display panels that includes one primary color sub-pixel having a higher resolution than two primary color sub-pixels. Consider the embodiment. A subpixel having a higher resolution is referred to as a majority subpixel in a subpixel repeating group. These particular embodiments utilize the green subpixel as the majority subpixel. However, it is understood that other primary colors may be suitable as majority subpixels (eg, specific display applications). In each of these embodiments, the majority subpixels are arranged in subpixel repeating groups to create vertical or horizontal stripes on the display panel. The majority subpixels are arranged in a similar manner to the checkerboard pattern in opposing quadrant subpixel repeating groups. That is, if a subpixel repeating group has N subpixels in two rows with N / 2 subpixels, the subpixel repeating group will have the same number of colors in opposite quadrants, as shown below. It can be seen to have four quadrants of N / 4 subpixels with minority subpixels. Here, P1 is the majority subpixel, and P2 and P3 are the two minority main color subpixels.
P1 P1 P2 P1 P1 P3
P1 P1 P3 P1 P1 P2

  If the directional display device includes a display panel that includes substantially one of these subpixel repeating groups, the first (R) and second (L) displays are in the other two primary color subpixels. It is generated on a sub-pixel repeating group containing one primary color sub-pixel having a higher resolution. Various applications of such various subpixel repeating groups or subpixel repeating groups illustrated in FIGS. 21B, 21C, 22B, 22C, 23B, 23C, 24B, and 24C are described in US Pat. Published Application 2003/0128225 (US Application No. 10/278353), “COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB— PIXEL RENDERING WITH INCREASED MODULATION TRANSFER FUNCTION RESPONSE) has already been disclosed and discussed. Thus, when a first or second display is generated as illustrated in the drawings herein, the image is a U.S. image with respect to an image formed on a display panel substantially including the subpixel arrangement disclosed therein. Having all the advantages discussed in patent 2003/0128225.

  FIG. 21A shows a portion of a display panel 2100 that substantially includes a subpixel repeating group 2110. Subpixel repeating group 2110 is arranged in 4 rows and 4 columns and includes 16 subpixels including 4 red subpixels 2112, 8 green subpixels 2114, and 4 blue subpixels 2116. The green subpixels 2114 have a half aspect ratio in the vertical axis relative to the red and blue subpixels, and are arranged in several rows across the display panel 2100 to form horizontal stripes. When the sub-repeat group is viewed in the four quadrants of each of the four sub-pixels, the red and blue sub-pixels are paired in each quadrant, and the red sub-pixel 2112 and blue sub-pixel 2116 pairs are opposite four. Arranged in different rows on the dividing plane to form a double checkerboard pattern. Four subpixels of three primary colors within a group of quadrants, for example, red 2112, two green 2114, and blue 2116 subpixels can be seen in a conventional overall pixel 2120. Accordingly, the display panel 2100 can be handled as an array of conventional full color whole pixels 2120 when operating in a two-dimensional mode.

  FIG. 21A has columns of subpixels 2124, 2122 labeled "R" and "L", respectively. When a display device having a display panel that includes a sub-pixel repeating group 2110 operates as a directional display device, the column 2124 labeled “R” faces the first (R) image and is labeled “L”. Column 2122 goes to the second (L) image. FIG. 21B shows the display 2104 generated by the column 2124 of subpixels labeled “R” in FIG. 21A. The image displayed in the display 2104 is rendered on a subpixel repeating group 2130 that is arranged in four rows and includes four green subpixels 2114, eight subpixels each including two red and blue subpixels. The green subpixels 2114 are arranged in a horizontal stripe shape on the subpixel repeating group 2130, and the green subpixels 2114 form a rectangular arrangement across the display 2104. That is, an imaginary line connecting the centers of four adjacent green subpixels forms a rectangle. The subpixels in subpixel repeating group 2130 occupy substantially the same position relative to subpixel repeating group 2110 that includes a horizontal stripe of green subpixels 2116 and a checkerboard pattern of red and blue subpixels. FIG. 21C shows the display 2102 generated by the column 2122 of subpixels labeled “L” in FIG. 21A. The image displayed in the display 2102 is also rendered on the subpixel repeating group 2130.

  Referring to FIG. 21B, the input of the conventional RGB image data set that constitutes the right display 2104 may include one input green image value for each green subpixel 2114 to reconstruct all green portions of the input image. Can be mapped to subpixel arrangements in the right display 2104 such that one (ie, one input image pixel) maps to one green subpixel. The red and blue data values of the input image data set are the red subpixels that make up the red and blue resample area arrays, respectively, as described above with respect to the subpixel rendering operation described in US Pat. No. 7,123,277. 2112 and the blue subpixel 2116 are reconstructed. Several types of filters can be used to achieve red and blue color plane mapping. As one method, depending on the input image pixel used to reconstruct the data value for the green subpixel adjacent to the target red or blue subpixel, the red and blue data values of some input image pixels The contribution is used to generate a data value for the target red or blue subpixel.

  As an example of such a mapping type, reference is made to FIG. 21B illustrating logical pixels 2160 and 2165 in which boundaries are drawn with a one-dot chain line. The overlapping logical pixels 2160 and 2165 are configured by a total of three sub-pixels, one red, green and blue sub-pixels in each logical pixel. In such an example of image mapping, each logical pixel 2160, 2165 each includes a unique green subpixel 2114A, 2114B, and is arranged adjacent to and overlaps other logical pixels, red subpixels and blue subpixels ( By way of example, the blue sub-pixel 2116A is shared. Accordingly, the target blue subpixel 2116A is surrounded by the green subpixels 2114A and 2114B on the upper and lower sides thereof. The box filter is used to map the blue data values of the two input image pixels that are used to map the green image data values to adjacent green subpixels 2114A, 2114B. The two values in the box filter may both be ½ (0.5). A similar operation is used to map the input image pixel data to data values for the red subpixel.

  FIG. 22A shows a portion of a display panel that substantially includes a subpixel repeating group 2210. Sub-repeat pixel group 2210 is arranged in 2 rows and 4 columns and includes 8 sub-pixels including 2 red sub-pixels 2212, 4 green sub-pixels 2214 and 2 blue sub-pixels 2216. The green sub-pixels 2214 have a half aspect ratio in the horizontal axis with respect to the red and blue sub-pixels, and are arranged in two rows that form vertical stripes across the display panel 2200. When the sub-repeat group is viewed in the four quadrants of each of the two sub-pixels, the red and blue sub-pixels are arranged in other rows in the opposite quadrant to form a checkerboard pattern. Four subpixels of three primary colors within a group of quadrants (eg, red 2212, two green 2214, blue 2216 subpixels) are viewed as a conventional global pixel 2220. Accordingly, the display panel 2200 can be treated as an array of conventional full color whole pixels 2220 when operating in a two-dimensional mode.

  FIG. 22A has a pair of sub-pixel columns 2224, 2222 labeled "R" and "L", respectively. When a display device having a display panel that includes a subpixel repeating group 2210 operates as a directional display device, a couple of columns 2224 labeled “R” on the display panel are directed to the first (R) image and the display panel The couple in column 2222 labeled “L” goes to the second (L) image. FIG. 22B shows the display 2204 produced by the pair of sub-pixel columns 2224 labeled “R” in FIG. 22A. The image displayed on the display 2204 is arranged in two rows and rendered on a subpixel repeating group 2230 that includes two green subpixels 2214, each including four subpixels including one red and blue subpixel. The green subpixels 2214 are arranged in a vertical stripe shape on the subpixel repeating group 2230, and the green subpixels 2214 form a rectangular arrangement across the display 2204. That is, an imaginary line connecting the centers of four adjacent green subpixels forms a rectangle. As can be seen by looking at the plurality of subpixel groups 2230, in display 2204, red subpixels 2212 are arranged in horizontal stripes alternating with horizontal stripes of blue subpixels 2216. In contrast to other embodiments disclosed and illustrated herein, a pair of sub-pixel columns 2224 when viewed toward the first (R) display 2004 is red and blue on the display panel 2220 of FIG. 22A. The subpixel does not form a checkerboard pattern across the first (R) display 2204. FIG. 22C shows a display 2202 produced by a pair of sub-pixel columns 2222 labeled “L” in FIG. 22A. The image displayed on the display 2202 is rendered on the subpixel repeating group 2240. Subpixel repeating group 2240 is similar to subpixel repeating group 2230 in which green subpixels 2214 are arranged in a vertical stripe. However, alternating horizontal stripes of red and blue are arranged oppositely.

  Referring to FIG. 22B, the conventional RGB image input data set constituting the right display 2204 can be mapped to the sub-pixel arrangement of the right display 2204. For example, input green image values can be mapped one by one to green subpixels 2214 (eg, one input image pixel can be mapped to one green subpixel) to reconstruct all green portions of the input image. . The red and blue data values of the input image data set are reconstructed into a red subpixel 2212 and a blue subpixel 2216 that make up the red and blue resample area array, respectively. This is similar to that described above for the subpixel rendering operation described in US Pat. No. 7,123,277. Several types of filters can be used to achieve the mapping of the red and blue color planes. In one embodiment, the red and blue data value contributions of some input image pixels used to reconstruct the data values of the green subpixel adjacent to the target red or blue subpixel are Used to provide pixel data values.

  As an example of the first type of mapping, reference is made to FIG. 22B illustrating a logical pixel 2260 delineated by a one-dot chain line. Logical pixel 2260 includes four subpixels, each including a unique green subpixel 2214A. The logical pixel 2260 is a logical pixel for the target red subpixel 2212A. The three input image pixels can be mapped to the data value of the target red subpixel 2212A. The three input image pixels are mapped to the first input image pixel mapped to the green subpixel 2214A adjacent to the target red subpixel 2212A, and to the second green subpixel 2214B and 2214C above and below the green subpixel 2214A. And a third input image pixel. The tent filter is used to map the first, second, and third input image pixels to provide a data value for the target red subpixel 2212A. The three values in the tent filter may be 1/4 (0.25), 1/2 (0.5), and 1/4 (0.25). A similar operation is used to map the input image pixel data to the data values for the blue subpixel. Considering the logical pixel 2262 for the target blue subpixel 2216A of FIG. 22B, three input image pixels can be mapped to the data value of the target blue 2216A using the same tent filter. The three input image pixels are mapped to the first input image pixel mapped to the green subpixel 2214D adjacent to the target blue subpixel 2216A, and to the second green subpixels 2214E and 2214F above and below the green subpixel 2214D. And a third input image pixel. When a sub-pixel rendering operation is performed according to such an embodiment, each logical pixel can be viewed as sharing a red or blue sub-pixel with the adjacent overlapping logical pixel. Overlapping logical pixels were not clearly shown in FIG. 22B to avoid overcomplicating the drawing.

  As an example of the second type of mapping, reference is made to FIG. 22C illustrating a logical pixel 2265 whose boundary is drawn by a one-dot chain line. Logical pixel 2265 includes three subpixels, each including a unique green subpixel 2214A. The logical pixel 2265 is a logical pixel for the target blue subpixel 2216A. The two input image pixels can be mapped to generate a data value for the target blue subpixel 2216A. The two input image pixels are a first input image pixel mapped to the green subpixel 2214A adjacent to the target blue subpixel 2216A, and a second image pixel mapped to the green subpixel 2214B above the green subpixel 2214A. It is. A box filter is used to map the blue data values of the first and second input image pixels to provide a data value for the target blue subpixel 2212A. The two values in the box filter may both be ½ (0.5). A similar operation is used to map input image pixel data to data values for the red sub-pixel. Using the same box filter, two input image pixels can be mapped to generate a data value for the target red color 2212B. The two input image pixels are a first input image pixel that is mapped to the green subpixel 2214B adjacent to the target red subpixel 2212B, and a second input image that is mapped to the green subpixel 2214A below the green subpixel 2214B. Pixel. When a sub-pixel rendering operation is performed according to such an embodiment, each logical pixel can be viewed as sharing a red or blue sub-pixel with the adjacent overlapping logical pixel. Overlapping logical pixels were not clearly shown in FIG. 22C to avoid overcomplicating the drawing.

  FIG. 23A shows a portion of a display panel 2300 that substantially includes a subpixel repeating group 2310. The sub-repeat pixel group 2310 is arranged in 4 rows and 4 columns and includes 16 subpixels including 4 red subpixels 2312, 8 green subpixels 2314, and 4 blue subpixels 2316. The green subpixel 2314 has a half aspect ratio in the vertical axis with respect to the red and blue subpixels. Then, the display panel 2300 is arranged in two rows forming horizontal stripes. When viewing the sub-repeat group in the four quadrants of each of the four sub-pixels, the pair of red sub-pixels 2312 and the pair of blue sub-pixels 2316 are arranged on opposite quadrants to form a double checkerboard pattern. . A group 2320 or quadrant of four sub-pixels can be treated as a “total” pixel. Accordingly, the display panel 2300 can be treated as an array of conventional full color whole pixels 2320 when operating in a two-dimensional mode.

  A display device having a display panel including the subpixel repeating group 2310 shown in FIG. 23A can also operate as a directional display device. FIG. 23B shows the display 2304 generated by the column 2324 of subpixels labeled “R” in FIG. 24A. The image displayed on the display 2304 is arranged in 4 rows and 2 columns, 8 sub-pixels including 2 red sub-pixels 2312, 2 blue sub-pixels 2316 and 4 green sub-pixels 2314 forming 2 rows of horizontal stripes. Rendered on a subpixel repeating group 2330 containing pixels. Within the display 2304, the positions of the green subpixels 2314 form a square arrangement across the display panel. In other words, a virtual line connecting the centers of four adjacent green subpixels forms a square. The red sub-pixel 2312 and the blue sub-pixel 2316 face each other diagonally in the checkerboard pattern.

  FIG. 23C shows the display 2302 generated by the column 2322 of subpixels labeled “L” in FIG. 23A. The image displayed in display 2302 is also rendered on the same subpixel repeating group 2330. Thus, the differentiated “L” and “R” images generated on the display panel that includes the subpixel repeating group 2310 of FIG. 23A substantially sub-pixel arrangement 2330 that utilizes the subpixel rendering operations described therein. All the advantages discussed for images formed on display panels that are included in general. Further, with respect to using the subpixel repeating group 2310 in the directional display system, as shown, adjusting the aspect ratio of the green subpixel 2314 maintains the axial resolution in the displays 2304 and 2302 approximately the same. To do.

  Referring to FIG. 23B, during a subpixel rendering operation that generates display 2304 (display labeled “R”), conventional RGB image input data representing display 2304 can be mapped to subpixel iteration group 2330. For example, input green image values can be mapped one by one to green subpixels 2314 (eg, one input image pixel to one green subpixel) to reconstruct all green portions of the input image. The red and blue data values of the input image data set are reconstructed into a red sub-pixel 2312 and a blue sub-pixel 2316 that make up the red and blue resample area array, respectively. This is the same as described above regarding the sub-pixel rendering operation described in US Pat. No. 7,123,277. Several types of filters can be used to achieve the mapping of the red and blue color planes. In general, such a filter will contribute the red or blue data value of some input image pixels used to reconstruct the data value for the green subpixel in the vicinity of the target red or blue subpixel. The degree is used to provide a data value for the target red or blue subpixel.

  As an example of such a mapping type, reference is made to FIG. 23B, which illustrates non-adjacent (NC) logical pixels 2360, 2361 delineated by a dash-dot line. The NC logical pixel is a logical pixel for the target blue subpixel 2316A, and is composed of six subpixels. In such an image mapping example, each NC logical pixel includes one unique first primary color subpixel and one second primary color subpixel of the target subpixel for the logical pixel. The first primary color subpixel is referred to as unique because it is the only green subpixel contained within the logical pixel. In the illustrated example, the NC logical pixel includes only one green subpixel 2314A and one blue subpixel 2316A of the target subpixel. Each NC logical pixel further includes four third primary color subpixels. As an example, the NC logical pixel includes four red subpixels that are not otherwise named on the drawing.

  A region resampling filter that maps the blue data values of the five input image pixels is used to provide the data values for the target blue subpixel 2316A. The first of the five input image pixels is the image pixel that is used to map the green data value to the only green subpixel associated with the logical pixel of the target subpixel. In the above example, the logical pixel for target blue subpixel 2316A includes only green subpixel 2314A. The input image pixel used to map the green data value to the green subpixel 2314A is the first of the five input image pixels that provides a contribution to the data value for the target blue subpixel 2316A. The second, third, fourth, and fifth input image pixels are specified according to their relative positions with respect to the first input image pixel. Green subpixel 2314A has four most adjacent adjacent green subpixels. In FIG. 23B, these are the green subpixel 2314B above the green subpixel 2314A, the green subpixel 2314C below the green subpixel 2314A, the green subpixel 2314D on the right side of the green subpixel 2314A, and the left side. Called a green sub-pixel 2314E. The blue data value of each input image pixel used to map the green data value to the four green subpixels provides a contribution to the target blue subpixel 2316A. For convenience, the input image pixel used to map the green data value to the green subpixel 2314A is referred to as the center input image pixel. A region resample filter that can be used to provide the data value of the target blue subpixel 2316A includes five values. The five values are 1/8 (0.125) for each of the four adjacent input image pixels and 1/2 (0.5) for the center input image pixel. A similar operation can be used to map the input image pixel data with the data values for the red subpixel.

  Utilizing a region resampling filter provides overlapping logical pixels. Each logical pixel consists of six in a NC logical pixel configuration, including the only green subpixel illustrated in FIG. 23B, one red or blue target subpixel, and four non-target primary color subpixels. Contains subpixels. Overlapping logical pixels were not clearly shown in FIG. 23B to avoid overcomplicating the drawing. However, FIG. 23C shows the NC logical pixels 2365, 2366 for the target red subpixel 2312A having only one green subpixel 2314F and bordered by a dashed line. The same region resampling filter as described above that provides the data value for the target blue subpixel can also be used to provide the data value for the target red subpixel 2312A. The resampling filter includes an input image pixel that provides a data value for the green subpixel 2314F and four input image pixels that provide a data value for the four adjacent green subpixels 2314G, 2314H, 2314J, and 2314K. Use.

  FIG. 24A shows a portion of a display panel 2400 that substantially includes subpixel repeating groups 2410. The sub-repeat pixel group 2410 is arranged in two rows and includes twelve sub-pixels including eight green sub-pixels 2414, two red sub-pixels 2412, and two blue sub-pixels 2416. The green subpixel 2414 has a half aspect ratio in the horizontal axis with respect to the red and blue subpixels. The narrow green subpixel pairs form adjacent vertical stripes on the display panel 2400. When the sub-repeat group is viewed in the four quadrants of each of the three sub-pixels, the red sub-pixel 2412 and the blue sub-pixel 2416 are arranged in different rows of the opposing quadrant to form a low resolution checkerboard pattern. To do.

  FIG. 24A has columns of sub-pixels 2424, 2422, 2423 labeled “R”, “L”, and “B”, respectively. From the drawing, it can be seen that half of the green sub-pixel column goes to the first display and the other half goes to the second display. A column 2423 labeled “B” containing alternating red and blue sub-pixels is the first (R) and second when a display device having a display panel that includes a sub-pixel repeating group 2410 operates as a directional display device. 2 (L) Go to all images. In the embodiment, the color primary is divided into two types according to relative luminance. In an embodiment, the relatively dark primary red and blue primary color subpixels are shared between the left and right views. As described above with other embodiments having columns that would go to both sides of the field of view, the sub-pixel arrangement allows the luminance channel represented by the lighter primary color sub-pixels to convey the desired stereoscopic image information. Take advantage of the features of the human visual system with an adapted resolution. The embodiment illustrated in FIG. 24A is particularly suited to autostereoscopic 3D display devices and switchable 2D3D display devices.

  FIG. 24B shows a display 2404 generated by column 2424 of subpixels labeled “R” and column 2423 labeled “B” in FIG. 24A. The image displayed in the display 2404 is arranged in two rows, a subpixel repeating group comprising four green subpixels 2416 forming vertical stripes, and eight subpixels each including two red and blue subpixels. Rendered on 2430. Green subpixels 2414 form a square arrangement across display 2404. In other words, a virtual line connecting the centers of four adjacent green subpixels forms a square. The red sub-pixel 2412 and the blue sub-pixel 2416 form a checkerboard pattern and are disposed on opposing quadrants. FIG. 24C shows a display 2402 generated by column 2422 of subpixels labeled “L” and column 2423 labeled “B” in FIG. 24A. The image displayed in the display 2402 is also rendered on the subpixel repeating group 2430.

  As pointed out in the discussion of the other embodiments having a column of subpixels that share between the left and right displays, the subpixel rendering operations used for rendering the left and right displays are shared by both displays. The average contribution of the input image data belonging to two separate displays 2404, 2402 can be obtained for the color plane corresponding to the color sub-pixel in column 2423. In the embodiment illustrated in FIG. 24A, the sub-pixel rendering operation can average the contribution of input image data belonging to two separate displays 2404, 2402 for the red and blue color planes.

  Referring to FIG. 24C, during a subpixel rendering operation that creates a display 2402 (display labeled “L”), conventional RGB image input data representing the epidermis 2402 can be mapped to a subpixel iteration group 2430. For example, the input green image values can be mapped one by one to the green subpixel 2414 to reconstruct all green portions of the input image (eg, one input image pixel can be mapped by one green subpixel). This is performed for the left display 2402 without sharing the data with the right display 2404 of FIG. 24B. The subpixel rendering operation utilizes the red and blue resample area array to reconstruct the red subpixel 2412 and the blue subpixel 2416, and the input image red and blue data values for the right display 2404 and left display 2402. Can be implemented above. The subpixel rendering operation is similar to that described above with respect to what was described in US Pat. No. 7,123,277. The results of the subpixel rendering operation can then be averaged. The order of sub-pixel rendering and averaging operations can be alternated because the operations are mathematical functions that satisfy the exchange law and the distribution law. It proves even more effective if the step of obtaining the average of the two main color planes for right and left display (eg two red input data color planes) is performed prior to the sub-pixel rendering step. (For example, the number of digital operations can be reduced).

  Several types of filters can be used to achieve the mapping of the red and blue color planes. In general, such a filter will contribute the red or blue data value of some input image pixels used to reconstruct the data value for the green subpixel in the vicinity of the target red or blue subpixel. The degree is used to provide a data value for the target red or blue subpixel. The discussion for the example subpixel rendering operation for target blue subpixel 2416A in FIG. 24C below is similar to the discussion for the example subpixel rendering operation for target blue subpixel 2316A in FIG. 23B. Here, detailed examination on it is omitted.

  FIG. 24C shows one non-adjacent (NC) logical pixel 2470, 2471, delimited by a dashed line. The NC logical pixel is a logical pixel for the target blue subpixel 2416A, and is composed of six subpixels. In such an example, each NC logical pixel includes one unique first primary color subpixel and one second primary color subpixel of the target subpixel for the logical pixel. The first primary color subpixel may be referred to as unique because it is the only green subpixel contained within the logical pixel. In the illustrated example, the NC logical pixel includes only one green subpixel 2414A and one blue subpixel 2416A of the target subpixel. Each NC logical pixel further includes four third primary color subpixels. In the illustrated example, the NC logical pixel includes four red subpixels that were not named on the drawing.

  A region resampling filter that maps the blue data values of the five input image pixels is used to provide the data values for the target blue subpixel 2416A. The first of the five input image pixels is the image pixel that is used to map the green data value to the only green subpixel associated with the logical pixel of the target subpixel. In the example above, the logical pixel for target blue subpixel 2416A includes only green subpixel 2414A. The input image pixel used to map the green data value to the green subpixel 2414A is the first of the five input image pixels that provide a contribution to the data value for the target blue subpixel 2416A. The first image pixel is referred to as the center pixel. The second, third, fourth, and fifth input image pixels are specified according to their relative positions with respect to the first input image pixels. Green subpixel 2414A has four most adjacent neighboring green subpixels. In FIG. 24C, a green subpixel 2414B above the green subpixel 2414A, a green subpixel 2414C below the green subpixel 2414A, a green subpixel 2314E to the left of the green subpixel 2414A, and the display on the display panel The case is referred to as a green subpixel 2414D to the right of the green subpixel 2414A and the red subpixel 2412B. The blue data value of each input image pixel used to map the green data value to the four green subpixels provides a contribution to the target blue subpixel 2416A. A region resample filter that can be used to provide data values for the target blue sub-pixel 2416A includes five values. The five values are 1/8 (0.125) for each of the four adjacent input image pixels and 1/2 (0.5) for the center input image pixel.

  A similar operation is used to map the input image pixel data to data values for the red sub-pixel. FIG. 24B shows one NC logical pixel 2460, 2461 in which a boundary is drawn with a one-dot chain line. The NC logical pixel is a logical pixel for the target red subpixel 2412A, and is composed of six subpixels including a single green subpixel 2414F. Map the red data values of the five input image pixels used to map the red data values to the green subpixels 2414F, 2414G, 2414H, 2414J, 2414K to provide data values for the target red subpixel 2412A. A region resampling filter is used. The region resample filter used to provide the data value of the target red subpixel 2412A is the same region resample filter described above that is used to provide the data value of the target blue subpixel 2416A of FIG. 24C. It may be. The use of the region resampling filter generates overlapping logical pixels. Each adjacent green subpixel 2414G, 2414H, 2414J, 2414K is the only green subpixel of the logical pixel having it. Red subpixel 2412 and blue subpixel 2416 are shared between displays 2404, 2402. It becomes part of several overlapping logical pixels. For example, the blue subpixel 2416A in FIG. 24C is a target subpixel of the NC logical pixels 2470 and 2471 formed at the boundary by the one-dot chain line, and the NC logical pixel 2460 formed at the boundary by the one-dot chain line in FIG. 2461.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can make various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

Claims (19)

A subpixel including at least 12 subpixels having at least a first main color, a second main color, a third main color, and a fourth main color subpixel and arranged in a matrix of 2 rows and 6 columns A display panel containing repeating groups;
A driving circuit for transmitting a signal to each of the sub-pixels on the display panel;
Including
The sub-pixel repeating group includes sub-pixels of a second main color and a fourth main color having relatively high luminance among the first main color, the second main color, the third main color, and the fourth main color. The first main color and the second main group, and the first main color, the second main color, the third main color, and the fourth main color of the first main color and the third main color, which are relatively low in luminance. And a third group consisting of
Each column of the subpixel repeating group includes a first column composed of the first group of subpixels, a second column composed of the second group of subpixels, and a third group of subpixels. The display device is repeatedly arranged in the row direction in the order of the third column. The first and third primary colors are red or blue, the second primary color is green, and the fourth primary colors are white, yellow, magenta, gray blue, blue green, and emerald. The display device according to claim 1, wherein the display device is one of colors. Light emitted from the first group of subpixels on the display panel is directed to a first field window, and light emitted from the second group of subpixels on the display panel is directed to a second field window. And an optical guiding member for guiding light emitted from the third group of subpixels on the display panel to the first and second viewing windows,
2. The autostereoscopic image display apparatus for recognizing a three-dimensional image when the observer places a left eye and a right eye in the first visual field window and the second visual field window, respectively. The display device described in 1. The display device, said the observer when to position the left and right eyes to each first view window and the second viewing window, the observer is an automatic three-dimensional image display apparatus recognizes a 3D image The display device according to claim 1. The display device according to claim 1, wherein the display device is a multi-view display device in which an observer observes a first image from a first visual field window and observes a second image from the second visual field window. . An optical direction switching device for controlling the operation of the optical guiding member in at least two modes;
The light direction switching device guides the light emitted from the optical guiding member in the first mode to the first and second visual field windows, and the optical guiding member in the second mode has two display panels. The display device according to claim 3, wherein a three-dimensional image is displayed. The display panel includes a liquid crystal display panel, an electroluminescent display panel, a plasma display panel, an electric field emitter display panel, an electrophoretic display panel, an iridescent display panel, an incandescent lamp display panel, a light emitting diode display panel, and an organic light emitting diode display panel. The display device according to claim 1, wherein the display device is any one of the above. The sub-pixel repeating group defines an output display format;
An input image receiving member for receiving input image data in a first format for rendering in the output display format on the display panel;
The display of claim 1, further comprising: a subpixel rendering member that performs a subpixel rendering operation on the input image data to generate a luminance value for each subpixel on the display panel. apparatus. The subpixel rendering operation includes forming a resample area for each subpixel and calculating the luminance value using an input image data value of the input image data portion that overlaps the resample area. The display device according to claim 8, wherein the luminance value is generated for each sub-pixel on the display panel. The subpixels in the subpixel repeating group are:
P2 P4 P1 P4 P2 P3
P4 P2 P3 P2 P4 P1
Are arranged like
The display device according to claim 1, wherein P1, P2, P3, and P4 indicate the first, second, third, and fourth main colors, respectively. At least 24 sub-pixels having at least a first main color, a second main color, a third main color, a fourth main color, and a fifth main color sub-pixels and arranged in a matrix in 2 rows and 12 columns. A display panel including a sub-pixel repeating group including pixels;
A driving circuit for transmitting a signal to each of the sub-pixels on the display panel;
Including
The sub-pixel repeating group includes sub-pixels of a fourth main color having a relatively high luminance among the first main color, the second main color, the third main color, the fourth main color, and the fifth main color. The first main color, the second group, the first main color, the second main color, the third main color, the first main color having a relatively low luminance among the fourth main color, and the second main color; A third group of sub-pixels of a primary color, a third primary color and a fifth primary color;
Each column of the subpixel repeating group includes a first column composed of the first group of subpixels, a second column composed of the second group of subpixels, and a third group of subpixels. The display device is repeatedly arranged in the row direction in the order of the third column. The subpixels in the subpixel repeating group are:
P4 P4 P1 P4 P4 P2 P4 P4 P5 P4 P4 P3
P4 P4 P5 P4 P4 P3 P4 P4 P1 P4 P4 P2
Are arranged like
P1, P2, P3, P4, and P5 represent the first, second, third, fourth, and fifth primary colors, respectively.
The fourth primary color is white;
The first, second, and third primary colors are each one of red, green, and blue, and the fifth primary color is yellow, magenta, gray blue, blue green, and emerald color. The display device according to claim 11, wherein the display device is any one of them. Light emitted from the first group of subpixels on the display panel is directed to a first field window, and light emitted from the second group of subpixels on the display panel is directed to a second field window. And an optical guiding member for guiding light emitted from the third group of subpixels on the display panel to the first and second viewing windows,
12. The autostereoscopic image display device for recognizing a three-dimensional image when the observer places a left eye and a right eye in the first visual field window and the second visual field window, respectively. The display device described in 1. The display device, said the observer when to position the left and right eyes to each first view window and the second viewing window, the observer is an automatic three-dimensional image display apparatus recognizes a 3D image The display device according to claim 11. The display device according to claim 11, wherein the display device is a multi-view display device in which an observer observes the first image from the first visual field window and observes the second image from the second visual field window. . An optical direction switching device for controlling the operation of the optical guiding member in at least two modes;
The light direction switching device guides the light emitted from the optical guiding member in the first mode to the first and second visual field windows, and the optical guiding member in the second mode has two display panels. The display device according to claim 13, wherein a three-dimensional image is displayed. The display panel includes a liquid crystal display panel, an electroluminescent display panel, a plasma display panel, an electric field emitter display panel, an electrophoretic display panel, an iridescent display panel, an incandescent lamp display panel, a light emitting diode display panel, and an organic light emitting diode display panel. The display device according to claim 11, wherein the display device is any one of the above. The sub-pixel repeating group defines an output display format;
An input image receiving member for receiving input image data in a first format for rendering in the output display format on the display panel;
The display of claim 11, further comprising: a subpixel rendering member that performs a subpixel rendering operation on the input image data to generate a luminance value for each subpixel on the display panel. apparatus. The subpixel rendering operation includes forming a resample area for each subpixel and calculating the luminance value using an input image data value of the input image data portion that overlaps the resample area. The display device according to claim 18, wherein the luminance value is generated for each sub-pixel on the display panel.

Images