JP2010266850A - Display controller, display device, image processing method, and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a means for compositing images displayed on a display part by solving the problem caused by a shading part, in a display for displaying respective different images by being directed to a plurality of visual points. <P>SOLUTION: A display controller 100 includes an image memory 120 for storing visual point image data for the plurality of the visual points; a writing control means 110 for writing the visual point data input from the outside to the image memory 120; and a reading control means 130 for reading the visual point image data from the image memory 120 to be output to a display module as a composite image data, in accordance with the reading procedure obtained in a repeating rule determined by positional relation of an image separation means and a display part 50, array of sub-pixels, a color number and color arrangement. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a device for displaying different images toward a plurality of viewpoints, a display controller thereof, and a signal processing method for image data to be displayed, and in particular, a configuration of a display unit for improving the display image quality, The present invention relates to image data processing means for sending image data for each viewpoint to a display unit, an image data processing method, and the like.

  In recent years, with the development of mobile phones and PDAs (personal digital assistants), display devices are becoming smaller and higher definition. On the other hand, as a display device having a new added value, a display device that observes different images according to the position where the observer observes the display device, that is, a display device that provides different images toward a plurality of viewpoints, A display device that provides a stereoscopic display to an observer by using different images as parallax images has attracted attention.

  As a method for providing different images for a plurality of viewpoints, image data for each viewpoint is synthesized and displayed on a display unit, and the displayed synthesized image is formed of a barrier (light-shielding plate) having a lens and a slit. A system is known in which an image is separated by an optical separation means and an image is provided to each viewpoint. The principle of image separation is based on limiting the pixels that can be seen in each viewing direction using optical means such as a barrier having a slit or a lens. As the image separation means, a parallax barrier composed of a barrier having a large number of striped slits or a lenticular lens in which cylindrical lenses having a lens effect in one direction are arranged is generally used.

  There has been proposed a multi-viewpoint display device or a three-dimensional display device including the above-described optical image separation means and means for synthesizing a composite image to be displayed from image data for each viewpoint (for example, Patent Documents). 1). Patent Document 1 discloses a display device that performs stereoscopic display using a liquid crystal panel and a parallax barrier, and a composite image combining method that is displayed on a display unit (liquid crystal panel) when performing stereoscopic display. In this liquid crystal panel, pixel electrodes constituting a plurality of sub-pixels are arranged in a matrix in a horizontal direction and a vertical direction on a display unit. A scanning line is provided in the horizontal direction at the boundary portion of each pixel electrode, a data line is provided in the vertical direction, and a TFT (thin film transistor) as a pixel switching element near the intersection of the scanning line and the data line. Is provided.

  A stereoscopic display device using an optical image separation means is suitable for mounting on a portable device in that it does not require wearing special glasses and there is no troublesome wearing glasses. Mobile devices that actually include a stereoscopic display device including a liquid crystal panel and a parallax barrier have been commercialized (for example, see Non-Patent Document 1).

  By the way, in the above-described method, that is, in a display device that provides different images toward a plurality of viewpoints using an optical separation unit, when the observer's viewpoint position moves and the image to be viewed changes, the image and The border with the image may appear dark. This phenomenon is caused by the fact that a non-display area (a light shielding portion generally called a black matrix in a liquid crystal panel) is visually recognized between pixels for each viewpoint. The above-mentioned phenomenon accompanying the observer's viewpoint movement does not occur in a general display device having no optical separation means. For this reason, the observer feels a sense of incongruity or a decrease in display quality in the above-mentioned phenomenon that occurs in a multi-viewpoint display device or a stereoscopic display device provided with an optical separation means.

  In order to improve the problems caused by the above optical separation means and the light shielding part, a display device has been proposed in which the shape and arrangement of the pixel electrode and the light shielding part of the display part are devised to suppress deterioration in display quality. (For example, patent document 2).

  FIG. 72 is a plan view showing a display unit in the display device described in Patent Document 2. FIG. The opening 75 shown in FIG. 72 is an opening of a sub pixel that is a minimum unit of image display. The vertical and horizontal arrangement directions of the openings 75 are defined as a vertical direction 11 and a horizontal direction 12, respectively, as shown in FIG. The shape of each opening 75 is a substantially trapezoidal shape with the characteristics described later. The image separating means is a lenticular lens in which cylindrical lenses 30 a having the longitudinal direction 11 as the longitudinal direction are arranged in the lateral direction 12. The cylindrical lens 30a has no lens effect in the longitudinal direction and has a lens effect only in the short direction. That is, the lens effect is exhibited in the lateral direction 12. Therefore, the light emitted from the openings 75 of the sub-pixel 41 and the sub-pixel 42 adjacent to each other in the horizontal direction 12 is directed in different directions.

  The opening 75 is inclined in directions opposite to each other with respect to the vertical direction 11, and a pair of sides having the same angle between the extending direction and the vertical direction 11 are arranged. As a result, in the horizontal direction 12, the position of the end of the opening 75 of the display panel and the position of the optical axis of the cylindrical lens 30 a are relatively different in the vertical direction 11. Furthermore, the openings 75 adjacent to each other in the vertical direction 11 are arranged so as to be line symmetric with respect to the line segment extending in the horizontal direction 12. Also, the openings 75 adjacent to each other in the horizontal direction 12 are at the intersection of a line segment connecting the midpoints of both ends in the vertical direction 11 and a line segment connecting the midpoints of both ends in the horizontal direction 12. On the other hand, they are arranged so as to be point-symmetric.

  Further, the opening width in the vertical direction 11 is substantially constant regardless of the position in the horizontal direction 12 when the opening portions 75 of the sub-pixel 41 and the sub-pixel 42 are added together in the inclined portion.

  For this reason, the display device described in Patent Document 2 assumes that the display panel cut surface is assumed in the vertical direction 11 perpendicular to the arrangement direction of the cylindrical lenses 30a at an arbitrary point in the horizontal direction 12. The ratio of the wiring 70 and the light shielding part 76) to the opening is substantially constant. Therefore, even when the observer moves the viewpoint in the lateral direction 12 that is the image separation direction and the observation direction changes, the ratio of the light shielding portion to be visually recognized is substantially constant. That is, the observer does not observe only the light shielding part from a specific direction, and the display does not appear dark. That is, it is possible to prevent display quality from being deteriorated due to the light shielding region.

JP 2008-109607 A JP-A-2005-208567

Nikkei Electronics, January 6, 2003, no. 838, p. 26-27

  However, the related art has the following problems. As described above, the display device of Patent Document 1 has a problem of deterioration in display quality caused by the light shielding portion.

  The display device disclosed in Patent Document 2 that solves the problem caused by the light shielding portion needs to maintain a complicated relationship between the shape of the aperture of the pixel electrode of the subpixel and the shape of the light shielding portion. For this reason, the switching means (TFT) serving as a light-shielding portion cannot be arranged at a uniform position for each pixel electrode such as near the intersection of the scanning line and the data line, unlike Patent Document 1. In addition, the display unit of the display device has a so-called aperture ratio that is determined by an area ratio between the aperture and the light-shielding unit that contributes to the display luminance, in order to improve the definition and to reduce the pixel pitch. It is required to increase. In order to realize a high aperture ratio while maintaining the aperture shape and the light shielding shape of the display unit disclosed in Patent Document 2, not only the position of the switching means but also the connection between the switching means and the scanning lines and data lines. Unlike Patent Document 1, the relationship cannot be made uniform for each pixel electrode. The fact that the connection relationship between the pixel electrode switching means, the scanning line, and the data line is not uniform for each pixel electrode means that a general synthetic image synthesizing method as shown in Patent Document 1 cannot be applied. .

[Object of invention]
The present invention has been made in view of such problems, and in a display device capable of displaying images toward a plurality of viewpoints, the shape and arrangement of sub-pixels for suppressing the problems caused by the above-described light-shielding portions are provided. To provide a display device including a display portion in which pixel electrodes, switching means, scanning lines, data lines, and the like are arranged and connected so as to maintain a high aperture ratio, and the display device It is an object of the present invention to provide a display controller, and further to provide a means for synthesizing a synthesized image to be displayed on the display unit and a method for synthesizing the synthesized image.

A display controller according to the present invention includes:
The sub-pixels connected to the data line through the switching means controlled by the scanning line are arranged in n rows and m columns when m and n are natural numbers, and the n + 1 data lines and the m + 1 scanning lines are arranged. A display driven by lines;
Image separating means for directing light emitted from the sub-pixel to a plurality of viewpoints in the extending direction of the data line in units of the sub-pixel;
To the display module with
A display controller that outputs composite image data,
An image memory for storing viewpoint image data for the plurality of viewpoints;
Write control means for writing the viewpoint image data input from the outside into the image memory;
Read control means for reading the viewpoint image data from the image memory and outputting it as the composite image data to the display module according to a read order corresponding to the display module;
It is provided with.

An image processing method according to the present invention includes:
The sub-pixels connected to the data line through the switching means controlled by the scanning line are arranged in n rows and m columns when m and n are natural numbers, and the n + 1 data lines and the m + 1 scanning lines are arranged. A display driven by lines;
Image separating means for directing light emitted from the sub-pixel to a plurality of viewpoints in the extending direction of the data line in units of the sub-pixel;
To the display module with
An image processing method for generating composite image data,
Viewpoint image data for the plurality of viewpoints is externally input and written to an image memory;
According to the reading order corresponding to the display module, the viewpoint image data is read from the image memory,
Outputting the read viewpoint image data as the composite image data to the display module;
It is characterized by that.

An image processing program according to the present invention includes:
The sub-pixels connected to the data line through the switching means controlled by the scanning line are arranged in n rows and m columns when m and n are natural numbers, and the n + 1 data lines and the m + 1 scanning lines are arranged. A display driven by lines;
Image separating means for directing light emitted from the sub-pixel to a plurality of viewpoints in the extending direction of the data line in units of the sub-pixel;
To the display module with
An image processing program for generating composite image data,
A procedure for inputting viewpoint image data for the plurality of viewpoints from outside and writing it into an image memory;
A step of reading the viewpoint image data from the image memory according to a reading order corresponding to the display module;
Outputting the read viewpoint image data as the composite image data to the display module;
Is to make the computer execute.

  According to the present invention, a general flat display device is provided for a display module that includes image separation means for directing light emitted from a sub-pixel to a plurality of viewpoints in the extending direction of a data line, and that suppresses problems caused by a light shielding portion or the like. Input image data in the same transfer format as can be used. For this reason, for example, an arithmetic unit or the like that outputs image data to a display device using the present invention does not need to perform rearrangement processing of image data or special processing associated with transfer, so that no burden is imposed. Further, by parameterizing conditions necessary for generating the composite image data and storing the parameters, it is possible to cope with changes in the display module by changing the parameters. For this reason, it is not necessary to change the video signal processing means, and the design man-hours can be reduced and the cost can be reduced.

It is a functional block diagram which shows 1st Embodiment. It is a schematic block diagram which shows 1st Embodiment. It is a top view which shows the 1st example of the structure of 4 sub pixels which comprise 1 part (2 rows 2 columns) of the display part in 1st Embodiment. It is explanatory drawing which shows the data line arrangement | positioning direction of the display part in 1st Embodiment. FIG. 4 is a plan view showing a first example of the structure of upper and lower subpixel pairs P2R and a circuit diagram showing an equivalent circuit 1 in the first embodiment. FIG. 3 is a plan view and a circuit diagram showing an equivalent circuit 1 showing a first example of a structure of an upper and lower subpixel pair P2L in the first embodiment. It is a graph which shows the input image data in 1st Embodiment. It is a schematic plan view which shows the 1st example of the image separation means arrangement | positioning in 1st Embodiment, and a color relationship. It is a schematic plan view which shows the arrangement pattern 1 of the display part in 1st Embodiment. It is a schematic plan view which shows the arrangement pattern 2 of the display part in 1st Embodiment. It is a schematic plan view which shows the arrangement pattern 3 of the display part in 1st Embodiment. It is a table | surface which shows polarity distribution when applying a gate line inversion drive to the display part (array pattern 2) in 1st Embodiment. It is a graph which shows polarity distribution when dot inversion drive is applied to the display part (array pattern 2) in 1st Embodiment. It is a graph which shows polarity distribution when dot inversion drive is applied to the display part (array pattern 3) in 1st Embodiment. It is a schematic plan view which shows the arrangement pattern 4 of the display part in 1st Embodiment. It is a chart which shows the synthetic image data 1 output to the display part of the arrangement | sequence pattern 1 in 1st Embodiment. It is a graph which shows the composite image data 2 output to the display part of the arrangement | sequence pattern 2 in 1st Embodiment. It is a chart which shows the synthetic image data 3 output to the display part of the arrangement | sequence pattern 3 in 1st Embodiment. It is a graph which shows the composite image data 4 output to the display part of the arrangement | sequence pattern 4 in 1st Embodiment. It is a schematic plan view which shows the 2nd example of the image separation means arrangement | positioning and color relationship in 1st Embodiment. It is a graph which shows the relationship between the odd / even of the data line of the display part in 1st Embodiment, and the viewpoint of input image data. It is a graph which shows the relationship between the data line of the display part in 1st Embodiment, and input image data. It is a graph which shows the relationship between the scanning line of the display part in 1st Embodiment, and input image data. It is a graph which shows the relationship between the scanning line of the display part in 1st Embodiment, and the column number of input image data. It is a graph which shows the connection information of the upper-lower subpixel pair P2R and P2L of the arrangement pattern 3 in 1st Embodiment. It is a graph which shows the example of the look-up table which memorize | stores the arrangement | sequence pattern in 1st Embodiment. It is a graph which shows the relationship between LUT (Dy, Gx), the even / odd of a scanning line and a data line, and the direction of a sub pixel in 1st Embodiment. It is a graph which shows the relationship between the odd / even of the data line of the display part in 1st Embodiment, a scanning line, and input image data. It is a graph which shows the preservation | save parameter required for synthetic | combination image data generation in 1st Embodiment. It is a flowchart which shows the operation | movement outline | summary for every frame of the display apparatus in 1st Embodiment. It is a flowchart which shows the outline | summary of the synthesized image output process in 1st Embodiment, and mainly shows the counting process of a scanning line unit. It is a flowchart which shows the outline | summary of the line data output process in 1st Embodiment, and mainly shows the count process of a data line unit. It is a flowchart which shows the outline | summary of the read rearrangement process in 1st Embodiment. It is a flowchart which shows the input data designation | designated process in case the count value s = 1 of the data line unit in 1st Embodiment. It is a flowchart which shows the input data designation | designated process in case the count value s = 2 of the data line unit in 1st Embodiment. It is a flowchart which shows the input data designation | designated process in case the count value s = 3 of the data line unit in 1st Embodiment. It is a flowchart which shows the input data designation | designated process in case the count value s = 4 of the data line unit in 1st Embodiment. It is a flowchart which shows the input data designation | designated process in case the count value s = 5 of the data line unit in 1st Embodiment. It is a flowchart which shows the input data designation | designated process in case the count value s = 6 of the data line unit in 1st Embodiment. It is a block diagram which shows the terminal device to which the display apparatus in 1st Embodiment is applied. FIG. 6 is a plan view and a circuit diagram showing an equivalent circuit 2 showing a second example of the structure of the upper and lower subpixel pair P2R in the first embodiment. FIG. 6 is a plan view showing a second example of the structure of the upper and lower subpixel pair P2L and a circuit diagram showing an equivalent circuit 2 in the first embodiment. It is a graph which shows polarity distribution when 2 dot inversion drive is applied to the display part (array pattern 2) in 1st Embodiment. It is a schematic plan view which shows the array pattern 6 of the display part in 1st Embodiment. It is a graph which shows polarity distribution when 2 dot inversion drive is applied to the display part (array pattern 6) in 1st Embodiment. It is a functional block diagram which shows 2nd Embodiment. It is a schematic plan view which shows the example of image separation means arrangement | positioning in 2nd Embodiment, and the example of a color scheme. It is explanatory drawing which shows the optical model in 2nd Embodiment. It is a schematic plan view which shows the arrangement pattern 5 of the display part in 2nd Embodiment. It is a table | surface which shows polarity distribution when applying dot inversion drive to the display part (array pattern 5) in 2nd Embodiment. It is a graph which shows the input image data in 2nd Embodiment. It is a graph which shows the composite image data 5 output to the display part of the arrangement | sequence pattern 5 in 2nd Embodiment. It is a graph which shows the example of the look-up table which memorize | stores the arrangement | sequence pattern 5 in 2nd Embodiment. It is a graph which shows one example of the input data rearrangement in 2nd Embodiment. It is a schematic plan view which shows the 1st example of the correspondence of the image separation means and the column number of a display part in 2nd Embodiment. It is a schematic plan view which shows the 2nd example of the correspondence of the image separation means and column number of a display part in 2nd Embodiment. It is a graph which shows an example of table TM which shows the value of the viewpoint number k with respect to the column number of the display part in 2nd Embodiment. It is a graph which shows the relationship between the odd / even of the data line in 2nd Embodiment, and input composite data. It is a flowchart which shows the operation | movement outline | summary of the display apparatus in 2nd Embodiment. It is a flowchart which shows an example of the input data rearrangement process of the display apparatus in 2nd Embodiment. It is a functional block diagram which shows 3rd Embodiment. It is explanatory drawing which shows an example of the transfer format of the input image data in 3rd Embodiment. It is a timing chart which shows the example of operation of a 3rd embodiment. It is explanatory drawing which shows the other example of the transfer format of the input image data in 3rd Embodiment. It is explanatory drawing which shows an example of the transfer format of the input image data in 4th Embodiment. It is a timing chart which shows the operation example of 4th Embodiment. FIG. 10 is a schematic plan view showing a correspondence relationship between the first and second columns of the second viewpoint image data M2 shown in FIG. 7 and the sub-pixels of the display panel having the arrangement pattern shown in FIG. It is a schematic plan view which shows the 1st example and display part of the data line drive circuit in 5th Embodiment. It is a timing chart which shows the operation example of 5th Embodiment. It is a schematic plan view which shows the 2nd example and display part of the data line drive circuit in 5th Embodiment. It is a schematic plan view which shows the 3rd example and display part of the data line drive circuit in 5th Embodiment. It is a top view which shows the display part in the display apparatus of related technology.

  A display module in a display device in which the display controller of the present invention is used is a display module including image separation means for directing light emitted from a sub-pixel to a plurality of viewpoints in the extending direction of the data line. High aperture ratio and high image quality are realized by the characteristic connection relationship with the pixel switching means. As will be described later, the present inventor has found regularity in the connection relationship between characteristic sub-pixels, scanning lines, and data lines in such a display module. Furthermore, the present invention has invented a display controller that generates composite image data from the found regularity, the installation conditions of the image separation means, the order of color arrangement of the subpixels, and the arrangement pattern of the upper and lower subpixel pairs.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the arrangement of pixel electrodes in the horizontal direction of the display panel is referred to as “row”, and the arrangement of pixel electrodes in the vertical direction is referred to as “column”. In the display panel according to the present invention, the scanning lines are arranged in the horizontal direction, the data lines are arranged in the vertical direction, and the image distribution direction by the image separation means is the horizontal direction.

(First embodiment)
First, an outline of the first embodiment will be described. The display module (200) includes a display unit (50) and image separation means (30). In the display unit (50), the sub-pixel (40) connected to the data line (D1,...) Through the switching means (46) controlled by the scanning line (G1,...) Uses m and n as natural numbers. Sometimes arranged in n rows and m columns and driven by n + 1 data lines (D1,...) And m + 1 scanning lines (G1,...). The image separating means (30) directs the light emitted from the sub-pixel (40) to a plurality of viewpoints in the extending direction of the data line (D1,...) In units of sub-pixel (40).

  The display controller (100) includes an image memory (120), a writing control means (110), and a reading control means (130), and outputs composite image data (CM) to the display module (200). The image memory (120) stores viewpoint image data for a plurality of viewpoints. The writing control means (110) writes the viewpoint image data input from the outside into the image memory (120). The read control means (130) reads the viewpoint image data from the image memory (120) according to the read order corresponding to the display module (200), and outputs it as composite image data (CM) to the display module (200).

  The readout order corresponding to the display module (200) is obtained by a repetition rule determined by the positional relationship between the image separating means (30) and the display unit (50), the arrangement of the sub-pixels (40), the number of colors and the color arrangement. The reading order may be used.

  The display controller (100) includes parameter storage means (140) for storing parameters indicating the positional relationship between the image separation means (30) and the display section (50), the arrangement of the sub-pixels (40), the number of colors, and the color arrangement. , May be further provided.

  The display unit (50) may be configured with an upper and lower subpixel pair (P2R, P2L) composed of two subpixels (40) arranged with one data line (D1,...) Interposed therebetween as a basic unit. . In this case, the switching means (46) included in each of the two sub-pixels (40) is commonly connected to the data lines (D1,...) Sandwiched between the two sub-pixels (40), and different scanning lines (G1). , ...). The upper and lower subpixel pairs (P2R, P2L) adjacent in the extending direction of the data lines (D1,...) Are arranged so as to be connected to different data lines (D1,...), Respectively.

  The number of colors of the sub-pixel (40) is, for example, three colors of a first color, a second color, and a third color. Here, the first color, the second color, and the third color are, for example, any one of R (red), G (green), and B (blue), and are different from each other. In this case, the display unit (50) may be configured as follows. When y is a natural number, one of the two sub-pixels (40) of the upper and lower sub-pixel pairs (P2R, P2L) connected to the y-th data line (Dy) is the first color and the other is the second color. Yes, one of the even and odd columns of the display unit (50) is formed. One of the two sub-pixels (40) of the upper and lower sub-pixel pairs (P2R, P2L) connected to the y + 1th data line (Dy + 1) is the second color and the other is the third color, and the display unit (50) The other of the even and odd columns is formed. One of the two sub-pixels (40) of the upper and lower sub-pixel pairs (P2R, P2L) connected to the y + second data line (Dy + 2) is the third color and the other is the first color, and the display unit (50) One of the even and odd columns. One of the two sub-pixels (40) of the upper and lower sub-pixel pairs (P2R, P2L) connected to the y + th data line (Dy + 3) is the first color and the other is the second color. The other of the row and the odd row is formed. One of the two sub-pixels (40) of the upper and lower sub-pixel pairs (P2R, P2L) connected to the y + 4th data line (Dy + 4) is the second color and the other is the third color, and the display unit (50) One of the even and odd columns. Of the two subpixels (40) of the upper and lower subpixel pairs (P2R, P2L) connected to the y + 5th data line (Dy + 5), one is the third color and the other is the first color, and the display unit (50) The other of the even and odd columns is formed.

  At this time, the read control means (130) may read the viewpoint image data from the image memory (120) according to the following read order. Corresponding to the y-th data line (Dy), the read color is the first color and the second color, and the read viewpoint image is the viewpoint image corresponding to one of the even and odd columns of the display unit (50). . Corresponding to the y + 1th data line (Dy + 1), the colors to be read are the second color and the third color, and the viewpoint image to be read is the viewpoint image corresponding to the other of the even number column and the odd number column of the display unit (50). . Corresponding to the y + second data line (Dy + 2), the color to be read is the third color and the first color, and the viewpoint image to be read is the viewpoint image corresponding to one of the even and odd columns of the display unit (50). . Corresponding to the y + 3th data line (Dy + 3), the color to be read is the first color and the second color, and the viewpoint image to be read is the viewpoint image corresponding to the other of the even number column and the odd number column of the display unit (50). . Corresponding to the y + 4th data line (Dy + 4), the read color is the second color and the third color, and the read viewpoint image is the viewpoint image corresponding to one of the even and odd columns of the display unit (50). . Corresponding to the y + 5th data line (Dy + 5), the color to be read is the third color and the first color, and the viewpoint image to be read is the viewpoint image corresponding to the other of the even number column and the odd number column of the display unit (50). is there.

  The image processing method of the present embodiment is realized by the operation of the display controller (100) of the present embodiment. That is, the image processing method of the present embodiment is an image processing method for generating composite image data (CM) on the display module (200), and includes the following steps 1 to 3. 1. Step of inputting viewpoint image data for a plurality of viewpoints from the outside and writing it into the image memory (120). 2. Reading viewpoint image data from the image memory (120) according to a reading order corresponding to the display module (200); 3. Outputting the read viewpoint image data to the display module (200) as composite image data (CM); The details of the image processing method of the present embodiment conform to the operation of the display controller (100) of the present embodiment. In addition, since the image processing method in other embodiment is implement | achieved by the operation | movement of the display controller in other embodiment similarly to this embodiment, the description is abbreviate | omitted.

  The image processing program of this embodiment is for causing a computer to execute the operation of the display controller (100) of this embodiment. When the display controller (100) includes a computer including a memory, a CPU, and the like, the image processing program of the present embodiment is stored in the memory, and the CPU reads, interprets, and executes the image processing program of the present embodiment. . That is, the image processing program of the present embodiment is an image processing program for generating composite image data (CM) to be output to the display module (200), and causes the computer to execute the following steps 1 to 3. belongs to. 1. A procedure for inputting viewpoint image data for a plurality of viewpoints from outside and writing them into the image memory (120). 2. A procedure for reading viewpoint image data from the image memory (120) according to a reading order corresponding to the display module (200). 3. A procedure for outputting the read viewpoint image data as composite image data (CM) to the display module (200). The details of the image processing program of the present embodiment conform to the operation of the display controller (100) of the present embodiment. In addition, since the image processing program in other embodiment is for making a computer perform the operation | movement of the display controller in other embodiment similarly to this embodiment, the description is abbreviate | omitted.

  By using this embodiment, an input image having the same transfer format as that of a general flat display device is used for a display module having an image separating unit that directs light emitted from the sub-pixels to a plurality of viewpoints in the extending direction of the data line. Data can be used. For this reason, in an arithmetic unit or the like that outputs image data to the display device of the present invention having the display controller, it is not necessary to perform rearrangement processing of image data or special processing associated with transfer, so that no burden is imposed. Furthermore, by providing means for parameterizing conditions necessary for generating the composite image data and storing the parameters, it is possible to cope with changes in the display module by changing the parameters. For this reason, it is not necessary to change the video signal processing means, and the design man-hours can be reduced and the cost can be reduced. Hereinafter, the first embodiment will be described in more detail.

[Description of configuration]
A configuration of the display device according to the first embodiment of the present invention will be described. FIG. 2 is a schematic configuration diagram of the stereoscopic display device of the present embodiment, which is an optical model viewed from the observer's head. The outline of the present embodiment will be described with reference to FIG. The display device of this embodiment includes a display controller 100 and a display module 200. The display controller 100 has a function of generating composite image data CM from first-viewpoint image data (left-eye image data) M1 and second-viewpoint image data (right-eye image data) M2 input from the outside. . The display module 200 includes a lenticular lens 30 that is an optical image separation unit for the displayed composite image and a backlight 15 on the display panel 20 that is a display unit for the composite image data CM.

  The optical system of the present embodiment will be described with reference to FIG. The display panel 20 is a liquid crystal panel and includes a lenticular lens 30 and a backlight 15. The display panel 20 includes a glass substrate 25 on which a plurality of sub-pixels 41 and 42 serving as a minimum display unit are formed, and a counter substrate 27 having a color filter (not shown) and a counter electrode (not shown). It is a sandwiching structure. Polarizing plates (not shown) are attached to the surface of the glass substrate 25 opposite to the liquid crystal layer 26 side and the surface of the counter substrate 27 opposite to the liquid crystal layer 26 side, respectively. The sub-pixels 41 and 42 each have a transparent pixel electrode (not shown). By applying a voltage to the liquid crystal layer 26 between each pixel electrode and the counter electrode provided on the counter substrate 27, the polarization state of the transmitted light is controlled. The light beam 16 emitted from the backlight 15 is intensity-modulated and colored by passing through the polarizing plate of the glass substrate 25, the liquid crystal layer 26, the color filter of the counter substrate 27, and the polarizing plate.

  The lenticular lens 30 is configured by arranging a plurality of cylindrical lenses 30 a having a lens effect in one direction in the horizontal direction X. The lenticular lens 30 uses a plurality of sub-pixels on the glass substrate 25 alternately as a first viewpoint (left-eye) sub-pixel 41 and a second viewpoint (right-eye) sub-pixel 42, and is separated from the lens by a distance OD. On the observation surface 17, the projection images from the sub-pixels 41 are all overlapped, and the projection images from all the sub-pixels 42 are overlapped. With the above configuration, the left eye of the observer at the distance OD is provided with the left-eye image including the sub-pixels 41, and the right eye is provided with the right-eye image including the sub-pixels 42.

  Next, details of the display controller 100 and the display panel 20 shown in FIG. 2 will be described. FIG. 1 is a block diagram of this embodiment showing a functional configuration from image input to image display.

  The input image data input from the outside includes viewpoint images M1 and M2, and the viewpoint images M1 / M2 are each composed of pixel data of i rows and j columns. Each pixel data has three-color luminance information about R (red) luminance, G (green) luminance, and B (blue) luminance. The image data is input with a plurality of synchronization signals, and the position of each pixel data in the image, that is, the row number and the column number are specified based on the synchronization signal. Hereinafter, a pixel constituting an arbitrary row and column of the input image data is represented as Mk (row, column) RGB (k represents a viewpoint number (left and right)). That is, M1 is an aggregate of pixel data from M1 (1,1) RGB, M1 (1,2) RGB,... To M1 (i, j) RGB. M2 is an aggregate of pixel data ranging from M2 (1,1) RGB, M2 (1,2) RGB,... To M2 (i, j) RGB. For example, “R” corresponds to the first color, “G” corresponds to the second color, and “B” corresponds to the third color.

  The display controller 100 includes a writing control unit 110, an image memory 120, a reading control unit 130, a parameter storage unit 140, and a timing control unit 150.

  The writing control unit 110 has a function of generating a writing address to be given to the input pixel data {Mk (row, column) RGB} according to a synchronization signal input along with the input image data. The write control unit 110 has a function of giving a write address to the address bus 95 and writing input image data composed of pixel data into the image memory 120 via the data bus 90. The synchronization signal input from the outside is indicated by a single thick arrow in FIG. 1 for the sake of convenience. For example, the synchronization signal includes a plurality of signals such as a vertical and horizontal synchronization signal, a data clock, and a data enable.

  The read control unit 130 responds to the parameter information 51 of the display unit 50 given from the parameter storage unit 140, the control signal 61 of the scanning line driving circuit 60 and the control signal 81 of the data line driving circuit 80 from the timing control unit 150. A function of generating a read address according to a predetermined pattern, a function of supplying the read address to the address bus 95 and reading out the pixel data via the data bus 90, and outputting the read data to the data line driving circuit 80 as composite image data CM. With functions.

  The parameter storage unit 140 has a function of storing parameters necessary for performing data rearrangement according to the arrangement of the display unit 50 described in detail later.

  The timing control unit 150 generates control signals 61 and 81 to be supplied to the scanning line driving circuit 60 and the data line driving circuit 80 of the display panel 20, and outputs them to the reading control unit 130, the scanning line driving circuit 60 and the data line driving circuit 80. The function to output to. The control signals 61 and 81 are indicated by a single thick arrow for convenience in FIG. 1, but include a plurality of signals such as a start signal, a clock signal, and an enable signal.

  The display panel 20 includes a plurality of scanning lines G1, G2,... Gm, Gm + 1 and a scanning line driving circuit 60, a plurality of data lines D1, D2... Dn, Dn + 1, a data line driving circuit 80, and a plurality of sub-lines. And a display unit 50 in which pixels 40 are arranged in n rows and m columns.

  FIG. 1 is a diagram schematically showing the functional configuration, and the shapes and connection relationships of the scanning lines G1,..., The data lines D1,. Although not shown, the sub-pixel 40 includes a thin film transistor (TFT) serving as switching means and a pixel electrode. The gate electrode of the TFT is connected to the scanning lines G1,..., The source electrode is connected to the pixel electrode, and the drain electrode is connected to the data lines D1,. A voltage is sequentially applied from the scanning line driving circuit 60 to any scanning line Gx to which the TFT is connected, and the TFT is turned ON / OFF according to this voltage. When the TFT is turned on, a voltage is written from the data lines D1,. The data line driving circuit 80 and the scanning line driving circuit 60 may be formed on a glass substrate on which TFTs are formed, or may be mounted on a glass substrate using a driving IC or separately from the glass substrate. Good.

  In the display panel 20 of this embodiment, in the display unit 50, the extending direction of the data lines D1,... Is installed in the horizontal direction, and the extending direction of the scanning lines G1,. When the display unit 50 has a landscape (for example, 16: 9 landscape), this arrangement relationship has an effect of reducing the area other than the display unit 50 that contributes to image display, that is, a so-called “frame”. There are the effects of increasing the number of sub-pixels of the unit 50 and increasing the resolution, and reducing the cost when the resolution is increased. The reason will be described below with reference to FIG.

  FIG. 4 is an example of a display panel including a landscape (horizontal) display unit 50, and includes driving ICs 80a and 80b as the data line driving circuit 80 (FIG. 1) and a scanning line driving circuit 60 (FIG. 1). The scanning circuits 60a and 60b are provided on a glass substrate (not shown) of the display panel. The scanning circuits 60a and 60b were configured using TFTs formed by the same process as the TFTs used as switching means.

  FIG. 4A shows an example in which data lines are arranged in the horizontal direction (X direction), as in the present embodiment. FIG. 4B shows an example in which data lines are arranged in the vertical direction (Y direction). The lenticular lens 30 as image separation means is arranged so that the image separation direction is the horizontal direction (X direction) in both FIGS. Further, sub-pixels (not shown) are arranged in a region surrounded by the scanning lines and the data lines. Light rays emitted from the sub-pixels are colored in red (R), green (G), or blue (B) by a color filter (not shown).

  In the display device according to the first embodiment, a display unit for the first viewpoint (for the left eye) is formed from red (R), green (G), and blue (B) sub-pixels, and similarly, red (R). , Green (G), and blue (B) sub-pixels form a display unit for the second viewpoint (for the right eye). Therefore, as shown in FIG. 4, the stereoscopic display unit 35 is configured by a total of six subpixels, and the pitches of the stereoscopic display unit in the horizontal direction (X direction) and the vertical direction (Y direction) are equal.

  The output pins of the drive ICs 80a and 80b are connected to the data lines of the display unit 50, respectively. In general, the pitch of output pins of a driving IC used as a data line driving circuit is narrower than the pitch of data lines. For this reason, since the wiring from the output pin of the driving IC to each data line is wide, the distances LDa and LDb from the display unit 50 to the driving ICs 80a and 80b are necessary for the wiring. If the pitch of the output pins of the drive IC is the same, the distance from the display unit to the drive IC can be shortened as the number of data lines to be connected decreases. Here, when the display unit is landscape (landscape), the number of data lines in FIG. 4A in which the data lines are arranged in the horizontal direction is smaller than that in FIG. 4B in which the data lines are arranged in the vertical direction. Few. Accordingly, the distance from the display unit to the driving IC is such that the distance LDa is shorter than the distance LDb. In other words, the frame can be made smaller by arranging the data lines in the horizontal direction.

  Further, focusing on the scanning line pitch, the stereoscopic display unit 35 shown in FIG. 4 is substantially square as described above, and therefore the scanning line pitch PGa shown in FIG. Is larger than the pitch PGb of the scanning lines shown in FIG. When the circuits for driving one scanning line are configured with the same number of TFTs in the scanning line driving circuits 60a and 60b configured using TFTs on the glass substrate, FIG. TFTs must be arranged in the horizontal direction X. Further, since the number of sub-pixels connected to one scanning line is larger in FIG. 4B than in FIG. 4A, the driving capability in FIG. 4B must be increased. For these reasons, when the scanning line driving circuits 60a and 60b are schematically represented by rectangles as shown in FIG. 4, the short side of the rectangle indicating the scanning line driving circuit 60a is shorter than the short side of the scanning line driving circuit 60b. Become. In other words, the frame can be made smaller by arranging the data lines in the horizontal direction.

  Further, in the landscape (horizontal) display unit, the scanning lines are shorter in the case where the scanning lines are arranged in the vertical direction (Y direction) as shown in FIG. 4A than in FIG. 4B. . For this reason, when the scanning lines are formed of the same width metal film as in FIGS. 4A and 4B, the signal transmission delay time due to the wiring resistance from the scanning line driving circuits 60a and 60b is as shown in FIG. a) is less than FIG. 4 (b). Therefore, in FIG. 4A, the width of the scanning line can be reduced, and the number of scanning lines per unit area can be increased, that is, higher resolution can be achieved.

  Furthermore, when the ratio between the horizontal direction and the vertical direction of the stereoscopic display unit 35 forming the display unit 50 is 3: 2 or more (for example, 16: 9 horizontally long), the number of sub-pixels driven by the scanning line is 4 (a) is smaller than FIG. 4 (b). For this reason, the capacity load of FIG. 4A is smaller than that of FIG. 4B, so that higher resolution can be achieved. In this case, the number of data lines is smaller in FIG. 4A in which the data lines are arranged in the horizontal direction. For this reason, for example, when a 1920 × 1080 display unit is configured in stereoscopic display units, 1080 × 3 + 1 = 3241 [lines] data lines are required in FIG. 4A in which data lines are arranged horizontally. On the other hand, in FIG. 4B in which the data lines are arranged vertically, 1920 × 2 + 1 = 3841 [lines] are required.

  Here, if a 720-output driver IC is used for the data line driver circuit 80, only five driver ICs are required in FIG. 4A, but six driver ICs are required in FIG. 4B. That is, FIG. 4A in which the data lines are arranged in the horizontal direction can reduce the number of driving ICs, and has an effect of reducing the cost.

  Next, the structure of the sub-pixel 40 constituting the display unit 50 will be described with reference to the drawings. FIG. 3 is a first example of the structure of the sub-pixel 40 of this embodiment, and is a top view seen from the observer. The size and scale of each component are appropriately changed and described in order to ensure the visibility of the drawing. In FIG. 3, the sub-pixel 40 is shown as two types of sub-pixels 40a and 40b depending on the shape direction.

  FIG. 3 illustrates four sub-pixels constituting 2 rows and 2 columns of the display unit 50 shown in FIG. In the XY axes in FIG. 3, X indicates the horizontal direction and Y indicates the vertical direction. In order to explain the arrangement direction of the image separation means, FIG. 3 illustrates a cylindrical lens 30a constituting a lenticular lens. The cylindrical lens 30a is a one-dimensional lens having a semi-cylindrical convex portion, has no lens effect in the longitudinal direction, and has a lens effect only in the short direction. In the present embodiment, the longitudinal direction of the cylindrical lens 30a is arranged along the Y-axis direction, and a lens effect is obtained in the X-axis direction. That is, the image separation direction is the horizontal direction X.

  The openings of a total of four subpixels of the subpixels 40a and 40b shown in FIG. 3 are bent in the horizontal direction that is the image separation direction, with three data lines Dy-1, Dy, and Dy + 1 arranged in parallel in the horizontal direction X. Is a substantially trapezoidal shape surrounded by three scanning line lines Gx, Gx + 1, Gx + 2 and a storage capacitor line CS. Hereinafter, the substantially trapezoidal shape is regarded as a trapezoid, and of the two parallel sides along the data lines Dy−1,..., Dy + 1, the short side is called the upper base E, and the long side is called the lower base F. That is, the subpixel 40a and the subpixel 40b have a trapezoidal direction opposite to the vertical direction Y, that is, the direction from the upper base E to the lower base F is opposite to each other.

  The sub-pixels 40a and 40b have a pixel electrode 45, a TFT 46, and a storage capacitor 44, respectively. The TFT 46 is formed at the intersection of the semiconductor layer 43 whose shape is indicated by a thick line in FIG. 3 and the scanning lines Gx,..., Gx + 2, and has a drain electrode, a gate electrode, and a source electrode (not shown). The gate electrode of the TFT 46 is formed at the intersection of the scanning lines Gx,..., Gx + 2 and the semiconductor layer 43, and is connected to the scanning lines Gx,. The drain electrode is connected to the data lines Dy−1,..., Dy + 1 via the contact hole 47. The source electrode is connected to a pixel electrode 45 whose shape is indicated by a dotted line in FIG.

  On the source electrode side of the semiconductor layer 43, a storage capacitor 44 is formed by disposing a metal film in the same layer as the scanning line via an insulating film. That is, one electrode forming the storage capacitor 44 is the semiconductor layer 43, and the other electrode is a metal film in the same layer as the scanning line. The other electrode of the storage capacitor 44 is connected through a contact hole 48 to a storage capacitor line CS formed of a metal film in the same layer as the data line. The storage capacitor line CS is arranged along the scanning line, and is connected to the storage capacitor 44 of each subpixel adjacent in the horizontal direction (X direction) via a contact hole 48.

  In the first structural example of the sub-pixel 40 shown in FIGS. 3, 5, and 6, the other storage capacitor 44 of the sub-pixel connected to the common data line and adjacent in the vertical direction (Y direction) is used. The electrodes are connected. Therefore, in the first structural example of the sub-pixel 40, the storage capacitor line CS is electrically connected to the storage capacitors 44 of the sub-pixels arranged in both horizontal and vertical directions as shown in the equivalent circuits of FIGS. ing.

  As shown in FIG. 3, the sub-pixel 40a and the sub-pixel 40b have a pixel electrode 45, a TFT 46, contact holes 47, 48, and 49, and storage capacitors 44, which are the respective constituent elements. It is point-symmetrical. That is, in the XY plane, when the subpixel 40a including each component is rotated 180 degrees, the configuration shape matches that of the subpixel 40b.

  Further, in the openings of the sub-pixels 40a and 40b arranged as described above, the ratio of the openings and the light-shielding portions in the Y-axis direction orthogonal to the image separation direction is relative to the X-axis direction, which is the image separation direction. It is desirable that it be substantially constant. The opening is an area contributing to display surrounded by the scanning lines, the data lines, the storage capacitor lines CS, and the semiconductor layer 43. A region other than the opening is defined as a light shielding portion. Then, the ratio of the opening and the light shielding portion in the Y-axis direction is obtained by dividing the length of the opening when the sub-pixel 40a or the sub-pixel 40b is cut in the Y-axis direction by the pixel pitch in the Y-axis direction. One-dimensional aperture ratio. Hereinafter, the one-dimensional aperture ratio in the direction orthogonal to the image separation direction is referred to as the vertical aperture ratio.

  Therefore, in other words, the ratio of the opening portion and the light shielding portion in the Y-axis direction is substantially constant with respect to the X direction, in other words, the vertical direction along the line BB ′ shown in FIG. This means that the aperture ratio and the vertical aperture ratio along the line AA ′ are designed to be substantially equal. Here, the vertical aperture ratio along the line BB ′ is obtained by dividing the length of the opening of the sub-pixel 40 a along the line BB ′ by the distance between the data line Dy−1 and the data line Dy. Value. The vertical aperture ratio along the line AA ′ is the sum of the length of the opening of the sub-pixel 40 b and the length of the opening of the sub-pixel 40 a along the line AA ′, and the data line Dy−1. It is a value divided by the distance to the data line Dy.

  The display unit includes sub-pixels 40a and 40b having the above-described features. In the present invention, two subpixels 40a and 40b having different orientations are treated as one unit, and the subpixels 40a and 40b connected to a common data line and arranged in the vertical direction are referred to as “upper and lower subpixel pairs”. . Specifically, the sub-pixel 40a connected to the scanning line Gx + 1 and the sub-pixel 40b connected to the scanning line Gx connected to the data line Dy shown in FIG. Treat as a unit of display.

  (1) of FIG. 5 is a plan view showing the upper and lower sub-pixel pairs, and is a structural diagram of the upper and lower sub-pixel pairs extracted from FIG. (2) in FIG. 5 is an equivalent circuit of the upper and lower sub-pixel pairs shown in (1) in FIG. 5, and the scanning lines Gx,..., The data lines Dy,. . The upper and lower subpixel pairs shown in FIG. 5 are referred to as upper and lower subpixel pairs P2R. (3) of FIG. 5 is a diagram showing FIG. 3 by an equivalent circuit of the upper and lower subpixel pairs P2R, and four subpixels surrounded by dotted lines correspond to FIG. As shown in (3) of FIG. 5, the four adjacent sub-pixels in FIG. 3 are composed of three upper and lower sub-pixel pairs. This is because the upper and lower subpixel pairs adjacent to each other in the extending direction of the data lines Dy,... Are connected to different data lines Dy,.

  The reason why the present embodiment having the display unit composed of the above-described upper and lower subpixel pairs achieves high aperture ratio and high image quality in the stereoscopic display device will be described. In order to achieve high aperture ratio and high image quality, it is necessary to increase the vertical aperture ratio while keeping the vertical aperture ratio of the pixels constant regardless of the position in the image separation direction.

  The scan line and the data line are preferably arranged around each pixel electrode. This is because if a scanning line or a data line having no pixel electrode is assumed between the scanning lines or the data lines, a dead space that does not contribute to display occurs between the wirings, and the aperture ratio decreases. In the present embodiment, as shown in FIG. 3, scanning lines Gx,..., Data lines Dy,.

  Further, the TFTs 46 included in the above-described upper and lower subpixel pairs are connected to different scanning lines Gx,. Furthermore, the horizontal direction of the upper and lower subpixel pairs, that is, the arrangement in the extending direction of the data lines Dy,... Therefore, the upper and lower subpixel pairs adjacent to each other in the extending direction of the data lines Dy,... Are connected to different data lines Dy,.

  With the above arrangement and connection relationship, the number of necessary wirings can be suppressed and the aperture ratio can be improved. Further, the scanning line is bent in the image separation direction in order to make the vertical aperture ratio constant regardless of the position in the image separation direction.

  As described above, the arrangement of the sub-pixels according to the present embodiment shown in FIG. 3 is based on the upper and lower sub-pixel pairs shown in FIG. The display unit of the present embodiment including a plurality of upper and lower subpixel pairs realizes a high aperture ratio and high image quality of a stereoscopic display device.

  Up to this point, the configuration of the display unit according to the present embodiment has been described with reference to FIGS. 1 to 5. However, the configuration of the display unit using the upper and lower subpixel pair P2L that is mirror-symmetrical with the upper and lower subpixel pair P2R illustrated in FIG. Is also possible. FIG. 6A is a plan view showing the structure of the upper and lower subpixel pair P2L, and FIG. 6B is an equivalent circuit of the upper and lower subpixel pair P2L. As shown in (1) of FIG. 6, the sub-pixels 40a ′ and 40b ′ constituting the upper and lower sub-pixel pair P2L are pixels that are constituent elements of the sub-pixels 40a and 40b shown in (1) of FIG. The shape, arrangement, and connection relationship of the electrode 45, the TFT 46, the contact holes 47, 48, and 49, the semiconductor layer 43, and the storage capacitor 44 are axisymmetric with respect to the Y axis. In other words, the upper and lower subpixel pairs P2R and the upper and lower subpixels P2L are line symmetric with respect to the Y axis, and are also line symmetric with respect to the X axis, and are in a mirror image symmetric relationship with each other. Therefore, even when the upper and lower sub-pixel pair P2L shown in FIG. 6 constitutes the display unit, high aperture ratio and high image quality can be realized as in the case of the upper and lower sub-pixel pair P2R.

  Here, the subpixels connected to the common data lines constituting the upper and lower subpixel pairs are referred to as “upward subpixels” and “downward subpixels” according to the direction of the base F of the trapezoid, and are used in the following description. That is, in the upper and lower subpixel pair P2R in FIG. 5, the subpixel 40a is an “upward subpixel” and the subpixel 40b is a “downward subpixel”. Similarly, in the upper and lower subpixel pairs P2L in FIG. 6, the subpixel 40a 'is an "upward subpixel", and the subpixel 40b' is a "downward subpixel". As described above, the upper and lower sub-pixel pair P2R and the upper and lower sub-pixel pair P2L have the same optical effect obtained from the structure, but the upward and downward sub-pixels and the scanning lines Gx and Gx + 1 respectively The connection relationship is reversed. That is, the sub pixel 40a is connected to the scanning line Gx + 1 and the sub pixel 40b is connected to the scanning line Gx, whereas the sub pixel 40a ′ is connected to the scanning line Gx and the sub pixel 40b ′ is connected to the scanning line Gx + 1. Do

  The display unit of the present embodiment may be configured with either the upper / lower sub-pixel pair P2R or the upper / lower sub-pixel pair P2L. Further, the upper and lower sub-pixel pair P2R and the upper and lower sub-pixel pair P2L may be combined. Hereinafter, a configuration example of the display unit 50 according to the present embodiment illustrated in FIG. 1 includes a first viewpoint image (left-eye image) and a second viewpoint image (right-eye image) including pixels in 4 rows and 6 columns. A specific example will be described using a display example. First, the input image data will be described with reference to FIG. 7, and the image separation means and the color arrangement relationship of the display unit of the present embodiment will be described with reference to FIG. A specific example of the display portion will be described after the description of FIGS.

  FIG. 7 is a diagram illustrating image data of a first viewpoint image (left-eye image) and a second viewpoint image (right-eye image) including pixels in 4 rows and 6 columns. As described above, M1 is a collection of pixel data from M1 (1,1) RGB, M1 (1,2) RGB,... To M1 (i, j) RGB, and M2 is M2 (1,1). 1) A set of pixel data ranging from RGB, M2 (1,2) RGB,... To M2 (i, j) RGB. “1 to i” indicate row numbers in the image, and “1 to j” indicate column numbers in the image. In the example of FIG. 7, i = 4 and j = 6. RGB means having color information of R: red, G: green, B: blue.

  FIG. 8 is a diagram showing an example of the arrangement of the image separation means and the color arrangement of the sub-pixels in the display unit 50 that displays the two image data shown in FIG. In the XY axes in the figure, X indicates the horizontal direction, and Y indicates the vertical direction.

  In FIG. 8, subpixels are shown as trapezoids, and an example of color arrangement is shown by shading. Specifically, an R: red color filter is disposed on the counter substrate of the subpixels arranged in the horizontal direction in the first row, and the first row functions as a subpixel that displays red. A G: green color filter is arranged on the counter substrate of the subpixels arranged in the horizontal direction in the second row, and the second row functions as a subpixel that displays green. On the counter substrate of the subpixels arranged in the horizontal direction in the third row, a B: blue color filter is arranged, and the third row functions as a subpixel that displays blue. Similarly, after the fourth row, the sub-pixels function in order of red, green, and blue in units of rows. In the present embodiment, any order can be applied. For example, the first to third lines may be blue, green, and red, and the subsequent lines may be repeated.

  In the image separating means, the cylindrical lens 30a constituting the lenticular lens 30 corresponds to the sub-pixel two-row unit, and the longitudinal direction having no lens effect is arranged parallel to the vertical direction, that is, parallel to the row. For this reason, due to the lens effect in the X direction of the cylindrical lens 30a, the light rays emitted from the even-numbered and odd-numbered subpixels are separated in different directions. That is, as described with reference to FIG. 2, the image is separated into an even-numbered row image and an odd-numbered row image at a position away from the lens surface. In this embodiment, as an example, the even-numbered sub-pixels function as the left-eye (for the first viewpoint), and the odd-numbered sub-pixels function as the right-eye sub-pixel by the arrangement of FIGS. .

  As described above, since the color filter and the image separation means are arranged, one pixel data of the input image data shown in FIG. 7 is displayed by three sub-pixels of red, green, and blue arranged in one column in FIG. The Specifically, the three sub-pixels in the first, second, and third rows in the second column display the upper left corner pixel data: M1 (1, 1) RGB for the left-eye (first viewpoint) image. .., And the three sub-pixels in the 11, 11th, and 12th rows in the 11th column display the lower right corner pixel data: M2 (4,6) RGB for the right-eye (second viewpoint) image. It is desirable that the pitch for every two subpixel columns and the pitch for every three subpixel rows are equal. Under the above-mentioned pitch condition, the resolution at the time of stereoscopic display using the input left and right images as the parallax image is equal to the resolution at the time of planar display using the input left and right images as the same image. This is because it has the characteristic of not. In addition, since the same color is arranged in the direction of the lens effect, that is, the direction of image separation, color separation by the image separation means does not occur, and high image quality can be achieved.

  Hereinafter, a connection example between a plurality of subpixels arranged in the matrix shown in FIG. 8 and scanning lines and data lines, that is, a specific example in which the display unit is configured from the upper and lower subpixel pairs shown in FIGS. 5 and 6 described above. 9 to 11 will be described.

  FIG. 9 shows an arrangement pattern 1 that constitutes the display unit from the upper and lower subpixel pairs P2R shown in FIG. In the arrangement pattern 1, the upper and lower subpixel pairs P2R are arranged starting from the arrangement in which the upward subpixels of the upper and lower subpixel pairs P2R are in the first row and the first column. At this time, the downward subpixels of the upper and lower subpixel pairs P2R are arranged in the first row of the even columns, and the upward subpixels of the upper and lower subpixel pairs P2R do not constitute a display unit. Similarly, in the twelfth row of the even column, the upward subpixels of the upper and lower subpixel pairs P2R are arranged, and the downward subpixels of the upper and lower subpixel pairs P2R do not constitute a display unit. NP shown in FIG. 9 indicates that subpixels that do not constitute the display unit are not arranged. Further, FIG. 9 corresponds to FIG. 8, and the shading of each sub-pixel indicates a display color, and the even-numbered sub-pixels are used for the left eye (for the first viewpoint) by the lenticular lens 30 which is an image separating unit. The odd-numbered sub-pixels function as the right-eye sub-pixels.

  FIG. 10 shows an arrangement pattern 2 that constitutes the display unit from the upper and lower sub-pixel pairs P2L shown in FIG. Since the arrangement pattern 2 shown in FIG. 10 is the same as the arrangement pattern 1 shown in FIG. 9 except that the upper and lower subpixel pairs P2R are changed to the upper and lower subpixel pairs P2L, description thereof is omitted.

  FIG. 11 is an example of an array pattern 3 constituting the display unit from the combination of the upper and lower sub-pixel pairs P2R shown in FIG. 5 and the upper and lower sub-pixel pairs P2L shown in FIG. As shown in FIG. 11, in the first column, the upper sub-pixel pair P2L and the upper sub-pixel pair P2L start from the first row and first column. The sub-pixel pair P2R is repeatedly arranged. In the second column, the upper and lower sub pixel pairs P2R and the upper and lower sub pixel pairs P2L are repeated in the Y-axis direction, which is the vertical direction, starting from an arrangement in which the downward sub pixels of the upper and lower sub pixel pairs P2R are in the first row and second column. Deploy. In the third column, the upper and lower subpixel pairs P2R and the upper and lower subpixel pairs P2L are repeated in the vertical Y-axis direction starting from the arrangement in which the upper subpixels of the upper and lower subpixel pairs P2R are in the first row and third column. Deploy. In the fourth column, the upper and lower sub-pixel pairs P2L and the upper and lower sub-pixel pairs P2R are repeated in the vertical Y-axis direction starting from the arrangement in which the downward sub-pixels of the upper and lower sub-pixel pairs P2L are in the first row and the fourth column. Deploy. From the fifth column onward, the arrangement pattern from the first column to the fourth column is repeated. This arrangement pattern 3 has the effect of enabling high image quality when the dot inversion driving method is applied to the polarity inversion driving method. Details will be described later.

  As shown in FIGS. 9 to 11, the display unit composed of 12 × 12 subpixels has upper and lower subpixel pairs as structural units, so that 13 data lines from D1 to D13 and scanning lines from G1 are used. Thirteen up to G13 are required. In other words, the display unit composed of sub-pixels of n rows and m columns according to the present embodiment is characterized by being driven by n + 1 data lines and m + 1 scanning lines. Note that the display unit of the present embodiment is configured with the upper and lower subpixel pairs shown in FIGS. 5 and 6 as structural units, and has various arrangement patterns other than those illustrated in FIGS. 9 to 11. Is possible.

  The difference in the arrangement pattern affects the polarity distribution of the display unit when the liquid crystal panel is driven for polarity inversion. Therefore, by selecting the arrangement pattern, it is possible to improve the image quality (for example, flicker suppression) due to the polarity distribution. However, in the display unit of the present invention, as in the examples of FIGS. 9 to 11, the subpixels arranged in one row in the horizontal direction are alternately connected to the two data lines, and the subpixels arranged in one column in the vertical direction. Are connected to the two scanning lines with regularity according to the arrangement pattern. For this reason, the display unit according to the present invention is different from a general liquid crystal panel in which one row of subpixels is connected to one scanning line and one column is connected to one data line. Are different, and the effect is also different. Hereinafter, the difference in effect obtained for each arrangement pattern of the present embodiment when applying the polarity inversion driving method of a general liquid crystal panel will be described.

  FIG. 12 shows the polarity distribution of the display portion and the data line polarity for each scanning line when gate line inversion driving (1H inversion driving) is applied to the array pattern 2 shown in FIG. “+” And “−” in the drawing represent the positive and negative polarities of the pixel electrode and the data line in an arbitrary frame (a period in which scanning of all scanning lines makes a round), and the positive and negative are reversed in the next frame. The gate line inversion driving is a driving method for inverting the polarity of the data line in units of scanning line selection periods. The gate line inversion driving can reduce the withstand voltage of the data line driving circuit (data line driving driver IC) by combining with the so-called common inversion driving in which the common electrode on the opposite substrate side is AC driven. There is an advantage that can be reduced.

  Further, in the case of applying the gate line inversion drive (1H inversion drive) to the array pattern 2 of the present embodiment, the polarity distribution of the sub-pixels forming one arbitrary row is the same as shown in FIG. In the previous and subsequent rows, the polarity is reversed. That is, the polarity distribution is the same as when a general panel is driven by gate line inversion driving (1H inversion driving). For this reason, the same flicker suppression effect as when a general panel is driven by gate line inversion driving (1H inversion driving) can be obtained even for so-called flicker in which a display image appears to flicker due to a luminance difference caused by polarity. .

  FIG. 13 shows the polarity distribution of the display section and the data line polarity for each scanning line when dot inversion driving is applied to the array pattern 2 shown in FIG. “+” And “−” in the figure indicate the polarity as in FIG. As shown in FIG. 13, dot inversion driving is a driving method that inverts the polarity for each data line and further inverts the polarity of the data line for each selection period of one scanning line. It is known as a method for suppressing and improving image quality.

  As shown in FIG. 13, the polarity distribution when the dot inversion driving is applied to the array pattern 2 of the present embodiment is the same polarity in units of rows when focusing only on the odd columns (that is, all the odd columns in one row). The polarity is the same), and the same applies to the case where only even columns are focused, but the polarities of the odd and even columns in the same row are reversed. Therefore, for each of the separated left-eye image and right-eye image, the same flicker suppression effect as that obtained when a general panel is driven with a gate line inversion drive (1H inversion drive) can be obtained. Furthermore, when the left eye image and right eye image projected by the image separating means are observed from an overlapping region without being separated, the same flicker suppressing effect as that obtained when a general panel is driven by dot inversion can be obtained.

  FIG. 14 shows the polarity distribution of the display unit and the data line polarity for each scanning line when dot inversion driving is applied to the array pattern 3 shown in FIG. “+” And “−” in the figure indicate the polarity as in FIG.

  As shown in FIG. 14, the polarity distribution when the dot inversion drive is applied to the array pattern 3 of the present embodiment focuses on only the odd columns, and the first column, the third column, the third column, and the fifth column in each row. Polarity inversion is repeated in units of odd-numbered columns such as eyes,. Similarly, when attention is paid only to even columns, polarity inversion is repeated in units of even columns in each row. Focusing on the polarity distribution in an arbitrary column, the pixel electrodes adjacent to each other in the vertical direction of the upper and lower subpixel pairs P2L and P2R have the same polarity, and the polarity is inverted every two rows. For this reason, the long sides of the pixel electrode represented by a trapezoid have the same polarity, and abnormal alignment of liquid crystal molecules in the vicinity of adjacent long sides can be suppressed, so that high image quality can be achieved. For each of the separated left-eye image and right-eye image, the column whose polarity is inverted every two rows of subpixels in the vertical direction is inverted in units of columns. That is, it is possible to obtain the same flicker suppressing effect as when a general panel is driven by inverting two vertical dots.

  As described above, the combination of the array pattern of the display units and the polarity inversion driving method may be appropriately selected according to the target display image quality, power consumption, and the like. Further, the display unit of the present embodiment can be applied to an arrangement pattern other than that illustrated and a polarity inversion driving method other than that illustrated. For example, application of the arrangement pattern 4 shown in FIG. 15 is also possible. The array pattern 4 forms a display unit from the upper and lower subpixel pairs P2R shown in FIG. 5 and starts from an arrangement in which the upward subpixels are in the first row and the second column. The array pattern 4 shown in FIG. 15 and the array pattern 1 shown in FIG. 9 composed of the same pair of upper and lower subpixels P2R are in a relationship of being moved in the horizontal direction by one column.

  However, the composite image data CM output to the data line driving circuit 80 shown in FIG. 1 must be changed according to the change in the array pattern. The combined image data CM is image data combined from the input images M1 and M2, and is input to the data line driving circuit 80 in order to write a voltage to each pixel electrode of the display unit 50 including n rows and m columns of subpixels. It is data to be. That is, in the composite image data CM, the pixel data constituting the input image data M1 and M2 are rearranged so as to correspond to the data line D1 to the data line Dn + 1 for each scanning line from the scanning line G1 to the scanning line Gm + 1. It is expressed by a data configuration of Dn + 1 rows and Gm + 1 columns.

  Therefore, as can be seen from the array patterns 1 to 4 shown in FIGS. 9 to 11 and 15, even in the sub-pixels specified by the same matrix, the data lines or the scan lines to be connected differ depending on the array pattern. The composite image data CM is also different.

  As a specific example, the composite image data CM to be output when displaying the input image data composed of a plurality of pixel data shown in FIG. 7 on the display unit of the array patterns 1 to 4 including the lenticular lens 30 as the image separation means. Are shown in FIGS. 16 to 19 show the viewpoint, position, and color of input image data given to an arbitrary data line Dy when an arbitrary scanning line Gx is selected. M1 / M2 is a viewpoint image, (row number, column number) is a position, and R / G / B is a color. Further, a cross indicates that there is no pixel electrode. Of course, there is no input image data M1 and M2 that should correspond to the x mark, and there is no pixel electrode that reflects the given data, so the data given to the x mark is arbitrary.

  The composite image data CM includes parameters determined by design such as the color arrangement of the color filter shown in FIG. 8, the arrangement patterns shown in FIGS. 9 to 11 and 15, and the setting of image separation means described later, and the upper and lower subpixel pairs. It is generated based on the regularity of connection in units of data lines and regularity in units of scanning lines.

  The regularity in units of data lines will be described. In the present embodiment, the viewpoint image M1 / M2 to be displayed for even / odd data line units is designated. This is because in the arrangement of the upper and lower subpixel pairs constituting the display unit, the same data line cannot be arranged in two columns, and the upper and lower subpixel pairs sharing the same data line are always arranged in every other column. It is. That is, the even / odd of the data line corresponds to the even / odd of the column in which the sub-pixels are arranged in the Y direction. Furthermore, the designation of the viewpoint images M1 / M2 is determined in units of sub-pixel columns in accordance with the installation of the image separation means having the image separation direction in the X direction.

  That is, the elements that determine the even / odd of the data line and the viewpoint image M1 / M2 are the arrangement pattern and the arrangement of the image separation means. For example, in the arrangement pattern 1 (FIG. 9) and the arrangement pattern 4 (FIG. 15) in which image separation means are arranged in the same manner with respect to the column numbers of the subpixels, the even / odd of the data line and the viewpoint image M1 / M2 Are opposite to each other as can be seen from the composite image data 1 and 4 (FIGS. 16 and 19). Further, the installation of the image separating means is not limited to the example shown in FIG. 8, and for example, the example shown in FIG. 20 is also possible. In FIG. 8, the first column is M2, the second column is M1, the sub-pixels in the odd columns are M2, and the sub-pixels in the even columns are M1. Conversely, in the case of FIG. 20, the first column is M1, the second column is M2, the sub-pixels in the odd columns are M1, and the sub-pixels in the even columns are M2. Thus, even / oddness of the column in which the viewpoint images M1 / M2 are displayed is determined by the arrangement of the image separation means.

  Here, the relationship between the even / odd of the data line and the viewpoint image M1 / M2 is summarized in FIG. In FIG. 21, the viewpoint of the input image corresponding to the odd data line is represented as v1, and the viewpoint of the input image corresponding to the even data line is represented as v2. The correspondence relationship between the even / odd data lines and the viewpoint images M1 / M2 described with reference to the arrangement pattern 1 (FIG. 9) and the arrangement pattern 4 (FIG. 15) is arranged in the first row and first column of the display unit. The subpixel is determined depending on whether it is an upward subpixel or a downward subpixel. Therefore, the upper and lower sides of the subpixel arranged in the first row and the first column are set as a variable “u”. When u = 0, the first row and the first column are upward subpixels, and when u = 1, the first row and the first column are It is assumed that the pixel is a downward subpixel. In FIG. 21, for example, the image separation means is installed so that the odd-numbered column of the display unit is M1 and the even-numbered column is M2, and the subpixels in the 1st row and 1st column of the display unit are facing upward (u = 0). V1 = 2, v2 = 1, that is, the data line odd-numbered viewpoint image is M2, and the data line even-numbered viewpoint image is M1.

  R / G / B, which is the color of the first row, is determined by the color filter. Since one data line is connected to two rows of sub-pixels, when the color and color arrangement order of the first row by the color filter are determined, the regularity of the color corresponding to the arbitrary data line is determined. For example, as shown in the above-described array patterns 1 to 3 (FIGS. 9 to 11) and array pattern 4 (FIG. 15), the color arrangement of R (red), G (green), and B (blue) that continues from the first row In order, the sub-pixels connected to the data line D3 are G and B, and the sub-pixels connected to the data line D4 are B and R. That is, when the color arrangement order is determined, two colors corresponding to an arbitrary data line are determined. When the repetition of the viewpoint image correspondence due to the even / odd of the data line described above is added to the repetition by the color filter composed of the three colors of RGB, the input image data designation rule has a period of every 6 lines in the data line unit. There is sex.

  Arbitrary data lines Dy are connected to the sub-pixels in the (y-1) th row and the y-th row of the display unit (however, in the display unit composed of the sub-pixels in the nth row and the mth column, the 0th row and the (n + 1) th row) Does not exist.) Since the upper and lower subpixel pairs are connected across the data line with respect to the connection between the data line and the subpixel, the upward pixel of the upper and lower subpixel pair connected to Dy is the y-1th row of the display unit, and the downward pixel is the yth row. Eyes. Therefore, as described above, the viewpoint number k and color (R / G / B) in the input image data “Mk (row, column) RGB” illustrated in FIG. 7 are designated for an arbitrary data line. In addition, a line number is also specified. Hereinafter, for arbitrary pixel data of the input image data, the row number is represented as Iy and the column number is represented as Ix.

  The relationship between the arbitrary data line Dy and the input image data is summarized in FIG. If the data line number is expressed using an arbitrary natural number p, the row number Iy of the input image data corresponding to the data line Dy (p) is also determined by p as shown in FIG. Furthermore, the viewpoint number of the input image data corresponding to the data line Dy (p) is shown by using v1 and v2 determined by FIG. The color of the input image data corresponding to the data line Dy (p) is C1, the second line is C2, the third line is C3, the fourth line is C1,. In the order of RGB from the first line, C1 = R, C2 = G, and C3 = B.

  Next, regularity in units of scanning lines will be described. As can be seen from the array patterns 1 to 4 shown in FIG. 9 to FIG. 11 and FIG. 15, an arbitrary scanning line Gx is connected to two columns of subpixels of the (x−1) th column and the xth column (however, n (The 0th column and the (m + 1) th column do not exist in the display unit composed of the sub-pixels in the row and m columns.) Since the sub-pixel corresponds to the viewpoint image M1 / M2 for each column by the image separation means, the viewpoint image in the (x-1) th column and the viewpoint image in the x-th column connected by the scanning line Gx are installed in the image separation means. And the even / odd of the scanning line. For example, in the case of FIG. 9 to FIG. 11 and FIG. 15 in which the image separating means is installed as shown in FIG. 8, when the scanning line Gx is an odd number, the x-1 column is the viewpoint image M1, and the x column is the viewpoint. When the scanning line Gx is an even number corresponding to the image M2, the x-1th column corresponds to the viewpoint image M2, and the xth column corresponds to the viewpoint image M1. For example, in the case where the image separating unit is installed in FIG. 20, when the scanning line Gx is an odd number, the x-1 column corresponds to the viewpoint image M2, the x column corresponds to the viewpoint image M1, and the scanning line Gx When the number is even, the x-1th column corresponds to the viewpoint image M1, and the xth column corresponds to the viewpoint image M2.

  As described above, the arbitrary scanning line Gx designates the viewpoint number k of the input image data “Mk (row, column) RGB” illustrated in FIG. 7, and further designates the column number. FIG. 23 shows scanning lines, viewpoint images of input image data, and column numbers in the array patterns 1 to 4 shown in FIGS. 9 to 11 and 15. Here, the viewpoint images M1 / M2 shown in FIG. 23 are also determined by the installation of the image separation means and the even / oddness of the data lines. That is, if the evenness of the data line is known, the viewpoint image is determined from FIG. Therefore, it is only necessary to derive the relationship with the column number of the input image data of the data line for an arbitrary scanning line Gx. 23, the column number of the input image data corresponding to the display unit x-1 column and the column number of the input image data corresponding to the display unit x column have periodicity for every two scanning lines. Therefore, the scanning line number is represented using an arbitrary natural number q, and the column number Ix of the input image data corresponding to the scanning line Gx (q) is represented by q.

  FIG. 24 summarizes the relationship between the scanning line and the column number of the input image data using the natural number q described above. Here, the x-1 column and the x column of the display unit to which the arbitrary scanning line Gx described above is connected, the even / odd of the scanning line Gx and the 1st row and 1st column through the relationship with the viewpoint image. Can be expressed by a variable “u” indicating the upper and lower sides of the sub-pixels arranged in FIG. For example, in the arrangement patterns 1 to 3 shown in FIGS. 9 to 11, “u = 0”, and the even-numbered scanning line Gx is connected to the x−1th column, and the even-numbered data line is connected to the even-numbered data line. The sub-pixel to which the scanning line Gx is connected to the x-th column is connected to an odd number of data lines. Further, in FIGS. 9 to 11 where “u = 0”, the odd-numbered scanning line Gx is connected to the x−1th column, the sub-pixel is connected to the odd-numbered data line, and the odd-numbered scanning line Gx is the xth column. The subpixels connected to are connected to even data lines. Further, for example, in the arrangement pattern 4 shown in FIG. 15, “u = 1”, and the even-numbered scanning line Gx is connected to the x−1th column, and the sub-pixels are connected to the odd-numbered data lines. The sub-pixel where Gx is connected to the x-th column is connected to an even number of data lines. Further, in FIG. 15 where “u = 1”, the odd-numbered scanning line Gx is connected to the x−1th column, the sub-pixel is connected to the even-numbered data line, and the odd-numbered scanning line Gx is connected to the xth column. The sub-pixel is connected to an odd number of data lines. When the above relation is used in FIG. 23 and an arbitrary natural number q is used, the column number of the input image data corresponding to the scanning line Gx (q) is determined by q as shown in FIG.

  Up to now, FIGS. 21 and 22 show the relationship between the viewpoint, row number, and color of the input image data corresponding to the upward / downward subpixel connected to the arbitrary data line. FIG. 24 shows the arbitrary scanning line. And the column number of the input image data. Therefore, the composite image data CM can be generated if the sub-pixel connected to the arbitrary data line Dy and the scanning line Gx is either the upward sub-pixel or the downward sub-pixel. That is, arrangement pattern information is required.

  As described above, the display unit according to the present embodiment uses the upper and lower subpixel pairs as structural units, and the upper and lower subpixel pairs P2R shown in FIG. 5, the upper and lower subpixel pairs P2L shown in FIG. 6, or the upper and lower subpixel pairs. It is configured by a combination of P2R and upper and lower subpixel pairs P2L. Therefore, as information on the arrangement pattern, it is only necessary to store which of the upper and lower subpixel pairs connected to the arbitrary data line Dy and the arbitrary scanning line Gx is P2R / P2L.

  FIG. 25 shows the upper and lower subpixel pairs P2R / P2L connected to the data line Dy and the scanning line Gx in the arrangement pattern 3 shown in FIG. In FIG. 25, the upper and lower sub-pixel pair P2R is set to “0”, the upper and lower sub-pixel pair P2L is set to “1”, and the x mark indicates that there is no connected upper and lower sub-pixel pair. For this reason, the value indicated by the x mark, for example, the value of (D1, G1) may be either “0” / “1”. Then, FIG. 25 shows a repeating pattern in units of four data lines and in units of four gate lines.

  FIG. 26 shows the pattern of the upper and lower sub-pixel pairs P2R / P2L in the array pattern 3 while paying attention to the repetition described above. In FIG. 26, the upper and lower subpixel pairs P2R / P2L of the array patterns 1 and 4 and the array pattern 2 are expressed using the lower bits when Dy and Gx are binary numbers, and also expressed using the lower 2 bits. Indicates a pattern. As shown in FIG. 26, the connection relationship between the data line Dy and the scanning line Gx according to the arrangement pattern and the upper and lower subpixel pairs is a lookup table LUT that returns a value of “0” / “1” with Dy and Gx as variables. Remember. From this, it is possible to determine whether the upper and lower sub-pixel pairs connected from the LUT (Dy, Gx) are P2R or P2L for an arbitrary data line Dy and an arbitrary scanning line Gx.

  When the LUT (Dy, Gx) illustrated in FIG. 26 is combined with the even / odd of the scanning line and the data line, the orientation of the sub-pixel connected to the arbitrary scanning line and the data line is determined as shown in FIG. When the relationship shown in FIG. 27 is used in FIG. 22 and the upward and downward pixels shown in FIG. 22 are replaced with LUT (Dy, Gx) and even / odd of the scanning line, the relationship shown in FIG. 28 is obtained.

  As described above, the composite image data CM can be generated from the information illustrated in FIGS. 21 and 26 and the regularity illustrated in FIGS. 24 and 28.

  FIG. 29 summarizes a specific example (array pattern 3) of parameter variables and variable contents necessary for generating the composite image data. At least one parameter set illustrated in FIG. 29 is stored in the parameter storage unit 140 shown in FIG. 1 and used for generating composite image data. In this way, by storing the parameters necessary for generating the composite image data, it is possible to cope with the design change of the display unit by changing the parameters. If a plurality of parameters are stored, the parameters can be switched and used in accordance with the change of the display module to be driven, and the man-hour for changing the parameters can be reduced.

[Description of operation]
The operation of this embodiment will be described with reference to the drawings. 30 to 39 are flowcharts showing an example of the display operation in the display device of the present embodiment.

[Step S1000]
As shown in FIG. 30, when the operation of the display device of this embodiment is started, various parameters necessary for generating a composite image are read from the parameter storage unit 140 shown in FIG. The viewpoint v1 of the input image data corresponding to the odd-numbered data line, the viewpoint v2 of the input image data corresponding to the even-numbered data line, C1, C2, and C3 indicating the color arrangement order in units of rows by the color filter, and the sub-pixels of the display unit 50 The number n of rows and the number m of columns, u indicating the orientation of the sub-pixel arranged in the first row and first column of the display unit 50, and the LUT indicating the arrangement pattern of the upper and lower sub-pixel pairs constituting the display unit 50 Is set in the read control means 130.

[Step S2000]
Input image data having viewpoint images M1 and M2 composed of pixel data of i rows and j columns and a synchronization signal are input to the writing control means 110 from the outside. The write control means 110 uses the synchronization signal to input pixels from M1 (1,1) RGB to M1 (i, j) RGB and M2 (1,1) RGB to M2 (i, j) RGB. Addresses are sequentially generated in the data and stored in the image memory 120. Therefore, from the input image data stored in the image memory 120, any viewpoint image M1 / M2, position (row Iy, column Ix), and color (R / G / B) luminance data can be selected by address designation. it can. That is, data reading is performed via the address assigned by the writing control unit 110. However, since it is only necessary to identify the viewpoint image, position, and color luminance data of the input image data, a specific address map in the memory will be described. Omit. The image memory 120 has a data storage area for at least two screens of composite image data to be output, and alternately uses a read screen area and a write screen area.

[Step S3000]
The input image data (viewpoint images M1, M2) stored in the image memory 120 shown in FIG. 1 is read by the read control unit 130 according to a predetermined pattern, rearranged, and synthesized image data CM is generated to generate the display panel 20. To the data line driving circuit 80. The operation of the composite image output process will be described separately with reference to the flowchart shown in FIG.

[Step S8000]
When the read rearrangement process is completed, the display operation for one frame is completed. Returning to step S2000, the above operation is repeated.

  In FIG. 30, for convenience of explanation of the operation, the input image data writing process (step S2000) and the reading rearrangement process (step S3000) are sequentially described. As described in step S1100, the image memory 120 has an area for two screens. Actually, the writing process of a certain frame Fn and the reading rearrangement of the frame Fn-1 already written in the image memory are performed. Processing is performed in parallel.

  Next, the operation of the composite image output process will be described with reference to FIG. FIG. 31 is a flowchart showing the processing contents of step S3000 in FIG. 30, and mainly shows a counting process for one frame in units of scanning lines.

[Step S3100]
The variable Gx, q, t is given 1 as an initial value. Gx is a variable for counting scanning lines, and the counted value corresponds to the scanning line selected on the display panel. t is a variable for counting even / odd scan lines, that is, two scan line cycles. As shown in FIG. 24, q is a variable used for designating the column number Ix of the input image data, and is incremented by 1 every time t is counted 2 times.

[Step S4000]
Composite image data for one line corresponding to the scanning line Gx of the display panel is output. The operation of the line data output process will be described separately with reference to the flowchart shown in FIG.

[Step S7100]
It is determined whether the count value of Gx has reached the last scanning line Gm + 1 of the display unit. The determination uses the column number m of the display unit set in step S1000 shown in FIG. 30. If m + 1 has not been reached, the process proceeds to step S7200 with determination Yes. If it is m + 1, the process of FIG. 31 is ended with determination No, and the process proceeds to step S8000 of FIG.

[Step S7200]
1 is added to each of the count values of t and Gx in accordance with the horizontal synchronization signal from the timing control means 150 shown in FIG.

[Step S7300]
Judgment is made based on the count value of t. If t is greater than 2, the process proceeds to step S7400 with a determination Yes. If t is 2 or less, the process proceeds to step S4000 with a determination No.

[Step S7400]
The count value of t is returned to 1, 1 is added to the count value of q, and the process proceeds to step S4000.

  Next, the operation of the line data output process will be described with reference to FIG. FIG. 32 is a flowchart showing the processing contents of step S4000 in FIG. 31, and mainly shows the counting process for one scanning line in units of data lines.

[Step S4100]
1 is given as an initial value to the variables Dy, p, and s. Dy is a variable for counting data lines. s is a variable for counting the period of six data lines shown in FIG. As shown in FIGS. 22 and 28, p is a variable used for designating the line number Iy of the input image data, and is incremented by 1 every time s counts six times.

[Step S5000]
The input image data corresponding to the scanning line Gx and the data line Dy is read from the image memory 120, the input image data is rearranged in the data order corresponding to the display panel, and stored in the line memory L in the order of the Dy count value. The operation of the read rearrangement process will be described separately with reference to the flowchart shown in FIG.

[Step S6000]
It is determined whether the count value of Dy has reached the total number of data lines Dn + 1 of the display unit. The determination uses the number of rows n of the display unit set in step S1000 shown in FIG. 30. If it has not reached n + 1, the determination proceeds to step S6100 with determination Yes. If the count value of Dy is n + 1, the process proceeds to step S7000 with a determination No.

[Step S6100]
1 is added to each of the count values of s and Dy according to a signal from the timing control means 150 shown in FIG.

[Step S6200]
The determination is made based on the count value of s. If s is greater than 6, the process proceeds to step S6300 with a determination Yes. If s is 6 or less, the process proceeds to step S5000 with a determination No.

[Step S6300]
The count value of s is returned to 1, 1 is added to the count value of p, and the process proceeds to step S5000.

[Step S7000]
The composite image data CM (Gx) for one line of the scanning line Gx stored in the storage L in the line memory is supplied to the data line driving circuit 80 shown in FIG. Is output in synchronization with the control signal 81. In step S7000, the line data output process ends, and the process proceeds to step 7100 shown in FIG. It should be noted that although the operation has been described when the processing ends after the processing of step S7000 and proceeds to step 7100 in FIG. 31, this is for convenience of explanation, and the output processing of the composite image data CM (GX) in step S7000 and the processing in FIG. The processing after step 7100 may be performed in parallel.

  Next, the operation of the read rearrangement process will be described with reference to FIG. FIG. 33 is a flowchart showing the processing contents of step S5000 of FIG. 32, and mainly shows branch processing for the count value s of the cycle of six data lines.

[Steps S5010 to S5050]
Branch processing according to the count value s. If s = 1, go to step S5100, if s = 2, go to step S5200, if s = 3, go to step S5300, and if s = 4, go to step S5400. If s = 5, the process proceeds to step S5500, and if s is a value other than the above (s = 6), the process proceeds to step S5600.

[Steps S5100 to S5600]
In accordance with the count value s, pixel data corresponding to the sub-pixel connected to the display panel (Dy, Gx) is designated from the input image data in the image memory. The operation of the input data specifying process is separately shown in FIGS. 34 to 39, respectively. By the input data specifying process, the viewpoint number k, row number Iy, column number Ix, and color CL of the input image data corresponding to the data line Dy and the scanning line Gx are determined.

[Step S5700]
It is determined whether or not the row number Iy and the column number Ix of the designated input image data are sub-pixels that do not exist in the display unit. For the determination, the number of rows n and the number of columns m of the display unit set in step S1000 shown in FIG. 30 are used. In any of the conditions Ix = 0, Ix = m / 2 + 1, Iy = 0, or Iy = n / 3 + 1, there is no subpixel corresponding to the display unit. Therefore, if any of the above conditions is met, the process proceeds to step S5710 with a determination Yes. If none of the above conditions is met, the process proceeds to step S5720 with a determination No.

[Step S5710]
This is processing when there is no sub-pixel corresponding to the display unit in the row number Iy and column number Ix of the designated input image data. Therefore, although not reflected in the display, z is output as the data PD of the data line Dy in the scanning line Gx. z is 0 as an example.

[Step S5720]
The corresponding address of the image memory is designated based on the viewpoint number k, row number Iy, column number Ix, and color CL of the designated input image data. The data PD = M (k) (Iy, Ix) (CL) of the data line Dy in the scanning line Gx is read from the image memory by the address designation.

[Step S5800]
The data PD of the data line Dy in the scanning line Gx is stored in the line buffer L that stores data for one scanning line. When the data PD is stored in the line buffer, the read rearrangement process is terminated, and the process proceeds to step S6000 shown in FIG. 32, where the data to the line buffer L for all the data lines (n + 1) connected to the scanning line Gx. It is determined whether or not the storage process has been completed.

  Next, the operation of the input data specifying process will be described with reference to FIGS. FIG. 34 shows a process of designating the viewpoint number k, row number Iy, column number Ix, and color CL of the input image data when the count value s indicating the counting process in FIG. For the specification, parameters v1, v2, C1, C2, C3, u, LUT read in step S1000 shown in FIG. 30, and variables Gx, q, t showing the counting process in FIG. 31, and FIG. The variables Dy and p indicating the counting process are used for.

[Step S5110]
It is determined whether the upper and lower subpixel pairs connected to the scanning line Gx and the data line Dy are P2L or P2R. As an example of the determination condition, LUT (Dy, Gx) = 0 is used as an example. If the determination is Yes (upper and lower subpixel pairs are P2R), the process proceeds to step S5111, and if the determination is No (upper and lower subpixel pairs are P2L), the process proceeds to step S5112. .

[Steps S5111, S5112]
The even / odd of the scanning line Gx is determined. As an example of the determination condition, t = 1 where the scanning line Gx is an odd number is used. The even and odd numbers of the scanning lines are related to the designation of the column number Ix as shown in FIG. 24, and are related to the designation of the row number Iy and the color CL as shown in FIG. In the determination Yes (the scan line is an odd number), the process proceeds from step S5111 to step S5121, and from step S5112, the process proceeds to step S5122, and the determination process of u is performed to specify the column number Ix. On the other hand, in the determination No., the scanning lines are even numbers. In this case, as shown in FIG. 24, the column number Ix does not depend on u. Therefore, in the determination No, the process proceeds from step S5111 to step S5133, and from step S5112, the process proceeds to step S5132, and the column number Ix is designated. Here, as shown in FIG. 28, since the designation of the row number Iy and the color CL by the LUT value is interchanged due to even / odd scan lines, the processing flows intersect as shown in FIG.

[Steps S5121, S5122]
In order to specify the column number Ix according to FIG. 24, it is determined whether the sub-pixel in the first row and first column of the display unit is an upward pixel or a downward pixel. U = 0 is used as the determination condition. In determination Yes (upward pixel), the process proceeds from step S5121 to step S5131, and from step S5122, the process proceeds to step S5133. On the other hand, in the determination No, the process proceeds from step S5121 to step S5132, and from step S5122, the process proceeds to step S5134.

[Steps S5131, S5134]
Each of them specifies the column number Iy of the input image data using q. Since s = 1, the number of data lines is an odd number, and the column number Iy is determined by the conditional branch and FIG. The process proceeds from step S5131, S5132 to step S5141, and from step S5133, S5134 to step S5142.

[Steps S5141, S5142]
The viewpoint number k, line number Ix, and color CL of the input image data are designated by the relationship shown in FIG. Note that s = 1 corresponds to the data line 6p-5 in FIG. The line number Ix is specified using p. The viewpoint number k and the color CL are specified by the parameters selected as shown in steps S5141 and S5142 from the parameters read in step S1000 shown in FIG. As described above, the viewpoint number k, the row number Iy, the column number Ix, and the color CL of the input image data are specified, the input data specifying process ends, and the process proceeds to step S5770 shown in FIG.

  FIG. 35 shows processing for designating the viewpoint number k, row number Iy, column number Ix, and color CL of the input image data when the count value s indicating the counting processing in FIG. As shown in FIG. 35, the processing flow is the same as in the case of s = 1, although the parameters to be selected as the viewpoint number k and the color CL and the designation of the line number Ix are different from those in FIG. However, when s is 2, since the data line is an even number, the designation of the column number Iy is different from that in FIG. 34 as shown in FIG. Therefore, u = 1 is used as a determination condition for determining whether the sub-pixel in the first row and first column of the display unit is an upward pixel or a downward pixel, unlike FIG.

  Similarly, in FIG. 36, when the count value s is 3, FIG. 37 is when the count value s is 4, FIG. 38 is when the count value s is 5, and FIG. 5 is a flowchart showing processing for designating a viewpoint number k, a row number Iy, a column number Ix, and a color CL. Since the processing flow is the same as in the case of s = 1, description of the operation is omitted.

  As described above, the composite image data corresponding to the display module is generated from the input image data input from the outside to the display device of the present embodiment by the processing described with reference to FIGS. Is possible. Note that the processing described is an example of the present embodiment, and the present invention is not limited to this. For example, the order of branch processing performed to specify the viewpoint number k, row number Iy, column number Ix, and color CL of the input image data written in the image memory is not limited to that shown in FIGS. The designation result of the input data designation process may be the same as that shown in FIGS. Also, for example, in FIG. 33, a sub-pixel that does not exist in the display unit is determined, and z = 0 is given as data PD. However, the data given as z is invalid because it does not contribute to display because there is no subpixel in the display unit. Therefore, when there is a sufficient capacity of the image memory, the determination process itself may be omitted, an invalid data address may be set, and the memory read process may be performed. In this case, steps S5700 and S5710 in FIG. 33 can be omitted, and the memory read process in step S5720 can be performed. Therefore, although the image memory increases, the process can be reduced.

  The configuration and operation of the first embodiment of the present invention have been described above.

  FIG. 40A is a block diagram of an example terminal device to which the display device of this embodiment is applied. A terminal device 300A illustrated in FIG. 40A includes an input device 301, a storage device 302, a computing unit 303, an external interface 304, the display device 305A of the present embodiment, and the like. As described above, since the display device 305A includes the display controller 100, data for two images may be sent in a format in which image data is sent from the computing unit 303 to a general display device. The two pieces of image data may be image data that is displayed in a plane on a general display panel. That is, since the display device 305A of the present embodiment includes the display controller 100, the computing unit 303 does not need to perform special processing associated with the transfer for the two image data to be output, and the computing unit 303 is burdened. There is an effect that does not apply. In addition, since the display controller 100 of the present embodiment includes the image memory 120 (FIG. 1), the two image data output from the computing unit 303 are in a format arranged in the horizontal direction showing the image in FIG. 40, a so-called side-by-side format. The format is not limited to the above, and may be a format arranged in the vertical direction or a frame time-division format.

  In the terminal device to which the present invention is applied, the display controller is not limited to the configuration mounted on the display device as in the example of FIG. 40A. For example, the display controller is not a display device but an arithmetic unit. It may be mounted on a circuit board on which 303 is mounted.

  Alternatively, as in a terminal device 300B illustrated in FIG. 40B, a processing procedure of the display controller may be programmed and the display controller 100 may be provided in the arithmetic unit 303.

  Further, in the terminal device to which the present invention illustrated in FIGS. 40A and 40B is applied, the display controller 100 is changed even when the display module A is changed to the display module B (not shown). It is possible to respond. The display module 200B (not shown) is different from the display module 200A in, for example, installation of image separating means, order of color filters, arrangement pattern of upper and lower subpixel pairs, and the like. The specifications of these display modules are determined by various elements required from the terminal device to be mounted, for example, image quality, cost, size, resolution, and the like. Since the display controller 100 according to the present invention includes the parameter storage unit 140 (FIG. 1), the display module can be changed by rewriting parameters or selecting parameters, and the same display controller 100 can be used. For this reason, it is possible to reduce the design man-hours and cost of the display device and the terminal device.

  In the present embodiment, the stereoscopic display device that provides separate images to both eyes of the observer by the image separation unit is shown as an example. However, a two-viewpoint display device that provides different images depending on the observation position may be used. Good.

  In the present embodiment, the lenticular lens is used as the optical image separation unit and the lenticular lens is arranged on the viewer side of the display panel. However, the lenticular lens may be arranged on the opposite side of the viewer. Further, for example, a parallax barrier may be applied as the optical image separation means. Furthermore, a substrate on which a polarizing element corresponding to each of the sub-pixels that display the viewpoint images M1 and M2 is arranged on the display panel so that the light emitted from the sub-pixel has a different polarization state for each viewpoint image, The present invention may be applied to a glasses-type stereoscopic display device.

  The structure of the sub-pixel 40 (FIG. 1) is not limited to the first example shown in FIGS. 3 to 6 (hereinafter referred to as “first sub-pixel” and “first upper and lower sub-pixel pair”), for example. Application of the second example shown in FIGS. 41 and 42 (hereinafter referred to as “second sub-pixel” and “second upper and lower sub-pixel pair”) is also possible. 41 is a diagram showing the structure and equivalent circuit of the second upper and lower subpixel pair P2R, and FIG. 42 is a diagram showing the structure and equivalent circuit of the second upper and lower subpixel pair P2L. In the structure diagram, the size and scale of each component are appropriately changed and described in order to ensure the visibility of the diagram.

  In the second subpixel shown in FIGS. 41 and 42, the difference from the first subpixel is the arrangement of the storage capacitor line CS. In the second subpixel, the storage capacitor line CSx is formed in the same metal layer as the scanning line. Therefore, the electrode on the opposite side of the semiconductor layer 43 among the electrodes forming the storage capacitor 44 and the storage capacitor line CSx can be formed of the same metal film. Further, by arranging the storage capacitor line CSx between the scan lines and perpendicular to the data lines, the contact hole 48 (FIG. 5 and the like) necessary for the first subpixel can be eliminated. . In the second sub-pixel, by reducing the contact hole, the sub-pixel can be miniaturized and the display portion can be increased in resolution.

  In the first subpixel, as shown in FIG. 5 and the like, the storage capacitor line CS connects the storage capacitors 44 of the subpixels arranged in the horizontal direction. On the other hand, in the second subpixel, as shown in FIGS. 41 and 42, the storage capacitor line CSx connects the storage capacitors 44 of the subpixels arranged in the vertical direction. For this reason, in the second sub-pixel, when the liquid crystal panel is driven to invert the polarity, it is necessary to pay attention to the storage capacitor line connected in units of columns and the polarity of the voltage written to the sub-pixel.

  For example, when dot inversion driving is applied to the array pattern 3 shown in FIG. 14, when an arbitrary scanning line (for example, Gx + 1 (FIG. 41 (3), FIG. 42 (3))) is selected, the column unit That is, the polarities written in the sub-pixels are aligned in units of storage capacitor lines (for example, CSx and CSx + 1, respectively). As described above, when the writing polarity of the sub-pixel connected to the storage capacitor line is aligned at the timing of gate selection, the potential variation of the storage capacitor line caused by the write voltage is also aligned. For this reason, crosstalk occurs in the extending direction of the storage capacitor line, and the display image quality is deteriorated.

  Therefore, when the second subpixel shown in FIGS. 41 and 42 is used, it is preferable to apply 2-dot inversion driving to the polarity inversion driving method. FIG. 43 shows the polarity distribution of the display unit and the data line polarity for each scanning line of 2-dot inversion when 2-dot inversion driving is applied to the array pattern 2 shown in FIG. “+” And “−” in the figure indicate the polarity as in FIG. As shown in FIG. 43, the 2-dot inversion driving is a driving method in which the polarity is inverted every two data lines and the polarity of the data lines is inverted every selection period of one scanning line. In this case, when an arbitrary scanning line Gx + 1 is selected, the polarities of the sub-pixels to which writing is performed are different for each column x and column x + 1. In other words, there are both positive and negative writing polarities of the sub-pixel connected to the storage capacitor line at the timing of gate selection. For this reason, the potential fluctuation of the storage capacitor line caused by the write voltage is canceled and uniformed, so that there is an effect of suppressing the occurrence of crosstalk in the extending direction of the storage capacitor line.

  In the polarity distribution of FIG. 43, the polarities are aligned in units of rows. For this reason, it is possible to obtain the same flicker suppressing effect as when a general panel is driven by gate line inversion driving (1H inversion driving). Further, when the second sub-pixel structure shown in FIGS. 41 and 42 is used, a general panel is driven by dot inversion by applying 2-dot inversion driving using the array pattern 6 shown in FIG. The same flicker suppression effect as the case can be obtained. FIG. 45 shows the polarity distribution of the display unit when 2-dot inversion driving is applied to the array pattern 6 shown in FIG.

  Note that the polarity inversion driving method in the case of using the second sub-pixel shown in FIGS. 41 and 42 is not limited to the above-described 2-dot inversion driving, and application of 3-dot inversion driving (pixel inversion driving) or the like. Is also possible.

  Moreover, the display panel in this embodiment was demonstrated as what is a liquid crystal display panel using a liquid crystal molecule. As the liquid crystal display panel, not only a transmissive liquid crystal display panel, but also a reflective liquid crystal display panel, a transflective liquid crystal display panel, a slightly reflective liquid crystal display panel having a transmissive area ratio larger than a reflective area, and a reflective liquid crystal display panel. The present invention can also be applied to a micro-transmission type liquid crystal display panel having a large area ratio. Further, the driving method of the display panel can be suitably applied to the TFT method.

  TFTs in the TFT system are suitable not only for those using amorphous silicon, low temperature polysilicon, high temperature polysilicon, single crystal silicon, but also for organic materials such as pentacene, metal oxides such as zinc oxide, and those using carbon nanotubes. Applicable. The present invention does not depend on the structure of the TFT. A bottom gate type, a top gate type, a staggered type, an inverted staggered type, or the like can be suitably used.

  In the present embodiment, the upper and lower subpixel pairs have been described with the subpixel shape being substantially trapezoidal. The trapezoidal shape is not limited as long as the optical characteristics of the upper and lower subpixel pairs and the connection relationship with the scanning line and the data line are maintained. Even other polygonal shapes are applicable. For example, if the upper side of the trapezoid described in the present embodiment is shortened, a triangular shape is obtained. Furthermore, if the upward subpixel and the downward subpixel are 180 degrees rotationally symmetric, a hexagonal shape, an octagonal shape, or the like in which the scanning line is bent can be applied.

  Further, the display panel can be applied other than the liquid crystal method. For example, an organic electroluminescence display panel, an inorganic electroluminescence display panel, a plasma display panel, a field emission display panel, or PALC (Plasma Address Liquid Crystal) can be applied.

(Second Embodiment)
A configuration of the display device according to the second embodiment of the present invention will be described. This is a display device that provides different images to a plurality of N viewpoints, and the first embodiment is a display device with N = 2, whereas N is 3 or more. The second embodiment will be described below by taking as an example a stereoscopic display device that provides different images for four viewpoints where N = 4.

  First, the outline of the second embodiment will be described with reference to FIG. The display controller 101 of this embodiment further includes input data rearranging means 160 that rearranges viewpoint image data of three or more viewpoints input from the outside into two image data. Hereinafter, the two image data rearranged by the input data rearranging unit 160 will be referred to as two input composite data.

  The writing control unit 110 has a function of writing the two input composite data rearranged by the input data rearranging unit 160 in the image memory 120 instead of the viewpoint image input from the outside. The two input composite data correspond to the viewpoint images M1 and M2 of the input image data in the first embodiment. Hereinafter, the second embodiment will be described in detail.

  The display unit in the second embodiment is composed of upper and lower subpixel pairs whose structures and equivalent circuits are shown in FIGS. Therefore, the description of the upper and lower subpixel pairs is the same as that in the first embodiment, and is omitted.

  FIG. 47 is an example showing the relationship between the image separating means and the display unit in the second embodiment. In the XY axes in the figure, X indicates the horizontal direction and Y indicates the vertical direction. Trapezoids arranged in 12 rows in the vertical direction and 12 columns in the horizontal direction represent the sub-pixels, and the shaded area indicates the color, and the color arrangement pattern repeats in order of R, G, and B for each row from the first row. Yes. The image separating means is arranged such that the cylindrical lens 30a constituting the lenticular lens 30 corresponds to the sub-pixel four-row unit, and the longitudinal direction is parallel to the vertical direction so as to have a lens effect in the horizontal direction. Due to the lens effect of the cylindrical lens 30a, the light rays emitted from the sub-pixels are separated in four columns in different directions in units of columns, and four viewpoint images are formed at positions away from the lens surface. Each of the four viewpoint images is composed of three RGB sub-pixels arranged in the vertical direction in units of columns. FIG. 47 shows an example of each of the first viewpoint image pixels as M1P, the second viewpoint image pixel as M2P, the third viewpoint image pixel as MP3, and the fourth viewpoint image as MP4.

  FIG. 48 is an optical model in which light rays emitted from the pixels M1P to MP4 for each viewpoint image form each viewpoint image. As shown in FIG. 48, the lenticular lens 30 is arranged on the viewer side of the display panel. Further, on the plane that is a distance OD away from the lens surface, the projected images from all M1Ps of the display unit overlap, and similarly M2P, Projected elephants from M3P and M4P overlap and are arranged so that the width of the projected elephant overlap is maximum in the X direction. With this arrangement, regions of a first viewpoint image, a second viewpoint image, a third viewpoint image, and a fourth viewpoint image are formed in order from the left in the horizontal direction when viewed from the observer.

  Next, a connection relationship between the sub-pixel illustrated in FIG. 47, the scan line, and the data line will be described. FIG. 49 shows an example in which the display unit of the second embodiment shown in FIG. 47 is composed of upper and lower subpixel pairs P2R and P2L. As shown in FIG. 49, the combination of the upper and lower subpixel pairs P2L / P2R of the array pattern 5 is the same as the array pattern 3 shown in FIG. 11 from the first column to the fourth column of the display unit. In the fifth to eighth columns, the upper and lower subpixel pairs P2R and the upper and lower subpixel pairs P2L are interchanged with respect to the arrangement pattern 3. Further, the ninth to twelfth columns of the display unit are the same as the arrangement pattern 3. That is, the array pattern 5 is an array pattern in which the array pattern 3 and a pattern in which the upper and lower sub-pixel pairs P2R and the upper and lower sub-pixel pairs P2L are switched with respect to the array pattern 3 are repeated every four columns. The arrangement pattern 5 has an effect of suppressing flicker and an effect of suppressing abnormal alignment of liquid crystal molecules when the dot inversion driving method is applied to the polarity inversion driving method.

  FIG. 50 shows the polarity distribution of the display unit and the data line polarity for each scanning line for dot inversion when dot inversion driving is applied to the array pattern 5 shown in FIG. As described with reference to FIG. 47, in the second embodiment, each viewpoint image is provided in a cycle of four columns. Therefore, as shown in FIG. 49, in accordance with the periodicity of the viewpoint image, the upper and lower subpixel pairs P2R and P2L in the arrangement pattern 3 (FIG. 11) are exchanged in a period of four columns, and dot inversion driving is applied. Then, in each of the separated viewpoint images of the first viewpoint image to the fourth viewpoint image, the polarity of the subpixels adjacent in the horizontal direction is inverted, and the polarity is inverted every two rows of subpixels in the vertical direction. . That is, it is possible to obtain the same flicker suppressing effect as when a general panel is driven by inverting two vertical dots. Further, the polarity distribution of the array pattern 5 is such that the long sides of the pixel electrodes represented by trapezoids have the same polarity, so that abnormal alignment of liquid crystal molecules in the vicinity of adjacent long sides can be suppressed, and high image quality can be achieved.

  Next, the composite image data provided to the display unit of the second embodiment will be described using an example in which the display unit is the array pattern 5 (FIG. 49). FIG. 51 shows image data for four viewpoints input from the outside to the display controller 101. The first viewpoint image data to the fourth viewpoint image data, which are input image data, are composed of pixel data arranged in i rows and j columns (i = 4, j = 3), and pixel data Mk (Iy, Ix). In each of the RGB codes, k represents a viewpoint number, Iy is a row number in the image, Ix is a column number in the image, and RGB has luminance information of each color of R: red, G: green, and B: blue. Means that.

  When the input image data shown in FIG. 51 is displayed in the array pattern 5 shown in FIG. 49, the composite image data 5 given to the display module is shown in FIG. The composite image data 5 uses the input data rearranging means 160 shown in FIG. 46, and, as will be described below, the setting parameters of the color separation setting parameters and the arrangement pattern of the image separation means and the color filter as in the first embodiment. Based on the parameters and the array (LUT) of the upper and lower sub-pixel pairs, it can be generated from the regularity of the data line unit and the scanning line unit. FIG. 53 shows an LUT (Dy, Gx) that is a pattern of upper and lower subpixel pairs P2R / P2L that connects an arbitrary data line Dy and an arbitrary scanning line Gx of the array pattern 5.

  The input data rearranging means 160 rearranges image data for N viewpoints input from the outside into two input composite data M1 'and M2' corresponding to the odd and even columns of the display unit in units of columns. In the arrangement of the image separating means on the display unit shown in FIGS. 47 and 48, input composite data M1 ′ and M2 ′ generated from the input image data for four viewpoints (N = 4) shown in FIG. 51 are shown in FIG. Show. As shown in FIG. 54, in order to perform column-by-column rearrangement, the same row number Iy corresponds to the arbitrary row number Iy of the input image data and the row number of the input composite data to be generated. However, since the column number of the input composite data is different from the arbitrary column number Ix of the input image data, the column number of the input composite image data is represented as Ix ′.

  In the first embodiment, the two viewpoint images M1 and M2 of the input image data are displayed separately in an even column and an odd column of the display unit. Therefore, as described above, the input composite data M1 ′ and M2 ′ generated by the rearrangement process corresponding to the even-numbered columns and the odd-numbered columns of the display unit are sent to the write control unit 110, and thus described in the first embodiment. The composite image data can be generated by a process similar to the process. However, in order to generate input composite data by associating image data for N viewpoints input from the outside with the even and odd columns of the display unit, the column number of the display unit and the viewpoint number of the input image data Information is needed.

  FIG. 55 shows the relationship between the column number x of the display unit, the viewpoint images M1 to M2 of the input image data, and the input composite data M1 ′ and M2 ′ in the relationship between the image separating means and the display unit shown in FIG. It is an example shown. The column number and viewpoint image Mk are related to the arrangement of the image separation means and the number of viewpoints, and are determined by the design of the display module. For example, as shown in FIG. 48, the image separating means arranged on the viewer side of the display panel can be arranged in relation to the display unit shown in FIG. In this case, as in FIG. 48, in order to form the first viewpoint image, the second viewpoint image, the third viewpoint image, and the fourth viewpoint image in order from the left in the horizontal direction as viewed from the observer, FIG. As shown in FIG. 2, the sub-pixels in the first column (x = 1) of the display unit correspond to M2, where x = 2 is M1, x = 3 is M4, x = 4 is M3, x = 5 is a relationship corresponding to M2,.

  Further, even if the positional relationship between the image separating means and the display unit is the same as in FIG. 55, unlike FIG. 48, when the image separating means is arranged on the opposite side of the display panel from the observer, the column number x = 1 is M1, x = 2 is M2, x = 3 is M3, x = 4 is M4, and so on. Further, if the number of viewpoints of the display module is changed, the correspondence between the column number x and the viewpoint number is different from that in FIG.

  As described above, in order to perform the input rearrangement process, it is necessary to store the relationship between the column number x of the display unit and the viewpoint number k in the display controller. As an example, FIG. 57 shows a table TM (N, op, x) indicating the value of the viewpoint number k in accordance with the column number x of the display unit. The table TM illustrated in FIG. 57 uses parameters N and op to correspond to a plurality of display modules. N represents the number of viewpoints, and op corresponds to the difference in the arrangement of the image separation means as shown in FIGS. As shown in FIG. 57, the table TM does not store the viewpoint k for all the m columns constituting the display unit, but compresses the information amount by storing it according to the repetition pattern of the viewpoint numbers with respect to the column numbers. Is possible. Further, the parameters N and op may be appropriately determined according to the design of the display controller, and the information amount of the table TM can be compressed by limiting the types. The table TM may be stored in the parameter storage unit 141 shown in FIG.

  Since the viewpoint number k of the input image data corresponding to the arbitrary column x of the display unit is obtained by the table TM, the input composite data M1 ′, M2 ′ can be generated. In the example of FIG. 55, input composite data M1 'is associated with an even number column of the display unit, and input composite data M2' is associated with an odd number column of the display unit. However, conversely, the input composite data M2 'may correspond to the even columns of the display unit, and the input composite data M1' may correspond to the odd columns of the display unit. However, the correspondence relationship between the input composite data M1 'and M2' and the even / odd column of the display unit is related to the viewpoint v1 of the odd data line and the viewpoint v2 of the even data line used in the read control unit 131. That is, as described with reference to FIG. 21 of the first embodiment, the values of the viewpoints v1 and v2 are determined together with the direction “u” of the sub-pixel in the first row and first column of the display unit. FIG. 58 summarizes the relationship between the input composite data M1 'and M2' and the even / odd of the data line.

  Also in the second embodiment, in order to generate the composite image data, the parameter variables shown in FIG. 29 are required in addition to the table TM as in the first embodiment. The table TM including the number of viewpoints (N) and the parameters shown in FIG. 29 are stored in the parameter storage unit 141 and used for generating the composite image data.

[Description of operation]
An example of the operation of the second embodiment will be described with reference to a flowchart. In addition, the process similar to 1st Embodiment is demonstrated using the same drawing and code | symbol. FIG. 59 is a flowchart showing an outline of the operation of the second embodiment.

[Step S21000]
As shown in FIG. 59, when the operation is started, the table TM necessary for generating the input composite data and various parameters necessary for generating the composite image are obtained from the parameter storage unit 141 shown in FIG. Is read. The viewpoint v1 indicates input composite data corresponding to the odd data lines, and the viewpoint v2 indicates input composite data corresponding to the even data lines. Other parameters are the same as those in the first embodiment, and thus the description thereof is omitted.

[Step S22000]
From the outside, the image data N viewpoints composed of pixel data of i rows and j columns and the synchronization signal are input to the input data rearranging means 160 shown in FIG. The input image data for N viewpoints are rearranged into two input composite data M1 ′ and M2 ′ corresponding to the odd and even columns of the display unit in units of columns, and output to the writing control means 110. The operation of the input data rearrangement process will be described separately with reference to the flowchart shown in FIG.

[Steps S2000, S3000, S8000]
Regarding the image input writing process and the composite image output process, the viewpoint images M1 and M2 of the input image data are replaced with the input composite data M1 ′ and M2 ′ in the reference numerals shown in the flowchart of the first embodiment, and the input image data This is a process in which the column Ix is replaced with the column Ix ′ of the input composite data. Refer to the first embodiment for the flowchart and operation description.

  Next, the operation of the input data rearrangement process will be described with reference to FIG. In the rearrangement process, the column number x of the display unit is counted, and the corresponding pixel data is read from the input buffer by a process using the table TM as a reference and the count value x as a reference. When the rearrangement process for one line of the input composite data is completed, the count value x is returned to 1. The same processing is performed over i rows of input image data.

[Step S22100]
Image data for N viewpoints input from the outside is stored in the input buffer using a synchronization signal input from the outside. As the data stored in the input buffer, arbitrary viewpoint number k, position (row Iy, column Ix), and color (R / G / B) luminance data can be selected in units of pixel data. The input buffer does not depend on the transfer format of the input image data for N viewpoints as long as it has a data capacity capable of storing all the input image data for N viewpoints. In other words, the data capacity of the input buffer can be compressed in accordance with the characteristics of the format (for example, side-by-side format) in which N-viewpoint image data is input.

[Step S22200]
Variables x, Iy, Ix ′, Nk, and Nq are each assigned 1 as an initial value. x indicates a column number of the display unit. Iy indicates the line number of the input image data and the line number of the input composite data, and Ix ′ indicates the column number of the input composite data to be generated. Nk is a count value for counting the number of viewpoints from 1 to N, and Nq is a variable used for designating the column number of the input pixel data.

[Step S22300]
The even / oddness of the column count value x is determined. The determination condition is whether or not x is an odd number. If the determination is Yes, the process proceeds to step S22400. If the determination is No, the process proceeds to step S2500.

[Step S22400]
The pixel data M {TM (N, op, x)} (Iy, Nq) RGB is read from the input buffer using the table TM and the count values x, Iy, Nq, and the input composite data M2 ′ (Iy, Ix ′) ) Substitute into RGB. Here, the process of substituting the input composite data is premised on the case where the input composite data M2 ′ is associated with an odd number column of the display unit. When the input composite data M1 ′ is associated with the odd number columns of the display unit, the input composite data M2 ′ in this step may be set as the input composite data M1 ′.

[Step S2500]
The pixel data M {TM (N, op, x)} (Iy, Nq) RGB is read from the input buffer using the table TM and the count values x, Iy, Nq, and the input composite data M1 ′ (Iy, Ix ′) ) Substitute into RGB. Here, the process of substituting into the input composite data is premised on the case where the input composite data M1 ′ is associated with the even-numbered columns of the display unit. In a case where the input composite data M2 ′ is associated with an even number column of the display unit, the input composite data M1 ′ in this step may be set as the input composite data M2 ′.

[Step S22600]
1 is added to the count value Ix ′ indicating the column number of the input composite data.

[Step S23000]
It is determined whether the count value Nk for counting the number of viewpoints has not reached N. The determination is performed by comparing the number of viewpoints (type) N of the input image data read as TM in step S21000 shown in FIG. 59 with the count value Nk. If the count value Nk has not reached the number of viewpoints N, the determination is Yes and the process proceeds to step S23100. If the count value Nk has reached the number of viewpoints N, the determination is No and the process proceeds to step S23200.

[Step S23100]
1 is added to the count value Nk, and the process proceeds to step S23400.

[Step S23200]
The count value Nk is returned to 1, and 1 is added to the count value Nq that specifies the column number of the input pixel data.

[Step S23300]
It is determined whether the count value x of the column of the display unit has reached the column number m for one row. The determination is made by comparing the count value x with the column number m of the display section read in step S21000 shown in FIG. If the count value x has not reached the column number m, the determination is Yes and the process proceeds to step S23400. If the count value x has reached the column number m, the determination is No and the process proceeds to step S24000.

[Step S23400]
1 is added to the count value x, and the process proceeds to step S22300.

[Step S24000]
Since the rearrangement process for one row is completed, the count values x, Ix ′, and Nq are returned to 1.

[Step S24100]
It is determined whether or not the row count value Iy has reached the row number n / 3 of the input image data calculated from the row number n of the sub-pixels of the display unit read in step S21000 shown in FIG. The determination is made by comparing the count value Iy with n / 3. If the count value Iy has not reached n / 3, the determination is Yes and the process proceeds to step S24200. If the count value Iy has reached n / 3, the determination is No and the process proceeds to step S24300.

[Step S24200]
1 is added to the count value Iy, and the process proceeds to step S22300.

[Step S24300]
The input composite data M1 ′ and M2 ′ rearranged by the above steps are output to the write control means 110 shown in FIG. By this step, the input data rearrangement process is completed, and the process proceeds to step S2000 shown in FIG.

  The operation of the second embodiment has been described above. However, this description shows an example, and the present invention is not limited to this. For example, in the input data rearrangement process shown in FIG. 60, the process is performed on the basis of the count value x for counting the columns of the display unit, and the input pixel data is alternately substituted into M2 ′ and M1 ′. However, the processing flow may be changed so that the assignment process to M1 ′ is performed after all the assignment processes to M2 ′ are performed.

  Furthermore, in the configuration of the second embodiment, in FIG. 46, the input data rearranging means 160 and the write control means 110 are shown separately. The configuration of the present embodiment is not limited to this. For example, the write control unit 110 may include an input data rearrangement function shown in FIG. In the writing control means 110, by controlling the generated address in units of columns of each viewpoint image, the same processing as the input data rearrangement processing shown in FIG. 54 can be executed.

[effect]
As shown in FIG. 48, in the second embodiment, the observer can enjoy stereoscopic images from different angles by changing the observation position as the number of viewpoints increases, and at the same time, motion parallax is also given. Therefore, there is an effect of giving a more stereoscopic effect.

(Third embodiment)
A configuration of a display device according to the third embodiment of the present invention will be described. In the display device according to the first embodiment, the third embodiment is obtained by reducing the area of the image memory provided in the display controller.

  FIG. 61 shows a functional block diagram of the third embodiment. Similar to the first embodiment, the display device according to the third embodiment includes a display controller 102 that generates composite image data CM from each viewpoint image data input from the outside, and a display that is a display unit for the composite image data CM. Panel 20. The display panel 20 includes a display unit 50 as in the first embodiment. In the display unit 50, the data lines are arranged so that the extending direction is the horizontal direction (X direction), and the scanning lines are arranged so that the extending direction is the vertical direction (Y direction).

  The configuration of the display controller 102 is different from that of the first embodiment in that the area of the image memory is reduced and the line memory 122 is provided. The line memory 122 has a memory area for a plurality of columns of the sub-pixels 40 of the display unit 50. The display controller 102 includes a writing control unit 112 having a function of writing input image data into the line memory 122 and a reading control unit 132 having a function of reading data from the line memory 122. Since the other structure of the display controller 102 is the same as that of the first embodiment, description thereof is omitted by using the same reference numerals as those of the first embodiment.

  In the third embodiment, by using the transfer format of input image data shown in FIG. 62C, an image memory that can write and store all input image data becomes unnecessary, and the memory area can be reduced. A transfer format of input image data in the third embodiment will be described with reference to FIG.

  FIG. 62A shows viewpoint images M1 and M2 that are left-eye and right-eye images. The viewpoint images M1 / M2 are each composed of pixel data of i rows and j columns, and the pixel data has three-color luminance information of R (red) luminance, G (green) luminance, and B (blue) luminance. FIG. 62 (b) is a stereoscopic image from an appropriate observation position when the viewpoint images M1 / M2 shown in FIG. 62 (a) are displayed on the display unit 50. FIG. 62 (c) is a transfer image of the viewpoint images M1 / M2 shown in FIG. 62 (a) in the third embodiment.

  Here, as shown in FIG. 8, in the image separation means (lenticular lens 30), the odd-numbered sub-pixels of the display unit 50 are M2 (for the right eye) and the even-numbered sub-pixels are M1 (for the left eye). Yes. In the third embodiment, in order to enable processing by the line memory 122, the viewpoint image data shown in FIG. 62A is transferred for each column. Further, the transfer order of the viewpoint images M1 / M2 is made to correspond to the start row of the display unit 50. Therefore, in the installation of the image separation means shown in FIG. 8, data transfer is started from M2 (1,1) RGB. Subsequently, when data transfer is performed with M2 (2,1) RGB, M2 (3,1) RGB,... And M2 (i, 1) RGB is reached, M1 (1,1) RGB, M1 (2,1) RGB, M1 (3,1) RGB,... M1 (i, 1) RGB are transferred. When the data transfer for the first column of M2 and M1 is completed, the second column, the third column,... Are repeated in the same manner as the first column, and the data transfer is performed up to the jth column.

  Next, the transfer method described with reference to FIG. 62 and the operation of the third embodiment using the line memory will be described with reference to FIG. FIG. 63 shows the output timing in units of scanning lines when the image data of the viewpoint image M1 / M2 composed of the pixels of 4 rows and 6 columns shown in FIG. 7 is input according to the transfer method described above. T represents one scanning period of the display panel, and input data represents transfer of the viewpoint images M1 / M2 shown in FIG. 7 in units of columns. L1 to L3 are line memories that can store one column of input viewpoint image data.

  The data in the first column of M2 is stored in L1 during the period T = 1 (hereinafter abbreviated as T1). Subsequently, at T2, the line data output processing (FIGS. 32 to 39) described in the first embodiment is performed using the data stored in L1, and the composite image data of the scanning line G1 is output. In T2, the data in the first column of M1 is stored in L2 in parallel. Next, at T3, the line data output processing (FIGS. 32 to 39) described in the first embodiment is performed using the data stored in L1 and L2, and the combined image data of the scanning line G2 is output. . In T3, the data in the second column of M2 is stored in L3 in parallel. Next, at T4, line data output processing is performed similarly to T2 and T3 using the data stored in L2 and L3, and composite image data of the scanning line G3 is output. Here, the output of the data in the first column of M2 stored in L1 has been completed at T2 and T3. Therefore, in T4, the data in the second column of M1 is stored in L1, and in the next T5, line data processing is performed using the data stored in L3 and L1, and the combined data of the scanning line G5 is output. The The above processing is repeated, and composite data up to the scanning line G13 is output as shown in FIG.

  Therefore, the memory area of the image data required in the third embodiment is for three columns of each viewpoint image data, and in the sub-pixel unit of the display unit, the number of sub-pixels connected to three scanning lines ( (However, G1 and Gm + 1 are excluded.) That is, in the example of displaying two input viewpoint image data of 4 rows and 6 columns shown in FIG. 63, a data area corresponding to the number of subpixels of 4 × 3 (color) × 3 (scanning line) = 36 is required, In an example in which the display unit includes n rows and m columns of sub-pixels, a data area corresponding to the number of n × 3 sub-pixels is required.

  As described above, in the third embodiment, as shown in FIG. 8, the image separation unit is configured such that the odd-numbered subpixels of the display unit 50 are M2 (for the right eye) and the even-numbered subpixels are M1 (for the left eye). It was explained using an example. However, as shown in FIG. 20, the image separation unit is configured to perform this operation even when the odd-numbered subpixels of the display unit 50 are M1 (for the left eye) and the even-numbered subpixels are M2 (for the right eye). The form is applicable. However, when the image separation means is shown in FIG. 20, it is necessary to change the transfer order of the viewpoint images M1 / M2 and perform data transfer from the first column of M1.

  In the third embodiment, the transfer format of the input image data shown in FIG. 62 is used to reduce the area of the image memory. However, the transfer format of the input image data is not limited to this. For example, FIG. The transfer format shown in FIG. The transfer format shown in FIG. 64 is a method in which viewpoint images M1 / M2 are alternately transferred in units of pixel data. However, in the case of the transfer method shown in FIG. 64, it is necessary to increase the memory capacity as compared with the transfer format shown in FIG.

  Furthermore, although the third embodiment has been described with the same N = 2 display device as in the first embodiment, it can also be applied to the display device of the second embodiment in which N is 3 or more. When N is 3 or more, the viewpoint image may be transferred for each column in accordance with the correspondence order of the viewpoint images of the display unit determined by the arrangement of the image separation means.

[effect]
In the third embodiment, since the image memory can be reduced to a line memory corresponding to sub-pixel data for three scanning lines, the circuit scale of the display controller can be greatly reduced, and the cost can be reduced. . Further, the size can be reduced, and for example, there is an effect that the number of options for the location where the display controller is mounted increases, for example, the display controller is built in the data line driving circuit.

(Fourth embodiment)
A display device according to a fourth embodiment of the present invention will be described. The configuration of the fourth embodiment is the same as the configuration shown in FIG. 61 using a line memory as in the third embodiment. However, compared to the third embodiment, the transfer format of the input image data and the arrangement of the image data The replacement process and the driving method are different.

  A transfer format of input image data used in the fourth embodiment will be described with reference to FIG. FIG. 65A shows viewpoint images M1 and M2 each composed of pixel data of i rows and j columns, as in FIG. 62A, and the pixel data has luminance information of three colors. FIG. 65 (b) is a stereoscopic image as in FIG. 62 (b), and FIG. 65 (c) is a transfer image of the viewpoint image M1 / M2 shown in FIG. 65 (a).

  As shown in FIG. 65 (c), the transfer format of the input image data of the fourth embodiment is a so-called frame time division transfer format in which data transfer is performed in units of viewpoint images. FIG. 65C shows an example in which the pixel data of the viewpoint image M1 is transferred following the viewpoint image M2. As described in the third embodiment, also in the fourth embodiment, viewpoint image data is transferred for each column in order to enable processing by the line memory. As shown in FIG. 65 (c), when transfer is started from M2 (1,1) RGB, data transfer is subsequently performed as M2 (2,1) RGB, M2 (3,1) RGB,. To M2 (i, 1) RGB, then M2 (1,2) RGB, M2 (2,2) RGB, M2 (3,2) RGB,... M2 (i, 2) RGB And forward. Similarly, the transfer is repeated, and when the data transfer up to the j-th column of the viewpoint image M2 and M2 (i, j) RGB is completed, the data transfer of the viewpoint image M1 is started from M1 (1,1) RGB. Subsequently, the data transfer of the first column is performed with M1 (2,1) RGB, M1 (3,1) RGB,... M1 (i, 1) RGB, and the second, third,. And the data transfer up to the j-th column of the viewpoint image M1, M1 (i, j) RGB is completed.

  Next, image data rearrangement processing and a driving method according to the fourth embodiment will be described with reference to FIG. As an example of the operation of the fourth embodiment, as shown in FIG. 8, the image separation means (30) is installed in the display unit 50 (FIG. 61), and the display panel 20 (FIG. 61) having the arrangement pattern shown in FIG. An example of driving is used. 66, when the image data of the viewpoint image M1 / M2 composed of the pixels of 4 rows and 6 columns shown in FIG. 7 is input according to the transfer method described above (FIG. 65 (c)), the display panel is scanned. It is a timing chart which outputs synthetic image data per line. 66 in FIG. 66 indicates one scanning period of the display panel, and the input data indicates transfer in units of columns of the viewpoint images M1 / M2 shown in FIG. L1 and L2 are line memories that can store one column of input viewpoint image data.

  In the fourth embodiment, since there is no image memory in which all input image data can be written and saved, as shown in FIG. 66, all scanning lines of the display panel are scanned every transfer period of input image data of one viewpoint. To do. At the time of scanning, out of the sub-pixels connected to the selected scanning line, the sub-pixel for the viewpoint in which data is stored in the line memory is read out from the line memory, and for the viewpoint having no data in the line memory. The sub-pixel outputs data for which the viewpoint image display is black display (minimum luminance display). Black in FIG. 66 indicates data that is displayed in black as described above.

  FIG. 66 will be described in detail. In the period T = 1 and T = 2 (hereinafter abbreviated as T1 and T2), the data in the first column of M2 is stored in L1. Subsequently, at T3 and T4, the line data output processing (FIGS. 32 to 39) described in the first embodiment is performed using the data stored in L1. At this time, in step S5720 shown in FIG. 33, if k is a value designating M1, the previous black data is given to the PD. At T3 and T4, the data in the second column of M2 is stored in L2 in parallel with the output operation of the composite image data of the scanning lines G1 and G2. Next, at T5 and T6, the composite image data of the scanning lines G3 and G4 is output using the data stored in L2 by the same processing as described above. Since the data in the first column of M2 stored in L1 has been read at T4, the data in the third column of M2 is stored in L1 at T5 and T6. Thereafter, the same processing is repeated, and at T15, the output of the composite image data up to the scanning line G13 is completed. The input data from T13 to T15 is indicated by hatching as invalid data, which is a so-called blanking period. Next, at T16 and T17, the data in the first column of M1 is stored in L1. Also, line data output processing (FIGS. 32 to 39) from T17 to the scanning line G1 is started. At this time, as described above, in step S5720 shown in FIG. 33, when k is a value designating M2, the previous black data is given to the PD. Subsequently, at T18 and T19, the composite image data of the scanning lines G2 and G3 is output using the data stored in L1. In parallel with this output operation, data in the second column of M1 is stored in L2. Thereafter, the same processing as described above is repeated, and at T29, the output of the composite image data up to the scanning line G13 is completed.

  In the fourth embodiment that operates as described above, the required memory area of the image data is for the line memories L1 and L2 in FIG. 66, that is, for two columns of input viewpoint image data. 67 shows a correspondence relationship between the first and second columns of the second viewpoint image data M2 shown in FIG. 7 and the sub-pixels of the display panel having the arrangement pattern shown in FIG. 67, when the memory area of the image data required in the fourth embodiment is expressed in units of sub-pixels of the display panel, the sub-pixels connected to two scanning lines (excluding G1 and Gm + 1) are shown. It becomes the number. In other words, when the display unit includes n rows and m columns of subpixels, the required memory area is n × 2 subpixels.

  As described above, in the fourth embodiment, as shown in FIG. 8, the image separation unit is configured such that the odd-numbered subpixels of the display unit 50 (FIG. 61) are M2 (for the right eye) and the even-numbered subpixels are M1 (for the left eye). ) Was described using the example. However, as shown in FIG. 20, the image separation means is configured such that the odd-numbered sub-pixels of the display unit 50 (FIG. 61) are M1 (for the left eye) and the even-numbered sub-pixels are M2 (for the right eye). However, the present embodiment can be applied. Further, the display unit configured by the arrangement pattern shown in FIG. 9 has been described as an example, but the present embodiment is not limited to this, and as described in the first embodiment, the regularity of the sub-pixel arrangement and the parameter setting Therefore, it can be applied to various arrangement patterns.

[effect]
In the fourth embodiment, since the image memory can be reduced to a line memory corresponding to sub-pixel data for two scanning lines, the circuit scale of the display controller can be greatly reduced, and the cost can be reduced. . Further, the size can be reduced, and for example, there is an effect that the number of options for the location where the display controller is mounted increases, for example, the display controller is built in the data line driving circuit.

(Fifth embodiment)
A display device according to a fifth embodiment of the present invention will be described. The fifth embodiment uses the same input image data transfer format (so-called frame time-division transfer format) as the fourth embodiment, and, similarly to the fourth embodiment, sub-pixel data for two scanning lines as an image memory. A considerable line memory line memory is used. The configuration of the data line driving circuit for driving the data lines is different from that of the fourth embodiment. The data line driving circuit used in the fifth embodiment alternately places even-numbered data lines and odd-numbered data lines in the display section in a high impedance state.

  The configuration of the fifth embodiment will be described with reference to FIG. FIG. 68 shows a display panel 20 (FIG. 61) using a data line driving circuit 85 different from the fourth embodiment in the present embodiment. Here, the same parts as those of the third and fourth embodiments shown in FIG. An example of the data line driving circuit used in the fifth embodiment shown in FIG. 68 includes a selection circuit 87 on the output side of the data line driving circuit 80 (hereinafter simply referred to as “circuit 80”) used in the other embodiments. This is an added configuration. The selection circuit 87 has a switch function for switching connection / disconnection for every odd number output / even number output in accordance with the signal SEL88. In FIG. 68, an odd number output is connected and an even number output is disconnected. The data line disconnected from the output of the circuit 80 by the selection circuit 87 is in a high impedance state.

  Next, the operation of the fifth embodiment will be described with reference to FIG. In FIG. 69, as in FIG. 66 used in the fourth embodiment, the image data of the viewpoint image M1 / M2 composed of the pixels of 4 rows and 6 columns shown in FIG. 7 is input according to the transfer method of FIG. 69 is a timing chart for outputting composite image data in units of scanning lines to the display panel shown in FIG. It is assumed that the display unit 50 has the arrangement pattern shown in FIG. 9, and image separation means is installed as shown in FIG.

  Since T, input data, line memories L1 and L2, and output in FIG. 69 are the same as those in FIG. 66 described in the fourth embodiment, detailed description is omitted using the same reference numerals. 69 is a signal for controlling the selection circuit 87 shown in FIG. 68. When SEL = H, the output of the circuit 80 is connected to the even-numbered data line, and the odd-numbered data line is in a high impedance state. When SEL = L, the even / odd relationship of the data lines is switched.

  At T2, when SEL = H, odd data lines are in a high impedance state. Next, at T3 and T4, as described in the fourth embodiment, the composite image data of the scanning lines G1 and G2 is output from the data of the input M2 (one column) stored in the line memory L1. During this period, there is no input image data of M1 in generating the composite image data. However, in this operation example, the sub-pixel for the M1 viewpoint is connected to the odd-numbered data line, and the scanning line is selected in the sub-pixel connected to the odd-numbered data line in the high impedance state due to SEL = H. But no writing is done. Therefore, in the generation of the composite image data, the PD when k designates M1 is invalid, and for example, black data may be given as in the fourth embodiment. That is, the processing operation performed in the period from T2 to T16 is the same as that in the fourth embodiment, and thus the description thereof is omitted.

  At T16, when SEL = L, even data lines are in a high impedance state. In this operation example, the sub-pixel connected to the even data line is for the M2 viewpoint. In the sub-pixel connected to the data line in the high impedance state, writing is not performed even when the scanning line is selected. For this reason, the state written in the period from T3 to T14 is retained. Further, as described above, the processing operation related to the generation of the composite image data is the same as that in the fourth embodiment, and thus the description thereof is omitted.

  As described above, in the fifth embodiment, the high impedance state of the odd / even data lines is repeated for every scanning period of all the scanning lines in accordance with the viewpoint of the input image data. Thus, data writing and holding of the written state are repeated for each scanning period of all scanning lines in units of sub-pixels for each viewpoint. Note that the necessary image data memory area is the line memories L1 and L2, that is, two columns of input viewpoint image data, as in the fourth embodiment. This is the number of subpixels connected to two lines (however, excluding G1 and Gm + 1).

  As described above, the data line driving circuit constituting the fifth embodiment has been described with reference to FIG. 68. However, the function of allowing the even-numbered data lines and the odd-numbered data lines of the display unit to be alternately in a high impedance state. If prepared, it is not limited to this. For example, the data line driving circuit shown in FIG. 70 can be configured. In FIG. 70, the configuration of the previous selection circuit 87 is changed to a selection circuit 89. In this case, the number of outputs of the circuit 80 in FIG. 68 can be reduced to half as in the circuit 86 shown in FIG. 70, and the circuit scale can be reduced. Furthermore, the data line driver circuit shown in FIG. 71 combining FIG. 68 and FIG. 70 can be configured.

  In the description of the fifth embodiment, in FIG. 68, one example including 12 rows and 12 columns of subpixels is used. However, the display unit is not limited to this, and includes n rows and m columns of subpixels. Composed. Moreover, although the image separation unit has been described using the example of being installed in the display unit as shown in FIG. 8, the image separation unit may be installed as shown in FIG. Further, the display unit configured by the arrangement pattern shown in FIG. 9 has been described as an example, but the present embodiment is not limited to this, and as described in the first embodiment, the regularity of the sub-pixel arrangement and the parameter setting Therefore, it can be applied to various arrangement patterns.

[effect]
In the fifth embodiment, in addition to the effect of reducing the image memory similar to that of the fourth embodiment to the line memory, compared to the fourth embodiment, since the black display is not performed, a bright display screen can be provided. .

  While the present invention has been described with reference to the above embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention. Further, the present invention includes a combination of some or all of the configurations of the above-described embodiments as appropriate.

  The present invention can be applied to a mobile phone, a portable game machine, a portable terminal, and other display devices in general (such as a notebook computer).

11; vertical direction 12; horizontal direction 15; backlight 16; light beam 17; observation surface 20; display panel 25; glass substrate 26; liquid crystal layer 27;
30a; Cylindrical lenses 40, 40a, 40a ′, 40b, 40b ′, 41, 42; sub-pixel 43; semiconductor layer 44; storage capacitor 45; pixel electrode 46; TFT (switching means)
47, 48, 49; contact hole 50; display 51; parameter information 60; scanning line driving circuits 61 and 81; control signal 70; wiring 75; opening 76; light shielding 80, 85, 85A; Data bus 95; address bus 100, 101, 102; display controller 110, 112; write control means 120; image memory 122; line memory 130, 131, 132; read control means 140, 141; parameter storage means 150; Means 160; input data rearranging means 200; display modules P2R, P2L; upper and lower subpixel pairs G1, Gx, Gm, Gm + 1; scanning lines D1, Dy, Dn, Dn + 1; data lines

Claims (15)

The sub-pixels connected to the data line through the switching means controlled by the scanning line are arranged in n rows and m columns when m and n are natural numbers, and the n + 1 data lines and the m + 1 scanning lines are arranged. A display driven by lines;
Image separating means for directing light emitted from the sub-pixel to a plurality of viewpoints in the extending direction of the data line in units of the sub-pixel;
To the display module with
A display controller that outputs composite image data,
An image memory for storing viewpoint image data for the plurality of viewpoints;
Write control means for writing the viewpoint image data input from the outside into the image memory;
Read control means for reading the viewpoint image data from the image memory and outputting it as the composite image data to the display module according to a read order corresponding to the display module;
A display controller comprising: The readout order corresponding to the display module is a readout order determined by a repetition rule determined by the positional relationship between the image separation means and the display unit, the arrangement of the sub-pixels, the number of colors, and the color arrangement.
The display controller according to claim 1. Parameter storage means for storing parameters indicating the positional relationship between the image separation means and the display unit, the arrangement of the sub-pixels, the number of colors, and the color arrangement;
The display controller according to claim 2, further comprising: The display unit is configured with an upper and lower sub-pixel pair composed of two sub-pixels arranged with one data line interposed therebetween as a basic unit,
The switching means included in each of the two sub-pixels is commonly connected to the data line sandwiched between the two sub-pixels and controlled by different scanning lines.
The upper and lower subpixel pairs adjacent in the extending direction of the data line are arranged to be connected to the different data lines, respectively.
4. The display controller according to claim 2, wherein the display controller is a display controller. The number of colors of the sub-pixels is three colors of a first color, a second color, and a third color;
When y is a natural number, one of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y-th data line is the first color and the other is the second color. Forming one of a row and an odd row;
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + 1-th data line is the second color and the other is the third color, and the other of the even and odd columns of the display unit Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + second data line is the third color and the other is the first color, and one of the even and odd columns of the display unit is Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + th data line is the first color and the other is the second color, and the other of the even and odd columns of the display unit Forming,
One of the two subpixels of the upper and lower subpixel pairs connected to the y + 4th data line is the second color and the other is the third color, and one of the even and odd columns of the display unit is Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + 5th data line is the third color and the other is the first color, and the other of the even and odd columns of the display unit Forming,
The read control means includes
Corresponding to the y-th data line, the color to be read is the first color and the second color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 1th data line, the color to be read is the second color and the third color, and the viewpoint image to be read is a viewpoint image corresponding to the other of the even number column and the odd number column of the display unit,
Corresponding to the y + second data line, the color to be read is the third color and the first color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 3th data line, the color to be read is the first color and the second color, and the viewpoint image to be read is a viewpoint image corresponding to the other of the even number column and the odd number column of the display unit,
Corresponding to the y + 4th data line, the color to be read is the second color and the third color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 5th data line, the readout color is the third color and the first color, and the readout viewpoint image is the viewpoint image corresponding to the other of the even and odd columns of the display unit. According to
Reading the viewpoint image data from the image memory;
The display controller according to claim 4. Input data rearranging means for rearranging the viewpoint image data of three or more viewpoints input from the outside into the viewpoint image data of two viewpoints;
The writing control means has a function of writing the viewpoint image data rearranged by the input data rearranging means to the image memory instead of the viewpoint image input from the outside.
The display controller according to claim 1, wherein the display controller is a display controller. The image memory has a data storage area for at least n rows and 2 columns of the sub-pixels.
The display controller according to claim 1, wherein the display controller is a display controller. A display controller according to any one of claims 1 to 7,
The display module;
A display device comprising: The sub-pixels connected to the data line through the switching means controlled by the scanning line are arranged in n rows and m columns when m and n are natural numbers, and the n + 1 data lines and the m + 1 scanning lines are arranged. A display driven by lines;
Image separating means for directing light emitted from the sub-pixel to a plurality of viewpoints in the extending direction of the data line in units of the sub-pixel;
To the display module with
An image processing method for generating composite image data,
Viewpoint image data for the plurality of viewpoints is externally input and written to an image memory;
According to the reading order corresponding to the display module, the viewpoint image data is read from the image memory,
Outputting the read viewpoint image data as the composite image data to the display module;
An image processing method. The readout order corresponding to the display module is a readout order determined by a repetition rule determined by the positional relationship between the image separation means and the display unit, the arrangement of the sub-pixels, the number of colors, and the color arrangement.
The image processing method according to claim 9. The display unit is configured with an upper and lower sub-pixel pair composed of two sub-pixels arranged with one data line interposed therebetween as a basic unit,
The switching means included in each of the two sub-pixels is commonly connected to the data line sandwiched between the two sub-pixels and controlled by different scanning lines.
The upper and lower subpixel pairs adjacent to each other in the extending direction of the data line are arranged so that the switching unit is connected by the different data lines, respectively.
The number of colors of the sub-pixels is three colors of a first color, a second color, and a third color;
When y is a natural number, one of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y-th data line is the first color and the other is the second color. Forming one of a row and an odd row;
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + 1-th data line is the second color and the other is the third color, and the other of the even and odd columns of the display unit Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + second data line is the third color and the other is the first color, and one of the even and odd columns of the display unit is Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + th data line is the first color and the other is the second color, and the other of the even and odd columns of the display unit Forming,
One of the two subpixels of the upper and lower subpixel pairs connected to the y + 4th data line is the second color and the other is the third color, and one of the even and odd columns of the display unit is Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + 5th data line is the third color and the other is the first color, and the other of the even and odd columns of the display unit When forming
When reading the viewpoint image data from the image memory according to the reading order,
Corresponding to the y-th data line, the color to be read is the first color and the second color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 1th data line, the color to be read is the second color and the third color, and the viewpoint image to be read is a viewpoint image corresponding to the other of the even number column and the odd number column of the display unit,
Corresponding to the y + second data line, the color to be read is the third color and the first color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 3th data line, the color to be read is the first color and the second color, and the viewpoint image to be read is a viewpoint image corresponding to the other of the even number column and the odd number column of the display unit,
Corresponding to the y + 4th data line, the color to be read is the second color and the third color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 5th data line, the readout color is the third color and the first color, and the readout viewpoint image is the viewpoint image corresponding to the other of the even and odd columns of the display unit. According to
Reading the viewpoint image data from the image memory;
The image processing method according to claim 10. Parameters indicating the positional relationship between the image separating unit and the display unit and the arrangement of the sub-pixels, the number of colors, and the color arrangement are stored in the parameter storage unit,
Reading the viewpoint image data from the image memory according to a reading order determined by a repetition rule determined by parameters read from the parameter storage means;
The image processing method according to claim 10 or 11, characterized in that: The sub-pixels connected to the data line through the switching means controlled by the scanning line are arranged in n rows and m columns when m and n are natural numbers, and the n + 1 data lines and the m + 1 scanning lines are arranged. A display driven by lines;
Image separating means for directing light emitted from the sub-pixel to a plurality of viewpoints in the extending direction of the data line in units of the sub-pixel;
To the display module with
An image processing program for generating composite image data,
A procedure for inputting viewpoint image data for the plurality of viewpoints from outside and writing it into an image memory;
A step of reading the viewpoint image data from the image memory according to a reading order corresponding to the display module;
Outputting the read viewpoint image data as the composite image data to the display module;
An image processing program for causing a computer to execute. The readout order corresponding to the display module is a readout order determined by a repetition rule determined by the positional relationship between the image separation means and the display unit, the arrangement of the sub-pixels, the number of colors, and the color arrangement.
The image processing program according to claim 13. The display unit is configured with an upper and lower sub-pixel pair composed of two sub-pixels arranged with one data line interposed therebetween as a basic unit,
The switching means included in each of the two sub-pixels is commonly connected to the data line sandwiched between the two sub-pixels and controlled by different scanning lines.
The upper and lower subpixel pairs adjacent to each other in the extending direction of the data line are arranged so that the switching unit is connected by the different data lines, respectively.
The number of colors of the sub-pixels is three colors of a first color, a second color, and a third color;
When y is a natural number, one of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y-th data line is the first color and the other is the second color. Forming one of a row and an odd row;
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + 1-th data line is the second color and the other is the third color, and the other of the even and odd columns of the display unit Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + second data line is the third color and the other is the first color, and one of the even and odd columns of the display unit is Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + th data line is the first color and the other is the second color, and the other of the even and odd columns of the display unit Forming,
One of the two subpixels of the upper and lower subpixel pairs connected to the y + 4th data line is the second color and the other is the third color, and one of the even and odd columns of the display unit is Forming,
One of the two sub-pixels of the upper and lower sub-pixel pairs connected to the y + 5th data line is the third color and the other is the first color, and the other of the even and odd columns of the display unit When forming
In the procedure of reading the viewpoint image data from the image memory according to the reading order,
Corresponding to the y-th data line, the color to be read is the first color and the second color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 1th data line, the color to be read is the second color and the third color, and the viewpoint image to be read is a viewpoint image corresponding to the other of the even number column and the odd number column of the display unit,
Corresponding to the y + second data line, the color to be read is the third color and the first color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 3th data line, the color to be read is the first color and the second color, and the viewpoint image to be read is a viewpoint image corresponding to the other of the even number column and the odd number column of the display unit,
Corresponding to the y + 4th data line, the color to be read is the second color and the third color, and the viewpoint image to be read is a viewpoint image corresponding to one of the even and odd columns of the display unit,
Corresponding to the y + 5th data line, the readout color is the third color and the first color, and the readout viewpoint image is the viewpoint image corresponding to the other of the even and odd columns of the display unit. According to
Reading the viewpoint image data from the image memory;
The image processing program according to claim 14.

Images