RU2615330C2 - Display device and method, and program - Google Patents

Abstract

FIELD: image forming devices.

SUBSTANCE: invention relates to stereoscopic image display. Display device comprising a display unit, a separating unit, an allocation control unit, a generating unit, allocation control unit includes a viewed position calculating unit, a boundary position calculating unit, wherein allocation control unit further includes a mixing ratio calculating unit.

EFFECT: easy display of a high-quality stereoscopic image.

3 cl, 24 dwg

Description

FIELD OF THE INVENTION

The present technology relates to display devices and methods, and programs, and more particularly, to a display device and method and program for stereoscopically displaying an image in a manner visible to the naked eye and using a parallax separation element, such as a parallax barrier.

State of the art

Examples of known methods for displaying stereoscopic images include methods with glasses, using glasses for stereoscopic viewing, and methods visible to the naked eye and designed to implement stereoscopic viewing with the naked eye without glasses specially designed for stereoscopic viewing.

A typical of the glasses methods is a method with glasses having optical shutters, which uses glasses with optical shutters that have an optical shutter for the left eye and an optical shutter for the right eye. By the method with glasses having optical shutters, the parallax (having parallax (offset)) image for the left eye and the parallax image for the right eye are alternately displayed on the two-dimensional display panel at high speed sequentially in frames. Since the optical shutter for the left eye and the optical shutter for the right eye are alternately closed synchronously with the display of each of the parallax images, only the parallax image for the left eye gets on the left eye of the viewer, and only the parallax image for the right eye gets on the right eye of the viewer. Accordingly, images can be viewed in a stereoscopic manner.

Meanwhile, typical methods for the naked eye include a parallax barrier method and a step lens method. In the case of the parallax barrier method or the stepped lens method, parallax images for stereoscopic viewing (parallax image for the right eye and parallax image for the left eye in the case of display with two observation points) are spatially separated and displayed on a two-dimensional display panel, and these parallax images undergo parallax separation in the horizontal direction by the parallax separation element. Thus, stereoscopic viewing is realized. In the parallax barrier method, a parallax barrier having slit-like openings is used for this purpose as a parallax separation element. In the stepped lens method, a stepped lens having cylindrical bilins arranged in parallel is used as a parallax separation element.

In addition, as a display device using the naked eye method, a device has been proposed in which the proper viewing distance for the structure can be reduced by reducing the distance between the imaging surface of the liquid crystal panel and the parallax barrier (see, for example, Patent Document 1).

List of referred documents

Patent document

Patent Document 1: JP 9-50019 A

Disclosure of invention

Problems to be Solved by the Invention

However, with the naked eye method using the parallax separation element, when the location of the observation point occupied by the user changes, crosstalk easily occurs, and the right and left parallax images are observed with one eye of the user. As a result of this, high-quality stereoscopic images cannot be displayed in a stable manner.

The present technology was developed in view of these circumstances, and should present high-quality stereoscopic images in a simpler way.

Problem solution

A display device according to one aspect of the present technology includes: a display module that has block regions, each of which is formed by pixels of three or more channels; a separation unit configured to separate an image displayed on pixels of respective channels in block areas; a assignment control module configured to assign one of the parallax images to the pixels of the respective channels in the block regions in accordance with the location of the observation point from which the user views the display module, while the display module is configured to display one of the parallax images in the first region, formed by pixels adjacent to each other in block areas, and formed by pixels of two or more different channels, display the other from allaksnyh images having a parallax with respect to said one of the parallax images in a second area different from the first area in the block areas; and a forming unit configured to form a combined image by combining parallax images in accordance with the assignment made by the assignment control unit.

The parallax images may be a parallax image for the right eye and a parallax image for the left eye.

In the case when the user looks at the display module from a given viewing position, he can see the pixels of one channel in the corresponding block areas.

The assignment control module may include: an observable position calculating module, configured to determine the observable position in the observable pixel observed by the user in each of the block areas based on the viewing position; and a boundary position calculation module, configured to calculate the boundary position, which is the position of the block region in which the observed position is essentially the center of the observed pixel, and highlighting the pixels of one channel in each of the block regions located between the specified boundary position and the other boundary position adjacent to the specified boundary position, the same image from the number of parallax images.

In the block regions located between the specified boundary position and the specified other boundary position, the boundary position calculation module is configured to extract the same image from the number of parallax images to pixels of the same channel as the channel of the observed pixel in the block region located in the specified boundary position, and the channel of the observed pixel in the block area located in the specified other boundary position.

The boundary position calculation module is configured to set the final boundary position, which is an intermediate position between the boundary position calculated based on the user's right eye and the boundary position calculated on the basis of the user's left eye.

The assignment control module may further include a mixing ratio calculation module configured to calculate a mixing ratio for the respective pixels observed by the right and left eyes of the user in the object region between the boundary position calculated based on the user's right eye and the boundary position calculated on based on the left eye of the user, the mixing ratio calculation module being configured to calculate the mixing ratio based on pi positions xels in the object area. The forming unit is configured to form pixels of a combined image to be displayed on pixels observed by the right and left eye in the object region by mixing the parallax image for the right eye and the parallax image for the left eye in the specified mixing ratio.

In the case where the viewing position is outside the predetermined area, the assignment control unit is configured to cause the display unit to display one image from the parallax image for the right eye and the parallax image for the left eye.

The display method or program according to one aspect of the present technology includes the steps of: assigning one of the parallax images to the pixels of each channel in the block areas in accordance with the viewing position occupied by the user looking at the display module, one of the parallax images being displayed in the first a region formed by pixels adjacent to each other in block regions, and formed by pixels of two or more different channels, another of parallax images, having parallax c with respect to said one of the parallax images, is displayed in a second region different from the first region in block regions; and form a combined image by combining parallax images in accordance with the specified attribution.

In this one aspect of the present technology, one of the parallax images is assigned to the pixels of each channel in the block regions in accordance with the viewing position occupied by the user looking at the display module, so that one of the parallax images is displayed in the first region, which is formed by pixels adjacent to each other to each other in block areas, and is formed by pixels of two or more different channels, and the other of parallax images, having parallax with respect to the specified one of the parallax and siderations, displayed in a second region different from the first region in the block areas. The combined image is formed by combining parallax images in accordance with the specified assignment.

The results of the invention

In accordance with one aspect of this technology, high-quality stereoscopic images can be represented in a simpler way.

Brief Description of the Drawings

Figure 1 is a diagram showing an exemplary structure of one embodiment of a display device.

FIG. 2 is a diagram showing a more specific example structure of a display module.

Figure 3 is a diagram for explaining stereoscopic display of parallax images for four observation points.

4 is a diagram for explaining corresponding parts of open areas.

5 is a diagram for explaining viewing from a distance that is half the proper viewing distance.

6 is a diagram for explaining the calculation of the observed location.

7 is a diagram for explaining the calculation of the observed location.

8 is a diagram for explaining the distribution of parallax images.

9 is a diagram for explaining the distribution of parallax images.

10 is a diagram for explaining the distribution of parallax images.

11 is a diagram for explaining locations of an observation point where stereoscopic imaging is not possible.

12 is a diagram for explaining an area in which stereoscopic display is possible.

13 is a flowchart for explaining a display operation.

14 is a diagram for explaining the distribution of parallax images.

Fig is a diagram showing an exemplary structure of a display system.

16 is a diagram for explaining a distribution of parallax images in a display module for six observation points.

17 is a diagram for explaining the occurrence of crosstalk in a half-distance display method.

18 is a diagram for explaining the occurrence of crosstalk in a half-distance display method.

19 is a diagram for explaining a reduction in crosstalk in a half-distance display method.

20 is a diagram showing another exemplary structure of a display device.

21 is a flowchart for explaining a display operation.

FIG. 22 is a flowchart for explaining a display operation. FIG.

23 is a diagram showing another exemplary structure of a display system.

24 is a diagram showing an example computer structure.

The implementation of the invention

The following description is a description with reference to the drawings of embodiments of the invention to which this technology is applied.

The first embodiment of the invention

An exemplary display device structure

Figure 1 is a diagram showing an exemplary structure of one embodiment of a display device to which this technology is applied.

This display device 11 is a display device that stereoscopically displays an object using parallax images for observation points. The display device 11 includes an image forming unit 21, a detection unit 22, a distribution control unit 23, a recording unit 24, a generating unit 25, a display control unit 26, and a display unit 27.

The imaging unit 21 introduces, for example, an image of a user located in the vicinity of the display device 11, or an image of a user observing an image displayed on the display unit 27 from a location located in front of the display unit 27 (this image will hereinafter be referred to as a peripheral image ), and provides this peripheral image to the detection module 22.

The detection unit 22 detects the user's eyes in a peripheral image provided from the image forming unit 21, and provides a detection result to the distribution control unit 23. In addition, the detection module 22 includes an observation point location calculation module 31, and this observation point location calculation module 31 calculates, based on the peripheral image, the location of the observation point occupied by the user with respect to the display module 27, and provides a result computing module 23 distribution control.

Based on the detection result and the location of the user occupied observation point provided from the detection module 22, the distribution control module 23 distributes parallax images to respective areas on the display surface in the display module 27. The distribution control module 23 includes a determination module 32, an observable location calculation unit 33, and a boundary location calculation unit 34.

[0027] Based on the location data of the observation point provided from the detection module 22, the determination module 32 determines whether stereoscopic display (three-dimensional display) of the object is possible by means of parallax images. According to the result of this determination, the distribution control module 23 controls the image generation in the generating module 25.

Based on the location data of the observation point provided from the detection unit 22, the observable location calculating unit 33 calculates the observable location, which is the location of each pixel observed by the user on the display surface in the display unit 27. Based on the observed location, the boundary location calculation unit 34 distributes the parallax images into respective areas on the display surface in the display unit 27.

The recording module 24 records the parallax images that make up the stereoscopic image, and, where necessary, provides these parallax images to the generating module 25. Under the control of the distribution control module 23, the generating module 25 generates a combined image formed by spatially separating the parallax images coming from the recording module 24, and combining these spatially separated images, and provides this combined image ue to the display control unit 26. Under the control of the distribution control module 23, the generating module 25 also provides one of the parallax images coming from the recording module 24 directly to the display control module 26.

The display control unit 26 provides the combined image from the generating unit 25 to the display unit 27 and causes the display unit 27 to display this combined image. By doing this, the display control unit 26 stereoscopically displays the object on the parallax images, and causes the display unit 27 to receive and display parallax images coming from the generating unit 25. The display unit 27 is made with a liquid crystal display panel or the like, which can display the stereoscopic image in a manner visible to the naked eye, and displays the combined image and parallax images provided from the display control unit 26 m.

An example display module structure

The display module 27 shown in FIG. 1 has, for example, the structure shown in FIG. 2.

In particular, the display module 27 is constituted by a backlight 61, an optical modulation panel 62 and a barrier element 63.

The backlight 61 is formed by a light source on light emitting diodes (LEDs), a light guide panel and the like, and emits and introduces light to display an image in the optical modulation panel 62.

The optical modulation panel 62 is provided with a liquid crystal layer corresponding to color filters: R (red), G (green) and B (blue) and the like, and transmits light input from the backlight 61 so that an image is displayed. At the same time, the optical modulation panel 62 sets the intensity levels for the respective image pixels by changing the light transmittance for each pixel in the optical modulation panel 62.

More specifically, the optical modulation panel 62 includes a transparent substrate 71, a transparent substrate 72, and a liquid crystal layer 73, and a liquid crystal layer 73 is interposed between the plate-like transparent substrates 71 and 72, which are facing each other. In the liquid crystal layer 73, transmission regions are provided as pixels for displaying an image. When voltage is applied to the electrodes provided in the transparent substrates 71 and 72 during image display, the transmittance of light entering these transmission elements from the backlight 61 changes with the applied voltage.

The barrier element 63 is made with a polarizer switching a liquid crystal layer and the like, and shields part of the light coming from the optical modulation panel 62, while letting the other part of the light pass, so as to optically separate the corresponding parallax images from each other. The barrier element 63 includes a transparent substrate 74, a transparent substrate 75, and a switching liquid crystal layer 76, and a switching liquid crystal layer 76 is interposed between the plate-like transparent substrates 74 and 75, which are facing each other.

On transparent substrates 74 and 75, electrodes are made. When voltage is applied to part or all of these electrodes, the orientation direction of the liquid crystal molecules in the switching liquid crystal layer 76 changes. As a result of this, a parallax barrier is formed in the switching liquid crystal layer 76.

In the example illustrated in FIG. 2, a parallax barrier is formed in the switching liquid crystal layer 76, which is formed with open sections: 81-1 through 81-3, which transmit light coming from the optical modulation panel 62, and shielding sections: 82- 1 through 82-3, which shield the light coming from the optical modulation panel 62.

Hereinafter, open sections: from 81-1 to 81-3, when there is no need to distinguish them from each other, will also be referred to simply as open sections 81, and screening sections: from 82-1 to 82-3, when there is no need to distinguish they from each other will also be referred to simply as shielding portions 82. In the case where the combined image for stereoscopic display of the object is displayed on the optical modulation panel 62, a parallax barrier is formed in the barrier element 63. However, in the case where the optical panel 62 module parallax images, which are two-dimensional images, are displayed, the parallax barrier in the barrier element 63 is not formed.

In the display module 27 of FIG. 2, the user observes the image displayed on the optical modulation panel 62 from the side of the barrier element 63. In particular, during the display of the combined image, the light that is emitted from the backlight 61 and passes through the panel 62 optical modulation and the barrier element 63, enters the right eye of the ER or the left eye of the EL user. In this case, various rays of light, separated by the barrier element 63, enter the right eye and the left eye of the user, and therefore, the right eye ER and the left eye EL of the user see different parallax images, each of which has parallax.

2, the barrier element 63 is shown as an example of a separating element that optically separates a parallax image. However, the separation element is not necessarily a parallax barrier, but may be a biconvex lens. In addition, the parallax barrier, as a separating element, is not necessarily a variable barrier, but may be a permanent barrier having open areas in the screen.

In addition, the barrier element 63 can be inserted between the optical modulation panel 62 and the backlight 61.

Viewing a stereoscopic image

For example, the display unit 27 forming the display device 11 displays parallax images for four different viewpoints, and it is made so that users view parallax images for two of the four viewpoints, so that a display device for four viewpoints that can stereoscopically display parallax images.

2, the horizontal direction and the vertical direction are set respectively as the x-axis and y-axis directions, and the direction perpendicular to the x-axis and y-axis directions is the z-axis. The x-axis direction is the direction in which the right eye of the ER and the left eye of the user EL are placed in line, or the parallax direction of the parallax image displayed on the optical modulation panel 62. The Y axis direction is a direction perpendicular to the display surface of the optical modulation panel 62.

In the case where the display module 27 is a display device for four observation points, in the x-direction on the display surface of the optical modulation panel 62, there are a number of block regions formed by pixels of four corresponding channels representing channels: CH0 to CH3, which are the pixels on which four corresponding parallax images should be displayed. For example, in each of the block regions, the pixels of channel CH0, channel CH1, channel CH2, and channel CH3 are arranged in a row from right to left, and pixels of the same channel are arranged in a row in the Z direction in FIG. 2.

The barrier element 63 has one open portion 81 forming a parallax barrier for one block region. The region formed by the pixels of the same channel in one block region is hereinafter also referred to as the channel. The display unit 27 will be further described below as a display device for four observation points.

In the case where parallax images for four observation points are displayed on the display module, the display module usually has block areas formed by channel pixels: CH0 to CH3, and parallax images for the corresponding points are displayed on the pixels of the respective channels.

A certain predefined location in front of the display module is set, for example, as a starting position, and the locations and sizes of the open sections of the display module are set so that when the user looks at the display module from the initial position, the user can see pixels of the same channel in each one block region, it should be noted that the distance in the direction along the y axis from the display surface in the display module to the aforementioned starting position is also omyanetsya as proper viewing distance.

In the case where parallax images for four observation points are displayed on such a display unit, the right eye ER and the left eye EL of the user see the pixels adjacent to each other through the open portion 112 made on the screen portion 111 of the display unit, for example, as shown in the left half in figure 3. 3, the horizontal direction and the vertical direction are, respectively, the x-axis direction and the y-axis direction.

In the example shown in FIG. 3, the pixel G11 is observed by the left eye of the user EL, and the pixel G12 adjacent to the pixel G11 is observed by the right eye of the user ER. At the same time, parallax images for various observation points are displayed on the pixel G11 and the pixel G12. Therefore, the right and left eyes of the user see parallax images for different points of observation, each of which has parallax.

In this situation, the user could move to the right in FIG. 3. Since the pixel G11 and the pixel G12 are adjacent to each other, the user's right eye ER can see not only the pixel G12 that was previously seen with the right eye ER, but also the pixel G11 that was observed with the left eye EL. As a result of this, crosstalk occurs. Thus, the user sees two objects on parallax images.

When the user looks at the display module from a location that is approximately half the proper viewing distance in the y direction between the display module and the location of the observation point occupied by the user, the user's right eye ER and left eye EL see positions spaced two pixels apart, for example, as shown in the right half of FIG.

In the example shown in FIG. 3, of three pixels: G13 to G15, which are arranged sequentially in a row, the pixel G13 is observed by the left eye of the user EL, and the pixel G15, which is two pixels apart from the pixel G13, is observed by the right eye of the user ER. Even if the location of the user's observation point moves slightly to the right in this situation shown in FIG. 3, the parallax image displayed on the pixel G13 is not observed by the user's right eye ER, and therefore, no crosstalk occurs.

As described above, when the display module is viewed from a distance of approximately half the proper viewing distance, the pixels in each block area of the block observed by the right eye and the left eye of the user are pixels two pixels apart from each other .

In the case where parallax images for the right eye and left eye are to be displayed on the display unit 27, these parallax images for the right eye and left eye are respectively displayed on the pixels of the respective channels, and the user observes the parallax images from a distance that is approximately half the proper distance viewing. In this way, crosstalk can be prevented.

For example, in the block area on the optical modulation panel 62, a parallax image for the right eye is displayed on the pixels of channel CH0 and channel CH1 adjacent to each other, and a parallax image for the left eye is displayed on pixels of channel CH2 and channel CH3 adjacent to each other.

In this case, the right eye of the user ER observes the parallax image for the right eye, and the left eye EL of the user observes the parallax image for the left eye. Even if the user in this situation moves a little along the x axis, the pixel of channel CH0 is two pixels from the pixel of channel CH2, and therefore, the parallax image for the left eye is not observed by the right eye of the user ER.

In addition, if the parallax images displayed on the pixels of the respective channels are switched in accordance with the movement of the position of the observation point occupied by the user before the crosstalk occurs, the image can be presented more naturally without the user noticing the right and left switching parallax images displayed in their respective areas.

As described above, when the parallax images for the right eye and the left eye are properly displayed on the pixels of the respective channels in accordance with the location of the observation point occupied by the user, and the user observes these parallax images from a distance that is approximately half the proper viewing distance, is prevented crosstalk, and a higher quality image may be presented. Such a method for displaying a stereoscopic image will hereinafter be referred to as a half-distance display method.

Parallax barrier design

In the case where the right and left parallax images are displayed in half-distance display mode of this kind, the distance between the open sections 81 and the distance from the open sections 81 to the optical modulation panel 62 must be properly set so that the user looking at the module 27 pixels from a place located at a distance that is approximately half the normal proper viewing distance, one pixel could be observed through each open area 81 the same channel.

For example, the distance between the right eye ER and the left eye EL (hereinafter referred to as the distance E between the eyes) of the user is 65 mm, and the proper viewing distance Z0 is 900 mm. The distance between the eyes of an average adult is approximately 65 mm.

In this case, the distance D1 from each open portion 81 to the optical modulation panel 62 and the distance D2 between the open portions 81 are determined as shown in FIG. 4. In this drawing, the horizontal direction and the vertical direction are, respectively, the direction along the x axis and the direction along the y axis.

In the left half of FIG. 4, a straight line that passes through the center of the open portion 81 and runs parallel to the y-axis direction is defined as a straight line A11, and one of the user's eyes is located at point PE11. In this case, the point PE11 is located at a distance X1 in the x axis direction from the straight line A11 and is located at a distance Z0 / 2 = 450 mm in the y direction from the open area 81. In the drawing of the barrier element 63, the rectangles shown in the lower part represent pixels on the optical modulation panel 62.

For example, as shown in the left half of the drawing, from the location PE11 of the location of one user's eye through the open area 81, a pixel G21 from among these pixels is visible. In the case where the distance between the pixels is D3, the center of the pixel G21 is spaced from the straight line A11 by the distance D3.

Here, the space between the barrier element 63 and the corresponding pixels of the optical modulation panel 62 is filled with glass material. In the case in which the relative refractive index of the light coming from the point PE11 to the glass material is represented by k1, X1: Z0 / 2 = D3: D1 / k1. Accordingly, D1 = (Z0 / 2) × D3 × k1 / X1. For example, in the case where Z0 = 900 mm, D3 = 0.05435 mm, X1 = 32.5 mm and k1 = 1.5, D1 is expressed through these values as 900/2 × 0.05435 × 1.5 / 32.5 = 1.1288 mm.

In addition, the user's eye could be located at point PE12 on a straight line A11, as shown in the right half of the drawing. In this case, the optical modulation panel 62 serves for four observation points, and the place on the optical modulation panel 62, which is visible through the left open portion 81 from the point PE12 in the drawing, and the place on the optical modulation panel 62, which is visible through the open portion 81, located to the right of this open area 81, must be separated from each other by four pixels.

Therefore, ZO / 2: D2 = ((Z0 / 2) + D1 / k1): 4 × D3. Accordingly, the distance D2 between the open sections 81 is determined from the expression: D2 = Z0 / 2 × D3 × 4 / ((Z0 / 2) + (D1 / k1)). In the case in which Z0 = 900 mm, D3 = 0.05435 mm, D1 = 1.1288 mm and k1 = 1.5, D2 is expressed through these values as 900/2 × 0.055435 × 4 / ((900 / 2) + (1.1288 / 1.5)) = 0.217037 mm.

Viewing from a distance of half the proper viewing distance

In the case where the size and location of each open portion 81 with respect to the optical modulation panel 62 are determined as described above, there may be a design in which, when the user looks at the open portion 81 from the point in front of the optical modulation panel 62, he sees the centers pixels, and there may be a design in which, when the user looks at the open area 81 from the point in front of the optical modulation panel 62, he sees the gaps between the pixels, for example, as shown in FIG.

5, the horizontal direction and the vertical direction are, respectively, the x-direction and the y-axis. The location of the observation point occupied by the user is at a distance Z0 / 2 in the y direction from the center of the optical modulation panel 62. Thus, the user observes the optical modulation panel 62 from the front and from a location located at a distance Z0 / 2 from the optical modulation panel 62.

For example, in the construction illustrated in the left half of FIG. 5, from the pixels: G31 to G34, in the block area formed for the open portion 81, the center of the pixel G31 is observed by the left eye of the user EL, and the center of the pixel G33 is observed by the right eye of the user ER . Here, the pixels: from G31 to G34, respectively, represent the pixels of the channels: from CH3 to CH0.

In this case, the user's left eye EL observes the pixel center of channel CH3 in each block region of the entire optical modulation panel 62, and the user's right eye ER observes the pixel center of channel CH1 in each block region of the entire optical modulation panel 62, as indicated by arrow Q11.

More specifically, the angle of refraction of light that is emitted from the optical modulation panel 62 and enters the user's eye through the open portion 81 varies depending on the location of the optical modulation panel 62. Therefore, in the block region located far from the center of the optical modulation panel 62, the portion of each pixel observed by the user is at a small distance from the center of the pixel.

In this kind of design, illustrated in the left half of FIG. 5, when the user looks at the optical modulation panel 62 from the front, each user's eye through each open portion 81 observes the center of the pixel, and accordingly, the image displayed on the optical modulation panel 62 looks bright.

In the case where the stereoscopic image is displayed by the half-distance display method while the user looks at the optical modulation panel 62 from the front, the control is performed so that the parallax image for the right eye is displayed on the pixel of the channel CH1 in each block region, and the parallax an image for the left eye was displayed on a pixel of channel CH3 in each block region. In this case, the parallax images for the right eye and the left eye to be displayed on channel CH0 and channel CH2 should switch between the right half and the left half of the optical modulation panel 62 observed by the user, while the right half and the left half are determined by the center of the panel 62 optical modulation, as will be described later.

On the other hand, in the structure illustrated in the right half of FIG. 5, the left eye EL observes, for example, places between the pixel G31 and the pixel G32 from among the pixels: G31 to G34, in the block area provided for the open portion 81. In addition, , the user's right eye ER observes the spaces between the pixel G33 and the pixel G34.

In this case, the right eye of the user ER observes the pixels of channel CH0 and channel CH1 in each block region of the entire optical modulation panel 62, as indicated by arrow Q12. In addition, the user's left eye EL observes the pixels of channel CH2 and channel CH3 in each block region of the entire optical modulation panel 62.

To describe it more specifically, since the angle of refraction of the light entering the user's eye from the pixel on the optical modulation panel 62 varies depending on the location on the optical modulation panel 62, each eye of the user sees a slightly larger area of one of two pixels than of another.

In the design illustrated in the right half of FIG. 5, when the user looks at the front of the optical modulation panel 62, the parallax image for the right eye is displayed on the pixels of channel CH0 and channel CH1, and the parallax image for the left eye is displayed on channel CH2 and channel CH3 in each block area. This design has the advantage that display control over parallax images is simpler.

In a situation where the user sees the optical modulation panel 62 in front, each eye of the user sees a portion between the pixels in each block region, and therefore, the parallax images distinguished by the user may appear somewhat darker.

However, if a user looking at the front of the optical modulation panel 62 moves the location of the observation point in the x-axis direction, each of the user's eyes alternately alternately observes from the center of the pixel, then observes the area between the pixels. In view of this, the display control performed on the parallax images in the display device 11 is basically the same for both the structure illustrated in the right half of the drawing and the structure illustrated in the left half of the drawing.

Display control with half-distance display method

Next, control is described specifically for displaying a stereoscopic image by a half-distance display method based on parallax images for the left eye and the right eye.

In the display device 11, when the location of the observation point occupied by the user is detected, based on this location of the observation point, it calculates which places at which pixels in each block area (open area 81) the user will see. Based on the result of this calculation, the parallax image for the right eye or left eye is distributed over the pixels of each channel in each block area.

To describe this more specifically, the display device 11 identifies the location of the block area having the highest light brightness from pixels observed by the user from the number of block areas on the display surface of the optical modulation panel 62, and sets this location as an edge location. Thus, the location of the block area in which the user's eyes will see the centers of the pixels is set as the boundary location.

After determining the boundary location, the display device 11 distributes the right and left parallax images to the pixels of the respective channels of each of the areas separated by the boundary location on the optical modulation panel 62. At the same time, the same parallax images are invariably distributed across the pixels of the same channel of all block regions in each of the regions separated by the boundary place.

After that, the combined image is generated in accordance with the distribution of parallax images over the pixels of the respective channels in these block regions, and the generated combined image is displayed on the optical modulation panel 62.

In addition, when in this situation, the location of the observation point occupied by the user moves, portions of pixels observed by the user change in each block area, and accordingly, the boundary location also moves with the change of location of the observation point. Therefore, as the boundary location moves, the distribution of parallax images across the pixels of the respective channels in the block regions changes.

Hereinafter, each region formed by block regions that are arranged sequentially in a row and in which the same parallax images are distributed across the pixels of the same channels on the optical modulation panel 62 will also be referred to as a sequential block region. Thus, consecutive block regions are regions separated by a boundary location.

The boundary location between consecutive block regions is the location of the block region having the highest light brightness from pixels observed by the user, as described above. Here, the block region having the highest brightness is a block region in which the user sees the centers of the pixels.

Meanwhile, it is known that near the edges of the display module 27, the apparent thickness of the glass material inserted between the barrier element 63 and the optical modulation panel 62 is less. Therefore, in the case in which the boundary position between successive block regions is determined based on the location of the observation point occupied by the user, it is preferable that in each block region using exact formulas of the angle of incidence and the angle of refraction of light to accurately determine which places on which pixels channels are observed by the user.

For example, as shown in FIG. 6, a certain predetermined light beam H11 passes through air, enters a glass material having a thickness D21, and reaches the surface of the optical modulation panel 62. A straight line that passes through the point of incidence of the light beam H11 on the glass material and runs perpendicular to the surface of the glass material is defined as a straight line A21.

Moreover, with respect to the angle of incidence T1 of the light beam H11, which propagates in the air and enters the glass material, the angle T2 between the path of the light of the light beam H11 after entering the glass material and the straight line A21 is determined from the relative refractive index k11 of the light beam H11, coming from air into the glass material, and the angle of incidence T1. Thus, the angle T2 is expressed as T2 = asin (sin (T1 / k11)).

Once the angle T2 is determined, the distance x11 from the straight line A21 to the point of incidence of the light beam H11 on the surface of the optical modulation panel 62 is determined based on the apparent thickness D22 of the glass material and angle T2. Thus, the distance x11 is expressed as x11 = D22 × tan (T2).

When the distance x11 is thus determined, the exact places on the pixels observed by the user (hereinafter also referred to as the observed places of the pixels) can be determined in each block area.

In particular, as shown in FIG. 7, the horizontal direction or direction parallel to the display surface in the optical modulation panel 62, in the drawing, is the x-axis direction, the vertical direction or direction perpendicular to the display surface in the optical modulation panel 62, in the drawing is is the y-axis direction, and, for example, some predetermined location in the xy coordinate system is the CP location of the user's eye.

The open section 81 located in the center of the barrier element 63 is the 0th open section 81, the open section 81 located on n open sections to the left of the 0th open section 81 in the drawing is the nth open section 81, and the open section 81, located on n open sections to the right of the 0th open section 81 in the drawing, is the nth open section 81.

Here, in the nth open section 81 (hereinafter also referred to as open section 81 with number n), it is determined which pixels of which channels in the block area will be observed by the user through the open section 81. First, based on the location coordinates of the CP and the location coordinates of the center of the open portion 81, the angle of incidence T11 of the light beam from the CP point to the nth open portion 81 is determined. Thus, the angle of incidence T11 is the angle between the straight line L21 parallel to the y direction and the light beam from the CP place.

After the angle of incidence T11 is determined, the angle T12 is determined between the straight line L21 and the light beam, which enters the open area 81 from the CP place and goes to the optical modulation panel 62, or the straight line L22 indicating the light path of this light beam. Thus, the angle T12 = asin (sin (T11 / k11)) is determined based on the angle of incidence T11 and the refractive index k11 of the glass material inserted between the open portion 81 and the pixels of the optical modulation panel 62, as described above with reference to FIG. 6.

As a result of this, a formula is defined that represents the straight line L22 (for example, y = ax + b). Accordingly, by calculating the coordinates of the point at which the straight line L22 indicating the light path of this light beam intersects with the pixel of the optical modulation panel 62, it is possible to determine which places on the pixels of which channels will be observed by the user. In Fig. 7, a light beam from the CP location has reached the pixel G41, and it is obvious that the pixel G41 will be observed by the user.

The location in the pixel observed by the user, or the location in the pixel observed by the user, is represented by a value from -0.5 to 0.5, while the location of the center of the pixel is 0. For example, the location of the left edge of the pixel in the drawing is represented by the value +0.5, and the location of the right edge of the pixel in the drawing is represented by a value of -0.5.

In the case where the channel m of the pixel is determined for the right eye and the left eye of the user by the above-described method, which will be observed by the user (hereinafter also referred to as the observed pixel) in each block region (open section 81), and the observed place on the observed pixel the results shown in FIG.

In Fig. 8, the abscissa axis indicates the n number of each open portion 81, and the ordinate axis indicates the channel number or the observed location of each observed pixel. The direction from the 0th open portion 81 to the nth (1 <n) open portion 81 represents the “+ x” direction, and the direction opposite to the “+ x” direction represents the “-x” direction.

In Fig. 8, the straight line C11 indicates the channel number of the observed pixel in each block region that will be visible from the right eye of the user, and curve C12 indicates the observed position in the observed pixel in each block region that will be visible from the right eye of the user.

In this case, it can be noted that through all open areas 81 in all block areas on the optical modulation panel 62, the right eye of the user observes the pixels of channel CH1. You can also notice that the user's right eye observing the 0th open portion 81 observes the center (center point) of the pixel of channel CH1.

In addition, it can be noted that the place on the pixel that will be observed by the user's right eye deviates in the “+ x” direction from the center, as the open portion 81 becomes more and more distant in the “+ x” direction from the 0th open of the portion 81. On the other hand, it can be seen that the place on the pixel that will be observed by the right eye of the user deviates in the “-x” direction from the center as the open portion 81 becomes more and more distant in the “-x” direction from the 0th open plot 81.

In Fig. 8, the straight line C13 indicates the channel number of the observed pixel in each block region that will be visible from the left eye of the user, and curve C14 indicates the observed place in the observed pixel in each block region that will be visible from the left eye of the user, as in case of the right eye.

For example, as can be seen from the straight line C13, through all open sections 81, the user's left eye observes the pixels of channel CH3, and the left eye of the user observing the 0th open section 81 observes the pixel center of channel CH3.

In addition, it can be noted that as the open area 81 becomes more and more distant in the + x direction from the 0th open area 81, the observed place deviates in the + x direction from the center of the pixel, and, as as the open area 81 becomes more and more distant in the "-x" direction from the 0th open area 81, the observed location deviates in the "-x" direction from the center of the pixel.

Having obtained such calculation results, the display device 11, based on the curve C12 and the curve C14, sets the location of the block area (open area 81) having the observed location 0 as the boundary location LB11 between consecutive block areas. More specifically, the boundary location is where the curves indicating the observed locations in the corresponding open areas 81, such as curve C12 and curve C14, intersect the ordinate axis at 0 in each section in which the observed pixels are pixels of the same channel, or the place where the values representing the observed places go from negative values to positive values.

After the boundary location LB11 is determined in the above manner, the display device 11 distributes parallax images to the pixels of the respective channels in each of the successive block regions separated by the boundary location LB11.

In particular, in each block region located between the edge of the optical modulation panel 62 located on the -x direction side and the boundary point LB11, the parallax image for the right eye is distributed among the pixels of channel CH0 and channel CH1, and the parallax image for left eye is distributed pixels of channel CH2 and channel CH3.

In the area to the left of the boundary location LB11 in the drawing, the user's right eye observes the pixels of channel CH1, and the observed places deviate from the centers of the observed pixels to the left in the drawing or towards the pixels of channel CH0. Therefore, in the area to the left of the boundary location LB11, the parallax image for the right eye is distributed among the pixels of channel CH0 and channel CH1.

Similarly, in each block region located between the edge of the optical modulation panel 62 located on the + x direction side and the boundary point LB11, the parallax image for the right eye is allocated to the pixels of channel CH1 and channel CH2, and the parallax image for the left eye is distributed pixels of channel CH0 and channel CH3.

In the example illustrated in FIG. 8, the pixels of the same channel in the corresponding block regions are observed as the observed pixels by the user's eyes. However, when the location of the observation point occupied by the user moves, the channel having pixels to be observed as observed pixels can change with block regions, for example, as shown in FIG. 9.

9, the abscissa axis indicates the n number of each open area 81, and the ordinate axis indicates the channel number or the observed location of each pixel in question.

In Fig. 9, broken line C21 indicates the channel number of the observed pixel in each block region that will be visible from the right eye of the user, and broken line C22 indicates the observed position in the observed pixel in each block region that will be visible from the right eye of the user.

In this example, you can see that in the open areas 81 located on the side of the + x direction from the 0th open area 81, the right eye of the user through these open areas 81 observes places on the sides of the + x direction in pixels of the channel CH0 . You can also notice that in the open areas 81 located on the direction side “-x” from the 0th open area 81, the right eye of the user through these open areas 81 observes places on the sides of the direction “-x” in pixels of channel CH1.

Similarly, in FIG. 9, the broken line C23 indicates the channel number of the observed pixel in each block area that will be visible from the left eye of the user, and the broken line C24 indicates the observed position in the observed pixel in each block area that will be visible from the left eye of the user .

As can be seen from the broken line C23 and broken line C24, in the open sections 81 located on the direction of the "+ x" from the 0th open section 81, the left eye of the user through these open sections 81 observes places on the sides of the direction "+ x" in pixels of channel CH2. You can also notice that in the open areas 81 located on the side of the "-x" direction from the 0th open area 81, the left eye of the user through these open areas 81 observes places on the sides of the "-x" direction in pixels of channel CH3.

In the example illustrated in FIG. 9, a broken line C22 and a broken line C24 representing the observed places do not intersect the observed location “0” (do not intersect 0) in each section in which the pixels observed are the same channel, and therefore, no boundary place is specified.

Therefore, in this case, the parallax image for the right eye is distributed among the pixels of channel CH0 and channel CH1, which are observed pixels, in each block region over the entire surface of the optical modulation panel 62. In each block region, the parallax image for the left eye is distributed across the pixels of channel CH2 and channel CH3, which are the pixels in question. In the example illustrated in FIG. 9, the entire optical modulation panel 62 is considered as one consecutive block region, since there is no boundary location.

As described above, as soon as the channel numbers of the observed pixels and the observed places in the observed pixels are determined for each open area 81 (block area), the boundary position between successive block areas is determined. As a result of this, in each block region belonging to the corresponding consecutive block regions, the channels are determined over which the right and left parallax images should be distributed.

The boundary position between successive block regions when observed from the right eye is exactly the same as the boundary position when observed from the left eye. However, in reality, the right eye and the left eye of the user are located in different places, and a difference may appear between the boundary places, as, for example, shown in Fig. 10.

The difference between the boundary location based on the user's right eye and the boundary location based on the user's left eye, the greater, the farther away the center is in the x-direction.

10, the abscissa axis indicates the n number of each open area 81, and the ordinate axis indicates the channel number or the observed location of each observed pixel.

In Fig. 10, broken line C31 indicates the channel number of the observed pixel in each block region that will be visible from the right eye of the user, and broken line C32 indicates the observed position in the observed pixel in each block region that will be visible from the right eye of the user. A straight line LB31 and a straight line LB32 indicate each boundary location between consecutive block regions, which is determined from a broken line C32.

In addition, the broken line C33 indicates the channel number of the observed pixel in each block region, which will be visible from the left eye of the user, and the broken line C34 indicates the observed position in the observed pixel in each block region, which will be visible from the left eye of the user. A straight line LB41 and a straight line LB42 indicate each boundary location between consecutive block regions, which is determined from a broken line C34.

Hereinafter, the straight line LB31 and the straight line LB32 will also be referred to as the boundary location LB31 and the boundary location LB32, and the straight line LB41 and the straight line LB42 will also be referred to as the boundary location LB41 and the boundary location LB42.

In the example illustrated in FIG. 10, the boundary location LB41 and the boundary location LB42 based on the left eye correspond to the boundary location LB31 and the boundary location LB32 based on the right eye, but there are differences between these boundary locations. With such differences, inconsistencies arise in the distribution of parallax images across the pixels of the corresponding channels in block regions.

For example, based on the right eye, the parallax image for the right eye is distributed among the pixels of channel CH0 and channel CH3 in block regions located between the edge of the optical modulation panel 62 located on the -x direction side and the boundary location LB31. Based on the left eye, the parallax image for the left eye is distributed across the pixels of channel CH2 and channel CH3 in block regions located between the boundary location LB41 and the boundary location LB42.

As a result of this, in the block regions located between the boundary location LB41 and the boundary location LB31, both the parallax image for the right eye and the parallax image for the left eye are distributed among the pixels of the channel CH3.

For this reason, in the display device 11, an intermediate location (middle location) between the boundary location LB31 and the boundary location LB41 and an intermediate location between the boundary location LB32 and the boundary location LB42 are set as the boundary location LB51 and the boundary location LB52, which are the final boundary locations .

Accordingly, as successive block regions, regions separated by the boundary place LB51 and the boundary place LB52 are defined, as, for example, shown in the lower half of the figure, and parallax images are distributed in each block region. The lower half of the drawing shows the number of pixel channels along which the parallax image for the right eye and the parallax image for the left eye are to be distributed in each region.

For example, in the block areas between the edge of the optical modulation panel 62 located on the “-x” direction side and the boundary point LB51, the parallax image for the right eye is distributed among the pixels of channel CH0 and channel CH3, and the parallax image for the left eye is distributed across pixels of the channel CH1 and channel CH2.

In addition, in the block regions between the boundary location LB51 and the boundary location LB52, the parallax image for the right eye is distributed among the pixels of channel CH0 and channel CH1, and the parallax image for the left eye is allocated to pixels of channel CH2 and channel CH3. In addition, in the block regions between the boundary location LB52 and the edge of the optical modulation panel 62 located on the + x direction, the parallax image for the right eye is distributed among the pixels of channel CH1 and channel CH2, and the parallax image for the left eye is distributed among pixels of the channel CH0 and channel CH3.

In the case where an intermediate location between the boundary location based on the right eye and the boundary location based on the left eye is specified as the final boundary location between consecutive block regions, small inconsistencies appear in the distribution of parallax images based on the right eye and the left eye , close to the border point, but this does not particularly affect the stereoscopic viewing of parallax images.

However, if the location of the observation point occupied by the user deviates from Z0 / 2, which is the optimal viewing distance for the half-way display method, or if the location of the observation point occupied by the user moves, for example, closer to the display module 27 or away from it, the difference between a borderline site based on the right eye and a borderline site based on the left eye is gradually becoming larger.

As a result of this, in some block regions, pixels of the same channel are observed as pixels observed both by the right eye and the left eye of the user, for example, as shown in FIG. 11. 11, the abscissa axis indicates the n number of each open area 81, and the ordinate axis indicates the channel number or the observed location of each observed pixel.

In Fig. 11, broken line C41 indicates the channel number of the observed pixel in each block area that will be visible from the right eye of the user, and broken line C42 indicates the observed position in the observed pixel in each block area that will be visible from the right eye of the user. The broken line C43 indicates the channel number of the observed pixel in each block region, which will be visible from the left eye of the user, and the broken line C44 indicates the observed position in the observed pixel in each block region, which will be visible from the left eye of the user.

In this example, the polyline C41 and the polyline C43 overlap each other, and in the block areas of the overlapping portions, pixels of the same channel are observed as pixels observed by the right eye and the left eye of the user. Therefore, parallax images for both the right eye and the left eye are distributed on the same channel. As a result of this, the user cannot stereoscopically observe the object, and stereoscopic display with a parallax image for the right eye and a parallax image for the left eye cannot be performed.

In the case where, at each location, the observation points are determined, in the manner described above, the observed pixels in each of the open sections 81 (block areas), a check can be performed to determine, based on the result, whether stereoscopic viewing of parallax is possible images when the user looks at the display module 27 from the current location of the observation point.

Accordingly, if the calculation for determining the observed pixels is performed for each block region with respect to each location of the observation point, then in the xy plane, a stereoscopically displayed (stereoscopically observed) region and a stereoscopically non-displayed region, for example, as shown in FIG. .12. 12, the horizontal direction and the vertical direction are, respectively, the x-axis direction and the y-axis direction.

In the example illustrated in FIG. 12, the hatched region WR11 in the region surrounding the display unit 27 indicates an area in which stereoscopic display of parallax images is possible. In the case where the stereoscopic display of parallax images is performed by the half-distance display method, the display device 11 sets the region WR12 in the region WR11 as the region in which stereoscopic display of the parallax images is possible. When the location of the observation point occupied by the user is in the area WR12, the display device 11 performs stereoscopic display of the object based on the right and left parallax images. When the location of the observation point occupied by the user is outside the area of WR12, the display device 11 displays one image from among the right and left parallax images.

As described above, the display switches between three-dimensional display and two-dimensional display in accordance with the location of the observation point occupied by the user, so that the natural image can be smoothly presented to the user.

Display Operation Description

The following describes the specific operation of the display device 11.

When a stereoscopic image formed by a parallax image for the right eye and a parallax image for the left eye is assigned, and a command to display these parallax images by the half-distance display method is issued, the display device 11 performs an operation for stereoscopic display of the parallax images. Turning now to the flowchart shown in FIG. 13, a display operation to be performed by the display device 11 is described.

In step S11, the image forming unit 21 inputs the image of the area surrounding the display unit 27 as a peripheral image, and provides this peripheral image to the detection unit 22.

In step S12, the detection unit 22, based on the peripheral image provided from the image forming unit 21, detects the eyes of the user. For example, the detection unit 22 detects a user’s face in a peripheral image, and further detects a user's eyes on an area of the detected face.

In step S13, the detection unit 22 determines whether or not the user's eyes are detected in the peripheral image.

If it is determined in step S13 that the user's eyes have been detected, then the observation point location calculation unit 31 calculates, in step S14, the location of the observation point occupied by the user based on the locations of the detected eyes of the user, and provides the result to the distribution control module 23. For example, the observation point location calculation unit 31 determines, as the location of the observation point, the intermediate position between the user's right and left eyes in the x-y plane.

In step S15, the determination module 32, the distribution control module 23, based on the location data of the observation point occupied by the user provided from the observation point location calculation module 31, determines whether stereoscopic display of parallax images is possible.

For example, the determining unit 32 records in advance area information for identifying a region of WR12 in which stereoscopic display is possible, for example, shown in FIG. Based on the recorded information about the area, a check is made to determine whether stereoscopic display is possible by determining whether the location of the observation point occupied by the user is located in the area WR12. Accordingly, in the case where the location of the observation point occupied by the user is, for example, in the region of WR12, it is determined that stereoscopic display is possible.

If it is determined in step S15 that stereoscopic display is possible, then the observable location calculation unit 33, based on the location data of the observation point occupied by the user provided from the observation point location calculation unit 31, calculates the observed pixels and the observed locations in step S16 for each open area 81.

In particular, the observable location calculation unit 33 performs the calculation described above with respect to FIG. 7 in order to determine the location of the right eye and the location of the left eye of the user based on the location of the observation point. By doing this, the observable location calculating unit 33 calculates the observable pixels to be observed through each open portion 81 and the observable locations on the observable pixels in each open portion 81 (block area). As a result of this, for example, the calculation results shown in FIG. 10 are obtained. Thus, in each block area, the channel numbers of pixels (observed pixels) that will be observed by the right eye or the left eye of the user, and the places (observed places) on the pixels that will be observed by the user are determined.

In step S17, the boundary position calculation unit 34, based on the calculation results of the observed pixels and the observed places in the respective block areas, calculates the boundary places between consecutive block areas.

In particular, the boundary location calculation unit 34, based on the observed locations in the respective block areas determined with respect to the location of the right eye, identifies the block areas having the observed location “0”. In the case where the signs of the observed places in the block areas located on the right and left (in the x axis direction) from one block area are different from each other, but the channels of the observed pixels in the three block areas are the same, the border calculation module 34 places defines as the boundary place, based on the right eye, the location of this block area having the observed location "0".

Similarly, based on the calculation results of the observed pixels and the observed locations in the respective block regions obtained with respect to the location of the left eye, the boundary location calculation unit 34 calculates the boundary locations based on the left eye. Thereafter, the boundary location calculation unit 34 determines the final boundary locations between successive block regions, each of which is an intermediate location between the boundary location based on the right eye and the boundary location that is based on the left eye and corresponds to the boundary location based on the right eye .

Here, the boundary location that is based on the left eye and corresponds to the boundary location based on the right eye is the boundary location that is based on the left eye and is closest to the boundary location based on the right eye.

By such calculations, for example, the boundary location LB51 and the boundary location LB52 shown in FIG. 10 are obtained. Depending on the location of the observation point occupied by the user, there may not be any boundary locations, as in the example illustrated in FIG. 9.

In step S18, the boundary location calculation unit 34, based on the results of the calculation of the boundary locations between consecutive block regions, distributes a parallax image for the right eye or a parallax image for the left eye in pixels in each block region.

For example, in the example illustrated in FIG. 9, in which there is no boundary location, the parallax image for the right eye is distributed among the pixels (channel regions) of the channel CH0 and channel CH1 in all block areas on the display surface of the optical modulation panel 62. In addition, the parallax image for the left eye is distributed among the pixels of channel CH2 and channel CH3.

In the example illustrated in FIG. 10, the parallax image for the right eye is distributed, for example, in the pixels of channel CH0 and channel CH1 in the block regions located between the boundary point LB51 and the boundary point LB52 from among the block regions on the display surface of the optical modulation panel 62. In addition, the parallax image for the left eye is distributed among the pixels of channel CH2 and channel CH3 in block regions located between the boundary location LB51 and the boundary location LB52.

More specifically, the block region BR1 and the block region BR2, each of which is formed by four pixels on the optical modulation panel 62, can be set in such a way as, for example, shown in Fig. 14. 14, the horizontal direction is the x-axis direction.

14, the rectangles indicated by arrows: Q41 to Q43 represent a parallax image for the right eye, a parallax image for the left eye, and an optical modulation panel 62. In addition, each one square in these rectangles represents one pixel, and the symbols "R" ("Red"), "G" ("Green") and "B" ("Blue") in the respective pixels indicate the colors of the respective pixels.

For example, as the block area BR1, an area that includes pixels: from G51 to G54 is set on the optical modulation panel 62, and as a block area BR2 that is set to an area that includes pixels: from G55 to G58. Here, a pixel G51 is a pixel that has an R (red) color filter and transmits only light in R (red color range), and a pixel G52 is a pixel that has a G (green) color filter and transmits only light in G ( green color range).

In the drawing, under the corresponding pixels on the optical modulation panel 62, the channel numbers of these pixels are shown. For example, pixel G51 is a pixel of channel CH0, and pixel G52 is a pixel of channel CH1.

In addition, in the drawing, pixels of parallax images for the right eye and left eye, which are located in the same places as the corresponding pixels in the optical modulation panel 62, in the horizontal direction, are shown in the same places as these pixels.

Typically, pixels in an image have the colors R (red), G (green), and B (blue). Therefore, the region formed by R, G, and B adjacent to each other is defined as one pixel, and the corresponding color regions R, G, and B are often considered as sub-pixels.

In particular, in the drawing, in the parallax image for the right eye, the region formed by three consecutive pixels: R (red), G (green) and B (blue), from the left edge is usually specified as one pixel (hereinafter, where it appropriate, also referred to as an RGB pixel), and the G61 pixel, G62 pixel, and similar pixels of corresponding colors are often considered sub-pixels. However, each G61 pixel, G62 pixel, and the like are referred to herein as a pixel.

Similarly, the tri-color region formed by pixels: from G51 to G53, is usually considered as one pixel, but each of the pixels: from G51 to G53, here is considered as one pixel.

For example, in the block region BR1 and the block region BR2, the boundary position calculation unit 34 can distribute the parallax image for the right eye in the pixels of channel CH0 and channel CH1, and distribute the parallax image for the left eye in pixels of channel CH2 and channel CH3.

At the same time, the boundary position calculation unit 34 distributes the pixel G61 and the right-eye parallax image pixel G62 to the pixel G51 and the pixel G52 on the optical modulation panel 62, which are located at the same places as these pixels. The edge location calculation unit 34 also distributes the left-eye pixel G71 and the left-eye parallax image pixel G72 to the pixel G53 and the pixel G54 on the optical modulation panel 62, which are located at the same locations as these pixels.

Similarly, the boundary location calculation unit 34 distributes the right-eye parallax image pixel G63 and the right-eye parallax image pixel G64 to the G55 pixel and the G56 pixel and distributes the left-eye parallax image pixel G73 and the G74 pixel to the G57 pixel and the G58 pixel.

As described above, when distributing a parallax image for the right eye or for the left eye over the pixels of a certain predetermined channel in the block area, pixels of the parallax image for the right eye or for the left eye, which are located at the same places as the pixels of this previously of a given channel are distributed among these pixels of this predefined channel.

After distributing the parallax image for the right eye or for the left eye into the pixels of each channel in each block region in the above-mentioned manner, the boundary location calculation unit 34 provides the result of this distribution to the generating unit 25 and issues a command to generate the combined image.

In step S19, based on the distribution result provided from the boundary position calculation unit 34 and the parallax images for the right eye and the left eye read from the recording unit 24, the generating unit 25 generates a combined image and provides this combined image to the display control unit 26. In the case in which the distribution illustrated in FIG. 14 is made, the generating unit 25 generates a combined image so that the pixel G61 and the pixel G62 of the parallax image for the right eye are displayed on the pixel G51 and the pixel G52, and the pixel G71 and the pixel G72 of the parallax image for the left eye were displayed on the pixel G53 and pixel G54.

Parallax images may not be obtained from the recording module 24, but may be obtained from some external device or received communication systems.

In step S20, the display control unit 26 provides the combined image provided from the generating unit 25 to the display unit 27 and causes the display unit 27 to display this combined image.

For example, the display unit 27 causes the backlight 61 to emit light based on the provided merged image, and controls, for each pixel, the light transmittance from the backlight 61 by supplying voltage to the optical modulation panel 62. The display unit 27 also has a voltage applied to the barrier element 63 to form a parallax barrier including exposed portions 81 and shield portions 82.

As a result of this, the light that was emitted from the backlight 61 and passed through the respective pixels on the optical modulation panel 62 is optically separated by a parallax barrier. Part of the divided light enters the right eye or the left eye of the user, and the object in parallax images is stereoscopically observed by the user. In particular, the region of the parallax image for the right eye in the combined image is observed by the right eye of the user, and the region of the parallax image for the left eye in the combined image is observed by the left eye of the user.

If, for example, there is sound accompanying the right and left parallax images, then the display device 11 outputs, together with showing the combined image, the accompanying sound from a speaker (not shown in the drawings).

In step S21, the display device 11 determines whether to turn off the power to the display device 11. When, for example, a command to turn off the power is issued by means of some user operation, the power should be turned off.

If it is determined in step S21 that the power should not be turned off, the operation returns to step S11, and the above procedures are repeated. In particular, the distribution of parallax images by the pixels of the respective channels in the block regions changes in accordance with the movement of the location of the observation point occupied by the user, and the combined image generated in accordance with the new distribution is displayed.

On the other hand, if it is determined in step S21 that the power should be turned off, the display device 11 completes the operations of the respective components and turns off the power. In this case, the display operation comes to an end.

If it is determined in step S15 that stereoscopic display is not possible, then the distribution control unit 23 instructs the generating unit 25 to display a two-dimensional parallax image, and the operation proceeds to step S22.

In step S22, the generating unit 25, in accordance with a command from the distribution control unit 23, obtains a two-dimensional parallax image to be displayed. In particular, the generating unit 25 reads one of the parallax images for the right eye and for the left eye from the recording unit 24, and provides the read parallax image directly to the display control unit 26.

The display control unit 26 provides the parallax image provided from the generating unit 25 to the display unit 27, and causes the display unit 27 to display this parallax image. Moreover, the barrier element 63, for example, does not form a parallax barrier, and the display unit 27 displays the parallax image as it is. Even in the case where the parallax barrier implemented in the display unit 27 is of a constant type, the parallax image is displayed on the display unit 27 as it is, and accordingly, the parallax image is displayed in a two-dimensional manner (two-dimensional display is performed).

After the parallax image was displayed in step S22, the operation proceeds to step S21, and then the above procedure is performed.

If it is determined in step S13 that the user's eyes have not been detected, the detection unit 22 provides a detection result indicating that no eyes have been detected to the distribution control unit 23, and the operation proceeds to step S23.

In step S23, the distribution control unit 23 determines whether a certain predetermined period of time has passed since the detection of the user's eyes has failed.

If it is determined in step S23 that this predetermined period of time has not yet passed, the operation proceeds to step S22, and the above procedure is performed. In particular, the parallax image is displayed, on the display unit 27, in a two-dimensional manner.

On the other hand, if it is determined in step S23 that this predetermined period of time has passed, then the distribution control unit 23, in step S24, controls the generation unit 25 so that no images are displayed. Under the control of the distribution control module 23, the generating module 25 stops providing images to the display control module 26. As a result of this, no image is displayed on the display unit 27. Thus, the display is stopped.

In the case where there is sound accompanying the parallax image, when the display is stopped, only sound can be reproduced, or the sound can also be turned off. As described above, in the case in which the user's eyes are not detected for a predetermined period of time, the user may not be looking at the parallax image, and by stopping the display, the power consumption can be reduced.

After the display is stopped at step S24, the operation proceeds to step S21, and the above procedure is performed. The display operation in this case comes to an end.

In the above method, the display device 11, based on the location of the observation point occupied by the user, calculates the observed pixels and the observed places in each block region and, based on the calculation result, distributes the parallax image for the right eye or left eye for the pixels of each channel in the block areas. Thus, a combined image is generated.

In this case, the parallax image for the same observation point is distributed over at least two pixels adjacent to each other in the x-axis direction in the block area, so that the occurrence of crosstalk can be prevented with greater ease, and can be higher quality images are presented.

In addition, the distribution of parallax images by the pixels of the respective channels in the block areas changes in accordance with the movement of the location of the observation point occupied by the user, so that a more natural and high-quality image could be presented, while the user does not notice the switching of parallax images displayed through the corresponding channels .

In addition, in the display device 11, when the user observes the display unit 27 from an area in which stereoscopic display is possible, the observed places among the respective block areas are almost the same places. Accordingly, uniform brightness is achieved in the entire displayed image, and moire stripes do not appear.

In addition, the display device 11 is designed so that when the location of the observation point occupied by the user is located at a distance that is almost half the proper viewing distance, the observed places in the respective block areas become almost the same places. Accordingly, the number of boundary locations between consecutive block regions can be reduced.

For example, in the case where a conventional display device for four observation points is viewed from a distance that is half the proper viewing distance, pixels of different channels are observed depending on block areas, and the number of boundary places between consecutive block areas is 4 or more. On the other hand, in the display device 11, the number of boundary locations is 3 or less, and display control of parallax images can be performed with greater ease.

In the above display operation, the determining unit 32 records in advance the area information for identifying an area in which stereoscopic display is possible. However, such region information may not be recorded in advance, and based on the calculation results of the observed pixels, a check can be performed to determine whether stereoscopic imaging is possible.

In this kind of case, the determination unit 32 uses the results of the calculations of the observed pixels in the respective block areas that were performed by the observable location calculation unit 33. Thus, in the case where there is a block observable pixel based on the right eye and an observable pixel based on the left eye are pixels of the same channel, the determination unit 32 determines that stereoscopic imaging is not possible.

Modification 1

In the above description, the display device 11 performs stereoscopic display by the half-distance display method alone. However, stereoscopic display by the half-distance display method can be performed by a display system formed by several devices.

In such a case, the display system of the structure shown, for example, in FIG.

In particular, the display system shown in FIG. 15 is constituted by an image forming apparatus 121, an image processing apparatus 122, and a display apparatus 123. In Fig. 15, components equivalent to those shown in Fig. 1 are denoted by the same reference numerals as those used in Fig. 1, and their explanation is not repeated here.

The image forming apparatus 121 inputs, as a peripheral image, an environment image of the display device 123, and provides this peripheral image to the image processing apparatus 122. The image processing apparatus 122, using the peripheral image provided from the image forming apparatus 121, generates a combined image, and provides this combined image to the display device 123.

The image processing device 122 is constituted by a detection module 22, a distribution control module 23, a recording module 24, and a generation module 25. The detection module 22 detects a user's eyes in a peripheral image provided from the image forming apparatus 121 and provides a detection result to the distribution control module 23. Based on the detection result provided from the detection module 2, the distribution control module 23 distributes the parallax images to the pixels of the respective channels in the block regions.

Under the control of the distribution control module 23, the generating module 25 generates a combined image from the parallax images for the right and left eyes recorded in the recording module 24, and provides this combined image to the display device 123.

The display device 123 is a display device that has the same functions as the functions of, for example, the display unit 27 and the display control unit 26, and can display a stereoscopic image. Based on the combined image provided by the generating module 25, the device 123 performs stereoscopic display of the object on the parallax images.

Modification 2

In addition, in the above description, the display module 27 has been described as a display device that can stereoscopically display parallax images for four observation points. However, the display module 27 may be a display device that can stereoscopically display parallax images for five or more viewing points.

In the case where the display module 27 can stereoscopically display parallax images, for example, for six observation points, the region formed by pixels of six different channels is set as the block region, and one open region 81 is provided for the block region, as shown in FIG. .16. In FIG. 16, components equivalent to the components shown in FIG. 2 are denoted by the same reference numerals as those used in FIG. 2, and their explanation is not repeated here.

In the example illustrated in FIG. 16, a region including pixels: G91 to G96, six different channels is defined as one block area.

In this case, the location of the observation point occupied by the user, from which parallax images can be stereoscopically observed, is such that the observed pixels, which are based on the right eye and the left eye of the user, become, for example, pixels located three pixels apart friend. In the example illustrated in FIG. 16, the pixel G95 is observed by the right eye of the user ER, and the pixel G92 is observed by the left eye of the user EL.

During the distribution of parallax images, the parallax image for the right eye or left eye is distributed across the pixels of at least three consecutive channels. For example, the parallax image for the left eye is distributed in pixels: from G91 to G93, in Fig. 16, and the parallax image for the right eye is distributed in pixels: from G94 to G96.

As described above, in a display module that can stereoscopically display parallax images for observation points, the observed pixels for the right eye and left eye are pixels spaced two or more pixels apart. With this arrangement, the parallax image for the same observation point can be distributed over two or more pixels arranged in a row in the parallax direction. Accordingly, the occurrence of crosstalk can be easily prevented, and parallax images of higher quality can be presented.

In the above description, the eyes of a user looking at the display device 11 observe almost the same places in the corresponding block regions. Accordingly, uniform brightness is achieved on the entire display surface of the optical modulation panel 62, and moire stripes do not appear, as described above.

However, if the width of the opening of each open area 81 is too small, then in the case when the user observes the centers of pixels, the screen is bright, but in the case when the user observes spaces between the pixels, the screen is dark. In this kind of case, when the user moves the location of the observation point in the x direction, the screen alternately changes the state between the bright state and the dark state in accordance with predetermined cycles.

To prevent such cycles of the bright state and dark state, it is necessary to appropriately set the width of each open portion 81, and the opening width can be made equal, for example, to the width of a pixel or the distance between pixels. Alternatively, the opening width may be set to a value obtained by subtracting the pixel width from a value equivalent to twice the distance between the pixels.

The second embodiment of the invention

Crosstalk occurrence and reduction

In the case where the stereoscopic image is displayed by the half-distance display method described above, crosstalk can be prevented and high-quality images can be presented. However, a small amount of crosstalk also occurs with the half-distance display method.

For example, as shown on the left side of FIG. 17, the user can observe the pixels on the optical modulation panel 62 through the open portion 81 when both eyes of the user are spaced Z0 / 2 in the y direction from the display unit 27, while the distance Z0 / 2 is half of the proper viewing distance (hereinafter also referred to as half of the proper viewing distance). 17, the horizontal direction and the vertical direction are, respectively, the x-axis direction and the y-axis direction.

In Fig. 17, in the x direction in the optical modulation panel 62, five pixels are arranged in a row: G121 through G125, and these pixels: G121 through G125 are pixels of the channels: CH0, CH1, CH2, CH3, and CH0. The numbers in the respective pixels indicate the channel numbers of these pixels.

In the example shown on the left side of the drawing, the right eye ER and the left eye EL of the user are located at half the proper viewing distance from the display unit 27, and the right eye ER and the left eye EL of the user are observing, respectively, the region VR11 and the region VL11 on the panel 62 optical modulation.

Region VR11 is essentially a region of pixel G122, and region VL11 is essentially a region of pixel G124. Accordingly, the right eye ER and the left eye EL of the user observe the almost central regions of the pixel G122 and the pixel G124. Thus, in this situation, crosstalk does not occur.

Meanwhile, in the case where the location of the observation point occupied by the user becomes closer to the display unit 27 than to the place located at half the proper viewing distance, in the situation illustrated on the left side of the drawing, the area observed by the user on the panel 62 optical modulation, changes as shown in the central part of the drawing. In particular, the region VR12 observed by the right eye of the user ER in this example is a region including the portion of the pixel G121 and the portion of the pixel G122, and the region VL12 observed by the left eye EL of the user is the region including the portion of the pixel G124 and part of the pixel G125.

Therefore, both the right eye and the left eye of the user see the pixel of the channel CH0, and crosstalk occurs.

In the case where the location of the observation point occupied by the user becomes even further from the display unit 27 than from the place located at half the proper viewing distance, in the situation illustrated on the left side of the drawing, the region observed by the user on the optical modulation panel 62, changes as shown on the right side of the drawing. In particular, the region VR13 observed by the right eye of the user ER, in this example, is the region including the portion of the pixel G122 and the portion of the pixel G123, and the region VL13 observed by the left eye of the EL user is the region including the portion of the pixel G123 and part of the pixel G124.

Therefore, both the right eye and the left eye of the user see the pixel of channel CH2, and crosstalk occurs.

To describe it more specifically, crosstalk caused by a change in the distance from which the user is browsing occurs near a boundary location between consecutive block regions, as shown in FIG. 18. FIG. 18 shows an exemplary case in which the location of the observation point occupied by the user is closer to the display unit 27 than to a location located at half the proper viewing distance. The horizontal direction in the drawing represents the direction along the x axis, and each one square in the drawing represents one pixel provided on the optical modulation panel 62. In addition, the numbers shown in these pixels represent the channel numbers of the corresponding pixels.

In Fig. 18, the respective regions: VR21-1 through VR21-8 represent the regions on the optical modulation panel 62 that will be observed through the corresponding open portions 81 by the user's right eye ER. In addition, the respective regions: VL21-1 through VL21-8, represent the regions on the optical modulation panel 62 that will be observed through the corresponding open regions 81 by the left eye of the user EL.

In the future, areas: from VR21-1 to VR21-8, will also be referred to simply as areas of VR21 when there is no particular need to distinguish these areas from each other, and areas: from VL21-1 to VL21-8 will also simply referred to as areas of VL21 when there is no particular need to distinguish these areas from each other.

In the half-distance display method, when the boundary place between successive block regions based on the right eye is different from the boundary place between successive block regions based on the left eye, an intermediate place between these boundary places is set as the final boundary place, and distribution is performed right and left parallax images.

For example, in FIG. 18, the straight line LB81 and the straight line LB82 represent, respectively, the boundary location based on the right eye and the boundary location based on the left eye, and these boundary locations are different places. Therefore, as the final boundary location between consecutive block regions, the location of the straight line LB83, located at an intermediate location between the straight line LB81, and the straight line LB82 are specified.

In this case, in the area located to the left of the straight line LB83 in the drawing, the parallax image for the left eye is distributed among the pixels of channel CH0 and channel CH3, and the parallax image for the right eye is distributed among the pixels of channel CH1 and channel CH2.

In addition, in the area located to the right of the straight line LB83 in the drawing, the parallax image for the left eye is distributed among the pixels of channel CH2 and channel CH3, and the parallax image for the right eye is distributed among the pixels of channel CH0 and channel CH1.

When performing such a distribution of parallax images, for example, the parallax image for the right eye can be displayed as a white image, and the parallax image for the left eye can be displayed as a black image.

We now turn our attention to the region between the location of the straight line LB83, as the boundary location between successive block regions, and the location of the straight line LB81, as the boundary location based on the right eye. The regions VR21 located in this region include the pixel regions of channel CH1 and channel CH0.

In particular, more than half of the pixel regions of channel CH1 in this region are observed by the right eye of the user. Accordingly, the observed pixels based on the right eye of the user are pixels of the channel CH1. However, not only the pixels of channel CH1 are observed with the right eye of the user, but also partial pixel regions of channel CH0.

However, in the region between the straight line LB83 and the straight line LB81, the parallax image for the left eye is distributed among the pixels of the channel CH0. Therefore, in this area, the right eye of the user sees a leak of the parallax image for the left eye. Thus, crosstalk occurs in the right eye of the user.

As a result of this, the image PR11, perceived by the right eye of the user, is an image that is grayish in the area corresponding to the area between the straight line LB83 and the straight line LB81. In particular, on the left side of the straight line LB83, as the boundary location in the drawing, the amount of crosstalk is greater in the area closer to the straight line LB83. However, on the right side of the straight line LB83 in the drawing, no crosstalk occurs. As a result of this, linear crosstalk occurs in the image of PR11, which are elongated in the z-axis direction, and these crosstalk are quite noticeable.

Similarly, we now turn our attention to the region located between the location of the straight line LB83 as the boundary between successive block regions and the location of the straight line LB82 as the boundary based on the left eye. The regions VL21 located in this region include the pixel regions of channel CH0 and channel CH3.

However, in the region between the straight line LB83 and the straight line LB82, the parallax image for the right eye is distributed among the pixels of the channel CH0. Therefore, in this area, the left eye of the user sees a leak of the parallax image for the right eye.

As a result of this, the image PL11, perceived by the left eye of the user, is an image that is whitish in the area corresponding to the area between the straight line LB83 and the straight line LB82. In particular, on the right side of the straight line LB83, as the boundary location in the drawing, the amount of crosstalk is greater in the area closer to the straight line LB83. However, no crosstalk occurs on the left side of the straight line LB83 in the drawing. As a result of this, linear crosstalk occurs in the image PL 11 nfr; t, which is elongated in the z-axis direction.

As described above, in the region between the straight line LB81 and the straight line LB82, the pixel regions of the channel CH0 are observed by the right and left eyes of the user, and as a result, crosstalk occurs, regardless of how the right and left parallax images are distributed. In the case in which parallax images are distributed using one of the locations as the boundary between consecutive block regions: the straight line LB81 and the straight line LB82, almost no crosstalk occurs in one eye from the right and left eyes, but a large number of cross interference occurs in the other eye.

In view of this, in order to further reduce crosstalk in the case of the half-distance display method, the right and left parallax images can be mixed and then displayed on the pixels that will cause the crosstalk, or on the pixels that will be observed as the right eye, so with the left eye.

For example, as shown in FIG. 19, pixels that will cause crosstalk are present in the area between the straight line LB81, as the borderline based on the right eye, and the straight line LB82, as the borderline based on the left eye. In Fig. 19, components equivalent to the components shown in Fig. 18 are denoted by the same reference numerals as those used in Fig. 18, and their explanation is not repeated here.

In the example illustrated in FIG. 19, pixels of the channel CH0 present in the region between the straight line LB81 and the straight line LB82 are observed by both eyes of the user and cause crosstalk, as described above with respect to FIG. 18.

In view of this, these pixels display an image with a pixel value obtained by mixing the pixel values of the pixels of the right and left parallax images in the mixing ratio, in accordance with the amount (amount of leakage) leaking out as crosstalk from the pixels of the channel CH0 in the region between straight line LB81 and straight line LB82.

For example, at the location of the straight line LB83 or at the pixel of the channel CH0 located at the boundary point, light (image) leaks from this pixel into the region VR21-4 and region VL21-5, and results in crosstalk. The amount of seepage is the same in both of the areas. In view of this, an image with a pixel value obtained by mixing the pixel values of the corresponding pixels of the right and left parallax images in an equal ratio is displayed on the pixel of the channel CH0 located at the boundary location.

In the pixel of the channel CH0, which in the drawing is adjacent to the straight line LB81 and is located on the right side of it, the light from this pixel seeps into the region VR21-2 and region VL21-3 and results in crosstalk. Here, the amount of seepage into the VL21-3 region or into the left eye is higher. In view of this, an image with a pixel value obtained by mixing pixels of the parallax image for the left eye in a higher ratio among the corresponding pixels of the right and left parallax images is displayed on the pixel of the channel CH0, which is adjacent to the straight line LB81 and is located on the right side of it.

In the pixel of the channel CH0, which in the drawing is adjacent to the straight line LB82 and is located on the left side of it, on the other hand, the light from this pixel seeps into the region VR21-6 and region VL21-7, and results in crosstalk. Here, the amount of leakage to the VR21-6 region or to the right eye is higher than the amount of leakage to the left eye. In view of this, an image with a pixel value obtained by mixing pixels of the parallax image for the right eye at a higher ratio among the corresponding pixels of the right and left parallax images is displayed on the pixel of the channel CH0, which is adjacent to the straight line LB82 and is located on the left side of it.

To summarize the above facts, then on the pixels that will cause the occurrence of crosstalk, an image with a pixel value Out (X) determined in accordance with the following equation (1) should be displayed.

Out (X) - (R (X) × (X-X1) + L (X) × (X2-X)) / (X2-XI) ... (1)

In equation (1), the variable X represents the location of the pixel on the optical modulation panel 62 in a coordinate system having, as the direction of the + X axis in the drawing, a direction to the right ("-x" direction), with a coordinate origin representing the location of the left edge the optical modulation panel 62 in the drawing or the location of the edge in the “+ x” direction.

R (X) and L (X) represent the pixel values of the pixels, respectively, of the parallax images for the right eye and the left eye, at location X, and X1 and X2 represent, respectively, the boundary location based on the right eye and the boundary location based on the left eye. For example, the location of the straight line LB81 represents the location X = X1, and the location of the straight line LB82 represents the location X = X2.

Accordingly, the pixel value Out (X) of the pixel at location X in the combined image to be displayed on the channel pixel that will be observed with both eyes of the user is determined by the calculation in accordance with equation (1), while location X is located between location X1 and location X2 . The pixel value Out (X) is determined by calculating the weighted average value between the pixel value of the pixel of the parallax image for the left eye at location X and the pixel value of the pixel of the parallax image for the right eye at location X, with a weight factor representing the ratio between the amount of light leaking from the pixel at location X in the right eye, and the amount of light leaking from the pixel at location X at the left eye.

The ratio (mixing ratio) between the amount of light leaking from a pixel in place X to the right eye and the amount of light leaking from a pixel in place X to the left eye is determined based on the relative position of place X and places X1 and X2, or based on the location the location of the pixel to be processed in the area where the blending should be performed. In other words, the blending ratio is the aspect ratio between the pixel region to be observed by the right eye and the pixel region to be observed by the left eye of the user. For example, at location X closer to location X1, the amount of light leaking from the pixel of channel CH0 to the left eye is higher, and accordingly, the parallax image for the left eye is mixed in a higher ratio.

In the case where the mixing is performed in accordance with the amount of light leaking as crosstalk, and the combined image resulting from the mixing is displayed, the image PR21 is perceived by the user's right eye ER, and the image PL21 is perceived by the user's left eye EL.

The combined image displayed in this case is an image obtained by replacing a part of a white image as a parallax image for the right eye and a part of a black image as a parallax image for the left eye with an image obtained by performing blending.

In the PR21 image and the PL21 image, a small amount of crosstalk occurs on the right and left side of the straight line LB83, but the crosstalk is scattered to the right and left of the straight line LB83 due to the parallax image mixing. Accordingly, crosstalk is not as noticeable as crosstalk on image PR11 and image PL11. Although the area where crosstalk occurs is larger, the amount of leakage in each area is smaller. Accordingly, the deterioration in image quality of a stereoscopic image due to the occurrence of crosstalk is reduced.

As for the light from the pixel of the channel CH0 located at the location of the straight line LB83, for example, the amount of leakage to the right eye of the user is essentially the same as the amount of leakage to the left eye of the user. In view of this, the pixels of the combined image to be displayed on this pixel are created in such a way as to include the same number of right and left parallax images. Thus, the amount of crosstalk in the right eye and left eye is made smaller than in the case where the pixels of the combined image include pixels of only one of the parallax images.

An exemplary display device structure

In the case in which parallax images are mixed for pixels that will cause crosstalk in the manner described above, the display device is constructed in a manner such as, for example, shown in FIG.

The display device 151 shown in FIG. 20 includes an image forming unit 21, a detection unit 22, a distribution control unit 23, a recording unit 24, a generating unit 25, a display control unit 26, and a display unit 27. In FIG. 20, components equivalent to those shown in FIG. 1 are denoted by the same reference numerals as those used in FIG. 1, and their explanation is not repeated here.

The display device 151 shown in FIG. 20 has the same structure as the display device 11 shown in FIG. 1, except that a calculation module 161 is provided in the distribution control unit 23 included in the display device 151 mixing ratios.

In the case where the stereoscopic image is to be displayed by the half-distance display method, when the optical modulation panel 62 has a channel pixel for which mixing is to be performed, the mixing ratio calculation unit 161 calculates the mixing ratio between the parallax images in the pixel of this channel. Hereinafter, the channel of the pixel for which mixing is to be performed is also referred to as the channel to be processed.

In the case where the combined image should be generated from the parallax images read from the recording module 24, when there is a region in which mixing should be performed, the generating module 25 generates the combined image, performing mixing for the pixel of a given channel in this region, based on the mixing ratio calculated by the mixing ratio calculation unit 161.

Display Operation Description

Now, with reference to the flowcharts shown in FIGS. 21 and 22, we will describe the display operation to be performed by the display device 151.

The procedures in steps S51 to S58 are the same as the procedures in steps Sll to S18 shown in FIG. 13, and therefore their explanation is not repeated here. In the procedures of steps S51 to S58, the parallax image for the right eye or the parallax image for the left eye is distributed across the pixels of each channel in each block area.

In step S59, the mixing ratio calculation unit 161 determines whether there is an area in which mixing is to be performed.

For example, in the case in which the boundary position based on the right eye, which was calculated by the procedure in step S57, is different from the boundary location based on the left eye, it is determined that there is an area in which blending is to be performed. In this case, the region between the boundary place based on the right eye and the boundary place based on the left eye is defined as the region in which mixing should be performed.

If it is determined in step S59 that there are no areas in which mixing should be performed, the boundary location calculation unit 34 provides the result of distributing the right and left parallax images by pixels of the respective channels to the generating unit 25. After that, the operation proceeds to step S60.

In step S60, based on the distribution result provided from the boundary position calculation unit 34 and on the parallax images for the right eye and the left eye read from the recording unit 24, the generating unit 25 generates an integrated image and provides this combined image to the display control unit 26 . At this step S60, the same procedure is performed as the procedure at step S19 shown in FIG. 13. After performing the procedure in step S60, the operation proceeds to step S64.

On the other hand, if it is determined in step S59 that the region in which mixing is to be performed, it is determined that the mixing ratio calculation unit 161 calculates in step S61 the channel to be mixed for which mixing is to be performed.

For example, the mixing ratio calculation module 161 determines the channel to be processed, which is the channel of the pixel that will be observed by the right and left eyes of the user, from the number of corresponding pixels located in the region between the boundary location based on the right eye and the boundary location based on the left the eye.

The channel to be processed can be determined based on the observed locations in the observed pixels located in the region between the boundary location based on the right eye and the boundary location based on the left eye.

For example, the area in which mixing is to be performed is the area between the straight line LB41 and the straight line LB31 shown in FIG. 10. In this area, the pixel to be observed with the right eye refers to channel CH0, but the broken line C31 indicates that the observed location of this observed pixel has a negative location. Therefore, the right eye of the user observes not only the pixel of channel CH0, but also the pixel of channel CH3.

Similarly, in this region, the pixel to be observed with the left eye refers to channel CH2, but the broken line C34 indicates that the observed location of this observed pixel has a positive location. Therefore, the left eye of the user observes not only the pixel of channel CH2, but also the pixel of channel CH3. Accordingly, in this case, the channel CH3 is identified as the channel to be processed.

In step S62, the mixing ratio calculation unit 161 calculates the mixing ratio in accordance with the above equation (1) for each pixel of the channel to be processed in the area in which the mixing is to be performed. For example, in the case where the location of the processed pixel of the channel to be processed is a certain location X, the mixing ratio for the parallax image for the left eye is expressed as (X2-X) / (X2-X1), and the mixing ratio for the parallax image for the right eye is expressed as (X-X1) / (X2-X1). Here, X1 and X2 represent, respectively, a borderline site based on the right eye and a borderline site based on the left eye.

After calculating the mixing ratio, the mixing ratio calculation module 161 provides the calculated mixing ratios and the distribution result of the right and left parallax images on the pixels of the respective channels to the generating module 25. After that, the operation proceeds to step S63.

In step S63, the generating unit 25 generates a combined image based on the mixing ratios provided from the mixing ratio calculating unit 161 as a result of distributing the parallax images and parallax images for the right eye and the left eye read from the recording unit 24.

For example, the generating unit 25 generates a combined image by performing the same procedure as the procedure in step S19 shown in FIG. 13. Moreover, for the pixels of the combined image corresponding to the pixels of the channel to be processed in the area in which mixing is to be performed, the generating module 25 performs the calculation in accordance with the above equation (1) based on the mixing ratios, and sets the calculated pixel values in as pixel values for the pixels of the merged image.

After generating the combined image, the generating unit 25 provides the generated combined image to the display control unit 26. After that, the operation proceeds to step S64.

After the combined image is generated in step S63 or step S60, the procedures in steps: S64 to S68 are performed, and after that, the display operation comes to an end. Since these procedures are the same as the procedures in steps: S20 to S24 shown in FIG. 13, their explanation is not repeated here.

In the above method, the display device 151 calculates observable pixels and observable locations in each block region based on the location of the observation point occupied by the user and, based on the calculation result, distributes the parallax image for the right eye or left eye over the pixels of each channel in the block areas. Thus, a combined image is generated.

In this case, the display device 151 generates pixels of the combined image corresponding to the pixels of the channel to be processed, mixing the right and left parallax images where necessary. As a result of this, crosstalk can be reduced, and higher quality images can be presented.

In the case where the above mixing operation is applied to the half-distance display method, corresponding operations can be performed by the display system shown in FIG. In FIG. 23, components equivalent to those shown in FIGS. 15 or 20 are denoted by the same reference numerals as those used in FIGS. 15 or 20, and their explanation is not repeated here.

The display system shown in FIG. 23 is constituted by an image forming apparatus 121, an image processing apparatus 181, and a display apparatus 123. The image processing device 181 is constituted by a detection unit 22, a distribution control unit 23, a recording unit 24, and a generating unit 25.

Here, the image processing device 181 has the same structure as the image processing device 122 shown in FIG. 15, except that a distribution ratio calculation module 161 is provided in the distribution control unit 23 included in the image processing device 181, . In the display system shown in FIG. 23, the same operation is performed as the display operation shown in FIGS. 21 and 22.

The above described sequence of operations may be performed by hardware, and may also be performed by software. In the case in which this sequence of operations is performed by software, a program with these software is installed from the recording medium of the program, for example, to a computer that is part of special-purpose hardware, or to a universal personal computer that can perform various types of functions, when installing programs of various kinds on it.

Fig is a structural diagram showing an exemplary hardware structure of a computer that performs, in accordance with the program, the above sequence of operations.

In a computer, a central processing unit (CPU) 201, read-only memory (ROM) 202 and random access memory (RAM) 203 are connected to each other via a bus 204.

In addition, an I / O interface 205 is connected to the bus 204. Connected to the input / output interface 205: an input data input module 206 formed by a keyboard, a mouse, a microphone, and the like; an output module 207 formed by a display device, a speaker, and the like; a recording module 208 formed by a hard magnetic disk, non-volatile memory, or the like; a communication module 209 formed with a network interface or the like; and a drive 210 that drives a removable storage medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory device or the like.

In a computer having the structure described above, the central processor 201, for example, downloads the program stored in the recording module 208 via the input / output interface 205 and the bus 204 to the random access memory 203 and executes the program so that the above-described sequence of operations is performed.

A program to be executed by a computer (central processing unit 201) may be recorded on a removable storage medium 211, which is a storage medium enclosed in a housing formed by a magnetic disk (including a flexible magnetic disk), an optical disk (such as a CD-ROM (read-only memory a device on a compact disc) or DVD (universal digital disc)), a magneto-optical disc, a semiconductor memory device or the like, or may be provided via a wired or wireless transmission medium, such as a local area network, the Internet or digital satellite broadcasting.

The program can be installed in the recording module 208 via the input / output interface 205 when installing the removable storage medium 211 in the drive 210. Alternatively, the program can be received by the communication module 209 via a wired or wireless transmission medium, and can be installed in the recording device 208 In addition, the program may be installed in advance in read only memory 202 or recording device 208.

A program to be executed by a computer may be a program for performing operations in chronological order in accordance with the sequence described in this description, or may be a program for performing operations in parallel or for performing an operation when necessary, as, for example, in case when there is a call.

It should be noted that the embodiments of the present technology are not limited to the above-described embodiments of the invention, and various changes may be made to them without departing from the scope of the present technology.

In addition, the present technology may be embodied in the following structures.

[1] A display device including:

a display module that has block regions, each of which is formed by pixels of three or more channels;

a separation element that divides the image displayed on the pixels of the respective channels in the block areas;

a distribution control module that distributes one of the parallax images to the pixels of the respective channels in the block areas in accordance with the location of the observation point occupied by the user looking at the display module, one of the parallax images being displayed in a first region, which is formed by pixels adjacent to each other to each other in block areas, and is formed by pixels of two or more different channels, the other of parallax images, having parallax relative to iju to that one of the parallax image is displayed in a second area different from the first area in the block areas; and

a generating unit that generates a combined image by combining parallax images in accordance with the distribution made by the distribution control module.

[2] The display device according to [1], wherein the parallax images are a parallax image for the right eye and a parallax image for the left eye.

[3] The display device according to [2], in which, when the user looks at the display module from a certain predetermined location of the observation point, he observes pixels of the same channel in the respective block areas.

[4] The display device according to [3], wherein

distribution management module includes:

a module for calculating the observed location, which, based on the location of the observation point, determines the observed location in the observed pixel, which will be observed by the user in each of the block areas; and

a boundary location calculation module that calculates a boundary location, which is the location of the block area in which the observed location is essentially the center of the observed pixel, and distributes the pixels of the same channel in each of the block areas located between this boundary location and the other boundary place closest to this boundary place, the same image from the number of parallax images.

[5] The display device according to [4], wherein in the block areas located between this boundary location and this other boundary location, the boundary location calculation module distributes the same image from among the parallax images to the pixels of the same channel, both the channel of the observed pixel in the block region located at this boundary location and the channel of the observed pixel in the block region located at this other boundary location.

[6] The display device according to [4] or [5] in which the boundary location calculation module defines a certain final boundary location, which is an intermediate location between the boundary location calculated based on the user's right eye and the boundary location calculated on the basis of the user's left eye.

[7] The display device according to [6], wherein

the distribution control module further includes a mixing ratio calculation module that calculates a mixing ratio for respective pixels to be observed by the right and left eyes of the user in the object area between the boundary location calculated based on the user's right eye and the boundary location calculated based on the left eye of the user, and the mixing ratio is calculated based on the places of pixels in the region of the object, and

the generating module generates pixels of the combined image, which will be displayed on the pixels that will be observed by the right and left eyes in the object region, mixing the parallax image for the right eye and the parallax image for the left eye in the mixing ratio.

[8] The display device according to any one of paragraphs: [2] to [7], in which, when the location of the observation point is outside a certain predetermined area, the distribution control module causes the display module to display one image from: parallax image for the right eye and parallax image for the left eye.

List of Reference Items

11 Display device

21 Imaging Module

22 Detection Modules

23 Distribution Control Module

25 Generation module

26 Display Control Module

27 Display Module

31 Module for calculating the location of the observation point

32 Definition Module

33 Observed location calculator

34 Border position calculation module, 81-1 to 81-3, 81 Open section, 161 Mixing ratio calculation module.

Claims (31)

1. A display device comprising: a display module comprising a plurality of block regions, each of which is formed by pixels of three or more channels; a separation unit configured to separate an image displayed on pixels of respective channels in block areas; a assignment control module configured to assign one of the parallax images to the pixels of the respective channels in the block areas in accordance with the viewing position occupied by the user looking at the display module, while the display module is configured to display one of the parallax images in the first region formed pixels adjacent to each other in block areas, and formed by pixels of two or more different channels, and display the other of parallax images having a parallax with respect to said one of the parallax images in a second area different from the first area in the block areas; and a forming unit configured to form a combined image by combining parallax images in accordance with the assignment made by the assignment control module; wherein the parallax images are a parallax image for the right eye and a parallax image for the left eye; at the same time, when the user views the display module from a predetermined viewing position, the user views the pixels of one channel in the respective block areas; wherein the assignment control module includes: a module for calculating the observed position, configured to determine, based on the viewing positions, the observed position in the observed pixel observed by the user in each of the block areas; and a boundary position calculation module, configured to calculate a boundary position that is a position of a block region in which the observed position is essentially the center of the observed pixel, and assign pixels to one channel in each of the block regions located between the specified boundary position and another boundary position, closest to the specified boundary position of the same image from the specified parallax images; while in the block areas located between the specified boundary position and the specified other boundary position, the boundary position calculation module is configured to assign the same image from the specified parallax images to the pixels of the same channel as the channel of the observed pixel in the block region located in the specified boundary position, and the channel of the observed pixel in the block area located in the specified other boundary position; wherein the boundary position calculation module is configured to set the final boundary position, which is an intermediate position between the boundary position calculated based on the user's right eye and the boundary position calculated on the basis of the user's left eye; wherein the assignment control module further includes a mixing ratio calculation module configured to calculate a mixing ratio for the respective pixels observed by the right and left eyes of the user in the object region between the boundary position calculated based on the user's right eye and the boundary position calculated based on the user's left eye, wherein the mixing ratio calculation module is configured to calculate the mixing ratio based on the positions pixels in the object area, and the forming unit is configured to form pixels of the combined image displayed on the pixels observed by the right and left eye in the object region by mixing the parallax image for the right eye and the parallax image for the left eye with respect to mixing. 2. The display device according to claim 1, in which, when the viewing position is outside the specified area, the attribution control module is configured to cause the display module to display a parallax image for the right eye or a parallax image for the left eye. 3. A display method for a display device including: a display module comprising a plurality of block regions, each of which is formed by pixels of three or more channels; a separation unit configured to separate an image displayed on pixels of respective channels in block areas; a assignment control module configured to assign one of the parallax images to the pixels of the respective channels in the block areas in accordance with the viewing position occupied by the user looking at the display module, while the display module is configured to display one of the parallax images in the first region formed pixels adjacent to each other in block areas, and formed by pixels of two or more different channels, and display another of the parallax of images having parallax with respect to said one of the parallax images in a second region different from the first region in block regions; and a forming unit configured to form a combined image by combining parallax images in accordance with the assignment made by the assignment control module; wherein the parallax images are a parallax image for the right eye and a parallax image for the left eye; at the same time, when the user views the display module from a predetermined viewing position, the user views the pixels of one channel in the respective block areas; wherein the assignment control module includes: a module for calculating the observed position, configured to determine, based on the viewing positions, the observed position in the observed pixel observed by the user in each of the block areas; and a boundary position calculation module, configured to calculate a boundary position that is a position of a block region in which the observed position is essentially the center of the observed pixel, and assign pixels to one channel in each of the block regions located between the specified boundary position and another boundary position, closest to the specified boundary position of the same image from the specified parallax images; while in the block areas located between the specified boundary position and the specified other boundary position, the boundary position calculation module is configured to assign the same image from the specified parallax images to the pixels of the same channel as the channel of the observed pixel in the block region located in the specified boundary position, and the channel of the observed pixel in the block area located in the specified other boundary position; wherein the boundary position calculation module is configured to set the final boundary position, which is an intermediate position between the boundary position calculated based on the user's right eye and the boundary position calculated on the basis of the user's left eye; wherein the assignment control module further includes a mixing ratio calculation module configured to calculate a mixing ratio for the respective pixels observed by the right and left eyes of the user in the object region between the boundary position calculated based on the user's right eye and the boundary position calculated based on the user's left eye, wherein the mixing ratio calculation module is configured to calculate the mixing ratio based on the positions pixels in the object region, and the forming unit is configured to form pixels of the combined image displayed on the pixels observed by the right and left eye in the object region by mixing the parallax image for the right eye and the parallax image for the left eye with respect to mixing; wherein the display method comprises the steps of: assigning, by the assignment control module, parallax images to the pixels of the respective channels in the block regions; and form an integrated image by means of the forming unit.

Images