WO2014119555A1

WO2014119555A1 - Image processing device, display device and program

Info

Publication number: WO2014119555A1
Application number: PCT/JP2014/051796
Authority: WO
Inventors: 英範栗林
Original assignee: 株式会社ニコン
Priority date: 2013-01-31
Filing date: 2014-01-28
Publication date: 2014-08-07

Abstract

This display device is equipped with: a first screen for displaying a first image that includes an object to be displayed and is based on first image data; a second screen for displaying a second image that includes the object to be displayed and is based on second image data; a detection unit for detecting the position of an observer who observes the first screen and the second screen; and a control unit that corrects an image data portion of the second image data that pertains to the vicinity of the contour of the object to be displayed on the basis of the observer's position detected by the detection unit and causes the result to be displayed on the second screen.

Description

Image processing apparatus, display apparatus, and program

The present invention relates to an image processing device, a display device, and a program.
This application claims priority based on Japanese Patent Application No. 2013-17968 filed on January 31, 2013, and Japanese Patent Application No. 2013-17969 filed on January 31, 2013, the contents of which are incorporated herein by reference. Incorporate.

Some image processing apparatuses generate image information to be displayed on a display system capable of three-dimensional display. In many cases, image information displayed on such a display system that enables three-dimensional display is created exclusively as image information for three-dimensional display. On the other hand, there is a technique for performing three-dimensional display based on image information for two-dimensional display (see, for example, Patent Document 1).

In recent years, for example, a plurality of images with ratios of pixel values (for example, brightness, luminance, hue, saturation) corresponding to the depth position of a stereoscopic image (three-dimensional image) are There is known a display method in which a user who perceives a plurality of images as a result of displaying them on a display surface perceives a stereoscopic effect (see, for example, Patent Document 2).

JP 2003-057596 A Japanese Patent No. 3464633

However, according to the technique described in Patent Document 1, the brightness of the image for two-dimensional display is adjusted and displayed in an overlapping manner, so that the display target indicated by the two images is shifted and overlapped. There is a problem that the visibility is reduced.

In the display method as described above, the positions of a plurality of images viewed from the user may be shifted depending on the definition of the pixels. In this case, there is a problem that the accuracy of the stereoscopic image perceived by the user cannot be improved depending on the display method as described above.

An object of an aspect of the present invention is to provide an image processing device and a program that improve the visibility of a displayed stereoscopic image.
Another object is to provide a display device that can improve the accuracy of a stereoscopic image perceived by a user.

A display device according to an aspect of the present invention includes a first display surface that displays a first image based on first image data including a display target, and a second image based on second image data including the display target. A second display surface to be displayed; a detection unit for detecting a position of an observer observing the first display surface and the second display surface; and an image in the vicinity of the contour portion to be displayed in the second image data. A control unit that corrects data based on the position of the observer detected by the detection unit and displays the corrected data on the second display surface.

A program according to an aspect of the present invention includes a first display surface that displays a first image based on first image data including a display target, and a second image based on second image data including the display target. Of the second image data in a computer of a display device comprising: a second display surface for displaying the image; and a detection unit for detecting a position of an observer observing the first display surface and the second display surface. The control step of correcting the image data in the vicinity of the contour portion to be displayed based on the position of the observer detected by the detection unit and displaying the correction on the second display surface is executed.

The display device according to one aspect of the present invention includes a first display surface that displays a first image based on first image data including an object, an observer who observes the first display surface, and the first A detection unit for detecting a relative position with respect to a display surface; and correcting image data in the vicinity of the contour of the object in the first image data based on the relative position detected by the detection unit, A control unit for displaying on the surface.

In addition, a program according to an aspect of the present invention includes a first display surface that displays a first image based on first image data including an object, an observer who observes the first display surface, and the first display. A detection unit that detects a relative position with respect to the surface; and a computer of a display device having image data in the vicinity of the contour of the object among the first image data based on the relative position detected by the detection unit. The control step of correcting and displaying on the first display surface is executed.

In addition, a display device according to an aspect of the present invention includes a first display unit that displays an image to be displayed at a first depth position, and a plurality of pixels that are two-dimensionally arranged. A second display unit that displays a contour image indicating the contour portion to be displayed at different second depth positions, a position of a contour pixel that displays the contour image among the pixels of the second display unit, and the contour A contour correcting unit that corrects the contour image based on a position on the first display unit of the contour unit corresponding to a pixel and a contour position on the second display unit determined based on a predetermined viewpoint position; .

In the display device according to one aspect of the present invention, the outline portion of the display target displayed by the second display unit at a second depth position different from the first depth position where the first display unit displays an image to be displayed. As for the contour image indicating the position, the position of the contour pixel that displays the contour image among the plurality of pixels arranged in a two-dimensional manner of the second display unit, and the first display of the contour portion corresponding to the contour pixel A contour correction unit configured to correct the contour image based on a position on the unit and a contour position on the second display unit determined based on a predetermined viewpoint position.

According to another aspect of the present invention, there is provided a program for displaying the display target displayed by the second display unit at a second depth position different from the first depth position at which the first display unit displays an image to be displayed. Regarding the contour image indicating the contour portion, the position of the contour pixel that displays the contour image among the plurality of pixels arranged in a two-dimensional manner of the second display portion, and the first portion of the contour portion corresponding to the contour pixel. A contour correction step for correcting the contour image is executed based on a position on the first display unit and a contour position on the second display unit determined based on a predetermined viewpoint position.

According to the aspect of the present invention, it is possible to provide an image processing device and a program that improve the visibility of a displayed stereoscopic image.

Further, according to the aspect of the present invention, the accuracy of the stereoscopic image perceived by the user can be improved.

It is a figure which shows the outline | summary of the display system in the 1st Embodiment of this invention. It is a block diagram which shows an example of a structure of the display system containing the display apparatus in this embodiment. It is a schematic diagram which shows an example of the image in this embodiment. It is a schematic diagram which shows an example of the image in this embodiment. It is a schematic diagram which shows an example of the image displayed by the display apparatus in this embodiment. It is a schematic diagram which shows an example of the optical image in this embodiment. It is a graph which shows an example of the brightness distribution of the optical image in this embodiment. It is a graph which shows an example of the binocular parallax which arises in the left eye and right eye in this embodiment. It is a figure explaining the influence when the position of the edge of two images displayed on a display apparatus shifts. It is a schematic block diagram which shows the structure of the display system by this embodiment. It is a figure which shows the positional relationship of an observer, a display apparatus, and the outline part in a target image. It is a figure explaining one Example of the correction | amendment of the outline image in the display system of this embodiment. It is a figure explaining the modification of the correction method of the outline image in the display system of this embodiment. It is a figure shown about the adjustment of the brightness (luminance) of an edge image as a modification of the correction method of the outline image in the display system of this embodiment. It is a figure shown about the adjustment of the brightness (luminance) of an edge image as a modification of the correction method of the outline image in the display system of this embodiment. It is a figure which shows the outline | summary of the display system in 2nd Embodiment. It is a figure which shows the outline | summary of the display system in 2nd Embodiment. It is a figure which shows the outline | summary of the display system in 2nd Embodiment. It is a schematic block diagram which shows the structure of the display system by this embodiment. It is a figure which shows the outline | summary of the display system in 3rd Embodiment. It is a figure which shows the outline | summary of the display system in 3rd Embodiment. It is a figure which shows the outline | summary of the display system in 3rd Embodiment. It is a schematic block diagram which shows the structure of the display system by this embodiment. It is a figure explaining the correction method in case an observer moves to the area | region which remove | deviates from the area | region which can observe the stereo image defined according to the optical characteristic of a lenticular lens. It is a figure explaining the correction method in case an observer moves. It is a figure explaining the modification of the display apparatus in a display system. It is a figure which shows the correction method of the image at the time of observing from three directions. It is a schematic block diagram which shows the structure of the display system by 4th Embodiment. It is a figure explaining the process which displays the display target displayed by the perspective method by rotating in a pseudo manner. It is a flowchart which shows the process which an image processing apparatus performs. It is a figure explaining an example of the display system of a stereo image. It is a schematic diagram which shows an example of the outline | summary of a structure of the display apparatus in the 5th Embodiment of this invention. It is a schematic diagram which shows an example of a structure of the pixel of the 2nd display surface of this embodiment. It is a schematic diagram which shows an example of the pixel of the 2nd display surface of this embodiment. It is a schematic diagram which shows an example of the specific structure of the display apparatus of this embodiment. It is a schematic diagram which shows an example of the image of the display target of this embodiment. It is a schematic diagram which shows an example of the outline image of this embodiment. It is a schematic diagram which shows an example of the positional relationship of the image in this embodiment, an outline image, and a viewpoint position. It is a schematic diagram which shows an example of the optical image visible to the observer's eyes in this embodiment. It is a graph which shows an example of the brightness of the optical image in the viewpoint position of this embodiment. It is a graph which shows an example of the outline part of the image which the observer in this embodiment perceives based on an optical image. It is a schematic diagram which shows an example of the outline image which the outline correction part of this embodiment correct | amends. It is a schematic diagram which shows an example of the outline image which the outline correction part of this embodiment correct | amends. It is a schematic diagram which shows an example of the outline image which the outline correction part of this embodiment correct | amends. It is a schematic diagram which shows an example of the outline image which the outline correction part of this embodiment correct | amends. It is a flowchart which shows an example of operation | movement of the display apparatus of this embodiment. It is a schematic diagram which shows an example of the positional relationship of the user and display apparatus by the modification of this embodiment. It is a schematic diagram which shows an example of a structure of the display apparatus by the 6th Embodiment of this invention. It is a schematic diagram which shows an example of a structure of the display apparatus by the 7th Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, an overview of stereoscopic image display will be described.

[First embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing an overview of a display system in the present embodiment. The display system 100 shown in this figure displays an image that allows stereoscopic viewing on the display unit.
Hereinafter, in the description of each drawing, an XYZ rectangular coordinate system is set, and the positional relationship of each part will be described with reference to this XYZ rectangular coordinate system. A direction in which the display device 10 displays an image is a positive direction of the Z axis, and orthogonal directions on a plane perpendicular to the Z axis direction are an X axis direction and a Y axis direction, respectively. Here, the X-axis direction is the horizontal direction of the display device 10, and the Y-axis direction is the vertical direction of the display device 10.
In the display device 10, the observer 1 is at a position where the display surface 11S of the display unit 11 and the display surface 12S of the display unit 12 enter the visual field. The display device 10 shown in FIG. 1 displays a stereoscopic image so that it can be stereoscopically viewed from a predetermined position (Ma) (viewing position) in the positive direction of the Z axis (the direction facing the display unit 12). The observer 1 can stereoscopically view the stereoscopic image displayed on the display unit 11 and the display unit 12 of the display device 10 from the viewing position.

Next, a display system that displays a stereoscopic image in the present embodiment will be described.
FIG. 2 is a configuration diagram illustrating an example of a configuration of the display system 100 including the display device 10 according to the present embodiment.
A display system 100 according to the present embodiment includes an image processing device 2 and a display device 10.
The image processing device 2 supplies the image information D11 and the image information D12 to the display device 10. Here, the image information D12 is information for displaying the image P12 displayed by the display device 10. The image information D11 is information for displaying the image P11 displayed by the display device 10, and is image information of the edge image PE generated based on the image information D12, for example. The edge image PE is an image showing an edge portion E in the image P12. The edge image PE will be described later with reference to FIGS. 3A and 3B.

The display device 10 includes a display unit 11 and a display unit 12. The display device 10 displays an image P 11 based on the image information D 11 acquired from the image processing device 2, and displays the image information D 12 acquired from the image processing device 2. Based on this, the image P12 is displayed.
The display unit 11 and the display unit 12 of this embodiment are arranged in the order of the display unit 11 and the display unit 12 in the (+ Z) direction. That is, the display unit 11 and the display unit 12 are arranged at different depth positions. Here, the depth position is a position in the Z-axis direction.
The display unit 12 includes a display surface 12S that displays an image in the (+ Z) direction, and displays the image P12 on the display surface 12S based on the image information D12 acquired from the image processing device 2. A light ray (light) R12 emitted from the image P12 displayed on the display surface 12S is visually recognized by the observer 1 as an optical image.
The display unit 11 includes a display surface 11S that displays an image in the (+ Z) direction, and displays the image P11 on the display surface 11S based on the image information D11 acquired from the image processing device 2. A light ray (light) R11 emitted from the image P11 displayed on the display surface 11S is visually recognized by the observer 1 as an optical image.

The display unit 12 of the present embodiment is a transmissive display unit that can transmit the light beam R11 (light) corresponding to the image P11 displayed by the display unit 11. That is, the display surface 12S displays the image P12 and transmits the light ray R11 of the image P11 displayed by the display unit 11. That is, the display device 10 displays the image P11 and the image P12 so that the viewer 1 can visually recognize the image P11 and the image P12 so as to overlap each other. In this way, the display unit 11 displays the image P11 indicating the edge portion in the image P12 at a depth position different from the depth position where the image P12 is displayed.

Next, the image P12 and the image P11 of this embodiment will be described with reference to FIGS. 3A and 3B. Here, when an image is shown in the following drawings, for the sake of convenience, a portion where the brightness of the image is bright (for example, high brightness) is shown darkly.
3A and 3B are schematic diagrams illustrating an example of an image P12 and an image P11 in the present embodiment.
FIG. 3A shows an example of the image P12 in the present embodiment. FIG. 3B shows an example of the image P11 in the present embodiment.
The image P12 of the present embodiment is an image showing a square pattern as shown in FIG. 3A, for example. Here, in the quadrilateral pattern shown by the image P12, the four sides constituting the quadrilateral can be edge portions, but in the following description, for convenience, an edge portion (left side edge portion) E1 indicating the left side of the quadrilateral The edge portion (right side edge portion) E2 indicating the right side will be described as the edge portion E.
The image P11 of the present embodiment includes, for example, as shown in FIG. 3B, an edge image (left side edge image) PE1 showing a left side edge part E1 of a square pattern and an edge image (right side edge image) PE2 showing a right side edge part E2. And an image including Here, an edge portion (which may be simply expressed as an edge or an edge region) is a portion where the brightness (for example, luminance) of adjacent or neighboring pixels in the image changes suddenly. For example, the edge portion E indicates a theoretical line segment having no width on the left side or the right side of the quadrangle shown in FIG. 3A and, for example, a region around the edge having a finite width corresponding to the resolution of the display unit 11. It also shows.

Next, a configuration in which the display device 10 according to the present embodiment displays the image P11 and the image P12 in association with each other will be described with reference to FIG.
FIG. 4 is a schematic diagram illustrating an example of an image displayed by the display device 10 according to the present embodiment.
In the present embodiment, the display unit 11 displays the image P11 so that the viewer 1 can visually recognize it. Moreover, the display part 12 displays the image P12 so that the observer 1 can visually recognize it. The image P12 is displayed at a position that is a predetermined distance ZD away from the position at which the image P11 is displayed in the Z-axis direction. As described above, the display unit 12 of the present embodiment is a transmissive display unit that transmits light. For this reason, the image P11 displayed on the display unit 11 and the image P12 displayed on the display unit 12 are visually recognized by the observer 1 so as to overlap. Here, the predetermined distance ZD is a distance between the position where the image P11 is displayed and the position where the image P12 is displayed.

As shown in FIG. 4, the display device 10 corresponds to a left side edge part E1 in the image P12 displayed by the display unit 12 and a left side edge image PE1 corresponding to the edge part. The images P11 and P12 are displayed so as to be visually recognized. Similarly, the display device 10 displays an image so that the right side edge portion E2 in the image P12 displayed by the display unit 12 and the right side edge image PE2 corresponding to the edge portion are visually recognized. P11 and image P12 are displayed.
At this time, for example, the display device 10 is connected to the left eye L of the observer 1 on the (−X) side of the left edge portion E1 of the quadrangle indicated by the image P12 (that is, outside the quadrilateral). Each image is displayed so that the left side edge image PE1 can be visually recognized.
Further, the display device 10 displays the right-side edge portion E2 and the right-side edge image on the left eye L of the observer 1 on the (−X) side of the right-side edge portion E2 of the square indicated by the image P12 (that is, on the inside of the square). Each image is displayed so that it overlaps with PE2. Similarly, for example, the display device 10 places the right side edge portion E2 and the right side on the right eye R of the observer 1 on the (+ X) side of the right side edge portion E2 of the square indicated by the image P12 (that is, outside the square). Each image is displayed so that the edge image PE2 overlaps and is visually recognized. In addition, the display device 10 has the left-side edge portion E1 and the left-side edge image PE1 on the right eye R of the observer 1 on the (+ X) side of the left-side edge portion E1 of the quadrangle indicated by the image P12 (that is, on the inner side of the quadrangle). Each image is displayed so that can be visually recognized.

Next, a mechanism in which the observer 1 recognizes a stereoscopic image (three-dimensional image) from the images P11 and P12 will be described.
First, when the observer 1 observes the image P12 and the edge image PE corresponding to the edge portion E of the image P12 at the overlapping position, the depth position within the display surface according to the luminance ratio between the image P12 and the edge image PE. An image is perceived at (for example, a position in the Z-axis direction). For example, when a rectangular pattern is observed, a step with such a small brightness that it cannot be recognized on the retina image of the observer 1 is formed. In such a case, a virtual edge is perceived between steps of brightness (for example, luminance) and recognized as one object. At this time, the left eye L and the right eye R slightly deviate from the virtual edges, and the depth position is changed as perceived as binocular parallax.
This mechanism will be described in detail with reference to FIGS.

FIG. 5 is a schematic diagram illustrating an example of the optical image IM in the present embodiment. Here, the optical image IM is an image in which the image P11 and the image P12 are visually recognized by the observer 1. The optical image IM includes an optical image IML visually recognized by the left eye L of the observer 1 and an optical image IMR visually recognized by the right eye R.
First, the optical image IML visually recognized by the left eye L of the observer 1 will be described.
As shown in FIG. 5, in the left eye L of the observer 1, an optical image IML formed by combining the image P11L visually recognized by the left eye L and the image P12L visually recognized by the left eye L is formed.
For example, as described with reference to FIG. 4, in the left eye L, the left side edge portion E1 is placed on the (−X) side of the left side edge portion E1 of the quadrangle shown by the image P12 (that is, outside the quadrangle). An optical image IML is formed by combining the image shown and the left-side edge image PE1. In the left eye L, the image indicating the right edge portion E2 and the right edge image PE2 are synthesized on the (−X) side (that is, inside the rectangle) of the square right edge portion E2 indicated by the image P12. An optical image IML is formed.

FIG. 6 shows the brightness distribution of the optical image IML visually recognized by the left eye L in the case of FIG.
FIG. 6 is a graph showing an example of the brightness distribution of the optical image IM in the present embodiment. In FIG. 6, X coordinates X ₁ to X ₆ are X coordinates corresponding to the brightness change points of the optical image IML.
As shown in FIG. 6, the brightness of the image P12L visually recognized by the left eye L will be described as zero in the X coordinates X ₁ to X ₂ here. The brightness of the image P12L is the brightness value BR2 at the X coordinates X ₂ to X ₆ . Here, the case of the brightness value BR will be described as an example of the brightness of the image.
In the case of this optical image IML, the brightness of the image P11L visually recognized by the left eye L is the brightness value BR1 at the X coordinates X ₁ to X ₂ and the X coordinates X ₄ to X ₅ , and the X coordinates X ₂ to X ₄ Is zero. Therefore, the brightness (for example, luminance) of the optical image IML visually recognized by the left eye L becomes the luminance value BR1 at the X coordinates X ₁ to X ₂ . The brightness of the optical image IML is the luminance value BR2 at the X coordinates X ₂ to X ₄ and the X coordinates X ₅ to X ₆ , and the luminance value BR1 and the luminance value BR2 at the X coordinates X ₄ to X ₅ The luminance value BR3 which is the synthesized brightness is obtained.

Next, a mechanism in which the edge portion is visually recognized by the left eye L of the observer 1 will be described.
FIG. 7 is a graph showing an example of binocular parallax that occurs in the left eye L and right eye R in the present embodiment.
The distribution of brightness of the image recognized by the observer 1 by the optical image IML imaged on the retina of the left eye L is as shown by the waveform WL in FIG. Here, for example, the observer 1 visually recognizes the position on the X-axis where the change in the brightness of the visually recognized image is maximized (that is, the gradient between the waveform WL and the waveform WR is maximized). Recognize that it is an edge part of an object. In the case of the present embodiment, for example, the observer 1 visually recognizes the position of the X _EL shown in FIG. 7 (that is, the position of the distance L _EL from the origin O of the X axis) for the waveform WL on the left eye L side. It is recognized as an edge part on the left side of the rectangle.

Next, a difference between the optical image IMR visually recognized by the right eye R of the observer 1 and the optical image IML will be described, and a mechanism for recognizing a stereoscopic image (three-dimensional image) based on the difference will be described.
As shown in FIG. 5, in the right eye R of the observer 1, an optical image IMR formed by combining the image P11R visually recognized by the right eye R and the image P12R visually recognized by the right eye R is formed.
Further, as shown in FIG. 6, the brightness (for example, luminance) of the optical image IMR visually recognized by the right eye R is applied to the left eye L in the X coordinates X ₁ to X ₃ and the X coordinates X ₄ to X ₆ . This is different from the brightness of the visually recognized optical image IML.
The distribution of brightness of the image recognized by the observer 1 by the optical image IMR synthesized on the retina of the right eye R is as shown by a waveform WR in FIG. Here, for example, the observer 1 visually _recognizes the position of the _XER shown in FIG. 7 (that is, the position of the distance _LER from the origin O of the X axis) for the waveform WR on the right eye R side. Recognize that it is a part.
Thus, the observer 1 recognizes the position X _EL of the edge portion of the square left eye L is viewing, and a position X _ER of the edge portion of the square right eye R is visually recognized as binocular parallax. Then, the observer 1 recognizes the quadrilateral image as a stereoscopic image (three-dimensional image) based on the binocular parallax at the edge portion.

As described above, the display device 10 according to this embodiment includes the display unit 12 that displays the image P12 and the edge that indicates the edge portion in the image P12 at a depth position different from the depth position where the image P12 is displayed. And a display unit 11 that displays an image P11 including the image PE. Accordingly, the display device 10 can display the image P12 and the edge image PE (that is, the edge portion) of the image P12 in an overlapping manner. That is, the display device 10 of the present embodiment has no influence on the image other than the edge portion displayed on the display unit 12 without the influence of the image displayed on the display unit 11 (that is, the edge image PE). An image can be displayed.

Here, with reference to FIG. 8, the influence when the positions of the edges of the two images displayed on the display device 10 are shifted will be described.
FIG. 8 is a diagram for explaining the influence when the positions of the edges of two images displayed on the display device 10 are shifted.
The display unit 11 and the display unit 12 in the display device 10 each have a display capable of displaying a stereoscopic image (3D image). Each display display is provided with a pixel array composed of two-dimensionally arranged pixels on the display surface. In the image P11 displayed on the display unit 11, the luminance at each position on the display surface 11S is adjusted in units of pixels in the pixel array of the display unit 11. For example, in the image P 12 displayed by the display unit 12, the luminance of each position on the display surface 12 S is adjusted in units of pixels in the pixel array of the display unit 12.

Even if an attempt is made to display a high-definition image on the display device, the definition of the displayable image may be limited by the resolution of the display device. In the display device 10 according to the present embodiment, as in the case described above, even if a fine edge is displayed by the edge image PE displayed on the display unit 11, the edge width (line width) is in units of pixels. It can only be adjusted and is limited by the size of the pixel.
Further, for example, in order to emphasize the edge of the edge image PE displayed on the display unit 11, the width of the edge may be displayed larger than the size (width) of the pixel. In this case, even if a plurality of pixels can be arranged side by side in the edge width direction and displayed with a thick edge width, the edge width is limited by the size of the pixel.
In the following description, the edge width corresponds to the width of one pixel. However, the present invention can be applied to the case where an edge formed by a plurality of pixels is displayed. The description based on the pixel size may be replaced with the description based on the pixel pitch.

With reference to Fig.8 (a), the image of the right side edge part E2 of the square Ob shown by the image P12 is demonstrated.
In FIG. 8A, FIGS. A1 to a4 arranged in order from the upper side show the following.
FIG. A1 shows a front view of the display unit 11 from the side of viewing the display surface 11S. This display surface 11S shows a state in which the right side edge image PE2 indicated by the image P11 displayed on the display unit 11 is displayed. The grid shown in the figure indicates the position of each pixel. Each pixel is arranged at a position corresponding to the grid. For example, in this figure, the right side edge image PE2 is displayed on the pixel in the kth column on the X axis. In the Z-axis direction,... (K−1) columns, k columns, (k + 1) columns.
FIG. A2 shows a state in which a quadrangle Ob indicated by an image P12 displayed on the display unit 12 is displayed on the front view of the display unit 12 from the display surface 12S side. A state in which the right end OR of the quadrangle Ob is in a position that coincides with the right end of the right side edge image PE2 is shown. In other words, the right end OR of the quadrangle Ob is at a position corresponding to the boundary between the pixel in the k-th column and the pixel in the (k + 1) -th column that displays the right-side edge image PE2 shown in FIG. In short, the right edge portion E2 of the quadrangle Ob is at a position corresponding to the right edge image PE2 shown in the k-th column in FIG.
FIG. A3 shows an image (composite image) that can be viewed in a state where the right edge image PE2 shown in FIG. A1 and the right edge portion E2 of the quadrangle Ob shown in FIG. A2 overlap.
FIG. A4 shows the brightness (luminance) of the part cut out in the horizontal direction (X-axis direction) so as to include the quadrangle Ob in the image (composite image) shown in FIG. A3. For example, an outline is shown in which the luminance (brightness) (V0) of the portion indicating the rectangle Ob before the outline correction is enhanced up to the luminance (brightness) Vp by being synthesized.

In FIG. 8A, in the right side edge portion E2 of the quadrangle Ob shown by the image P12, the right side of the right end OR of the quadrangle Ob is on the (−X) side (that is, the inside of the quadrangle). An image when the right end of the edge image PE2 is displayed so as to touch is shown. Since the right edge of the right-side edge image PE2 is in contact with the right edge OR of the quadrangle Ob as described above, the change in the luminance of the image at the right-side edge portion E2 of the quadrangle Ob is large and sharply changed. Can be synthesized. The observer 1 can visually recognize an image whose luminance peak value is increased to Vp (FIG. A4).
The image synthesized in this way can be visually recognized when the viewing position of the observer 1 is at a position where the contour can be emphasized most. In the present embodiment, the visual recognition position where the synthesized image can be visually recognized is set as a predetermined position where the observer 1 can visually recognize the stereoscopic image.

On the other hand, when the observer 1 moves from a predetermined position where the stereoscopic image can be viewed, the image shown in FIG. 8A cannot be observed. For example, FIG. 8B shows a case where the observer 1 moves in the (−X) axis direction along the X axis, and FIG. 8B shows a case where the observer 1 moves in the (+ X) axis direction along the X axis. This is shown in FIG. FIGS. B1 to b4 shown in FIG. 8B and FIGS. C1 to c4 shown in FIG. 8C correspond to the above-described FIGS. A1 to a4, respectively. Hereinafter, FIG. 8B and FIG. 8C will be described in order focusing on differences from FIG. 8A.

First, an image that can be visually recognized will be described with reference to FIG.
In FIG. B2, observation is performed by moving the right end OR of the quadrangle Ob in the (+ X) axis direction from the boundary between the pixel in the k-th column and the pixel in the (k + 1) -th column that displays the right-side edge image PE2 illustrated in FIG. Is in the position to be. In short, the right end OR of the quadrangle Ob is at a position where it is observed by moving in the (+ X) axis direction from the right end of the right side edge image PE2.
As described above, the right end OR of the quadrangle Ob is displayed at a position moved in the (+ X) axial direction from the right end of the right side edge image PE2, so that the position of the edge image PE2 in the right side edge portion E2 of the quadrangle Ob is a quadrangle. The image moved inside Ob is synthesized.
In this synthesized image, an image similar to that in FIG. 8A described above is synthesized with the brightness of the contour image emphasized by the right edge image PE2 and the width in the X-axis direction at the right edge portion E2 of the quadrangle Ob. Has been. However, in the synthesized image, the luminance of the image at the right edge portion E2 of the quadrangle Ob changes in a staircase pattern. Thus, in an image whose luminance changes stepwise, the amount of enhancement as a contour image by the added right-side edge image PE2 is reduced compared to the case of FIG. 8A described above.

Next, an image that can be visually recognized in FIG. 8C will be described.
In FIG. C2, the right end OR of the rectangle Ob moves in the (−X) axis direction from the boundary between the pixel in the k-th column and the pixel in the (k + 1) -th column that displays the right-side edge image PE2 shown in FIG. In the position to be observed. In short, the right end OR of the quadrangle Ob is at a position where it is observed by moving in the (−X) axis direction from the right end of the right side edge image PE2.
As described above, the right end OR of the quadrangle Ob is displayed at a position moved in the (−X) axis direction from the right end of the right side edge image PE2, so that the position of the edge image PE2 in the right side edge portion E2 of the quadrangle Ob is determined. An image that moves in the outward direction of the rectangle Ob and protrudes from the shape of the rectangle Ob is synthesized.
In the synthesized image, an image having the same brightness as that of FIG. 8A described above is synthesized at the right edge portion E2 of the quadrangle Ob with the brightness of the contour image emphasized by the right edge image PE2. However, in the synthesized image, the width in the X-axis direction of the above-described range in which the luminance is ensured is narrowed, and the luminance of the image at the right edge portion E2 of the quadrangle Ob changes in a staircase pattern. As described above, in an image whose luminance changes stepwise, the amount of enhancement as a contour image by the added right-side edge image PE2 is reduced compared to the case of FIG. 8A described above. In addition, since the width in the X-axis direction of the range in which the brightness of the contour image is ensured is narrower than in FIGS. 8A and 8B described above, the same right edge as in FIGS. 8A and 8B. Although the image PE2 is displayed, the enhancement amount as the contour image is reduced as compared with the case of FIGS. 8A and 8B described above.

As described above, when the observer 1 moves from a predetermined position where a stereoscopic image can be viewed, the image shown in FIG. 8A cannot be viewed, and the visibility of the stereoscopic image may be reduced. In addition, the factor in the case where the visibility of the stereoscopic image is reduced is different from the factor in the case where the displayed image is deteriorated due to aliasing caused by the pixels of the display device 10 being discretely arranged.

Therefore, in the display system 100 according to the present embodiment, the visibility of the stereoscopic image is improved by adjusting the edge image PE according to the method described below. Hereinafter, the display system 100 in the present embodiment will be described in detail.

<Configuration of display system>
Next, the configuration of the display system 100 will be described with reference to FIG.
FIG. 9 is a schematic block diagram showing the configuration of the display system 100 according to an embodiment of the present invention. A display system 100 illustrated in FIG. 9 includes an image processing device 2 and a display device 10.

The display device 10 has a display capable of displaying a stereoscopic image (3D image) for displaying a stereoscopic image so as to be stereoscopically viewed from a predetermined viewing position. Here, the stereoscopic image (3D image) may be any of 3D video (3D moving image) and 3D still image. A stereoscopic image (3D image) is any image of a natural image obtained by photographing an actual subject and an image (computer graphics (CG) image or the like) generated, processed, or synthesized by software processing. Also good. This display is, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, a plasma display, etc., and is a display capable of displaying a stereoscopic image as described above. In short, the display display of the display device 10 includes a pixel array including pixels arranged two-dimensionally on the display surface.

The image processing apparatus 2 includes a contour correction unit 210, an imaging unit 230, a detection unit 250, a control unit 260, and a storage unit 270.

The contour correction unit 210 corrects and outputs at least one of the supplied image information according to the image information supplied to the contour correction unit 210. For example, the image information to be processed by the contour correcting unit 210 includes image information D11P (first image information) and image information D12P (second image information). The image information D11P is displayed on the display unit 11 out of image information for stereoscopically displaying a display target to be displayed on the display unit 11 (first display unit) and the display unit 12 (second display unit) at a predetermined position by binocular parallax. This is image information to be displayed. Further, the image information D12P is image information to be displayed on the display unit 12 among the image information for stereoscopically displaying the display target at a predetermined position by binocular parallax.

Note that the contour correction unit 210 in the present embodiment corrects the image information D11P (first image information) to generate image information D11. The contour correction unit 210 outputs the image information D12P as it is without correcting the image information D12P (second image information).

The contour correction unit 210 according to the present embodiment includes a predetermined position (Ma (FIG. 1)) for stereoscopic display of a display target to be displayed on the display unit 11 and the display unit 12 by binocular parallax, and a plurality of the display unit 11 has. Based on the position of the pixel (for example, the position of the pixel arrayed two-dimensionally) and the pixel position on the display unit 11 corresponding to the contour part (for example, the edge part E) to be displayed, The image information corresponding to the contour portion to be displayed is corrected.
Here, the predetermined position where the display target to be displayed on the display unit 11 and the display unit 12 is stereoscopically displayed by binocular parallax is a position where the observer 1 can visually recognize a stereoscopic image. The positions of the plurality of pixels arrayed two-dimensionally included in the display unit 11 are the positions of the pixels in the pixel array including the pixels arrayed two-dimensionally provided in the display provided on the display surface 11S. The pixel position on the display unit 11 corresponding to the display target contour is a position at which the display target contour is displayed on the display unit 11.

The contour correcting unit 210 corrects the image information corresponding to the contour portion to be displayed according to the image information D12P (second image information) when correcting the image information D11P. As described above, the image information D12P is image information to be displayed on the display unit 12 among image information for stereoscopically displaying a display target at a predetermined position by binocular parallax.

The contour correction unit 210 has a relative relationship between the pixel position in the display unit 11 corresponding to the display target contour unit and the positions of the plurality of pixels arranged in the display unit 11 in the display target contour unit. Image information corresponding to the contour portion to be displayed in the image information D11P is corrected so as to reduce the reduction in the visibility of the stereoscopic display caused by the positional relationship. For example, the contour correction unit 210 corrects the luminance of the contour portion to be displayed in the correction of the image information D11P included in the contour portion to be displayed.
Further, for example, the contour correcting unit 210 corrects the width of the contour portion to be displayed in the correction of the image information D11P included in the contour portion to be displayed.
Details of the process of correcting the image information corresponding to the contour portion of the display target in the contour portion of the display target will be described later so as to reduce the reduction in the visibility of the stereoscopic display.

The contour correction unit 210 in the present embodiment will be described with a more specific example.
The contour correction unit 210 in the present embodiment includes a determination unit 213 and a correction unit 211.
The determination unit 213 performs determination for determining a condition for controlling correction processing in the correction unit 211 described later. For example, in the correction of the image information D11P included in the contour portion to be displayed, the determination unit 213 has the position of the contour portion to be displayed on the display portion 11 that is adjacent to the first pixel adjacent to the display portion 11. It is determined whether or not it falls within the range of the second pixel. For example, the determination unit 213 determines that, based on the determination result, the position of the contour portion to be displayed on the display unit 11 falls within the range of the first pixel and the second pixel adjacent to each other among the pixels of the display unit 11. It is determined that correction is necessary, and it is determined that correction is not necessary when the range of the adjacent first pixel and second pixel among the pixels of the display unit 11 is not applied. The adjacent first pixel and second pixel are pixels arranged side by side in a direction (horizontal direction) in which stereoscopic parallax occurs.

The correction unit 211 displays a display target to be displayed on the display device 10 when it is determined that the position of the contour of the display target is within the range of the first pixel and the second pixel based on the determination result in the determination unit 213. Correction of the contour portion of. When the correction unit 211 performs correction, for example, the image information D11P to be displayed on at least one of the first pixel and the second pixel is arranged in a two-dimensional manner with a predetermined position and the display unit 11 The correction is performed based on the positions of the plurality of pixels and the pixel positions on the display unit 11 corresponding to the contour portion to be displayed.

The correction unit 211 corrects the image information D11P displayed on the first pixel and the second pixel according to the correction amount of the image information D11P determined by pairing the first pixel and the second pixel. Thereby, the contour correction unit 210 sets the image information D11P so that the position of the observer 1 (user) who views the display unit 11 and the display unit 12 is a predetermined position where the display target can be stereoscopically viewed by binocular parallax. It can be corrected.

The imaging unit 230 images the direction including the above-described viewing position on the display surface side displayed by the display device 10. That is, the imaging unit 230 captures the direction facing the display surface of the display device 10.
For example, the imaging unit 230 is not shown, but an optical lens, an imaging device that captures a subject light beam (optical image) input via the optical lens, and imaging data captured by the imaging device are digital images. An imaging signal processing unit that outputs data. Then, the imaging unit 230 supplies the captured image (digital image data) to the detection unit 250 and the control unit 260.

The detection unit 250 includes an observer detection unit 251 (detection unit), a face detection unit 252, and a face recognition unit 253.
The observer detection unit 251 detects the relative position of the observer on the display surface side displayed by the display device 10 with respect to the display device 10 based on the image captured by the imaging unit 230. That is, the observer detection unit 251 detects the relative position of the observer with respect to the display device 10 in the direction facing the display device 10 based on the image captured by the imaging unit 230. For example, the observer detection unit 251 is a surface parallel to the display surface of the display device 10 based on the position of the image region of the observer's face detected by the face detection unit 252 with respect to the image region captured by the imaging unit 230. An observer's position (X-axis and Y-axis coordinates) in (XY plane) is detected.

The observer detection unit 251 also determines the distance (the distance in the Z-axis direction) from the display device 10 to the observer with respect to the display surface of the display device 10 based on the image area of the observer's face detected by the face detection unit 252. , Z-axis coordinates). For example, the observer detection unit 251 determines the size of the image area of the observer's face detected by the face detection unit 252 or the interval between the left eye image area and the right eye image area in the face image area. Based on the above, the distance (distance in the Z-axis direction, coordinates in the Z-axis) to the display surface of the display device 10 from the display device 10 to the observer is detected. Note that the observer detection unit 251 may detect an observer detected from an image captured by the imaging unit 230 based on human characteristics other than the face (for example, body shape characteristics).

The face detection unit 252 detects a face image area from the image captured by the imaging unit 230.
For example, the face detection unit 252 extracts image information indicating the outline of the face and the position of the eyes from the image captured by the imaging unit 230, and the extracted image information and information indicating the characteristics of the human face (face And the image area of the face in the direction facing the display device 10, that is, the face of the observer is detected. In the following description, “detecting a face image area” is also simply referred to as “detecting an observer's face”. Here, the above-mentioned information indicating the characteristics of the human face is stored in the storage unit 270 as a face detection database used for detecting a face from an image, for example. Then, the face detection unit 252 supplies the detection result to the observer detection unit 251 or the face recognition unit 253.

If the face detection unit 252 fails to detect a face from the image captured by the imaging unit 230, the face detection unit 252 observes a detection result indicating that there is no face in the direction facing the display device 10, that is, there is no observer. To the person detection unit 251 or the face recognition unit 253.

The face recognition unit 253 recognizes the face of the observer detected by the face detection unit 252 based on the image captured by the imaging unit 230. For example, the face recognition unit 253 detects the detected face based on the detection result of the face detection unit 252 (information indicating the outline of the face, the position of the eyes, etc.) and the information indicating the characteristics of the faces of a plurality of people. Which observer's face is recognized.

Here, the information indicating the facial features of each of the plurality of persons described above is stored in the storage unit 270 as a face recognition database used to recognize a face extracted from an image, for example.

Note that the face recognition database may be configured to arbitrarily add information. For example, the display system 100 is provided with a menu for registering information indicating the features for recognizing the observer's face, and by executing this menu, the imaging unit 230 images the face of the observer to be registered, and the image is captured. Information for recognizing the face indicating the characteristics of the face of the observer to be registered based on the face image may be generated and registered in the face recognition database.

The storage unit 270 stores information necessary for the detection unit 250 to detect. For example, the storage unit 270 stores, as a face detection database, information indicating human face characteristics necessary for detecting a face from an image. In addition, the storage unit 270 stores, as a face recognition database, information indicating facial features of each of a plurality of persons necessary to recognize a face extracted from an image.

The control unit 260 includes a difference calculation unit 261, a contour correction control unit 262, and a display control unit 263.

The difference calculation unit 261 calculates a difference (positional difference) between the relative position of the observer detected by the observer detection unit 251 and the visual recognition position where the stereoscopic image displayed on the display device 10 can be stereoscopically viewed. . For example, the difference calculation unit 261 calculates a difference between positions detected by coordinates on the X, Y, and Z axes of the detected relative position of the observer and the visual recognition position.

The contour correction control unit 262 displays correction information for correcting the contour of an image to be displayed so that a stereoscopically viewable image can be displayed from the viewing position of the viewer 1 based on the image captured by the image capturing unit 230. 210. For example, the contour correction control unit 262 performs a predetermined stereoscopic display of the display target to be displayed on the display unit 11 and the display unit 12 based on the relative position of the observer 1 detected by the observer detection unit 251. The position information indicating the position of is generated. The contour correction control unit 262 supplies the generated position information to the contour correction unit 210, and the correction information for correcting the contour of the image displayed on the display device 10 is contoured in the contour correction unit 210 based on the generated position information. The correction unit 210 generates the data. In the following description, the relative position of the observer may be described as the position of the observer.

The display control unit 263 controls the display of the display device 10. The display control unit 263 causes the display device 10 to display a stereoscopic image based on the input image signal.

Here, with reference to FIG. 10, the positional relationship between the observer, the display device, and the contour portion in the target image will be described.
FIG. 10 is a diagram illustrating a positional relationship between an observer, a display device, and a contour portion in a target image. The position of the observer in FIG. 10 is based on information detected as position information of the observer 1 detected by the observer detection unit 251 as described above.
FIG. 10A shows a view of the display device 10 viewed from the display surface side ((+ Z) axis side). FIG. 10B shows a plan view of the XZ plane from the (+ Y) axis side.
In the following description, the positional relationship between the edge portion E in the image P12 and the edge image PE in the image P11 will be described in a simplified manner so that the positional relationship can be clearly shown. For example, it is assumed that the edge portion E in the image P12 can be visually recognized by overlapping the edge image PE in the image P11 from the position of Ma where the observer 1 is present. Assume that the positional relationship in this case is such that the image P11 and the image P12 are arranged at positions where stereoscopic viewing is easy. More specifically, the position of one point (point POS2) representing the edge portion E in the image P12 and the position of one point (point POS1) on the image P11 with respect to the same point (point POS2) match on the synthesized image. By doing so, when the edges of the image P12 and the edge image PE coincide with each other, the images can be visually recognized as overlapping images.

Here, the position of each point shown in FIG. 10 will be described. The position of the observer 1 is a position that is separated by a distance LD in the + Z-axis direction from the surface of the display device 10 (display unit 12) on the Z-axis. Further, the position of the observer 1 is indicated by Ma (0, 0, LD), the position of the point POS2 is indicated by (X2, Y2, 0), and the position of the point POS1 is indicated by (X1, Y1, -ZD). By aligning Ma (0, 0, LD), point POS2, and point POS1 in a straight line, the point POS2 and the point POS1 can be visually recognized.
Due to such a positional relationship, the observer 1 located at Ma (0, 0, LD) can visually recognize a stereoscopic image formed by the image P11 and the image P12.

On the other hand, when the position of the observer 1 moves from Ma1 (0, 0, LD) to Mb (−ΔX, 0, LD) or Mc (+ ΔX, 0, LD) in the direction along the X axis, POS1 does not overlap point POS2. For example, when the position of the observer 1 moves from Ma to Mb, the position of the point POS1 moves to the point POS1 ′. When the position of the observer 1 moves from Ma to Mc, the position of the point POS1 moves to the point POS1 ″.
If the movement amount of the position of the point POS1 is a movement amount in units of the width d of one pixel in the display unit 11 in the X-axis direction, the position of the point POS1 can be moved in units of one pixel in the display unit 11. . However, the amount of movement of the position of the point POS1 is not necessarily the amount of movement in units of the width of one pixel in the display unit 11 in the X-axis direction. Since the position where the edge image PE is displayed depends on the position of the pixel on the display unit 11, the position where the edge image PE can be displayed may not necessarily correspond to the position of the point POS1 calculated as described above. As described above, since the point POS1 does not overlap the point POS2, even if an attempt is made to move the display to an appropriate position by adjusting the position where the contour image is displayed, the display is performed so as to overlap with the limit of the resolution of the display unit 11. There are cases where it cannot be done.

Therefore, when the position of the point POS1 moves from the original (X1, Y1, -ZD) due to the observer 1 moving from Ma, the control unit 260 increases the movement amount from (X1, Y1, -ZD). Accordingly, the contour correcting unit 210 is controlled to correct the contour image of the image P11.
Note that, from the positional relationship shown in FIG. 10B, the display unit 11 of the image displayed on the display unit 11 is based on the movement amount of the observer 1 by the proportional calculation based on the similarity relationship of the triangles. The amount of movement on the display surface 11S can be calculated.

Next, an example of contour image correction in the display system 100 will be described with reference to FIG.
FIG. 11 is a diagram for explaining the correction of the contour image in the display system 100.
As described with reference to FIG. 8 above, depending on the observation position of the observer 1, the position of the edge of the two images displayed on the display device 10 may be shifted.
In the present embodiment, the image processing apparatus is configured so as to reduce the reduction in the visibility due to the above-described deviation by spreading an area having the same brightness (brightness) as the brightness (brightness) of the area indicating the outline in the outline image. 2 corrects the contour image. Hereinafter, an example will be shown and the details will be described.

Each diagram shown in FIG. 11 corresponds to each diagram in FIG. 8 described above. For example, FIG. 11A shows an image of the right side edge portion E2 of the quadrangle Ob indicated by the image P12 as in FIG. 8A described above.
11A to FIG. 4A arranged in order from the upper side in FIG. 11A are the same as FIG. 8A to FIG. 4A in FIG. 8A.

On the other hand, when the observer 1 moves from a predetermined position where a stereoscopic image can be visually recognized, the observer 1 cannot visually recognize the image shown in FIG. For example, FIG. 11B shows a case where the observer 1 moves in the (−X) axis direction along the X axis, and FIG. 11B shows a case where the observer 1 moves in the (+ X) axis direction along the X axis. 11 (c). FIGS. B1 to b4 shown in FIG. 11B and FIGS. C1 to c4 shown in FIG. 11C correspond to the above-described FIGS. A1 to a4. Hereinafter, FIG. 11B and FIG. 11C will be described in order centering on the difference from FIG.
Here, in the present embodiment, the width of the edge portion E (right edge portion E2) of the quadrangle Ob in the image P12 is the width of the pixel in the display unit 11 in the X-axis direction (d (FIG. 10)).

First, correction of the contour image in FIG. 11B will be described.
In FIG. B2, the right end OR of the rectangle Ob is in the (+ X) axis direction from the boundary between the pixel in the k-th column (column k) and the pixel in the (k + 1) -th column ((k + 1) -th column) shown in FIG. It is in a position to be observed by moving. When the right end OR of the quadrangle Ob is located at such a position, the right-side edge portion E2 of the quadrangle Ob is applied to the pixels in the adjacent column in the X-axis direction. For example, the pixels in the columns adjacent to each other in the X-axis direction are shown as a pixel in the kth column and a pixel in the (k + 1) th column shown in FIG.

Here, the contour correction unit 210 generates a right side edge image PE2 ′ from the right side edge image PE2 indicated by the image information D11P. The contour correction unit 210 according to the present embodiment arranges the right side edge image PE2 ′ side by side with respect to the right side edge image PE2 so as to correct pixels in columns adjacent in the X-axis direction according to the right side edge image PE2. In FIG. 11B, the contour correcting unit 210 arranges the right side edge image PE2 ′ in the (k + 1) column side by side with respect to the right side edge image PE2 located in the k column.
FIG. 11B shows an example in which the luminances of the pixels shown as the right side edge image PE2 and the right side edge image PE2 ′ are the same. The case of adjusting the luminance of the pixels indicating the right side edge image PE2 and the right side edge image PE2 ′ will be described later.

As described above, the contour correcting unit 210 detects that the right end OR of the quadrangle Ob is displayed at a position moved in the (+ X) axis direction from the right end of the right side edge image PE2. 'Is displayed. Thereby, the image corrected by the edge image PE2 and the right-side edge image PE2 'in the right-side edge portion E2 of the quadrangle Ob is synthesized (FIGS. B3 and b4). As a result of this correction, the edge image PE2 and the right-side edge image PE2 ′ are arranged side by side, and the luminance is enhanced in the right-side edge portion E2 of the quadrangle Ob as in FIG. 11A in FIG. A contour image is synthesized (FIG. B4). Even when the right end OR of the quadrangle Ob is moved in the (+ X) axis direction from the right end of the right side edge image PE2, the right end OR of the quadrangle Ob is obtained by the presence of the right side edge image PE2 and the right side edge image PE2 ′. Contour images in which the luminance peak value (Vp) is held up to the position are continuously present. Note that the right-side edge image PE2 'is arranged on the (+ X) axis side of the right-side edge image PE2 so as to continue to the right-side edge image PE2.

As described above, according to the above correction method, when the edge position in the contour image is relatively displaced inside the rectangle Ob, the influence of the edge position displacement can be reduced.

Next, the correction of the contour image in FIG.
In FIG. C2, the right end OR of the rectangle Ob is from the boundary between the k-th pixel (k column) and the (k + 1) -th pixel ((k + 1) column) displaying the right-side edge image PE2 shown in FIG. It is in a position to be observed by moving in the (−X) axial direction. When the right end OR of the quadrangle Ob is in such a position, the right edge portion E2 of the quadrangle Ob is shown as the pixel in the k-th column and the pixel in the (k−1) -th column shown in FIG. This is a situation where the pixels on the adjacent columns in the direction are applied.

Here, the contour correction unit 210 generates a right side edge image PE2 ′ from the right side edge image PE2 indicated by the image information D11P. The contour correction unit 210 according to the present embodiment arranges the right side edge image PE2 ′ side by side with respect to the right side edge image PE2 so as to correct pixels in columns adjacent in the X-axis direction according to the right side edge image PE2. In FIG. 11C, the contour correcting unit 210 arranges the right side edge image PE2 ′ in the (k−1) column side by side with respect to the right side edge image PE2 located in the k column.
Further, FIG. 11C shows an example in which the luminance of the pixels shown as the right side edge image PE2 and the right side edge image PE2 ′ is the same. The case of adjusting the luminance of the pixels indicating the right side edge image PE2 and the right side edge image PE2 ′ will be described later.

As described above, the contour correcting unit 210 detects that the right end OR of the quadrangle Ob is displayed at a position moved in the (−X) axis direction from the right end of the right side edge image PE2. 'Is displayed. Thereby, the image corrected by the edge image PE2 and the right-side edge image PE2 'in the right-side edge portion E2 of the quadrangle Ob is synthesized (FIGS. C3 and c4). As a result of this correction, the edge image PE2 and the right-side edge image PE2 ′ are arranged side by side, and the luminance is enhanced in the right-side edge portion E2 of the quadrangle Ob as in FIG. 11A in FIG. A contour image is synthesized (FIG. C4). Further, even when the right end OR of the quadrangle Ob is moved in the (−X) axis direction from the right end of the right side edge image PE2, the right end OR of the quadrangle Ob is obtained by the presence of the right side edge image PE2 and the right side edge image PE2 ′. There are successive contour images in which the peak value of luminance is held up to the position of. Note that the right side edge image PE2 'is arranged on the (−X) axis side of the right side edge image PE2 so as to continue to the right side edge image PE2.

As described above, according to the correction method described above, when the edge position in the contour image is relatively shifted outside the quadrangle Ob, the influence of the shift in the edge position can be reduced.

In short, in the synthesized images shown in FIGS. 11B and 11C, the brightness peak value Vp of the contour image is in any case compared with the synthesized images shown in FIGS. 8B and 8C. The same. However, in the composite image shown in FIGS. 11B and 11C, the width indicating the peak luminance value Vp of the contour image that continues to the position of the right end OR of the quadrangle Ob can be secured wider than the pixel width. It is different from (b) and (c). In short, by widening the width indicating the luminance peak value of the synthesized image in the vicinity of the right end OR of the quadrangle Ob, the position of the end recognized as the edge of the contour image can be matched with the right end OR of the quadrangle Ob. As a result, the display system 100 can show an outline in which the width of the outline indicated by the peak value Vp is wider than the width of the pixel, with the end aligned with the right end OR.
According to the present embodiment, the display system 100 synthesizes the contour image in which the brightness of the edge portion is enhanced by adding the right-side edge image PE2 ′ to the right-side edge image PE2 to enhance the contour image. Thereby, the display system 100 can reduce the influence of the shift of the edge position caused by the observer 1 moving from a predetermined position.
As described above, the display system 100 according to the present embodiment can improve the visibility of a stereoscopic image even when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized.

(Modification in this embodiment)
A modification of the contour image correction method in the display system 100 of the present embodiment will be described with reference to FIGS.

(First modification)
FIG. 12 is a diagram for explaining a modification of the contour image correction method in the display system 100.
In the present modification, the above-described deviation is allowed by arranging an area in which the brightness (luminance) is reduced from the brightness (luminance) in the outline area of the outline image, continuously with the outline area before correction. It can be so. Details will be described below.

Each diagram shown in FIG. 12 corresponds to each diagram in FIG. 8 described above. For example, FIG. 12A shows an image of the right edge portion E2 of the quadrangle Ob indicated by the image P12 as in the above-described FIG. 8A.
FIGS. A1 to a4 arranged in order from the upper side in FIG. 12A are the same as FIGS. A1 to a4 in FIG. 8A.

On the other hand, when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized, the observer 1 cannot visually recognize the image shown in FIG. For example, FIG. 12B shows a case where the observer 1 moves in the (−X) axis direction along the X axis, and FIG. 12B shows a case where the observer 1 moves in the (+ X) axis direction along the X axis. 12 (c). FIGS. B1 to b4 shown in FIG. 12B and FIGS. C1 to c4 shown in FIG. 12C correspond to the above-described FIGS. A1 to a4, respectively. In the following, FIG. 12B and FIG. 12C will be described in order centering on the difference from FIG.
Here, in this modification, the width of the edge portion E (right edge portion E2) of the quadrangle Ob in the image P12 is set as the width of the pixel in the display unit 11 in the X-axis direction.

First, the outline image correction in FIG. 12B will be described. The position where the contour image is corrected in FIG. 12B is performed at the same position as the position where the contour image is corrected in FIG. In short, the contour correcting unit 210 arranges the right-side edge image PE2 'in the (k + 1) column side by side with respect to the right-side edge image PE2 located in the k column.

However, FIG. 12B shows an example in which the luminances of the pixels shown as the right side edge image PE2 and the right side edge image PE2 ′ are different from those of FIG. 11B described above.
A specific difference is that when the right-side edge image PE2 ′ is generated from the right-side edge image PE2 indicated by the image information D11P for the pixels in the (k + 1) -th column, as shown in FIG. The brightness (luminance) of the right side edge image PE2 ′ is different. In the case of this modification, the luminance of the right side edge image PE2 ′ is set to be lower than the luminance of the right side edge image PE2 as a base. Note that the correction of the contour image in this modification is different in this respect from the correction of the contour image shown as an example of the first embodiment.

As described above, the right edge image PE2 ′ is displayed by detecting that the right edge OR of the quadrangle Ob is displayed at a position moved in the (+ X) axis direction from the right edge of the right edge image PE2. Thereby, the image corrected by the edge image PE2 and the right-side edge image PE2 ′ in the right-side edge portion E2 of the quadrangle Ob is synthesized (FIGS. B3 and b4).
As a result of this correction, the edge image PE2 and the right-side edge image PE2 ′ are arranged side by side, so that the luminance is enhanced in the right-side edge portion E2 of the quadrangle Ob as in FIG. 12A in FIG. A contour image is synthesized (FIG. B4). Further, even when the right end OR of the quadrangle Ob moves in the (+ X) axis direction from the right end of the right side edge image PE2, the right side edge image PE2 and the right side edge image PE2 ′ provide the right edge OR of the quadrangle Ob. Contour images continue to the position. In this modification, the luminance peak values of the contour image in the right side edge image PE2 and the right side edge image PE2 ′ are different. Therefore, the peak brightness value of the contour image in the right edge image PE2 ′ section is lower than the peak brightness value (Vp) of the contour image in the right edge image PE2 section. Note that the right side edge image PE2 ′ is arranged on the (+ X) axis side of the right side edge image PE2 so as to continue to the right side edge image PE2.

In short, in the synthesized image shown in FIG. 12B, in contrast to the synthesized image shown in FIG. 8B, the width indicating the peak value Vp of the brightness of the contour image is changed to the pixel width in FIG. Although it is the same as b), it is different from FIG. 8B in that the contour image continues to the position of the right end OR of the quadrangle Ob. In short, by increasing the brightness value of the composite image at the right end OR of the quadrangle Ob, the position of the end recognized as the edge of the contour image is matched with the right end OR of the quadrangle Ob, and the width indicating the peak value Vp is set at that position. A delicate contour with the width of the pixel can be shown.

Next, the correction of the contour image in FIG. The position where the contour image is corrected in FIG. 12C is performed at the same position as the position where the contour image is corrected in FIG. In short, the contour correcting unit 210 arranges the right side edge image PE2 'in the (k-1) column side by side with respect to the right side edge image PE2 located in the k column.

However, FIG. 12C shows an example in which the luminances of the pixels shown as the right side edge image PE2 and the right side edge image PE2 ′ are different from those of FIG. 11C described above.
A specific difference is that, as shown in FIG. A1 in FIG. 12C, the right-side edge image PE2 ′ is generated from the right-side edge image PE2 indicated by the image information D11P at the pixel in the (k−1) -th column. In this case, the brightness (luminance) of the right side edge image PE2 ′ is different. In the case of this modification, the luminance of the right side edge image PE2 ′ is set to be lower than the luminance of the right side edge image PE2 as a base. Note that this is different from the correction of the contour image shown as an example of the first embodiment.

As described above, by detecting that the right end OR of the quadrangle Ob is displayed at a position moved in the (−X) axis direction from the right end of the right side edge image PE2, the right side edge image PE2 ′ is displayed. Thereby, the image corrected by the edge image PE2 and the right-side edge image PE2 ′ in the right-side edge portion E2 of the quadrangle Ob is synthesized (FIGS. C3 and c4).
As a result of this correction, the edge image PE2 and the right-side edge image PE2 ′ are arranged side by side, and the luminance is enhanced in the right-side edge portion E2 of the quadrangle Ob as in FIG. 12A in FIG. A contour image is synthesized (FIG. C4). Further, even when the right end OR of the quadrangle Ob is moved in the (−X) axis direction from the right end of the right side edge image PE2, the right end OR of the quadrangle Ob is obtained by the presence of the right side edge image PE2 and the right side edge image PE2 ′. The contour image continues to the position of. In the present modification, the peak value of the brightness of the contour image is different between the edge image PE2 and the right-side edge image PE2 ′. Therefore, the peak brightness value of the contour image in the right edge image PE2 ′ section is lower than the peak brightness value of the contour image in the edge image PE2 section. Note that the right side edge image PE2 ′ is arranged on the (−X) axis side of the right side edge image PE2 so as to continue to the right side edge image PE2.

In short, in the synthesized image shown in FIG. 12C, the width indicating the luminance peak value Vp of the contour image is the same as that in FIG. 8C when compared with the synthesized image shown in FIG. Further, the point that the contour image is corrected inside the rectangle Ob is different from FIG. In short, the width recognized as the contour image can be widened by increasing the brightness value of the composite image in the region inside the rectangle Ob from the contour image in the region of the contour image of the luminance peak value Vp. .
By synthesizing the contour image in which the luminance is enhanced in this way, the contour image by the added right-side edge image PE2 can be enhanced as compared with FIG. 8 described above.

As described above, even when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized, the visibility of the stereoscopic image can be improved.

(Second modification)
Next, a modified example of adjusting the brightness (luminance) of the edge image PE ′ when generating the edge image PE ′ from the edge image PE will be described.
In this modification, an area in which the brightness (luminance) is reduced from the outline of the outline image is arranged continuously to the area of the outline before correction, and the luminance of the arranged area is set to the magnitude of the deviation. By adjusting accordingly, the above-described deviation can be allowed. Details will be described below.
FIG. 13 is a diagram illustrating the adjustment of the brightness (luminance) of the edge image PE ′ as a modification of the contour image correction method in the display system 100 of the present embodiment.
The upper part shows the relative positional relationship between the images P11 and P12 displayed on the display device 10 (display unit 11, display unit 12 (FIG. 1)) of the observer 1. The brightness (luminance) of the contour image displayed on the display unit 11 is shown in the middle. The result of combining the images displayed on the display device 10 is shown in the lower part.
The situation in which the display of the contour changes according to the amount of movement that the observer 1 has moved from the predetermined position (Ma (FIG. 10)) is shown in order from FIG. 13 (a) to FIG. 13 (e). .

FIG. 13 (a) shows a case where the position of the observer 1 coincides with a predetermined position (Ma (FIG. 10)), and corresponds to the above-described FIG. 11 (a) and FIG. 12 (a).

FIG. 13B shows a first stage in which the position of the observer 1 has moved from the predetermined position (Ma (FIG. 10)) in the (+ X) axial direction. FIG. 13B and FIG. It corresponds to c). That is, the contour correction unit 210 generates an edge image PE1 '(PE2') in which the luminance is lower than the luminance of the edge image PE1 (PE2).

FIG. 13 (c) shows a second stage in which the position of the observer 1 is further moved from the predetermined position (Ma (FIG. 10)) in the (+ X) axis direction. It corresponds to (c). That is, the contour correction unit 210 generates an edge image PE1 '(PE2') having the same luminance as that of the edge image PE1 (PE2).

FIG. 13D shows a third stage in which the position of the observer 1 is further moved from the predetermined position (Ma (FIG. 10)) in the (+ X) axis direction.
Until the second stage described above, the brightness of the generated edge image PE1 ′ (PE2 ′) is adjusted while maintaining the brightness of the edge image PE1 (PE2) at the initial value (Vp). After the third stage, the luminance of the edge image PE1 (PE2) is adjusted while the luminance of the edge image PE1 ′ (PE2 ′) is held at the initial value (Vp).
Specifically, the contour correction unit 210 reduces the luminance of the edge image PE1 (PE2) while maintaining the luminance of the edge image PE1 ′ (PE2 ′) at the same value (Vp) as in the second stage. ing.

FIG. 13 (e) shows a fourth stage in which the position of the observer 1 is further moved from the predetermined position (Ma (FIG. 10)) in the (+ X) axis direction. At this stage, the movement amount of the observer 1 is increased, and the edge image PE1 ′ (PE2 ′) generated as the correction information is displayed next to the pixel that displayed the edge image PE1 (PE2) in FIG. By displaying on a pixel, it shows that it has transfered to the state which can display a proper outline. At this stage, the edge image PE1 '(PE2') is displayed and the edge image PE1 (PE2) is not displayed.

In the above-described modification, a region for adjusting the luminance of the edge image PE1 (PE2) and a region for adjusting the luminance of the edge image PE1 ′ (PE2 ′) are determined according to the movement amount of the observer 1. Yes. Thereby, although it is a simplified method, the correction amount of a contour image can be continuously adjusted according to the movement of the observer 1.
As described above, even when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized, the visibility of the stereoscopic image can be improved.

(Third Modification)
Next, a modified example of adjusting the brightness (luminance) of the edge image PE ′ when generating the edge image PE ′ from the edge image PE will be described.
In this modified example, the area in which the brightness (luminance) is reduced from the outline of the outline image is arranged continuously with the outline before correction, and the luminance of the area arranged along with the outline area and the outline is set as described above. By adjusting each according to the magnitude of the deviation, the above deviation can be allowed. Details will be described below.
FIG. 14 is a diagram illustrating adjustment of the brightness (luminance) of the edge image PE ′ as a modification of the contour image correction method in the display system 100 of the present embodiment.
The upper part shows the relative positional relationship between the images P11 and P12 displayed on the display device 10 (display unit 11, display unit 12 (FIG. 1)) of the observer 1. The brightness (luminance) of the contour image displayed on the display unit 11 is shown in the middle. The result of combining the images displayed on the display device 10 is shown in the lower part.

In the second modification described above, the region for adjusting the luminance of the edge image PE1 (PE2) and the region for adjusting the luminance of the edge image PE1 ′ (PE2 ′) are set according to the movement amount of the observer 1. The embodiment which divides | segments was illustrated. On the other hand, in the present modification, the region for adjusting the luminance of the edge image PE1 (PE2) and the region for adjusting the luminance of the edge image PE1 ′ (PE2 ′) are divided according to the movement amount of the observer 1. An embodiment in which the brightness is adjusted according to the movement amount of the observer 1 without any change will be described below.

For example, coefficients k1 and k2 whose values change according to the movement amount of the observer 1 are determined. The coefficient k1 changes from 1 to 0 as the movement amount of the observer 1 increases, and the coefficient k2 changes from 0 to 1 as the movement amount of the observer 1 increases. It shall be. In accordance with the coefficients k1 and k2 determined in this way, the brightness k of the edge image PE1 (PE2) is multiplied by the coefficient k1 to set the brightness of the edge image PE1 (PE2), thereby setting the edge image PE1 (PE2). Is multiplied by the coefficient k2 to set the luminance of the edge image PE1 ′ (PE2 ′). By setting the coefficients k1 and k2 in this way, the luminance of the edge image PE1 (PE2) gradually decreases and the luminance of the edge image PE1 ′ (PE2 ′) gradually increases as the movement amount of the observer 1 increases. To rise.

Note that the value of the coefficient k1 and the value of the coefficient k2 may be added to be 1. By setting in this way, the range in which the observer 1 moves can be determined according to the pixel width in the display unit 11. Further, when the half of the range determined as the range in which the observer 1 moves is reached, the luminance of the edge image PE1 (PE2) and the luminance of the edge image PE1 ′ (PE2 ′) may be set to the same luminance. it can. As a result, the set luminance value can be made half the luminance value of the original edge image PE1 (PE2).

14 are arranged in the order of FIG. 14 (a) to FIG. 14 (e) in accordance with the amount of movement that the observer 1 has moved from a predetermined position (Ma (FIG. 10)).

FIG. 14 (a) shows a case where the position of the observer 1 coincides with a predetermined position (Ma (FIG. 10)), which is shown in FIGS. 11 (a), 12 (a) and 13 (a). Equivalent to.

FIG. 14B shows a first stage in which the position of the observer 1 has moved from a predetermined position (Ma (FIG. 10)) in the (+ X) axis direction. According to the coefficients k1 and k2, there is a relationship of 0 <k2 <k1 <1.
That is, the luminance value of the edge image PE1 (PE2) is reduced from the initial luminance value (Vs) of the edge image PE1 (PE2) to V1. On the other hand, the luminance value of the edge image PE1 generated from the edge image PE1 (PE2) '(PE2' ), to the initial edge image PE1 (PE2) _{V 3} which greatly reduces the luminance value (Vs) of.

FIG. 14C shows a second stage in which the position of the observer 1 is further moved from the predetermined position (Ma (FIG. 10)) in the (+ X) axis direction. When expressed using the above-described coefficients k1 and k2, there is a relationship of k1 = k2 = 0.5. That is, the luminance of the edge image PE1 (PE2) and the edge image PE1 ′ (PE2 ′) is reduced to the same value (V ₂ ) that is half the value (Vs) of the original edge image PE1 (PE2). To do.

FIG. 14D shows a third stage in which the position of the observer 1 is further moved from the predetermined position (Ma (FIG. 10)) in the (+ X) axis direction. According to the coefficients k1 and k2, there is a relationship of 0 <k1 <k2 <1.
That is, the value of the luminance of the edge image PE1 (PE2), significantly reduce the brightness values of the original edge image PE1 (PE2) (Vs) to _{V 3.} On the other hand, the brightness of the edge image PE1 edge image PE1 produced from (PE2) '(PE2') , the _{V 1} was reduced from a luminance value (Vs) of the original edge image PE1 (PE2).

FIG. 14E shows a fourth stage in which the position of the observer 1 is further moved from the predetermined position (Ma (FIG. 10)) in the (+ X) axis direction. At this stage, the movement amount of the observer 1 is increased, and the edge image PE1 ′ (PE2 ′) generated as the correction information is displayed next to the pixel that displayed the edge image PE1 (PE2) in FIG. By displaying on a pixel, it shows that it has transfered to the state which can display a proper outline. At this stage, the edge image PE1 '(PE2') is displayed and the edge image PE1 (PE2) is not displayed.

In the above-described modification, the region for adjusting the luminance of the edge image PE1 (PE2) and the region for adjusting the luminance of the edge image PE1 ′ (PE2 ′) are respectively set according to the movement amount of the observer 1. I decided to adjust the brightness. Thereby, although it is a simplified method, the correction amount of a contour image can be continuously adjusted according to the movement of the observer 1. Furthermore, according to the contour image correction method in the present modification, the luminance in the edge image PE1 (PE2) and the edge image PE1 ′ (PE2 ′) is reduced according to the movement amount of the observer 1. By controlling in this way, it is possible to prevent the edge from being excessively emphasized by arranging the edge image PE1 (PE2) and the edge image PE1 ′ (PE2 ′).
As described above, according to the display system 100 shown in the present embodiment, the visibility of a stereoscopic image can be improved even when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized.

[Second Embodiment]
Next, a display system 100A according to the second embodiment will be described with reference to FIGS. 15A to 15C and FIG.

15A to 15C are diagrams showing an overview of the display system in the present embodiment. The display system 100A shown in this figure displays an image that allows stereoscopic viewing on the display unit.
FIG. 15A is a schematic diagram in which a part of a cross section of the display device 10A in the display system 100A is enlarged. FIG. 15B shows the positional relationship between the display device 10 A and the observer 1. FIG. 15C shows the arrangement of pixels on the display surface 11S of the display unit 11A.
Even when the observer 1 moves within a predetermined range from the illustrated position, the display device 10A displays the image to be displayed so that it can be viewed stereoscopically.

The display unit 11A and the display unit 12 of the display device 10A correspond to the display unit 11 and the display unit 12 of the display device 10 (FIGS. 1 and 2) in the first embodiment, and as in the case of the display device 10, Arranged at different depth positions. In short, in the display device 10A, similarly to the display device 10 described above, an image to be displayed on the display unit 11A is transmitted through the image to be displayed on the display unit 12, and a display target is displayed. The display device 10A in which the display unit 11A and the display unit 12 are combined displays a stereoscopic image by optically combining the images displayed on the respective display units. In short, the optically synthesized stereoscopic image becomes a stereoscopic image in which binocular parallax generated in the left eye L and the right eye R as shown in FIG.
In this way, the display system 100A displays the edge of the target image displayed on the display unit 12 on the display unit 11A, thereby displaying the image displayed on the display device 10A in a three-dimensional manner.

Note that the display unit 11A of the present embodiment has a single display that can display a stereoscopic image (3D image) displayed so as to be stereoscopically viewed from a predetermined viewing position. Even a three-dimensional image can be displayed. For example, as a display method for displaying a stereoscopic image that can be stereoscopically viewed with the naked eye without using special glasses, different images that cause binocular parallax are displayed so as to be seen by the left eye and the right eye, respectively. There is a method. To give more specific examples, a lenticular lens system in which a lenticular lens is arranged in front of the display surface, or a parallax barrier in which a parallax barrier (parallax barrier) is arranged in front of the display surface as shown in FIG. Examples include methods. The lenticular lens method can easily increase the amount of light reaching the eyes (left eye (L) and right eye (R)) when emitting light with the same amount of light emission as compared to other methods such as a parallax barrier method. . As described above, the lenticular lens method is a method suitable for the display unit 11A of the present embodiment for further displaying the image through the display unit 12, and an example in which the lenticular lens method is applied to the display unit 11A. Shown in 15A.

Hereinafter, as an example of the display system 100A in the present embodiment, a case where the display unit 11A of the lenticular lens type is provided will be described as an example.

A sheet-like lenticular lens 13 is provided on the display surface 11S of the display unit 11A. The lenticular lens 13 is provided with a plurality of convex lenses (for example, cylindrical lenses) that have a curvature in one direction and do not have a curvature in a direction orthogonal to the one direction in a direction orthogonal to the extending direction. Here, the extending direction of the convex lens is the vertical direction (Y-axis direction).
On the display surface 11S of the display unit 11A, a plurality of rectangular display areas are provided along the extending direction (Y-axis direction) of the convex lens so as to correspond to the convex lenses in the lenticular lens 13. For example, as an example of the display unit 11A in the present embodiment, a plurality of display regions R1, R2, R3, R4, and R5 that display images for the right eye are displayed on the plurality of display regions, and a display for the left eye. A plurality of display areas L1, L2, L3, L4, and L5 for displaying images are assigned so as to be alternately arranged. The observer 1 is within a range in which a pair of right-eye images (for example, images displayed in the display area R1) and left-eye images (for example, images displayed in the display area L1) can be observed corresponding to the convex lens. When arranged, the display on the display unit 11A can be observed as a stereoscopic image.
As shown in FIG. 15C, the display area 11S of the display unit 11A has display areas in the order of display areas L1, R1, L2, R2, L3, R3, L4, R4, L5, R5,. It is arranged. In each display area, a plurality of pixels are arranged side by side in the extending direction (Y-axis direction) of each display area. For example, in the display areas L1, R1, and L2, the pixel PICL1, the pixel PICR1, and the pixel PICL2 are provided in order along the X-axis direction. For example, the pair of the pixel PICL1 and the pixel PICR1 is a pair that allows the observer 1 to visually recognize a stereoscopic image. Further, the brightness (luminance) in each pixel is displayed with uniform brightness (luminance). Each pixel in the display unit 11A may be any pixel as long as it can be handled as a single pixel, and each pixel may further include a plurality of sub-pixels. For example, as long as the display unit 11A can display a color image, the sub-pixels included in each pixel may be provided according to three colors (RGB).
In the display unit 11A having such a configuration, the most suitable position for observing the stereoscopic image to be displayed is discretely arranged like the position of the observer 1 illustrated in FIG. 15B. A predetermined range based on a position most suitable for observing the stereoscopic image to be displayed is an area where the stereoscopic image is easily observed.

Next, the configuration of the display system 100A in the present embodiment will be described with reference to FIG.
FIG. 16 is a schematic block diagram showing the configuration of a display system 100A according to an embodiment of the present invention. A display system 100A illustrated in FIG. 16 includes an image processing device 2A and a display device 10A.
The display device 10A in the present embodiment includes a display unit 11A and a display unit 12.
The image processing device 2A generates a contour image for displaying a stereoscopic image on the display device 10A.
The image processing apparatus 2A includes a contour correction unit 210A, an imaging unit 230, a detection unit 250, a control unit 260, and a storage unit 270.

In accordance with the supplied image information (image information D11P, image information D12P), the contour correcting unit 210A in the present embodiment corrects and outputs at least one of the supplied image information. The contour correction unit 210A supplies, for example, image information D11 obtained by correcting the image information D11P to the display device 10A.
The contour correction unit 210A in the present embodiment includes a determination unit 213 and a correction unit 211A. The correction unit 211A corresponds to the above-described correction unit 211 (FIG. 9).
The correction unit 211A of the present embodiment generates image information D11 of an image to be displayed for each of the left eye (L) and the right eye (R) based on the image information D11P. In the following description of the present embodiment, image information D11 of an image displayed on the display unit 11A for the left eye (L) and the right eye (R), respectively, is referred to as image information D11L and image information D11R.

In generating the image information D11L and the image information D11R, the contour correction unit 210A applies the contour image correction method described in the example and the modifications in the first embodiment described above, and corresponds to the image information D12P. Generated as a contour image. In the first embodiment described above, the pixel of the display unit 11 is read as a pixel of the display unit 11A in the present embodiment or a rectangular display region discretely arranged as the display unit 11A.
In the generation of the contour image in the first embodiment described above, the case where the contour image is corrected based on the detected position of the observer 1 is exemplified. On the other hand, the contour correcting unit 210A of the present embodiment replaces the position of the observer 1 and the position of the left eye (L) and the right eye (R) of the observer 1 estimated from the detected position of the observer 1. The contour image is corrected based on the position of. Alternatively, the contour correcting unit 210A corrects the contour image based on the detected position of the left eye (L) and right eye (R) of the viewer 1 instead of the position of the viewer 1.

In short, the contour correction unit 210A generates image information D11L from the image information D11P with reference to the position of the left eye (L) of the observer 1, and displays the image on the display unit 11A for the left eye (L). Display as. Thereby, the image observed in the left eye (L) is an image obtained by optically combining the image based on the image information D11L and the image based on the image information D12. The contour correction unit 210A generates image information D11R from the image information D11P with reference to the position of the right eye (R) of the observer 1 and displays the image information D11R for the right eye (R) on the display unit 11A. Display as. Thereby, the image observed in the right eye (R) is an image obtained by optically combining the image based on the image information D11R and the image based on the image information D12.
In the present embodiment, as described above, the images to be displayed for the left eye (L) and the right eye (R) are generated independently. However, the images are formed by optically synthesized images. The result is as shown in FIG.
In the right eye R of the observer 1, an optical image IMR formed by combining the image P11R visually recognized by the right eye R and the image P12R visually recognized by the right eye R is formed.
In the display system 100A of the present embodiment, the images to be displayed for the left eye (L) and the right eye (R) are generated independently, and the left eye (L) and the right eye (R) On the other hand, an image that can be easily viewed stereoscopically is displayed. Thereby, the observer 1 can observe a stereoscopic image with a more stereoscopic effect.
Further, in the generation of the image P11R visually recognized by the right eye R and the image P12R visually recognized by the right eye R, the contour image is corrected as shown in the first embodiment, so that 2 is displayed on the display unit 11A. When displaying a contour image of one pixel, the influence can be reduced.

As described above, according to the display system 100A shown in the present embodiment, the display target to be displayed on the display unit 11A (first display unit) and the display unit 12 (second display unit) is stereoscopically displayed at a predetermined position by binocular parallax. Of the image information to be displayed, image information to be displayed on the display unit 11A is referred to as image information D11 (first image information).
The contour correction unit 210A is based on the predetermined position, the positions of a plurality of pixels arranged in a two-dimensional manner in the display unit 11A, and the pixel position in the display unit 11A corresponding to the contour part to be displayed. In the image information D11, the image information corresponding to the contour portion to be displayed is corrected. The predetermined position is set to, for example, each position of both eyes of the observer 1. In addition, it is good also as a single position which represents the observer 1 like the above-mentioned 1st Embodiment, without making said predetermined position into each position of both eyes of the observer 1. FIG.

(Modification of display unit 11A)
In addition, although the case where the two-lens type lenticular method is applied to the display unit 11A in the above description is described as an example, a multi-lens type lenticular method can be applied to the display unit 11A.
When the multi-lens lenticular method is applied to the display unit 11A, a stereoscopic image can be observed from a plurality of directions in which the display device 10A is viewed. The display unit 11A displays the stereoscopic image so that the stereoscopic image can be observed from a position corresponding to the front of the display unit 11A and a position deviated from the front. In this case, even if the observer 1 moves from a position in front of the display unit 11A, a contour image that can continuously observe a stereoscopic image suitable for observation from those directions is displayed on the display unit 11A. It is good to display.

Therefore, when observing from a direction deviating from the front of the display unit 11A, the contour correcting unit 210A causes the display unit 11A to display a contour image that displays a stereoscopic image suitable for the direction in which the stereoscopic image can be observed. .
For example, the contour correction unit 210A displays, in each direction, image information D11 that displays a stereoscopic image suitable for the direction in which the stereoscopic image can be observed based on the supplied image information (image information D11P, image information D12P). Generate and output a corresponding contour image. In generating the image information D11, the contour correction unit 210A applies, for example, the contour image correction method as described in the first embodiment, and is suitable for the direction in which the stereoscopic image determined by the lenticular lens 13 can be observed. A contour image for displaying the stereoscopic image is output.
For example, the contour correction unit 210A outputs a contour image that displays a three-dimensional image suitable for the direction in which the three-dimensional image is observable by the contour image correction method as described in the first embodiment. May be. In addition, the contour correction unit 210A uses the pixel indicating the contour when viewed from the front of the display unit 11A as a reference, and the luminance of the image displayed on the pixel adjacent to the pixel indicating the contour when viewed from the front. It adjusts according to the brightness | luminance of the pixel which shows an outline. As a result, a contour image observed from each direction can be generated by the contour correcting unit 210A and displayed on the display unit 11A.

In this way, by displaying the contour images from the respective directions deviating from the front of the display unit 11A on the display unit 11A, it is possible to display a stereoscopic image that changes according to the movement of the observer 1. . Furthermore, the contour correcting unit 210A generates a contour image that continuously changes the contour image to be displayed in accordance with the movement of the observer 1, whereby the stereoscopic image displayed on the display unit 11A is moved by the observer 1. Can be changed gradually and continuously according to the movement, and the stereoscopic image can be changed and displayed in accordance with the movement.
As described above, even when the multi-lens type lenticular method is applied, the position of the contour portion of the display target displayed by the image information D11 (first image information) is adjusted according to the position of the observer 1. Thus, the display system 1 can display a contour image that allows the display target to be stereoscopically viewed from the position of the observer 1A according to the stereoscopically visible direction of the display unit 11A. Thereby, the range which can observe a stereo image from the observer 1 can be expanded.
As described above, according to the display system 100A shown in the present embodiment, the visibility of a stereoscopic image can be improved even when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized.

[Third Embodiment]
Subsequently, a display system 100B according to the third embodiment will be described with reference to FIGS. 17A to 21.

17A to 17C are diagrams showing an outline of the display system in the present embodiment. The display system 100B shown in this figure displays an image that allows stereoscopic viewing on the display unit.
FIG. 17A shows a state where the viewer 1 is located in a stereoscopically viewable range by enlarging a part of the cross section of the display device 10B in the display system 100B. FIG. 17B shows the positional relationship between the display device 10 B and the observer 1. FIG. 17C shows an arrangement of pixels on the display surface 10S of the display device 10B. Since the viewer 1 is illustrated, the viewer can stereoscopically view the image displayed on the display device 10B even if the viewer 1 moves a predetermined range from the position.

The display device 10B according to the present embodiment displays a stereoscopic image (3D image) so that a stereoscopic image can be stereoscopically viewed from a predetermined viewing position even when used alone without being combined with another display device. An example having a display that can be used will be described.
A sheet-like lenticular lens 13 is provided on the display surface 10S of the display device 10B shown in FIG. 17A. The lenticular lens 13 has a curvature in one direction, and a plurality of convex lenses (for example, cylindrical lenses) that do not have a curvature in a direction orthogonal to the one direction are aligned in the direction orthogonal to the extension direction. Is provided. Here, the extending direction of the convex lens is the vertical direction (Y-axis direction).

The display surface 10S of the display device 10B is provided with a plurality of rectangular display areas corresponding to the convex lenses in the lenticular lens 13 along the extending direction (Y-axis direction) of the convex lenses. For example, as an example of the display device 10B according to the present embodiment, a plurality of display regions R1, R2, R3, R4, and R5 that display images for the right eye are displayed on the plurality of display regions, and a display for the left eye. A plurality of display areas L1, L2, L3, L4, and L5 for displaying images are allocated.

Thus, the display device 10B displays a stereoscopic image using the parallax generated by the lenticular lens 13. The display device 10B of the present embodiment includes, for example, a lenticular lens display (display unit 11B and display unit 12B).
The display unit 11 B is provided with a display area for displaying an image to be presented to one of the eyes dispersed in a plurality of display areas. Similarly to the display unit 11B, the display unit 12B is also provided with a display area for displaying an image to be presented to the other eye of both eyes dispersed in a plurality of display areas. In the case of FIG. 17A, for example, the display unit 11B is provided in the display regions R1, R2, R3, R4, and R5 (first display region), and the display unit 12B includes the display regions L1, L2, L3, L4, L5 (second display area) is provided. In this way, the arrangement of the display unit 11B and the display unit 12B in the display device 10B is different from the display device 10 (FIGS. 1 and 2) in the first embodiment and is arranged along the same surface (display surface 10S). The

Further, as shown in FIG. 17C, the display areas on the display surface 10S of the display device 10B are display areas L1, R1, L2, R2, L3, R3, L4, R4, L5, R5,. It is arranged. In each display area, a plurality of pixels are arranged side by side in the extending direction (Y-axis direction) of each display area. For example, in the display areas L1, R1, and L2, the pixel PICL1, the pixel PICR1, and the pixel PICL2 are provided in order along the X-axis direction. The pair of the pixel PICL1 and the pixel PICR1 is a pair that allows the observer 1 to visually recognize a stereoscopic image. Further, the brightness (luminance) in each pixel is displayed with uniform brightness (luminance). Each pixel in the display unit 11A may be any pixel as long as it can be handled as a single pixel, and each pixel may further include a plurality of sub-pixels. For example, as long as the display unit 11B and the display unit 12B can display a color image, the sub pixels included in each pixel may be provided according to three colors (RGB).

With reference to FIG. 18, the structure of the display system 100B in this embodiment is demonstrated.
Hereinafter, as an example of the display system 100B in the present embodiment, a case where a two-lens lenticular lens system is applied to a display device will be described as an example.
FIG. 18 is a schematic block diagram showing the configuration of a display system 100B according to an embodiment of the present invention. A display system 100B illustrated in FIG. 18 includes an image processing device 2B and a display device 10B.
The image processing device 2B generates a contour image for displaying a stereoscopic image on the display device 10B.
The image processing device 2B includes a contour correction unit 210B, a stereoscopic image generation unit 220B, an imaging unit 230, a detection unit 250, a control unit 260, and a storage unit 270.

The stereoscopic image generation unit 220B according to the present embodiment uses the image information D11P and the image information D12P such that the display target displayed on the display unit 11B and the display unit 12B can be stereoscopically viewed from a predetermined position by binocular parallax. Is generated. The predetermined position is a position where the visual recognition position of the observer 1 can emphasize the outline most, and the observer 1 can visually recognize the stereoscopic image. Accordingly, the stereoscopic image generation unit 220B generates image information D11P and image information D12P in which the position of the contour portion to be displayed displayed by the image information D11P is adjusted according to the predetermined position.
For example, the stereoscopic image generation unit 220B receives the supply of the image information D11S for display on the display unit 11B and the display unit 12B, and the display target can be stereoscopically viewed from a predetermined position based on the image information D11S. Such image information D11P and image information D12P are generated.
The stereoscopic image generation unit 220B is image information in which the position of the contour portion to be displayed is adjusted according to a predetermined position, and includes the lenticular lens 13 as an optical unit that generates binocular parallax. The first image information to be displayed on the display unit 11B may be generated.

The contour correction unit 210B in the present embodiment includes a determination unit 213B and a correction unit 211B.
For example, in the correction of the image information D11P and the image information D12P included in the contour portion to be displayed, the determination unit 213B determines that the position of the contour portion to be displayed on the display portion 11B is the pixel of the display portion 11B. It is determined whether or not it falls within the range between the adjacent first pixel and second pixel. In the case of a two-lens lenticular lens, the first and second pixels adjacent to each other in the display unit 11B are pixels provided in adjacent columns in the display unit 11B.
For example, the determination unit 213B determines that, based on the determination result, the position of the contour portion to be displayed on the display unit 11B falls within the range of the first and second pixels adjacent to each other among the pixels of the display unit 11B. It is determined that correction is necessary, and it is determined that correction is not necessary when the range of the adjacent first pixel and second pixel among the pixels of the display unit 11 is not applied. The adjacent first display area and second display area are areas arranged side by side in a direction (horizontal direction) in which stereoscopic parallax occurs.

A determination is made to determine conditions for controlling correction processing in the correction unit 211B described later. For example, in the correction of the image information D11P included in the contour portion to be displayed, the determination unit 213B has the position of the contour portion to be displayed displayed on the display portion 11B as a first pixel adjacent to the pixel of the display portion 11B. It is determined whether or not it falls within the range of the second pixel.
For example, the determination unit 213B determines that, based on the determination result, the position of the contour portion to be displayed on the display unit 11B falls within the range of the first and second pixels adjacent to each other among the pixels of the display unit 11B. It is determined that correction is necessary, and it is determined that correction is unnecessary when the range of the first pixel and the second pixel adjacent to each other among the pixels of the display unit 11B is not applied. The adjacent first pixel and second pixel are pixels (display areas) arranged side by side in a direction (horizontal direction) in which stereoscopic parallax occurs.

The correction unit 211B displays a display target to be displayed on the display device 10B when it is determined that the position of the contour of the display target is within the range between the first pixel and the second pixel based on the determination result in the determination unit 213. Correction of the contour portion of. When the correction unit 211B performs correction, for example, image information D11P to be displayed on at least one of the first pixel and the second pixel is arranged in a two-dimensional manner with a predetermined position and the display unit 11 The correction is performed based on the positions of the plurality of pixels and the pixel position (display area position) in the display unit 11 corresponding to the contour part to be displayed.

The correction unit 211B corrects the image information D11P to be displayed on either the first pixel or the second pixel according to the correction amount of the image information D11P determined by pairing the first pixel and the second pixel.
The correction unit 211B corrects the image information D12P to be displayed on either the first pixel or the second pixel according to the correction amount of the image information D12P determined by pairing the first pixel and the second pixel.
As a result, the contour correction unit 210B has the image information D11P so that the position of the observer 1 (user) who views the display unit 11B and the display unit 12B becomes a predetermined position where the display target can be stereoscopically viewed by binocular parallax. The image information D12P can be corrected.

As described above, the contour correction unit 210B according to the present embodiment corrects and outputs at least one of the supplied image information according to the image information supplied to the contour correction unit 210B. For example, the image information to be processed by the contour correcting unit 210 includes image information D11P (first image information) and image information D12P (second image information).

The image information D11P includes the display unit 11 and the display unit 11 among the image information that stereoscopically displays a display target to be displayed on the display unit 11 (first display unit) and the display unit 12 (second display unit) at a predetermined position by binocular parallax. This is image information to be displayed on any one of the display unit 12. The image information D12P is image information that is displayed on either the display unit 11 or the display unit 12 among the image information for stereoscopically displaying the display target at a predetermined position by binocular parallax.

In the first display mode, the contour correction unit 210B in the present embodiment corrects the image information D11P (first image information) to generate the image information D11, and the image information D12P (second image information). Image information D12 is generated by correcting (image information). In the case of the second display mode, the contour correction unit 210B corrects the image information D11P (first image information) to generate image information D12, and corrects the image information D12P (second image information). To generate image information D11.
In short, the outline correction unit 210B switches the correspondence between the image information D11P (first image information) and the image information D12P (second image information) and the image information D11 and the image information D12 according to the display form. Output.

As the correction method in the present embodiment, the correction method in the first embodiment can be applied.
Further, the contour correction unit 210B in the present embodiment may perform correction by applying a plurality of correction methods according to the movement amount of the observer 1 as described below.

In the lenticular lens type display device shown in FIG. 18 described above, an area where a stereoscopic image can be observed is limited depending on the optical characteristics of the lenticular lens 13.
Hereinafter, referring to FIG. 19, as an example of selecting a correction method based on the area, the observer moves to an area outside the area where the stereoscopic image determined according to the optical characteristics of the lenticular lens 13 can be observed. An image correction method in this case will be described.
FIG. 19 is a diagram for explaining a correction method in a case where the observer moves from a region where a stereoscopic image determined according to the optical characteristics of the lenticular lens 13 can be observed to a region outside the region. In the display device 10B illustrated in FIG. 19, the display unit 11B is indicated by a column S1, and the display unit 12B is indicated by a column S2. FIG. 19 shows the display device 10B and the observer 1 (1 ′) at different positions in the X-axis direction.

When the observer 1 is located at Ma (i) (or Ma (i + 1)), the left eye of the observer 1 is in the area Z1 (or area Z3) and the right eye is in the area Z2 (or area Z4). Is inside. Region Z1 (or region Z3) indicates a range in which the column S1 of the display unit 11B can be observed, and region Z2 (or region Z4) indicates a range in which the column S2 of the display unit 12B can be observed. The left eye of the observer 1 is located in the region Z1 (or region Z3), the right eye is located in the region Z2 (or region Z4), and the left eye is displayed on the display unit 11B (column S1). In the first display mode in which an image to be presented is displayed and an image to be presented to the right eye is displayed on the display unit 12B (column S2), the observer 1 can observe a stereoscopic image.
In the first display mode, the left eye of the observer 1 is located in an area outside the area Z1 (or area Z3), or the right eye is located in an area outside the area Z2 (or area Z4). As a result, the observer 1 cannot observe the stereoscopic image. In short, even if the image is displayed in the first display form so that the stereoscopic image can be observed, the stereoscopic image is observed while the position of the observer 1 moves from Ma (i) to Ma (i + 1). There are areas that cannot be done.

Therefore, the display system 100B according to the present embodiment performs a process in which a part of the area in which the stereoscopic image existing in the first display form cannot be observed is changed to an area in which the stereoscopic image can be observed. For example, a part of the regions in which the stereoscopic image existing in the first display form cannot be observed can be observed as a stereoscopic image when the following condition is satisfied. Become. For example, as in the case where the position of the observer 1 is located at Ma ′ (i), the left eye of the observer 1 is located inside the area Z2 and the right eye is located inside the area Z3. In this case, instead of the first display form, it is possible to display the second display form so that it can be observed as a stereoscopic image. The display according to the second display form is a display form in which the positions for displaying the images presented to the left eye and the right eye of the observer 1 are reversed with respect to the display according to the first display form.
In this way, by switching the display state of the display device 10B according to the position of the observer 1, a part of the region in which the stereoscopic image cannot be observed based on the first display state can be changed based on the second display state. With this, an area where a stereoscopic image can be observed can be made.

As described above, when the observer 1 moves to a region outside the region where the stereoscopic image determined according to the optical characteristics of the lenticular lens 13 can be observed, the contour correction unit 210B may switch the display form.

Next, a correction method when the observer moves will be described with reference to FIG.
FIG. 20 is a diagram illustrating a correction method when the observer moves.
Hereinafter, a stereoscopic image displayed on the display device 10B until the position of the observer 1 shown in FIG. 19 is from Ma (i) to Ma ′ (i) will be described.
FIG. 20A schematically shows a stereoscopic image observed when the observer 1 observes the target image from the position of Ma (i).
The diagrams from FIG. 20A to FIG. 20D move along the X axis from the position of Ma (i) to Ma ′ (i) while the observer 1 observes the display device 10B. The three-dimensional image observed in the case of doing is shown typically.
The upper part shows the positional relationship between the display device 10B and the observer 1 as shown in FIG.
From the top to the bottom, the brightness of the edges (contour image PE1 and contour image PE2) of the image presented to the left eye to be corrected according to the position of the observer 1 and the brightness of the image information D11P (D12P) are sequentially displayed from the top. The brightness of the image presented to the left eye and the brightness of the image presented to the right eye are shown.

In the present embodiment, the correction amount of the contour image PE1 and the contour image PE2 is calculated by the contour correction unit 210B based on each of the image information D11 and the image information D12. In the description of FIG. 20, the description until the image information D11 is obtained from the image information D11P will be representative, and only the result of the image information D12 will be shown.
In short, the brightness of the image presented to the left eye is calculated by adding the brightness of the contour image PE1 and the contour image PE2 generated based on the image information D11P to the brightness of the image information D11P. For example, the luminance of the image information D11 corresponds to an image that causes the left eye of the observer 1 to perceive brightness IML as shown in FIG. In this way, an image in which the edge portions of the object (the left side edge portion E1 and the right side edge portion E2) are emphasized is generated and displayed on the display unit 11B as the image information D11. Similarly, the luminance of the image presented to the right eye is calculated based on the image information D12P.
As a result, the images observed with both eyes each cause binocular parallax with the luminance or width of the edge portion corrected. For example, the image perceived by the observer 1 is such that the brightness of the edge portion is different as in the image information D11 and the image information D12 shown in FIG.
In FIG. 20A, the observer 1 is located at Ma (i), and the edge parts (left edge part E1 and right edge part E2) of the rectangular object displayed substantially in front of the observer 1 are shown. ), An image in which a contour image PE1 and a contour image PE2 for correcting the contour are generated is displayed. For example, an image corrected so that the brightness of the contour image PE1 and the brightness of the contour image PE2 in the correction of the edge portion are equal to each other is displayed. The display form in FIG. 20A is, for example, the first display form described above with reference to FIG.

When the position of the observer 1 moves in the X-axis direction (Ma ′ (i) direction) to the position as shown in FIG. 20B, the direction in which the object 1 is expected to be seen by the observer 1 is as shown in FIG. In the case of (a), the image is observed to the left from the viewer 1 as compared to the direction to be viewed. The position of the observer 1 in the case shown in FIG. 20B is in the range of half or less from Ma (i) to Ma ′ (i), and is half of the position from Ma (i) to Ma ′ (i). It is assumed that it is within a predetermined range near the position. Thus, even if the observer 1 moves relatively little, the direction in which the object is viewed changes. Therefore, in order to reduce the change in the direction in which the object is viewed, the correction amounts of the contour image PE1 and the contour image PE2 are adjusted according to the movement amount of the observer 1. As shown in this figure, when the observer 1 moves in the X-axis direction from the reference position (Ma), the brightness of the edge portion in the same direction as the direction in which the observer 1 moves is displayed higher. Correct as follows. For example, the above-described various methods can be applied to adjust the correction amounts of the contour image PE1 and the contour image PE2 according to the movement amount of the observer 1. Here, a case where the correction method as shown in FIG. 13 is applied will be described. In short, the contour image PE1 before correction and the contour image in the direction (X-axis direction) in which the viewer 1 moves with respect to the contour image PE1 and contour image PE2 before correction according to the movement amount of the viewer 1. Perform correction to add an equal amount of edge to PE2.
By correcting in this way, a stereoscopic image is generated that allows the observer 1 to recognize that the object has moved in the same direction as the movement direction of the observer 1 without changing the position where the object is displayed on the display device 10B. can do.
In short, the display form in FIG. 20B is maintained in the first display form (FIG. 19) as in the case of FIG.

When the position of the observer 1 is further moved in the X-axis direction from the position shown in FIG. 20B and displayed by the same display method up to the above-described FIG. 20B, it is shown in FIG. As described above, it reaches an area where the stereoscopic image cannot be observed.
In short, in the case shown in FIG. 20B, the observer 1 is inside the region that can be corrected from the image when Ma (i) at a position suitable for observing the stereoscopic image is used as a reference. The state where the observer 1 is located near the limit point when moving in the X-axis direction is shown.

Here, when the position is further moved in the X-axis direction (Ma ′ (i) direction) from the position shown in FIG. 20B, the display form in the display device 10B is displayed as the second display as shown in FIG. Switch to form. For example, the position where the display form is switched is set to a half position from Ma (i) to Ma ′ (i). In addition, when the display form up to FIG. 20B is the first display form, the display form after switching is the second display form. FIG. 20C shows a state immediately after switching the display form.
Here, as a result of switching the display mode, the display mode is switched to the second display mode (FIG. 19), so that the position is separated from Ma (i) from the half position from Ma (i) to Ma ′ (i). The area is an area where a stereoscopic image can be observed. In short, the display form in FIG. 20B is maintained in the first display form (FIG. 19) as in the case of FIG.
While the position of the observer 1 further moves in the X-axis direction and reaches the position of Ma ′ (i) shown in FIG.

Thus, by making the region where the stereoscopic image cannot be observed in the process in which the viewer 1 moves from the position Ma (i) to the position Ma ′ (i), the viewer 1 can A stereoscopic image displayed on the display device 10B can be observed while moving the range.

In calculating the correction amount, by adjusting the correction amount so that the stereoscopic image in the case of FIG. 20C and the stereoscopic image in the case of FIG. Even when the observer 1 moves from Ma (i) shown in a) to Ma ′ (i) shown in FIG. 20 (d), the image of the target portion that the observer 1 sees has not changed. Make them recognize.
In particular, when switching the reference image, the image quality such as the brightness of the image before and after switching is matched.

The correction shown in FIG. 20 has been described as calculating the correction amount according to the movement amount of the observer 1, but in the detection of the movement amount of the observer 1, the observer is based on a predetermined representative value. The amount of calculation required for this correction processing is reduced by using a detection value that approximates the amount of movement of 1 with a discrete value or approximating the correction amount of each contour image with a discrete value. Can do.
For example, from Ma (i) shown in FIG. 20 (a) to Ma ′ (i) shown in FIG. 20 (d), the number of images that can be displayed according to the position of the observer 1 is several. By limiting, it is possible to reduce the calculation load of the correction calculation process according to the movement of the observer 1.

(Modification example when applying the multi-lens lenticular lens method to the display device)
With reference to FIG. 21 and FIG. 22, a modified example in the case of applying the binocular lenticular lens method to the display device in the display system 100 B of the present embodiment will be described.
FIG. 21 is a diagram illustrating a modification of the display device 10B in the display system 100B.
FIG. 21 shows an enlarged part of a cross section of the display device 10B. In FIG. 17C and FIG. 19 showing the above-described embodiment, the display device 10B is assumed to be provided with a binocular lenticular lens type display. However, the display device 10B in this modification shown in FIG. A lenticular lens type display is provided.
In the display system 100B according to this modification, when viewed from each of a plurality of viewing positions (viewing regions), a stereoscopic image is displayed on the display device 10B so that stereoscopic viewing is possible from the viewed angle.
Images captured from a plurality of angles corresponding to angles viewed from each of a plurality of viewing positions (viewing regions) are respectively displayed for a plurality of viewpoints. Such a display method is sometimes called an integral method (multi-view method).

The multi-lens type lenticular lens type display unit 11B and display unit 12B further divide the regions of the columns S1 and S2 in the display unit 11B and the display unit 12B shown in FIG. 19 into a plurality of columns. For example, the column S1 of the display unit 11B is divided into five columns (S11, S12, S13, S14, S15), and the column S2 of the display unit 12B is divided into five columns (S21, S22, S23, S24, S25). To divide. In short, the display surface 10S of the display device 10B is arranged in the order of columns S11, S12, S12, S14, S15, S21, S22, S23, S24, S25,. In each column, a plurality of pixels are arranged side by side in the extending direction (Y-axis direction) of each column. As a result, stereoscopic images viewed from five directions can be displayed respectively.

Thus, when observed from five directions, the stereoscopic image displayed on the display device 10B can be observed from the position where it is most easily observed. When observing a stereoscopic image from a position that is shifted from the position at which it is most easy to observe, it is preferable to detect the position of the observer 1 and perform correction according to the deviation calculated based on the detected position of the observer 1.

The correction method will be described by exemplifying an image that can be observed when observed from three of the five directions described above.
FIG. 22 is a diagram illustrating a method of correcting an image when observed from three directions.
Here, the directions Da0, Db0, and Dc0 indicate directions in which the stereoscopic image is most easily observed. Three stereoscopic images based on the direction are prepared. The direction in which the viewer 1 looks at the display device 10B can be calculated from the relative positional relationship with the display device 10 based on the result of detecting the viewer 1.

Here, a case where the objects (OBJ1 and OBJ2) exist at different positions in the depth direction will be described. An object close to the observer 1 is indicated by reference numeral OBJ1, and an object far from the observer 1 is indicated by reference numeral OBJ2.
Each of the stereoscopic images observed from the directions Da0, Db0, and Dc0 has an emphasized outline as an outline image for enabling stereoscopic viewing. Here, in order to simplify the description, the following description will be made with the amount of contours in the stereoscopic image observed from the directions Da0, Db0, and Dc0 as equal amounts.
When observed from the direction Da0, a part of the shape of the object OBJ2 is shielded by the object OBJ1 and can be observed. When observed from the direction Da1, a part of the shape of the object OBJ2 is shielded by the object OBJ1, and the shielded range can be observed wider than in the case of the direction Db0. When observed from the direction Dc0, the shape of the object OBJ2 can be observed without being shielded by the object OBJ1.

The above three cases will be described in order.
First, the case of observing from the direction Da0 will be described. The direction observed from the positive direction side of the X axis with respect to the direction Da0 is indicated as the direction Da1 with reference to the stereoscopic image that can be observed from the direction Da0, and the direction observed from the negative direction side of the X axis with respect to the direction Da0. The direction is defined as Da2. As in the case of the direction Da0, the directions Db1, Db2 and the directions Dc1, Dc2 are determined based on the direction Db0.

When the actual object is observed from the direction Da1, the shielded range is observed wider than in the case of the direction Da0 compared to the case of observing from the direction Da0. On the other hand, when observed from the direction Da2, the shielded range is observed to be narrower than when observed from the direction Da0 compared to the direction Da0. Thus, even if the observation direction changes slightly, the observer 1 recognizes that the assumed positional relationship with the object has changed when the actual object is observed.
In the multi-lens lenticular lens system shown as this modification, even in the multi-lens display device 10B, the directions in which a stereoscopic image can be observed stereoscopically are limited. Therefore, the display device 10B can present an image in a limited direction, but it is difficult to present an image in which the observation direction is continuously changed. Therefore, when observing from a direction in which an image as an image to be presented in a limited direction is not prepared, an image in a representative direction prepared to present the image in a limited direction is used as a basis. Correct the image and display it. The correction method will be described below.
A left-side edge image PE1 added to the left side of the object and a right-side edge image PE2 added to the right side are added to the stereoscopic image of the object OBJ1 indicated by the symbol A0 as the edge image PE. Further, the left side edge image PE1 ′ added to the left side of the object and the right side edge image PE2 ′ added to the right side are added to the stereoscopic image of the object OBJ2 as the edge image PE.
Next, in the three-dimensional image of the object OBJ1 indicated by reference numeral A1, the luminance of the left side edge image PE1 is increased and the luminance of the right side edge image PE2 is decreased. In the stereoscopic image of the object OBJ2, the luminance of the left side edge image PE1 ′ is lowered and the luminance of the right side edge image PE2 ′ is increased. By performing the correction in this way, the object OBJ1 and the object OBJ2 are perceived by the observer 1 because the region where the objects OBJ2 appear to overlap is widened. The observer 1 can feel as if viewed from the direction of Da1.
Next, in the three-dimensional image of the object OBJ1 indicated by reference numeral A2, the luminance of the left side edge image PE1 is lowered and the luminance of the right side edge image PE2 is increased. In the stereoscopic image of the object OBJ2, the luminance of the left side edge image PE1 ′ is increased and the luminance of the right side edge image PE2 ′ is decreased. By performing the correction in this way, the area where the object OBJ1 and the object OBJ2 appear to overlap is narrowed and perceived by the observer 1. The observer 1 can feel as if viewed from the direction of Da2.

Then, each figure referred with code | symbol B0, B1, B2 is demonstrated.
When the actual object is observed from the direction Db1, the shielded range is observed more widely than in the direction Db0. On the other hand, when observed from the direction Db2, the shielded range is observed narrower than in the direction Db0. This tendency is the same as that in the direction Da0 described above.
As shown in the diagrams referenced by the symbols B0, B1, and B2, corrected images can be generated in the same manner as the diagrams referenced by the aforementioned symbols A0, A1, and A2.

Then, each figure referred with code | symbol C0, C1, C2 is demonstrated.
As shown in the figure referenced by the reference C0, the object OBJ1 and the object OBJ2 observed from the direction Dc0 do not have a region that shields each other.
When the actual object is observed from the direction Dc1, the distance between the object OBJ1 and the object OBJ2 is observed to be narrower than in the direction Dc0. On the other hand, when observed from the direction Dc2, the shielded range is observed wider than in the direction Dc0.
As shown in the diagrams referenced by the symbols C0, C1, and C2, corrected images are generated in the same manner as the diagrams referenced by the symbols A0, A1, and A2.
As a result, in the three-dimensional image of the object OBJ1 and the object OBJ2 indicated as the reference C1, the distance between the object OBJ1 and the object OBJ2 is narrowed and perceived by the observer 1.
Next, in the three-dimensional image of the object OBJ1 and the object OBJ2 indicated by the reference symbol C2, the interval between the object OBJ1 and the object OBJ2 is widened and perceived by the observer 1.

In this way, the observer 1 can make a relative correction with respect to the object in the same manner as in the case of observing the actual object only by slightly correcting the displayed image when the viewing direction of the display device 10B changes. The observer 1 can recognize that the positional relationship has changed.

As described above, according to the display system 100B shown in the present embodiment, the visibility of a stereoscopic image can be improved even when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized.

[Fourth Embodiment]
Next, a display system 100C according to the fourth embodiment will be described with reference to FIGS.
FIG. 23 is a schematic block diagram showing a configuration of a display system 100C according to an embodiment of the present invention. A display system 100 C illustrated in FIG. 23 includes an image processing device 2 C and a display device 10. The image processing apparatus 2C has a feature of generating a contour image.

The image processing apparatus 2C includes a contour correction unit 210, a stereoscopic image generation unit 220C, an imaging unit 230, a detection unit 250, a control unit 260, and a storage unit 270.

The contour correcting unit 210 in the present embodiment corrects at least one of the supplied image information according to the image information (image information D11P, image information D12P) supplied from the stereoscopic image generating unit 220C. Output.

The stereoscopic image generation unit 220C according to the present embodiment generates image information D11P that allows the display target to be viewed stereoscopically from a predetermined position by binocular parallax, based on the display target displayed on the display unit 11 and the display unit 12. As described above, the predetermined position is a position where the viewer's 1 visual recognition position can emphasize the outline most, and the observer 1 can visually recognize the stereoscopic image.

The stereoscopic image generation unit 220C generates image information D11P in which the position of the contour portion to be displayed displayed by the image information D11P is adjusted according to the predetermined position. For example, the stereoscopic image generation unit 220C receives the supply of the image information D11S to be displayed on the display unit 11 and the display unit 12, and the display target can be stereoscopically viewed from a predetermined position based on the image information D11S. Such image information D11P is generated.
At this time, the stereoscopic image generation unit 220C outputs image information D12P based on the image information D11S. Alternatively, the stereoscopic image generation unit 220C may generate image information D12P that allows the display target to be viewed stereoscopically from a predetermined position based on the image information D11S.
More specifically, the stereoscopic image generation unit 220C sets, as the image information D11P, an image for adding the edge image PE to the image information D11S based on the image information D11S. The stereoscopic image generation unit 220C generates image information D11P from the image information D11S based on the positional relationship between the position of the observer 1 and the display device 10. For example, the stereoscopic image generation unit 220C generates the image information D12P based on the image information D11S, and the magnification of the image information D11P based on the image information D11S is determined based on the positional relationship between the position of the observer 1 and the display device 10. Image information D11P is output according to the display position.

Further, for example, the stereoscopic image generation unit 220C may generate the image information D11P that displays the display target displayed by the perspective method as an image rotated with reference to the virtual axis according to the predetermined position. . In this case, the stereoscopic image generation unit 220C receives supply of information (D11S) to be displayed on the display unit 11 and the display unit 12, and based on the supplied information (D11S), the stereoscopic image generation unit 220C determines the display target by binocular parallax. Image information D11P is generated so that the display target can be viewed stereoscopically from a predetermined position. Thus, the process of displaying the display target as an image rotated with respect to the axis can be applied to information having three-dimensional information. Details of the generation method will be described later.

Note that the stereoscopic image generating unit 220C deforms the shape of the display target displayed based on the image information D11P according to the displacement of the predetermined position, thereby setting the position of the contour part of the display target. Information D11P may be generated. In addition, the stereoscopic image generation unit 220C displays image information for displaying a display target by transmitting one image through the other image among the image P11 displayed on the display unit 11 and the image P12 displayed on the display unit 12. The position of the contour portion to be displayed may be adjusted according to the predetermined position.
In the present embodiment, as shown in FIG. 1, the display unit 11 is arranged at a distance from the display unit 12 in the normal direction (−Z direction) of the display unit 12. In this case, the display unit 12 is a transmissive display unit. In short, the stereoscopic image generation unit 220C displays the contour of the display target according to the predetermined position so that the image P11 displayed on the display unit 11 is transmitted through the image P12 displayed on the display unit 12 and displayed. Image information D11P is generated as image information whose position has been adjusted.

In this way, the stereoscopic image generation unit 220C generates the image information D11P to be displayed on the display unit 11 that is arranged at a distance from the display unit 12 in the normal direction (−Z direction) of the display unit 12.
In generating the image information D11P, the three-dimensional image generation unit 220C includes information indicating a contour portion to be displayed from the image information D12P for displaying an image on the display unit 12 among the image information displayed in a three-dimensional manner at the predetermined position. And the extracted information is generated as image information D11P.

(Generation of stereoscopic images according to the movement of the observer)
The stereoscopic image generating unit 220C extracts feature points for displaying a stereoscopic image from the base image information (image information D11S), and generates a stereoscopic image for emphasizing the extracted feature points to display a stereoscopic image.
The image information D11S based on the stereoscopic image generation unit 220C may be any of a still image, a CG image, and a moving image.
The feature points for performing the stereoscopic image display extracted from the base image information D11S can be optimized according to the base image information D11S.

First, a case of a still image will be described as an example of a base image.
(1: For still images)
In the case of a still image, the stereoscopic image generation unit 220C can select processing corresponding to the main subject based on information associated with the image or predetermined information.

(1-1: Still image (portrait))
As a first mode in which the base image is a still image, there is a portrait in which a person is a main subject. When the base image is a portrait, the image processing apparatus 2C (stereoscopic image generation unit 220C) extracts a person or a focused subject as a feature point for displaying a stereoscopic image. A known method can be applied to a method for extracting a person from a base image and a method for extracting a focused subject from a base image. The image processing device 2C (stereoscopic image generation unit 220C) generates stereoscopic image information based on the extracted feature points (such as a person) so as to stereoscopically display the main subject corresponding to the feature points.

(1-2: Still image (image in which main subject is specified in advance))
As a second mode in which the base image is a still image, there is an image that is set to be a main subject at the time of shooting. When the base image is an image that is set to be a main subject at the time of shooting, the image processing device 2C extracts the main subject as a feature point for performing stereoscopic image display. Note that the information indicating the main subject is indicated by, for example, meta information associated with the image. The image processing device 2C (stereoscopic image generation unit 220C) generates stereoscopic image information so that the extracted main subject is stereoscopically displayed.

(1-3: Still image (image from which feature points can be extracted based on image features))
As a third aspect in which the base image is a still image, there is an image from which feature points can be extracted based on the features of the image. For example, when the main subject and the background of the main subject are configured based on the golden ratio, feature points can be extracted based on the features of the image. When the base image is an image from which feature points can be extracted based on the image characteristics exemplified above, the image processing apparatus 2C determines whether or not there is a dividing line at a position assumed based on the golden ratio. And feature points can be detected based on the determination result.
The image processing apparatus 2C may extract feature points according to the arrangement in the screen. For example, for the one arranged at the corner of the screen, a setting such as lowering the priority of extraction from the one arranged at the center is performed. By setting the priority in this way, it is possible to set the position where the feature points are extracted so as not to be biased by reducing the probability that the feature points are extracted from the corners of the screen.
Note that the image processing apparatus 2C (stereoscopic image generation unit 220C) specifies a main subject based on the feature points of the extracted image, and generates stereoscopic image information so that the specified main subject is stereoscopically displayed. Examples of cases that can be extracted from such a technique include buildings and landscape pictures.

(1-4: Still image (landscape image))
As a fourth mode in which the base image is a still image, there is an image whose scenery is the main subject.
The image processing apparatus 2 C may extract the distant scenery as a feature point preferentially when it is determined that the base image is the main subject. Alternatively, the image processing apparatus 2 C may extract the feature point preferentially in the foreground subject when the subject in focus on the near side can be detected even if the image is the main subject in the landscape. . This selection may be switched by setting.

(1-5: Still images (images taken intermittently))
As a fifth aspect in which the base image is a still image, there is an image photographed intermittently. When the base image is an intermittently captured image, the image processing device 2C can extract the main subject based on the difference information of the plurality of images.
For example, the image processing apparatus 2C can extract a subject having a large amount of movement in the screen or a subject photographed in a plurality of continuous images as a feature point. The process of extracting a moving subject (moving amount, direction) showing a feature different from the feature that the background moves from an image photographed in a plurality of consecutive images is performed by “frame There are known methods for applying “difference between” and vector processing of the movement amount. The image processing apparatus 2C (stereoscopic image generation unit 220C) specifies a main subject based on the extracted subject and the feature points of the subject, and generates stereoscopic image information so that the specified main subject is stereoscopically displayed.

Next, a case of a moving image will be described as an example of a base image.
(2: For moving images)
When the base image is a moving image, the main subject can be extracted from the focal length information based on the history information at the time of shooting and the distance information to the subject.
For example, the image processing apparatus 2C uses the focal length information and the distance information based on the history information at the time of shooting to extract the subject at the focused position at the time of shooting as the main subject. The image processing device 2C (stereoscopic image generation unit 220C) generates stereoscopic image information so that the extracted main subject is stereoscopically displayed.

Subsequently, a case of a computer graphics image (CG image) will be described as an example of a base image.
(3: For CG images)
When the base image is a CG image, information in the depth direction (depth MAP) about the display target can be created using the information of the 3D model. A display target can be extracted based on the depth direction information (depth MAP), or the direction in which an object is displayed on the display device 10 can be set.

With reference to FIG. 24, the process of displaying the display object displayed by the perspective method in a pseudo-rotation will be described.
FIG. 24 is a diagram illustrating a process of displaying a display object displayed by perspective in a pseudo-rotation manner.
FIGS. 24A and 24B show the rectangular parallelepiped in perspective (two-point perspective).
FIG. 24A shows a rectangular parallelepiped when FP1 and FP2 are defined as vanishing points, that is, a rectangular parallelepiped having the vertices (QA, QB, QC, QD, QE, QF, QF, QG) illustrated. (However, vertices hidden in the body are not included.)

For example, a case will be described in which an image of the rectangular parallelepiped shown in FIG. 24A is virtually generated when viewed from a position closer to the front side of the surface composed of QA-QB-QF-QG than the current viewpoint. When the viewpoint position is moved as described above, there is a place where a rectangular parallelepiped can be visually recognized as shown in FIG.
In the conversion process from FIG. 24A to the diagram shown in FIG. 24B, it is obtained as if the coordinate system including the rectangular parallelepiped is rotated about the rotation axis RA shown in FIG. it can. In short, the stereoscopic image generation unit 220C uses an image obtained by rotating a rectangular parallelepiped (display target) displayed by the perspective method with reference to the rotation axis RA (virtual axis) according to the predetermined position, as shown in FIG. The image information D11P and the image information D12P for displaying the rectangular parallelepiped shown in FIG.
By such conversion processing, an image of a rectangular parallelepiped viewed from various directions can be obtained by calculation processing. In the present embodiment, the movement of the position of the observer 1 may be detected and rotated in conjunction with the detected amount of movement with respect to the rectangular parallelepiped displayed on the display device 10. In this way, by interlocking with the movement amount (movement) of the observer 1, the image to be displayed can be rotated without using any special input means.

In addition, as described above, the shape of the rectangular parallelepiped to be displayed is deformed in accordance with the rotation linked to the movement amount (movement) of the observer 1. In order to stereoscopically display an image viewed from an arbitrary direction, the stereoscopic image generation unit 220C generates a contour image in which input image information and the position of a rectangular parallelepiped contour portion to be displayed are set according to display conditions. Thereby, even when the display condition is changed, the responsiveness until the stereoscopic image is displayed can be shortened.

As described above, in the display system 100C, various images such as a still image, a moving image, or a CG image can be displayed, and an object to be displayed in an emphasized manner according to the characteristics of the various images. By specifying as the main subject, it is possible to enhance the stereoscopic expression power in the generated stereoscopic image information.

Also, the contour correcting unit 210 in the image processing apparatus 2C corrects the contour image based on the image information D11P and image information D12P (stereoscopic image information) generated by the stereoscopic image generating unit 220C. The contour correction unit 210 corrects the position / direction in which the contour image is arranged and the brightness balance based on the representative position of the user. The contour correcting unit 210 sets the brightness of the contour portion according to the amount of movement of the position of the contour image obtained by calculation. For the correction processing performed by the contour correction unit 210, the methods described in the above embodiments can be applied.

Subsequently, processing performed by the image processing apparatus 2C in the display system 100C will be described with reference to FIG. FIG. 25 is a flowchart illustrating processing performed by the image processing apparatus 2C.

First, the detection unit 250 detects the position of the observer 1 based on image information obtained by the imaging unit 230 imaging so that the observer 1 is included in the imaging range (step S10). In the detection of the position of the observer 1, the detection unit 250 performs based on image information captured by the imaging unit 230.

The stereoscopic image generation unit 220C generates a contour image of a stereoscopic image that can be stereoscopically viewed from the observer 1 based on the detected position of the observer 1 (step S20). The position of the observer 1 is the position detected by the detection unit 250 in step S10. The stereoscopic image generation unit 220C generates a contour image in at least one image information indicating an image that is visually recognized as a superimposed image so that the stereoscopic image can be visually recognized from the detected position of the observer 1. For example, the stereoscopic image generation unit 220C generates at least image information (contour image) D11P.

The contour correction unit 210 corrects the contour portion of the generated contour image based on the detected position of the observer 1 (step S30). For example, the generated contour image is at least the contour image D11P. The contour correction unit 210 corrects at least the contour portion of the contour image D11P to generate image information D11.

The control unit 260 displays the corrected contour image on the display unit 11 and the display unit 12 in the display device 10 (step S40). For example, the control unit 260 causes the display unit 11 in the display device 10 to display the image information D11 including the corrected contour image.

By the processing described above, the image processing device 2C can correct the contour of the image information displayed on the display device 10. Thereby, even if it is a case where the observer 1 moves from the predetermined | prescribed position which can visually recognize a stereo image, the visibility of a stereo image can be improved.

In addition, although the outline image which shows only an outline was illustrated and demonstrated as one Example shown in 1st Embodiment, and the outline image D11P in each modification, the information of the original image used as the basis of the production | generation of the outline image D11P, and The new image information synthesized based on the image information of the above-described contour image D11P may be used as the contour image. In short, the image information newly obtained by synthesizing as described above corresponds to the original image in which the contour is emphasized.
As described above, according to the display system 100C shown in the present embodiment, the visibility of a stereoscopic image can be improved even when the observer 1 moves from a predetermined position where the stereoscopic image can be visually recognized.

As described above, the display system 100 (100A, 100B, 100C) shown in the present embodiment detects the position of the moving observer 1 (user) and displays a stereoscopic image corresponding to the position of the observer 1 (user). 10 (10A, 10B). In the stereoscopic image displayed on the display device 10 (10A, 10B), the edge portions in the images observed from the left eye and the right eye are corrected so as to generate parallax. As a result, the observer 1 can stereoscopically view from the position where the observer 1 is present.
In the description of the present embodiment, a person (object existing on the display surface side) existing on the display surface side displayed by the display device 10 (10A, 10B) of the display system 100 (100A, 100B, 100C) is observed. It is called person 1. The observer 1 is, for example, a person who is looking at the display surface displayed by the display device 10 (a person who sees it), a person who is trying to see (a person who is trying to see), or a person who can see (a person who can see) Person), or a person who is simply present on the display surface side. The viewing position at which the stereoscopic image can be viewed stereoscopically is a position within the viewing area where the stereoscopic viewing is possible, which is determined by, for example, the distance and angle with respect to the display surface displaying the stereoscopic image. In the description of the present embodiment, this “viewing area” or “viewing position” in the “viewing area” is described as “viewing position”.

Note that the requirements of the first to fourth embodiments described above can be changed as appropriate within a range that does not affect the technical features of the invention. Some components may not be used.

For example, the contour of the stereoscopic image exemplified in each of the above embodiments is exemplified by the vertical direction (Y-axis (FIG. 1)) of the display device 10, but the contour of the display device 10 in the horizontal direction and the oblique direction is also illustrated. Can be applied. When generating a contour image with respect to the horizontal or oblique contour of the display device 10, the correction amount for correcting the contour image in a direction orthogonal to the extending direction of the target contour may be adjusted.

For example, the position of the pixel that performs the correction of the contour image exemplified in each of the above embodiments has been described as an example of the pixel adjacent to the position of the contour before correction. However, the position of the contour before correction is described. Alternatively, the position may be a predetermined number of pixels from the position. For example, when a contour is shown by connecting a plurality of pixels, a predetermined number of pixels corresponding to the width of the contour may be separated.

For example, the display unit that displays the contour image shows an example of display on the display unit 11 in the depth direction ((−Z) axis direction) among the display units arranged so that the displayed images overlap. The display unit 12 disposed in front of the display surface 11S of the display unit 11 may be used. Further, the contour image can be displayed on at least one of the displays arranged so that the images to be displayed overlap. Further, among the displays arranged so that the images to be displayed overlap, the contour image can be displayed on a plurality of display units. Moreover, it does not restrict | limit displaying the image information from which the result which combined the image each displayed on a some display part becomes an outline image.

For example, the display system 100 may supply image information to be displayed on a head-mounted display device, a so-called head mounted display (HMD), instead of the display device 10. Alternatively, the display system 100 may supply image information to be displayed on a stereoscopic image display device using lens shutter glasses instead of the display device 10.

[Fifth Embodiment]
Hereinafter, a fifth embodiment of the present invention will be described with reference to the drawings.
FIG. 27 is a schematic diagram illustrating an example of a schematic configuration of a display device 2100 according to the fifth embodiment of the present invention. Hereinafter, in the description of each drawing, an XYZ rectangular coordinate system is set, and the positional relationship of each part will be described with reference to this XYZ rectangular coordinate system. A direction in which the display device 2100 displays an image is a positive direction of the Z axis, and orthogonal directions on a plane perpendicular to the Z axis direction are an X axis direction and a Y axis direction, respectively. Here, the X-axis direction is the horizontal direction of the display device 2100, and the Y-axis direction is the vertical upward direction of the display device 2100. Hereinafter, an outline of a configuration of the display device 2100 will be described.

A display device 2100 according to this embodiment includes a first display unit 2011 as a display unit 2010 and a second display unit 2012. The first display unit 2011 includes a first display surface 2011S for displaying an image in the depth position _{Z 1.} The second display unit 2012 is provided with a second display surface 2012S for displaying an image in the depth position _{Z 2.} User 1 (viewer) sees from the viewpoint position VP predetermined for depth position _{Z VP,} the first display surface 2011S, and a second display surface 2012S. Since the second display surface 2012S is a transmissive screen, when the user 1 views the second display surface 2012S from the viewpoint position VP, the image displayed on the first display surface 2011S and the second display surface 2012S are displayed. It looks like the image to overlap.

Here, as an example, a case where the display target OBJ is a cube shown in FIG. 27 will be described. The first display surface 2011S displays a cubic image P11. The second display surface 2012S displays a cubic image P12. Here, the second display surface 2012S is displayed in advance so that when the user 1 is viewed from the viewpoint position VP, the ridge lines of the cube indicated by the image P12 appear to overlap the ridge lines of the cube indicated by the image P11. The size and position are set.

Note that the image P12 displayed on the second display surface 2012S may be an image showing the display target OBJ as it is, or an image showing the outline (edge part) of the display target OBJ in an emphasized manner. For example, the image P12 displayed on the second display surface 2012S may be a contour image showing a contour portion of the display target OBJ. This contour image is generated by extracting the contour portion of the image P11 displayed on the first display surface 2011S by using, for example, a differential filter. In addition, the contour image may be an image in which the width of the pixel representing the contour portion is one pixel, or may be an image in which the width of the pixel representing the contour portion is a plurality of pixels. Hereinafter, a case where the image P12 is a contour image will be described. That is, a case where the second display surface 2012S displays the contour image P12 will be described.

When the user 1 superimposes the image P11 and the contour image P12 from the viewpoint position VP, a difference occurs in how the ridge lines of the cube overlap between the left eye L and the right eye R of the user 1. That is, when the user 1 superimposes the image P11 and the contour image P12 whose depth positions are different from the viewpoint position VP, binocular parallax occurs. Due to this binocular parallax, the user 1 perceives a cubic stereoscopic image. Details of the mechanism by which the user 1 perceives a stereoscopic image will be described later. Here, it is assumed that the second display surface 2012S is a transmissive screen and is located on the near side (+ Z side) of the depth position with respect to the first display surface 2011S when viewed from the viewpoint position VP. Not limited. For example, the first display surface 2011S may be a transmissive screen and may be located closer to the depth position than the second display surface 2012S (+ Z side) when viewed from the viewpoint position VP.

Here, if the ridge line of the cube displayed on the second display surface 2012S can be precisely aligned with the ridge line of the cube displayed on the first display surface 2011S, the display device 2100 is highly accurate for the user 1. A stereoscopic image can be perceived. For example, if the position of the ridgeline of the cube displayed on the first display surface 2011S viewed from the viewpoint position VP and the position of the ridgeline of the cube displayed on the second display surface 2012S are precisely aligned, the display device 2100 The user 1 can perceive a highly accurate stereoscopic image. Here, the first display surface 2011 S and the second display surface 2012 S are, for example, a liquid crystal display or a screen of a liquid crystal projector, and have two-dimensionally arranged pixels. The second display surface 2012S displays the ridge line of the cube on the pixel including the position Pt2 corresponding to the position Pt1 of the ridge line of the cube displayed on the first display surface 2011S viewed from the viewpoint position VP. Here, the pixel has an area corresponding to the definition of the second display surface 2012S. When the position Pt2 and the center position Pt3 of the pixel coincide with each other, the second display surface 2012S displays the position Pt1 of the cube ridgeline displayed on the first display surface 2011S viewed from the viewpoint position VP. The position of the ridge line of the cube is precisely aligned. However, in general, the position Pt2 and the center position Pt3 of the pixel do not coincide with each other. In this case, the alignment accuracy is lowered. Accordingly, if the position Pt2 and the center position Pt3 of the pixel do not coincide with each other and the second display surface 2012S displays the contour image P12 without correction, the alignment accuracy decreases. . In this case, the display device 2100 may reduce the accuracy of the stereoscopic image perceived by the user 1 (for example, the sense of depth of the stereoscopic image). The accuracy of alignment between images will be described with reference to FIGS. 28 and 29. FIG.

FIG. 28 is a schematic diagram illustrating an example of a pixel configuration of the second display surface 2012S of the present embodiment. The second display surface 2012S has a plurality of pixels arranged two-dimensionally on the XY plane. Some of the pixels indicate the ridges of a cube that is the display target OBJ. A plurality of pixels Px (pixels Px11 to Px33) indicating the ridgelines of the cube will be described with reference to FIG.

FIG. 29 is a schematic diagram illustrating an example of a pixel Px on the second display surface 2012S of the present embodiment. As an example, the plurality of pixels Px indicating the cubic ridge lines are nine pixels including a central pixel Px22 and surrounding pixels Px11 to Px33. The central pixel Px22 is a pixel including a position Pt2 corresponding to the position Pt1 of the cubic ridgeline displayed on the first display surface 2011S viewed from the viewpoint position VP. The position Pt3 described above is the center position of the pixel Px22 here. Here, a case will be described in which the position Pt2 is shifted by a distance ΔPt in the (+ Y) direction with respect to the position Pt3.

As described above, when the position Pt2 and the center position Pt3 of the pixel coincide with each other, the position Pt1 of the ridge line of the cube displayed on the first display surface 2011S viewed from the viewpoint position VP and the second display surface The position of the ridgeline of the cube displayed by 2012S is precisely aligned.
However, when the position Pt2 is shifted from the center position Pt3 of the pixel by the distance ΔPt in the (+ Y) direction, the ridge line is shifted in the (−Y) direction from the original position where the cube ridge line is to be displayed. Will be displayed.

The display device 2100 of this embodiment includes a contour correction unit 2013 that corrects the contour image P12.
The contour correcting unit 2013 corrects the contour image P12 based on the direction of deviation between the position Pt2 and the position Pt3. The display device 2100 uses the contour correction unit 2013 to improve the accuracy of the stereoscopic image perceived by the user 1. Hereinafter, a specific configuration of the display device 2100 including the contour correction unit 2013 will be described.

FIG. 30 is a schematic diagram illustrating an example of a specific configuration of the display device 2100 of the present embodiment. As described above, the display device 2100 includes the first display unit 2011, the second display unit 2012, and the contour correction unit 2013. The first display unit 2011 includes a first display surface 2011S. The first display unit 2011 emits the light R11 to the user 1 by displaying the image P11 on the first display surface 2011S. The light R11 passes through the second display surface 2012S, which is a transmissive screen, and reaches the user 1. The first display surface 2011S converts the image information D11 supplied from the image supply device 2002 into an image P11 and displays it. The image information D11 is, for example, image information indicating a cube that is the display target OBJ. The second display unit 2012 includes a second display surface 2012S. The second display unit 2012 emits the light R12 to the user 1 by displaying the contour image P12 on the second display surface 2012S. The second display surface 2012S displays the image information D12 supplied from the image supply device 2002 after converting the corrected image information D12C corrected by the contour correcting unit 2013 into a contour image P12. The image information D12 is, for example, image information of a contour image indicating a contour portion of a cube that is the display target OBJ. The corrected image information D12C is image information of a corrected contour image obtained by correcting the image information D12 by the contour correcting unit 2013.

In this way, the display device 2100 displays the contour image P12 and the contour image indicating the contour portion of the display object OBJ in an overlapping manner. Thereby, a stereoscopic effect can be given to the display object OBJ observed by the user 1. That is, when the user 1 sees the contour image P12 and the contour image indicating the contour portion of the display target OBJ in an overlapping manner, the user 1 perceives a stereoscopic image in which the display target OBJ jumps out in the Z-axis direction. A mechanism for giving a stereoscopic effect to the user 1 using an image displayed on the display device 2100 will be described with reference to FIGS. 31 to 37D.

FIG. 31 is a schematic diagram illustrating an example of an image P11 of the display target OBJ according to the present embodiment. Here, the case where the display target OBJ is a square pattern as an example will be described below. This square pattern is a square pattern in which four sides of equal length intersect at right angles at each vertex. This rectangular pattern has four sides as contour lines that separate the outside and the inside of the rectangular pattern. An observer who sees the square pattern perceives the contour line as the edge portion E of the square pattern when the difference in brightness between the outside and the inside of the square pattern is large. That is, the edge portion E is a portion of the display object OBJ in which the difference in ambient brightness is relatively larger than the difference in brightness in other portions. In the case of a square pattern, each side can be an edge portion E, but here, of each edge portion E, two sides parallel to the Y-axis direction of the square pattern are defined as an edge portion E1 and an edge portion E2, respectively. explain.

Next, an example of the contour image P12 corresponding to this square pattern will be described with reference to FIG.
FIG. 32 is a schematic diagram illustrating an example of the contour image P12 of the present embodiment. As described above, when the display target OBJ is a square pattern, the contour image P12 is an image including the edge image PE1 indicating the edge portion E1 of the square pattern and the edge image PE2 indicating the edge portion E2. That is, when the display target OBJ is a quadrangular pattern as described above, the second display surface 2012S displays the contour image P12 including the edge image PE1 and the edge image PE2 corresponding to the edge portion E1 and the edge portion E2, respectively. To do.

Next, with reference to FIG. 33, the relationship between the position of the square pattern as the display object OBJ, the position of the contour image P12 including the edge image PE1 and the edge image PE2, and the position of the observer's viewpoint position VP. explain.
FIG. 33 is a schematic diagram illustrating an example of a positional relationship among the image P11, the contour image P12, and the viewpoint position VP in the present embodiment. Observer, the viewpoint position VP at the position _{Z VP,} seen superimposed a contour image P12 at the position _{Z 2,} and an image P11 in the position _{Z 1.} As described above, the contour image P12 is an image including the edge image PE1 and the edge image PE2 corresponding to the edge portion E1 and the edge portion E2 of the square pattern as the display object OBJ. Here, the position in the X direction of the edge portion E1 of the square pattern is the position X2, and the position in the X direction of the edge portion E2 is the position X5.

As described above, the second display surface 2012S displays the contour image P12 so that the edge portion E1 at the position X2 and the edge image PE1 of the contour image P12 appear to overlap at the viewpoint position VP. Similarly, the second display surface 2012S displays the contour image P12 so that the edge portion E2 at the position X5 and the edge image PE2 of the contour image P12 appear to overlap at the viewpoint position VP. When the observer superimposes the contour image P12 displayed in this way and the image P11 showing the display object OBJ (for example, a square pattern), the brightness is so small that it cannot be recognized on the retina image of the observer. There is a step. In such a case, a virtual contour (edge) is perceived between steps of brightness (for example, luminance), and the contour image P12 and the image P11 are perceived as one image. At this time, since binocular parallax occurs between the optical image IML viewed by the left eye L and the optical image IMR viewed by the right eye R, the virtual contour is slightly shifted and perceived as binocular parallax. Thus, the apparent depth position of the image P11 changes. Hereinafter, the optical image IML viewed by the left eye L and the optical image IMR viewed by the right eye R will be described in this order, and a mechanism for changing the apparent depth position of the image P11 will be described.

FIG. 34 is a schematic diagram illustrating an example of an optical image IM that can be seen by an observer's eye in the present embodiment. Among these, FIG. 34 (L) is a schematic diagram showing an example of an optical image IML that can be seen by the left eye L of the observer. As shown in the figure, in the position of the left eye L of the viewpoint position VP at the position _{Z VP,} looking at the image P11 and the contour image P12, the edge image PE1 and the edge portion E1 is, the position X2 ~ position X3 Appears overlapping in range. As described above, since the edge portion E1 of the square pattern is located at the position X2, the edge image PE1 and the edge portion E1 are located on the left eye L of the observer inside the square pattern (in the + X direction) than the edge portion E1. ) Appear to overlap. Further, at the position of the left eye L of the viewpoint position VP at the position _{Z VP,} looking at the image P11 and the contour image P12, edge image PE2 and the edge E2 is visible overlap in the region of the position X5 ~ position X6 . As described above, since the edge portion E2 of the square pattern is at the position X5, the edge image PE2 and the edge portion E2 are outside the square pattern (+ X direction) than the edge portion E2 in the left eye L of the observer. ) Appear to overlap.

At this time, the brightness of the optical image at the position of the left eye L of the observer will be described with reference to FIG.
FIG. 35 is a graph showing an example of the brightness of the optical image IM at the viewpoint position VP of the present embodiment. Among these, FIG. 35 (L) is a graph showing an example of the brightness of the optical image IML at the position of the left eye L at the viewpoint position VP. At the position of the left eye L at the viewpoint position VP, an optical image IML having a brightness obtained by combining the brightness of the image P11 and the brightness of the image (contour image) P12L seen from the position of the left eye L is generated. Here, specific examples of the brightness viewed from the viewpoint position VP of the square pattern as the image P11 and the brightness viewed from the viewpoint position VP of the contour image P12L will be described. The brightness inside the square pattern viewed from the viewpoint position VP is brightness BR2. Further, the brightness of the outside of the rectangular pattern viewed from the viewpoint position VP and the brightness 0 (zero). As described above, the position of the edge portion E1 of the pattern square at the position Z ₁ is located X2, the position of the edge portion E2 is the position X5. Accordingly, the brightness viewed from the viewpoint position VP of the square pattern is the brightness BR2 at the positions X2 to X5, and the brightness at the positions from the position X2 to the (−X) direction and from the position X5 to the (+ X) direction. 0 (zero).

The brightness viewed from the viewpoint position VP of the edge image PE1 and the edge image PE2 of the contour image P12 is brightness BR1. As described above, the edge image PE1 of the contour image P12L seen from the position of the left eye L is displayed so as to overlap the edge portion E1 of the square pattern in the range of the position X2 to the position X3. Further, the edge image PE2 of the contour image P12L is displayed so as to overlap the edge portion E2 of the square pattern in the range of the position X5 to the position X6. Accordingly, the brightness viewed from the viewpoint position VP of the contour image P12L is brightness BR1 at positions X2 to X3 and positions X5 to X6, and brightness 0 (zero) at other positions in the X direction.

Therefore, when the image P11 and the contour image P12L are viewed at the viewpoint position VP, the brightness of the optical image IML will be described next. That is, the brightness of the optical image IML is brightness BR3 from position X2 to position X3, brightness BR2 from position X3 to position X5, brightness BR1 from position X5 to position X6, (−X) direction from position X2, and position. The brightness is 0 (zero) at a position in the (+ X) direction from X6.

Next, a mechanism in which the observer who has seen the optical image IML perceives the contour portion of the image P11 will be described.
FIG. 36 is a graph showing an example of a contour portion of the image P11 that is perceived by the observer in the present embodiment based on the optical image IML. Among these, FIG. 36 (L) is a graph showing an example of a contour portion of the image P11 perceived by the observer based on the optical image IML at the position of the left eye L of the observer. Here, the outline portion of the image P11 is a portion in which the change in brightness is larger than the change in brightness in the surrounding portions in the portion of the optical image that shows the image P11. The distribution of brightness of the image recognized by the observer by the optical image IML formed on the retina of the left eye L of the observer at the viewpoint position VP is as shown by a waveform WL in FIG. . At this time, the observer observes the position on the X-axis where the change in the brightness of the recognized optical image IML is maximized (that is, the gradient of the waveform WL is maximized) at the contour portion of the image P11 being observed. Perceived to be. Specifically, the observer observing the optical image IML sets the X _EL position (that is, the position of the distance L _EL from the origin O of the X axis) shown in FIG. Perceived to be

So far, the optical image IML that can be seen by the left eye L of the observer and the position of the contour portion by the optical image IML have been described. Next, the optical image IMR that can be seen by the observer's right eye R and the position of the contour portion by the optical image IMR will be described.

As shown in FIG. 34 (R), at the position of the right eye R of the viewpoint position VP at the position _{Z VP,} looking at the image P11 and the contour image P12, and the edge image PE1 and the edge portions E1, position X1 ~ It appears to overlap in the range of the position X2. This is different from the position X2 to the position X3 in which the edge image PE1 and the edge portion E1 appear to overlap each other at the position of the left eye L. Further, as described above, since the edge portion E1 of the rectangular pattern is at the position X2, the edge image PE1 and the edge portion E1 are located outside the rectangular pattern from the edge portion E1 in the right eye R of the observer ( -X direction) appears to overlap. This is different from the fact that the edge image PE1 and the edge portion E1 appear to overlap with the left eye L of the observer at a position inside the square pattern (in the + X direction) than the edge portion E1.

Further, at the position of the right eye R of the viewpoint position VP at the position _{Z VP,} looking at the image P11 and the contour image P12, edge image PE2 and the edge E2 is visible overlap in a range of positions X4 ~ position X5 . This is different from the fact that when the image P11 and the contour image P12 are viewed at the position of the left eye L, the edge image PE2 and the edge portion E2 appear to overlap in the range from the position X5 to the position X6. Further, as described above, since the edge portion E2 of the square pattern is located at the position X5, the edge image PE2 and the edge portion E2 are located on the right eye R of the observer inside the square pattern (see FIG. -X direction) appears to overlap. This is different from the fact that the left image L of the observer appears to overlap the edge image PE2 and the edge portion E2 at a position outside the square pattern (in the + X direction) with respect to the edge portion E2.

At this time, the brightness of the optical image at the position of the right eye R of the observer will be described with reference to FIG. FIG. 35 (R) is a graph showing an example of the brightness of the optical image IMR at the position of the right eye R at the viewpoint position VP. At the position of the right eye R at the viewpoint position VP, an optical image IMR having a brightness obtained by combining the brightness of the image P11 and the brightness of the image (contour image) P12R seen from the position of the right eye R is generated. Among these, the brightness viewed from the viewpoint position VP of the square pattern as the image P11 is the same as the brightness at the position of the left eye L. A specific example of brightness viewed from the viewpoint position VP of the contour image P12R will be described. The brightness viewed from the viewpoint position VP of the edge image PE1 and the edge image PE2 of the contour image P12R is the brightness BR1. As described above, the edge image PE1 of the contour image P12R that can be seen from the position of the right eye R is displayed so as to overlap the edge portion E1 of the square pattern in the range from the position X1 to the position X2. This is different from the fact that the edge image PE1 of the contour image P12L seen from the position of the left eye L is displayed so as to overlap the edge portion E1 of the square pattern in the range of the position X2 to the position X3. Further, the edge image PE2 of the contour image P12R is displayed so as to overlap with the edge portion E2 of the square pattern in the range of the position X4 to the position X5. This is different from the fact that the edge image PE2 of the contour image P12L is displayed so as to overlap the edge portion E2 of the square pattern in the range of the position X5 to the position X6.

Therefore, the brightness viewed from the viewpoint position VP of the contour image P12R is brightness BR1 at positions X1 to X2 and position X4 to position X5, and brightness 0 (zero) at other positions in the X direction. This is different from the fact that the brightness viewed from the viewpoint position VP of the contour image P12L is the brightness BR1 at the positions X2 to X3 and the positions X5 to X6.

Therefore, when the image P11 and the contour image P12R are viewed at the viewpoint position VP, the brightness of the optical image IMR will be described next. That is, the brightness of the optical image IMR is brightness BR1 from position X1 to position X2, brightness BR2 from position X2 to position X4, brightness BR3 from position X4 to position X5, (−X) direction from position X1, and position. The brightness is 0 (zero) at the position in the (+ X) direction from X5. This is different from the brightness of the optical image IML in that the position X2 to position X3 is brightness BR3, the position X3 to position X5 is brightness BR2, and the position X5 to position X6 is brightness BR1.

Next, a mechanism in which the observer who has seen the optical image IMR perceives the contour portion of the image P11 will be described. FIG. 36 (R) is a graph showing an example of the contour portion of the image P11 perceived by the observer based on the optical image IMR at the position of the right eye R of the observer. The distribution of brightness of the image recognized by the observer by the optical image IMR formed on the retina of the right eye R of the observer at the viewpoint position VP is as shown by a waveform WR in FIG. . At this time, the observer observes the position on the X-axis where the change in brightness of the recognized optical image IMR is maximized (that is, the gradient of the waveform WR is maximized) at the contour portion of the image P11 being observed. Perceived to be. Specifically, an observer is observing an optical image IMR, the position of the X _ER shown in FIG. 36 (R) (i.e., the origin O of the distance L _ER of position in the X-axis) contour of the square pattern Perceived to be This is different from the case where an observer observing the optical image IML perceives the position of the distance L _EL from the origin O of the X axis as a rectangular pattern outline.

Thus, the viewer perceives the position X _EL contour portion of square left eye L is observed, the position X _ER of contour of the square right eye R is observed as binocular parallax. Then, the observer perceives the square pattern as a stereoscopic image (three-dimensional image) based on the binocular parallax of the contour portion.

So far, the mechanism in which the display device 2100 causes the user 1 at the viewpoint position VP to recognize the stereoscopic image of the display target OBJ has been described. Hereinafter, a configuration in which the contour correcting unit 2013 of the display device 2100 corrects the contour image will be described.

37A to 37D are schematic diagrams illustrating an example of a contour image corrected by the contour correction unit 2013 of the present embodiment. As described with reference to FIG. 29, the contour correction unit 2013 includes a position Pt2 on the second display surface 2012S corresponding to the position Pt1 of the ridge line of the cube displayed on the first display surface 2011S viewed from the viewpoint position VP. The contour image P12 is corrected based on the center position Pt3 of the pixel Px22 of the contour image P12. That is, the contour correcting unit 2013 displays the position Pt3 of the pixel Px22 (contour pixel) displaying the contour image P12 among the pixels of the second display unit 2012 and the first display of the contour corresponding to the pixel Px22 (contour pixel). The contour image P12 is corrected based on the position Pt1 on the part 2011 and the position Pt2 (contour position) on the second display part 2012 determined based on the predetermined viewpoint position VP.

Here, the position Pt2 is the second display surface 2012S corresponding to the contour displayed on the first display surface 2011S when the first display surface 2011S and the second display surface 2012S are viewed from the viewpoint position VP. It is the upper position. As described above, if the contour image displayed on the second display surface 2012S is displayed around the position Pt2, the image P11 and the contour image P12 are precisely aligned. Therefore, as shown in the figure, when the position Pt2 is deviated from the center position Pt3 of the pixel, the contour correcting unit 2013 corrects the pixel values of the pixels Px11 to Px33. For example, the contour correcting unit 2013 sets the pixel Px11 so that the position Pt2 becomes the center of gravity when the pixel values of the pixels around the pixel Px22 (pixels Px11 to Px33) are weighted and averaged based on the distance on the XY plane. -Correct the pixel value of the pixel Px33.

Specifically, as illustrated in FIG. 37A, when the position Pt2 is shifted in the (+ Y) direction with respect to the center position Pt3 of the pixel Px22, the contour correction unit 2013 is in the (+ Y) direction of the pixel Px22. The pixel value of the adjacent pixel Px12 is corrected. As shown in FIG. 37B, when the position Pt2 is shifted in the (−Y) direction with respect to the center position Pt3 of the pixel Px22, the contour correcting unit 2013 is adjacent to the (−Y) direction of the pixel Px22. The pixel value of the current pixel Px32 is corrected.

As shown in FIG. 37C, when the position Pt2 is shifted in the (−X) direction with respect to the center position Pt3 of the pixel Px22, the contour correcting unit 2013 is adjacent to the (−X) direction of the pixel Px22. The pixel value of the current pixel Px21 is corrected. Here, the pixel Px21 is a pixel displaying the contour portion indicated by the contour image P12 even before correction. For this reason, the contour correcting unit 2013 corrects the pixel value of the pixel Px21 with a pixel value obtained by adding the corrected pixel value of the pixel Px22 to the pixel value of the contour image P12 before the correction of the pixel Px21. Similarly, as illustrated in FIG. 37D, when the position Pt2 is shifted in the (+ X) direction with respect to the center position Pt3 of the pixel Px22, the contour correction unit 2013 is adjacent to the (+ X) direction of the pixel Px22. The pixel value of the current pixel Px23 is corrected.

As described above, the contour correcting unit 2013 corrects the pixel values of pixels around (for example, adjacent to) the pixel Px22 (contour pixel) displaying the contour image P12 among the pixels of the second display unit 2012. Accordingly, the display device 2100 can improve the accuracy of alignment between the image P11 displayed on the first display surface 2011S and the contour image P12 displayed on the second display surface 2012S.

In addition, although the outline correction | amendment part 2013 demonstrated as correcting the pixel value of the pixel (for example, adjacent) surrounding the pixel Px22 (contour pixel) which displays the outline image P12 here, it is not restricted to this. The user 1 viewing the first display surface 2011S and the second display surface 2012S from the viewpoint position VP may correct the position Pt2 so that the position Pt1 is perceived to overlap the position Pt1, and the contour correction unit 2013 can detect the pixel Px22. It can also be configured to correct the pixel values of neighboring pixels. Here, the neighboring pixels are not necessarily adjacent to each other. For example, the neighboring pixel may be a pixel at a position further adjacent to the pixel adjacent to the pixel.

Although the contour correcting unit 2013 has described the configuration for correcting the pixel value of the pixel in the direction in which the position Pt2 is deviated from the center position Pt3 of the pixel Px22, the present invention is not limited to this. For example, the contour correcting unit 2013 may correct the pixel value of the pixel in the direction opposite to the direction in which the position Pt2 is shifted from the center position Pt3 of the pixel Px22. Specifically, in FIG. 37A, the contour correction unit 2013 may correct the pixel value of the pixel Px32 in the direction opposite to the direction in which the position Pt2 is shifted from the center position Pt3 of the pixel Px22. .
Further, for example, the contour correcting unit 2013 may correct the pixel value of a pixel that is in an oblique direction with respect to the direction in which the position Pt2 is deviated from the center position Pt3 of the pixel Px22. Specifically, in FIG. 37A, the contour correction unit 2013 corrects the pixel value of the pixel Px11 in the oblique direction with respect to the direction in which the position Pt2 is shifted from the center position Pt3 of the pixel Px22. Also good. In this case, the contour correction unit 2013 also selects any of the pixels Px13, Px31, and Px33 that are oblique to the direction in which the position Pt2 is shifted from the center position Pt3 of the pixel Px22. These pixel values may be corrected. In addition, the contour correction unit 2013 combines any or all of the pixels in the direction shifted from the position Pt3, the pixel in the opposite direction, and the pixel in the oblique direction. Thus, the pixel values of the plurality of pixels may be corrected.

Further, although the contour correction unit 2013 has been described here as correcting the pixel value of one pixel, the present invention is not limited to this. The contour correction unit 2013 includes a plurality of pixels in the vicinity of the pixel Px22 so that the user 1 viewing the first display surface 2011S and the second display surface 2012S from the viewpoint position VP perceives the position Pt2 overlapping the position Pt1. It can also be configured to correct the pixel value of the pixel.

Next, the operation of the display device 2100 will be described with reference to FIG.
FIG. 38 is a flowchart showing an example of the operation of the display device 2100 of the present embodiment.

The first display unit 2011 acquires the image information D11 from the image supply device 2002, and displays the image P11 based on the image information D11 on the first display surface 2011S (step S2010).

Next, the contour correction unit 2013 acquires the image information D12 from the image supply device 2002 (step S2020).

Next, the contour correcting unit 2013 generates corrected image information D12C obtained by correcting the acquired image information D12 based on the position Pt2 and the position Pt3. Here, the contour correcting unit 2013 compares the position Pt2 that is the contour position with the position Pt3 that is the center position of the pixel, and determines the direction of the shift of the contour position with respect to the center position of the pixel (step S2030). ). If the contour correction unit 2013 determines that the position Pt2 is displaced in the (+ Y) direction with respect to the position Pt3 that is the center position of the pixel (step S2030-UP), the contour correction unit 2013 sets the pixel value of the pixel Px12. to correct. When the contour correcting unit 2013 determines that the position Pt2 is shifted in the (−Y) direction with respect to the position Pt3 that is the center position of the pixel (step S2030—DOWN), the contour correcting unit 2013 determines the position of the pixel Px32. Correct the pixel value. Similarly, the contour correcting unit 2013 determines that the position Pt2 is shifted in the (−X) direction with respect to the position Pt3 (step S2030−LEFT), or is determined to be shifted in the (+ X) direction. In the case (step S2030-RIGHT), the pixel values of the pixel Px21 and the pixel Px23 are corrected.

Next, the second display unit 2012 acquires the corrected image information D12C from the contour correcting unit 2013, and displays the contour image P12 based on the corrected image information D12C on the second display surface 2012S (step S2040). The display device 2100 repeats these steps S2010 to S2040 to display the image P11 and the contour image P12 while correcting the contour image P12.

As described above, the display device 2100 of this embodiment includes the first display unit 2011, the second display unit 2012, and the contour correction unit 2013. The first display unit 2011 displays an image to be displayed at the first depth position. In addition, the second display unit 2012 has a plurality of pixels arranged two-dimensionally, and displays a contour image indicating a contour portion to be displayed at a second depth position different from the first depth position. The contour correction unit 2013 also includes the position of the contour pixel that displays the contour image among the pixels of the second display unit 2012, the position of the contour corresponding to the contour pixel on the first display unit 2011, and a predetermined viewpoint position. The contour image is corrected based on the contour position on the second display unit 2012 determined based on the VP.

As described above, the first display surface 2011S and the second display surface 2012S are, for example, a screen of a liquid crystal display or a liquid crystal projector, and have pixels arranged two-dimensionally.
Since this pixel has an area, there may be a deviation between the position Pt2 corresponding to the position Pt1 of the cubic ridgeline displayed on the first display surface 2011S viewed from the viewpoint position VP and the position Pt3 of the center of the pixel. When the position Pt2 is shifted from the center position Pt3 of the pixel, the alignment accuracy between the contour image P12 displayed on the second display surface 2012S and the image P11 displayed on the first display surface 2011S is lowered. . In this case, the user 1 cannot perceive an accurate stereoscopic image. Therefore, the contour correction unit 2013 of the present embodiment corrects the position of the contour (for example, a cubic ridge line) indicated by the contour image P12 based on the shift between the position Pt2 and the center position Pt3 of the pixel. Thereby, the display device 2100 reduces the degree to which the accuracy of alignment between the contour image P12 displayed on the second display surface 2012S and the image P11 displayed on the first display surface 2011S is reduced. In this way, the display device 2100 can cause the user 1 to perceive a highly accurate stereoscopic image.

The contour correction unit 2013 corrects the pixel value of the pixel in the vicinity of the pixel Px22 (contour pixel) based on the correction amount based on the distance between the center position Pt3 and the position Pt2 (contour position) of the pixel Px22 (contour pixel). May be. Specifically, when the position Pt2 and the position Pt3 are separated by the distance ΔPt, the contour correcting unit 2013 sets the pixel value of the pixel to be corrected by the correction amount according to the distance ΔPt. For example, the contour correction unit 2013 sets the pixel value of the pixel to be corrected by increasing the correction amount as the position Pt2 is farther from the center position Pt3 of the pixel. Thereby, the outline correction | amendment part 2013 can improve the precision of correction | amendment. Therefore, the display device 2100 can cause the user 1 to perceive a more accurate stereoscopic image.

[Modification]
The contour correction unit 2013 also includes a first contour position Pt2L determined based on the position of the left eye L of the user 1, a second contour position Pt2R determined based on the position of the right eye R of the user 1, and a pixel Px22. The configuration may be such that the contour image P12 is corrected based on the position Pt3 of (contour pixel).

FIG. 39 is a schematic diagram illustrating an example of a positional relationship between the user 1 and the display device 2100 according to a modification of the present embodiment. As described above, the first display surface 2011S displays the cubic image P11. The second display surface 2012S displays a cubic outline image P12. The user 1 sees overlapped with the first display surface 2011S in the depth position _{Z 1} from the viewpoint position VP in the depth position _{Z VP,} and a second display surface 2012S in the depth position _{Z 2.} When viewed from this viewpoint position VP, the position Pt1 of the cube ridgeline displayed on the first display surface 2011S and the position Pt2 on the second display surface 2012S appear to overlap. Here, the left eye L and the right eye R of the user 1 are different from each other in the position on the second display surface 2012S that appears to overlap the position Pt1 of the cube ridgeline displayed on the first display surface 2011S. Specifically, when viewed from the position of the left eye L of the user 1, the position Pt1 of the cubic ridgeline displayed on the first display surface 2011S and the position Pt2L on the second display surface 2012S appear to overlap. When viewed from the position of the right eye R of the user 1, the position Pt1 of the cubic ridgeline displayed on the first display surface 2011S and the position Pt2R on the second display surface 2012S appear to overlap.

Here, the contour correcting unit 2013 uses the position of the midpoint on the XY plane between the position Pt2L on the second display surface 2012S and the position Pt2R as a reference for correcting the pixel value described above (contour position). To correct the contour image P12.

As described above, the contour correcting unit 2013 can correct the contour image P12 based on the positions of the left eye L and the right eye R of the user 1, so that the correction accuracy can be improved. Therefore, the display device 2100 can cause the user 1 to perceive a more accurate stereoscopic image.

[Sixth Embodiment]
Next, a display device 2100a according to a sixth embodiment of the present invention will be described with reference to FIG. The display device 2100a of the present embodiment is different from the above-described embodiment in that the display device 2100a includes a detection unit 2014 that detects the viewpoint position VP. In addition, about the structure same as embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 40 is a schematic diagram showing an example of the configuration of the display device 2100a according to the sixth embodiment of the present invention. The display device 2100a includes a contour correction unit 2013a and a detection unit 2014.

The detection unit 2014 includes a distance measuring sensor, detects the position where the user 1 is, outputs the detected position as the viewpoint position VP, and outputs information indicating the viewpoint position VP to the contour correction unit 2013a.

The contour correction unit 2013a acquires information indicating the viewpoint position VP detected by the detection unit 2014, and calculates a position Pt2 (contour position) on the second display unit 2012 based on the information indicating the acquired viewpoint position VP. . Then, the contour correcting unit 2013a corrects the contour image P12 based on the calculated position Pt2 and the position Pt3 of the pixel Px22 (contour pixel) that displays the contour image P12. In other words, the contour correcting unit 2013a determines the position Pt2 (contour position) determined based on the position Pt3 of the contour pixel, the position Pt1 on the first display unit 2011 of the contour corresponding to the contour pixel, and the detected viewpoint position VP. Based on the above, the contour image P12 is corrected.

Accordingly, the display device 2100a can detect the position where the user 1 is present as the viewpoint position VP. For example, even if the user 1 moves, the contour image P12 is corrected according to the position where the user 1 moves. can do. Therefore, even if the position of the user 1 changes, the display device 2100a improves the accuracy of alignment between the image P11 displayed on the first display surface 2011S and the contour image P12 displayed on the second display surface 2012S. Can do.

Note that the detection unit 2014 may detect the center position of the face of the user 1 as the viewpoint position VP.
For example, the detection unit 2014 includes a video camera (not shown) and an image analysis unit. The image analysis unit analyzes an image captured by the video camera and extracts the face of the user 1. Is detected as the viewpoint position VP. Here, the center position of the face of the user 1 includes the position of the center of gravity based on the outline of the face of the user 1 and the position of the midpoint between the position of the left eye L and the position of the right eye R of the user 1. Thereby, even if the orientation of the face of the user 1 changes, the display device 2100a can set the viewpoint position VP according to the orientation of the face. Therefore, the display device 2100a aligns the image P11 displayed on the first display surface 2011S and the contour image P12 displayed on the second display surface 2012S even when the orientation of the face as well as the position of the user 1 changes. Accuracy can be improved.

Further, the contour correcting unit 2013a may correct the contour image P12 with a correction amount based on the distance to the user 1 detected by the detecting unit 2014. Here, when the user 1 is in a position close to the display device 2100a, a detailed portion of the image is easily perceived by the user 1, so that the image P11 displayed on the first display surface 2011S and the second display surface 2012S are displayed. The position shift from the contour image P12 to be performed is easily perceived by the user 1. On the other hand, when the user 1 is at a position far from the display device 2100a, the detailed portion of the image is less likely to be perceived by the user 1, and thus the image P11 displayed on the first display surface 2011S and the second display surface 2012S are displayed. The positional deviation from the contour image P12 is less likely to be perceived by the user 1.

Therefore, when the distance to the user 1 detected by the detection unit 2014 is relatively large (for example, larger than a predetermined threshold value), the contour correction unit 2013a reduces the correction amount to reduce the contour image P12. Make corrections. The contour correction unit 2013a may not perform correction when the distance to the user 1 detected by the detection unit 2014 is further larger (for example, greater than a predetermined threshold value). On the other hand, when the distance to the user 1 detected by the detection unit 2014 is relatively small (for example, smaller than a predetermined threshold value), the contour correction unit 2013a increases the correction amount to increase the contour image P12. Make corrections. As described above, the contour correction unit 2013a corrects the contour image P12 according to the distance to the user 1 detected by the detection unit 2014, so that even if the position of the user 1 changes, the contour P11 and the contour image The positional deviation from P12 can be made difficult to be perceived by the user 1. Therefore, even if the position of the user 1 changes, the display device 2100a improves the accuracy of alignment between the image P11 displayed on the first display surface 2011S and the contour image P12 displayed on the second display surface 2012S. Can do.

[Seventh Embodiment]
Next, a display device 2100b according to a seventh embodiment of the present invention will be described with reference to FIG. The display device 2100b of the present embodiment is different from the above-described embodiment in that it includes a first display unit 2011b, a second display unit 2012b, and a third display unit 2015. In addition, about the structure same as embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 41 is a schematic diagram showing an example of the configuration of a display device 2100b according to the seventh embodiment of the present invention. The display device 2100b includes a first display unit 2011b, a second display unit 2012b, and a third display unit 2015.

The first display unit 2011b includes a first display surface 2011Sb for displaying an image in the depth position _{Z 1.} The second display unit 2012b includes a second display surface 2012Sb for displaying an image in the depth position _{Z 2.}

In each embodiment described above, the first display unit 2011 and the second display unit 2012 may be either a monochrome (monochrome) display unit or a color display unit. On the other hand, in the present embodiment, the first display unit 2011b and the second display unit 2012b are monochrome display units. That is, the first display unit 2011b displays an image P11b that is a monochrome image on the first display surface 2011Sb. The second display unit 2012b displays an image P12b that is a monochrome image on the second display surface 2012Sb. Here, the monochrome image is an image having only pixel values of brightness (for example, luminance) without pixel values of chromaticity and saturation. This monochrome image includes a monochrome binary image or a gray-grey image of white and black. The image P11b includes an image of the display target OBJ. That is, the first display unit 2011b displays the image P11b including the image of the display target OBJ on the first display surface 2011Sb. Further, the image P12b includes an edge image PE ′ that shows the contour portion of the display object OBJ. Here, the edge image PE ′ is a monochrome image showing the outline of the display object OBJ. That is, the second display unit 2012b displays the edge image PE ′ indicating the outline of the display target OBJ on the second display surface 2012Sb. The first display unit 2011b and the second display unit 2012b display these images to generate a stereoscopic image of the display target OBJ. The stereoscopic image of the display object OBJ is a monochrome stereoscopic image.

The third display unit 2015 is a color display unit that displays an image P15 that is a color image. The image P15 is an image corresponding to the image P11b and the image P12b. Image P15 from the viewpoint position VP when the user 1 is viewed the display unit, so as to overlap the image P11b and image P12b, is displayed on the depth position _{Z 3.} The third display unit 2015 gives a color to the images P11b and P12b, which are monochrome images, by displaying the image P15. That is, when the user 1 superimposes these images from the viewpoint position VP, the images P11b and P12b that are monochrome images appear to be color images.

As described above, if binocular parallax occurs between the image P11b and the image P12b, a stereoscopic image is generated. Therefore, a stereoscopic image is generated even if the image P11b and the image P12b are monochrome images. Here, when it is easier to improve the accuracy of pixel values in a monochrome image than in a color image, the accuracy of binocular parallax can be improved by displaying a monochrome image instead of a color image. That is, the display device 2100b can improve the accuracy of the stereoscopic image perceived by the user 1 by displaying the image P11b and the image P12b, both of which are monochrome images. On the other hand, a color image may display more information than a monochrome image. In this case, the stereoscopic image generated by the images P11b and P12b is displayed by overlapping the image P15, that is, the color image, thereby improving the accuracy of the stereoscopic image perceived by the user 1 and improving the stereoscopic image. The amount of information can be increased. In other words, the display device 2100b can increase the information amount of the stereoscopic image while improving the accuracy of the stereoscopic image, and can cause the user 1 to perceive the stereoscopic image.

As mentioned above, although embodiment of this invention has been explained in full detail with reference to drawings, a concrete structure is not restricted to this embodiment and can be suitably changed in the range which does not deviate from the meaning of this invention. . You may combine the structure as described in each embodiment mentioned above.

In addition, each part with which the display system 100 in said embodiment is provided, and each part with which each display apparatus (

display apparatus

2100, 2100a, 2100b. These are generically described as a display apparatus) in said embodiment are provided. It may be realized by dedicated hardware, or may be realized by a memory and a microprocessor.

In addition, each part with which the display system 100 is provided, and each part with which a display apparatus is provided are comprised by memory and CPU (arithmetic processing apparatus, central processing unit), and implement | achieve the function of each part with which the display system 100 is provided, and each part with which a display apparatus is provided. The function may be realized by loading a program to be executed into a memory and executing the program.

Also, each unit included in the display system 100 and a program for realizing the function of each unit included in the display device are recorded on a computer-readable recording medium, and the computer system reads the program recorded on the recording medium. By executing, the processing by each of the above-described units may be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM or a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, it also includes those that hold a program for a certain period of time, such as a volatile memory inside a computer system serving as a server or client in that case. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

100, 100A, 100B,

100C Display system

10, 10A,

10B Display device

11, 11A, 11B, 12,

12B Display unit

2, 2A, 2B, 2C

Image processing device

210, 210A, 210B

Contour correction unit

220B, 220C Stereoscopic image Generator.
2011 ... 1st display part, 2012 ... 2nd display part, 2013, 2013a ... Contour correction part, 2014 ... Detection part, 2100, 2100a ... Display apparatus.

Claims

A first display surface for displaying a first image based on the first image data, including a display target;
A second display surface for displaying a second image based on second image data, including the display object;
A detection unit for detecting a position of an observer observing the first display surface and the second display surface;
A control unit that corrects image data in the vicinity of the contour portion to be displayed among the second image data based on the position of the observer detected by the detection unit, and displays the correction on the second display surface. A display device.
The display device according to claim 1,
The control unit corrects image data corresponding to a contour portion of the display target in the second image data and image data corresponding to the vicinity of the contour portion of the display target.
The display device according to claim 1 or 2,
The controller corrects the second image data so that image data corresponding to the contour portion of the display target and image data corresponding to the vicinity of the contour portion of the display target are displayed on the second display surface. A display device characterized by performing.
A display device according to any one of claims 1 to 3,
The control unit corrects the second image data so that a display target displayed on the first display surface and the second display surface is stereoscopically displayed by binocular parallax at the position of the observer. A display device.
A display device according to any one of claims 1 to 4,
The display device, wherein the first display surface is disposed at a depth position different from that of the second display surface.
A display device according to any one of claims 1 to 5,
The display device, wherein the first image data and the second image data are generated from the same image data.
A display device according to any one of claims 1 to 5,
The second image data includes only data indicating a contour portion of the display target among the display targets.
A display device according to any one of claims 1 to 7,
The control unit corrects at least one pixel value of the first image data and the second image data, and changes a depth position of the display target to be perceived by the observer.
A display device according to any one of claims 1 to 8,
At least one of the first display surface and the second display surface is a transmissive display unit.
A first display surface for displaying a first image based on first image data including a display target, a second display surface for displaying a second image based on second image data including the display target, and the first A display unit having a detection unit that detects a position of an observer observing the display surface and the second display surface;
In order to execute the control step of correcting the image data in the vicinity of the contour portion to be displayed in the second image data based on the position of the observer detected by the detection unit and displaying the corrected image data on the second display surface Program.
A first display surface for displaying a first image based on the first image data including an object;
A detector for detecting a relative position between an observer observing the first display surface and the first display surface;
A control unit that corrects image data in the vicinity of the contour of the object of the first image data based on the relative position detected by the detection unit, and displays the corrected data on the first display surface. Display device.
The display device according to claim 11,
A photographing unit for photographing the observer and generating an image;
The display unit detects a relative position between an observer who observes the first display surface and the first display surface based on the image generated by the photographing unit.
A first display surface that displays a first image based on first image data, including an object, a detection unit that detects a relative position between an observer observing the first display surface and the first display surface; In a display device computer having
A program for executing a control step of correcting image data in the vicinity of the contour of the object in the first image data based on the relative position detected by the detection unit and displaying the corrected data on the first display surface.
A first display for displaying an image to be displayed at a first depth position;
A second display unit that has a plurality of pixels arranged two-dimensionally and displays a contour image indicating a contour portion of the display target at a second depth position different from the first depth position;
The position of the contour pixel that displays the contour image among the pixels of the second display section, the position of the contour section corresponding to the contour pixel on the first display section, and a predetermined viewpoint position are determined. A contour correcting unit that corrects the contour image based on a contour position on the second display unit;
A display device comprising:
The position of the contour pixel is the center position of the contour pixel,
The contour correction unit
The display device according to claim 14, wherein the contour image is corrected by correcting a pixel value of a pixel in the vicinity of the contour pixel based on a center position of the contour pixel and the contour position. .
The pixel in the vicinity of the contour pixel includes at least a pixel adjacent to the contour pixel,
The contour correction unit
The display according to claim 15, wherein the contour image is corrected by correcting a pixel value of a pixel adjacent to the contour pixel based on a direction from a center position of the contour pixel to the contour position. apparatus.
The contour correction unit
The display device according to claim 15 or 16, wherein a pixel value of a pixel near the contour pixel is corrected by a correction amount based on a distance between a center position of the contour pixel and the contour position.
The viewpoint position includes the position of the left eye of the user and the position of the right eye,
The contour position includes a first contour position determined based on the position of the left eye and a second contour position determined based on the position of the right eye,
The contour correction unit
The display according to any one of claims 14 to 17, wherein the contour image is corrected based on a position of the contour pixel, and the first contour position and the second contour position. apparatus.
A detection unit for detecting the viewpoint position;
The contour correcting unit is based on the position of the contour pixel and the contour position determined based on the position of the contour corresponding to the contour pixel on the first display unit and the detected viewpoint position. The display device according to any one of claims 14 to 18, wherein the contour image is corrected.
The detector is
The display device according to claim 19, wherein a center position of a user's face is detected as the viewpoint position.
The contour correction unit
21. The contour image is corrected by a correction amount based on a distance between the display unit of either the first display unit or the second display unit and the viewpoint position. The display device according to any one of the above.
The second display unit has an outline image indicating the outline of the display target displayed by the second display unit at a second depth position different from the first depth position at which the first display unit displays the image to be displayed. It is determined based on the position of a contour pixel that displays the contour image among a plurality of pixels arranged in two dimensions, the position of the contour corresponding to the contour pixel on the first display unit, and a predetermined viewpoint position. A display device comprising: a contour correction unit that corrects the contour image based on a contour position on the second display unit.
On the computer,
The second display unit has an outline image indicating the outline of the display target displayed by the second display unit at a second depth position different from the first depth position at which the first display unit displays the image to be displayed. It is determined based on the position of a contour pixel that displays the contour image among a plurality of pixels arranged in two dimensions, the position of the contour corresponding to the contour pixel on the first display unit, and a predetermined viewpoint position. A program for executing a contour correcting step of correcting the contour image based on the contour position on the second display unit.