JP2014090395A - Display device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simplify the settings of pixel values for stereoscopically displaying an object to be displayed.SOLUTION: The display device includes a contour correction unit that corrects pixel values of contour pixels that display contour parts of the object to be displayed among a plurality of pixels arranged in two dimension included in a first display screen on the basis of depth positions of the object to be displayed that is stereoscopically displayed by a binocular parallax of image information that is displayed respectively by the first display screen and a second display screen.

Description

  The present invention relates to a display device and a program.

  In recent years, for example, a plurality of images with ratios of pixel values (for example, brightness, luminance, hue, saturation) corresponding to depth positions of a stereoscopic image (three-dimensional image) are displayed on a plurality of display surfaces having different depth positions A display method is known in which a stereoscopic image is recognized by an observer who observes the plurality of images (for example, see Patent Document 1).

Japanese Patent No. 3464633

  However, depending on the display method as described above, the observer cannot recognize the display target as a stereoscopic image (three-dimensional image) unless the pixel values of the plurality of images are precisely matched between the images. There is. In this case, the display method as described above has a problem that it is not possible to simplify the setting of pixel values for stereoscopic display of a display target.

  The present invention has been made to solve the above problems, and an object of the present invention is to provide a display device that can simplify the setting of pixel values for stereoscopic display of a display target.

  In one embodiment of the present invention, the first display surface has a two-dimensional display based on a depth position of a display target displayed stereoscopically by binocular parallax of image information displayed on the first display surface and the second display surface, respectively. A display device comprising: a contour correcting unit that corrects a pixel value of a contour pixel that displays a contour portion to be displayed among the plurality of pixels arranged in the display area.

  In one embodiment of the present invention, a first display unit that displays first image information, a second display unit that displays second image information, and the first image information displayed by the first display unit. And a plurality of two-dimensionally arranged in the first display unit based on the depth position of the display target that is stereoscopically displayed by binocular parallax with the second image information displayed by the second display unit And a contour correcting unit that corrects a pixel value of a contour pixel that displays the contour portion to be displayed.

  In addition, according to an embodiment of the present invention, the display target displayed on the first display surface and the second display surface is displayed on the computer based on the depth position of the display target displayed stereoscopically by binocular parallax. It is a program for executing a contour correction procedure for correcting a pixel value of a contour pixel that displays the contour portion to be displayed among a plurality of pixels arranged in a two-dimensional manner on one display surface.

  In one embodiment of the present invention, a first display procedure for displaying first image information indicating a display target on a computer, a second display procedure for displaying second image information indicating the display target, The display target in which the first image information displayed by the first display procedure and the display target indicated by the second image information displayed by the second display procedure are stereoscopically displayed by binocular parallax. A contour correction procedure for correcting a pixel value of a contour pixel that displays a contour portion to be displayed among a plurality of pixels arranged in a two-dimensional manner constituting the first image information based on the depth position of the first image information. This is a program to be executed.

  According to the present invention, it is possible to simplify the setting of pixel values for stereoscopic display of a display target.

It is a block diagram which shows an example of a structure of the display system containing the display apparatus in this embodiment. It is a schematic diagram which shows an example of a structure of the 2nd display surface with which the 2nd display part of this embodiment is provided. It is a schematic diagram which shows an example of the 2nd image information which the 2nd display surface of this embodiment displays. It is a table | surface which shows an example of the 2nd pixel value information which the 2nd display part of this embodiment acquires. It is a schematic diagram which shows an example of a structure of the 1st display surface with which the 1st display part of this embodiment is provided. It is a table | surface which shows an example of the 1st pixel value information which the outline correction part of this embodiment acquires. It is a table | surface which shows an example of the depth position information which the outline correction part of this embodiment acquires. It is a block diagram shown about an example of the depth position of the display target which the display apparatus of this embodiment displays. It is a table | surface which shows an example of the contour part information which the contour correction part of this embodiment acquires. It is a table | surface which shows an example of a structure which the outline correction part of this embodiment produces | generates 3rd image information. It is a schematic diagram which shows an example of the 1st image information which the 1st display part of this embodiment displays. It is a schematic diagram which shows an example of the positional relationship of the 1st display surface in this embodiment, and a 2nd display surface. It is a schematic diagram which shows an example of the optical image in this embodiment. It is a graph which shows an example of the brightness distribution of the optical image in this embodiment. It is a graph which shows an example of the binocular parallax which arises in the left eye and right eye in this embodiment. It is a flowchart which shows an example of operation | movement of the display apparatus of this embodiment.

[First embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a configuration diagram illustrating an example of a configuration of a display system 100 including a display device 10 according to the present embodiment. The display system 100 of this embodiment includes an image information supply device 2 and a display device 10. Hereinafter, in the description of each drawing, an XYZ rectangular coordinate system is set, and the positional relationship of each part will be described with reference to this XYZ rectangular coordinate system. A direction in which the display device 10 displays an image is a positive direction of the Z axis, and orthogonal directions on a plane perpendicular to the Z axis direction are an X axis direction and a Y axis direction, respectively. Here, the X-axis direction is the horizontal direction of the display device 10, and the Y-axis direction is the vertical direction of the display device 10.

  The image information supply device 2 supplies the first image signal and the second image signal to the display device 10. Here, the first image signal is information for the display device 10 to display the first image information P11. The second image signal is information for the display device 10 to display the second image information P12.

The display device 10 includes a first display unit 11, a second display unit 12, and a contour correction unit 13. First, the second display unit 12 will be described.
The second display unit 12 is a transmissive display unit that transmits light in the (+ Z) direction. The second display unit 12 transmits the light beam (first light beam R11) of the image information displayed on the first display surface 110 of the first display unit 11 in the (+ Z) direction. The second display unit 12 includes a second display surface 120 that displays image information in the (+ Z) direction. An example of the configuration of the second display surface 120 will be described with reference to FIG.

  FIG. 2 is a schematic diagram illustrating an example of the configuration of the second display surface 120 provided in the second display unit 12 of the present embodiment. The second display surface 120 has pixels that are two-dimensionally arranged in the X-axis direction and the Y-axis direction. As an example, the second display surface 120 has two-dimensionally arranged pixels of 8 pixels in the X-axis direction and 8 pixels in the Y-axis direction. Note that the arrangement of the pixels on the second display surface 120 is not limited to this. For example, the second display surface 120 may have two-dimensionally arranged pixels of 1920 pixels in the X-axis direction and 1080 pixels in the Y-axis direction.

  In the second display surface 120, the pixel at the upper left corner when the viewer 1 looks at the second display surface 120 in the (−Z) direction is the origin O, and the pixels Px211 to Px218 from the origin O to the (+ Y) direction. Have The second display surface 120 includes pixels Px221 to Px228 in the (+ Y) direction from a position shifted by one pixel in the (+ X) direction from the origin O. Similarly, the second display surface 120 includes pixels Px231 to Px288.

With reference to FIG. 1 again, the description of the second display unit 12 is continued.
The second display unit 12 acquires a second image signal supplied from the image information supply device 2. The second display surface 120 displays the second image information P12 based on the second image signal acquired by the second display unit 12. The second image signal includes second pixel value information indicating the pixel value of each pixel on the second display surface 120. The second display surface 120 displays the second image information P12 by controlling the pixel value of each pixel based on the second pixel value information included in the acquired second image signal. The second light flux R12 emitted from the second display surface 120 that displays the second image information P12 is observed as an optical image of the second image information P12 by the observer 1 at a predetermined position. An example of the second image information P12 displayed on the second display surface 120 will be described with reference to FIG.

  FIG. 3 is a schematic diagram illustrating an example of the second image information P12 displayed on the second display surface 120 of the present embodiment. As described above, the second display surface 120 displays the second image information P12. The second image information P12 includes image information of the display target OBJ2. When an image is shown in the following drawings, for the sake of convenience, a portion where the brightness of the image information is bright (for example, high brightness) is thin, and a portion where the brightness of the image information is dark (for example, low brightness) is dark. Show. Further, when an image is shown in the following drawings, the boundary of the pixel is indicated by a grid-like solid line in order to clearly indicate the position of each pixel.

  Here, the display object OBJ2 is, for example, a square pattern. Specifically, the square pattern is a pattern that indicates a region surrounded by four sides having the pixel Px233, the pixel Px236, the pixel Px266, and the pixel Px263 as vertices. The second display unit 12 displays the brightness of the pixels included in the region surrounded by these four sides, that is, the display region of the display target OBJ2, in the display region of the display target OBJ2 among the pixels of the second display surface 120. The display target OBJ2 is displayed with a brightness lower than that of the pixels not included. An example of the second pixel value information indicating the display target OBJ2 displayed on the second display surface 120 will be described with reference to FIG.

  FIG. 4 is a table showing an example of second pixel value information acquired by the second display unit 12 of the present embodiment. As described above, the second image signal includes the second pixel value information indicating the pixel value (for example, brightness) of each pixel included in the second display surface 120. For example, the pixel value indicated by the second pixel value information is the pixel value of the region surrounded by the four sides having the pixel Px233, the pixel Px236, the pixel Px266, and the pixel Px263 as the vertex, where the display target OBJ2 is displayed, It is set to be larger (for example, brighter) than the pixel value of the region. Specifically, the pixel value indicated by the second pixel value information is that the pixel value of the region surrounded by the four sides having the pixel Px233, the pixel Px236, the pixel Px266, and the pixel Px263 as the vertex is “63”, respectively. The pixel value of the area is set to “0”. When the pixel value indicated by the second pixel value information included in the acquired second image signal is “255”, the second display surface 120 maximizes the brightness of the pixel associated with the pixel value, Display image information. On the other hand, when the pixel value indicated by the second pixel value information included in the acquired second image signal is “0”, the second display surface 120 minimizes the brightness of the pixel associated with the pixel value. Display image information. In addition, when the pixel value indicated by the acquired second image signal is “1” to “254”, the second display surface 120 increases the brightness of the pixel associated with the pixel value from the minimum to the maximum. Image information is displayed at a brightness corresponding to the pixel value between them. In this way, the second display surface 120 displays the above-described square pattern shown in FIG. 3 based on the second pixel value information indicating the square pattern shown in FIG.

  Next, the first display unit 11 will be described. As shown in FIG. 1 described above, the first display unit 11 includes a first display surface 110 that displays image information in the (+ Z) direction. An example of the configuration of the first display surface 110 will be described with reference to FIG.

  FIG. 5 is a schematic diagram illustrating an example of the configuration of the first display surface 110 provided in the first display unit 11 of the present embodiment. Similar to the second display surface 120 described above, the first display surface 110 has pixels that are two-dimensionally arranged in the X-axis direction and the Y-axis direction. As an example, the first display surface 110 has two-dimensionally arranged pixels of 8 pixels in the X-axis direction and 8 pixels in the Y-axis direction. Note that the arrangement of the pixels on the first display surface 110 is not limited to this. For example, the first display surface 110 may have two-dimensionally arranged pixels of 1920 pixels in the X-axis direction and 1080 pixels in the Y-axis direction.

  The first display surface 110 includes pixels Px111 to Px118 from the origin O to the (+ Y) direction with the pixel at the upper left corner viewed in the (−Z) direction as the origin O. The first display surface 110 includes pixels Px121 to Px128 in the (+ Y) direction from a position shifted by one pixel in the (+ X) direction from the origin O. Similarly, the first display surface 110 includes pixels Px131 to Px188. The first display surface 110 displays image information based on the third image signal output from the contour correction unit 13. Hereinafter, the contour correction unit 13 and the third image signal will be described.

Again, the outline correction unit 13 will be described with reference to FIG.
The contour correction unit 13 acquires the first image signal supplied from the image information supply device 2. The first image signal includes first pixel value information indicating the pixel value (for example, brightness) of each pixel on the first display surface 110. Further, the first image signal includes contour information indicating a contour portion of the display target for stereoscopic display of the display target to be displayed on the first display surface 110 and the second display surface 120 at a predetermined position by binocular parallax. And depth position information (for example, a depth map). The first pixel value information, binocular parallax, predetermined position, contour information, and depth position information will be described later.

  Next, the contour correcting unit 13 generates a third image signal based on the acquired first image signal, and supplies the generated third image signal to the first display unit 11. Here, the third image signal is an image signal obtained by correcting the first pixel value information indicating the pixel value of the pixel corresponding to the contour portion of the display object OBJ1 among the first pixel value information included in the first image signal. It is. In other words, the contour correcting unit 13 displays the contour of the display target OBJ1 based on the first pixel value information, the depth position information, and the contour information included in the acquired first image signal. The pixel value of each of the eleven pixels is corrected. The depth position information is information indicating a depth position at which a display target is stereoscopically displayed. The contour information is information indicating the contour of the display target OBJ1. First, the first pixel value information will be described with reference to FIG.

  FIG. 6 is a table showing an example of first pixel value information acquired by the contour correcting unit 13 of the present embodiment. Here, the display target OBJ1 is, for example, a square pattern, like the display target OBJ2. Specifically, the square pattern is a pattern indicating a region surrounded by four sides having the pixel Px133, the pixel Px136, the pixel Px166, and the pixel Px163 as vertices. The pixel value indicated by the first pixel value information is that the pixel value of the region surrounded by the four sides with the pixel Px133, the pixel Px136, the pixel Px166, and the pixel Px163 as the vertices where the display target OBJ1 is displayed is the other region. It is set to be larger (for example, brighter) than the pixel value. Specifically, the pixel value indicated by the first pixel value information is that the pixel value of the region surrounded by the four sides with the pixel Px133, the pixel Px136, the pixel Px166, and the pixel Px163 as the vertices is “63”. The pixel value of the area is set to “0”.

Next, depth position information will be described with reference to FIG.
FIG. 7 is a table showing an example of depth position information acquired by the contour correction unit 13 of the present embodiment. As shown in the figure, in the depth position information, a value indicating a depth position, which is a position where the display target is stereoscopically displayed, is set in association with the position of each pixel on the first display surface 110. Specifically, the depth position of the display target is the depth position of the region surrounded by the four sides with the pixel Px233, the pixel Px236, the pixel Px266, and the pixel Px263 as vertices. In other words, the depth position of the other area is set to “0”. Next, the depth position will be described with reference to FIG.

  FIG. 8 is a configuration diagram illustrating an example of the depth position of the display target displayed by the display device 10 of the present embodiment. As described above, the first display surface 110 displays the first image information P11. The first display surface 110 emits a first first light beam R11 based on the first image information P11. The first first light beam R11 emitted from the first display surface 110 is observed as an optical image of the first image information P11 by the observer 1 at a predetermined position. Similarly, the second display surface 120 displays the second image information P12. The second display surface 120 emits a second second light beam R12 based on the second image information P12. The second second light beam R12 emitted from the second display surface 120 is observed as an optical image of the second image information P12 by the observer 1 at a predetermined position. The observer 1 recognizes the stereoscopic image SI in which the display target is stereoscopically displayed by simultaneously observing the first first light beam R11 and the second second light beam R12 at a predetermined position. A mechanism for the observer 1 to recognize the stereoscopic image SI will be described later.

  Here, the depth position of the display target is the position in the Z-axis direction (that is, the depth method) of the stereoscopic image SI recognized by the observer 1. Specifically, the depth position is indicated by a distance in the (+ Z) direction with the position in the Z-axis direction of the second display surface 120 as a reference position. This depth position is a position where the reference position is “0”, the display device 10 can display the stereoscopic image SI, and the position in the (+ Z) direction farthest from the reference position is “255”, and (+ Z) The direction is set to 256 levels. For example, when the display device 10 displays a display target in which the depth position of the stereoscopic image SI is set to “value D0”, the observer 1 observing from a predetermined position, as shown in FIG. The stereoscopic image SI is recognized at the depth position “value D0”, which is an intermediate position between “0” and the depth position “255”.

Next, the outline information will be described with reference to FIG.
FIG. 9 is a table showing an example of the contour information acquired by the contour correcting unit 13 of the present embodiment. As shown in the figure, in the contour information, a value indicating the contour to be displayed is set in association with the position of each pixel on the first display surface 110. Here, the value indicating the contour portion to be displayed is set such that the contour portion is set to “1” and the non-contour portion other than the contour portion is set to “0” in the image information displayed on the first display surface 110. Value. Specifically, the value indicating the outline of the display target is “1” in the area including the four sides with the pixel Px133, the pixel Px136, the pixel Px166, and the pixel Px163 as the vertex, and “0” in the other areas. Is set. That is, in the contour information, the position of the pixel corresponding to each side of the square pattern indicated by the first pixel value information acquired by the contour correcting unit 13 is set to “1”. That is, the contour information is information indicating a contour portion (edge portion, ridge line portion) to be displayed displayed on the first display surface 110. Here, the contour portion (which may be simply expressed as a contour or a contour region) is, for example, a portion where the brightness (for example, luminance) of adjacent or neighboring pixels in image information changes suddenly. is there. For example, the contour portion indicates a theoretical line segment having no width of each side of the square pattern shown in FIG. 3 and, for example, around the contour having a finite width according to the resolution of the first display surface 110. The area is also shown.

Next, a configuration in which the contour correcting unit 13 generates the third image signal based on the first image signal will be described with reference to FIG.
FIG. 10 is a table showing an example of a configuration in which the contour correction unit 13 of the present embodiment generates the third image information. The contour correction unit 13 generates third image information based on the first pixel value information, the depth position information, and the contour information included in the acquired first image signal. Specifically, the contour correcting unit 13 first extracts contour information and depth position information from the acquired first image signal. Next, the contour correction unit 13 performs a predetermined calculation based on the extracted contour portion information and the extracted depth position information, and generates correction information as a predetermined calculation result.

  For example, the contour correction unit 13 performs a logical product operation of the extracted contour information and the extracted depth position information, and the depth of the contour portion in which the depth position information of the contour portion is set in the depth position information. Position information is generated (FIG. 10A). Next, the contour correction unit 13 generates correction information (here, a value d0 as an example) obtained by performing a predetermined calculation on the generated depth position information of the contour portion. For example, the contour correction unit 13 generates correction information (value d0) by multiplying the generated depth position information (value D0) by a predetermined coefficient (FIG. 10B).

  Next, the contour correction unit 13 extracts the first pixel value information from the acquired first image signal, and calculates the extracted first pixel value information (value 63) and the generated correction information (value d0). (For example, the value d0 is subtracted from the value 63) to generate contour correction information (FIG. 10C). Here, for example, the contour correction unit 13 rounds off the decimal part of the calculation result so that each pixel value indicated by the contour correction information becomes an integer of 0 to 255. In other words, the contour correcting unit 13 selects the contour part to be displayed among the plurality of pixels arranged in a two-dimensional manner of the first display unit 11 based on the depth position of the display target stereoscopically displayed at a predetermined position. The pixel value of the contour pixel to be displayed is corrected. The contour correction unit 13 generates a third image signal including the contour correction information generated in this way.

Next, the configuration displayed by the first display unit 11 based on the third image signal generated by the contour correcting unit 13 will be described.
The first display unit 11 acquires the third image signal generated by the contour correction unit 13. When the pixel value indicated by the third pixel value information included in the acquired third image signal is “255”, the first display unit 11 maximizes the brightness of the pixel associated with the pixel value, Display image information. On the other hand, when the pixel value indicated by the third pixel value information included in the acquired third image signal is “0”, the first display unit 11 minimizes the brightness of the pixel associated with the pixel value. Display image information. In addition, when the pixel value indicated by the acquired third image signal is “1” to “254”, the first display unit 11 increases the brightness of the pixel associated with the pixel value from the minimum to the maximum. Image information is displayed at a brightness corresponding to the pixel value between them. The first image information P11 displayed by the first display unit 11 will be described with reference to FIG.

  FIG. 11 is a schematic diagram illustrating an example of the first image information P11 displayed by the first display unit 11 of the present embodiment. As shown in the figure, the first display unit 11 is a square pattern corresponding to the quadrangle pattern displayed by the second display unit 12, and the brightness of the outline portion is compared to the inside of the square pattern. A square pattern set to be dark is displayed on the first display surface 110.

  Next, with reference to FIG. 12 to FIG. 15, a configuration in which the display device 10 stereoscopically displays a display target as a stereoscopic image SI will be described. First, referring to FIG. 12, the position of the first image information P11 displayed on the first display surface 110, the position of the second image information P12 displayed on the second display surface 120, and the observer 1 A relationship with a predetermined position where image information is observed will be described.

FIG. 12 is a schematic diagram illustrating an example of a positional relationship between the first display surface 110 and the second display surface 120 in the present embodiment.
The first display surface 110 of the first display unit 11 displays the first image information P11. The second display surface 120 of the second display unit 12 displays the second image information P12 at a position separated by a predetermined distance Lp in the (+ Z) direction from the position where the first image information P11 is displayed. As described above, the second display unit 12 is a transmissive display unit that transmits light in the Z-axis direction. For this reason, the light beam (first light beam R11) emitted from the first display surface 110 displaying the first image information P11 passes through the second display unit 12 and is observed by the observer 1. Further, the light beam (second light beam R12) emitted from the second display surface 120 displaying the second image information P12 is observed by the observer 1 as it is. That is, the observer 1 observes the first image information P11 and the second image information P12 in an overlapping manner. Here, the predetermined distance Lp is a distance between a position in the Z-axis direction where the first image information P11 is displayed and a position in the Z-axis direction where the second image information P12 is displayed. . This predetermined distance Lp is determined in advance based on, for example, the position in the Z-axis direction where the first image information P11 is displayed and the predetermined position of the observer 1.

  Further, as shown in FIG. 12, the display device 10 includes the contour portion RL1L in the first image information P11 displayed on the first display surface 110 and the second image information P12 displayed on the second display surface 120. The first image information P11 and the second image information P12 are displayed so that the contour portion RL2L corresponding to the contour portion RL1L is observed corresponding to the observer 1. Similarly, the display device 10 displays the contour portion RL1R in the first image information P11 displayed on the first display surface 110 and the contour portion RL1R in the second image information P12 displayed on the second display surface 120. The first image information P11 and the second image information P12 are displayed so that the corresponding contour portion RL2R is observed corresponding to the observer 1.

  At this time, the display device 10 has the contour portion RL2L on the left eye L of the observer 1 on the (−X) side (that is, outside the quadrilateral) of the quadrangular contour portion RL2L indicated by the first image information P11. Each image is displayed so that the outline portion RL1L overlaps and is observed. In addition, the display device 10 has the contour RL2R and the contour on the left eye L of the viewer 1 on the (−X) side (that is, on the inner side of the quadrilateral) of the quadrangular contour RL2R indicated by the first image information P11. Each image is displayed so that the part RL1R overlaps and is observed. Similarly, for example, the display device 10 has the contour portion RL2R on the right eye R of the observer 1 on the (+ X) side (that is, outside the quadrilateral) of the quadrangular contour portion RL2R indicated by the first image information P11. Each image is displayed so that the outline portion RL1R overlaps and is observed. Further, the display device 10 has the contour portion RL2L and the contour portion on the right eye R of the observer 1 on the (+ X) side (that is, on the inner side of the quadrilateral) of the quadrangular contour portion RL2L indicated by the first image information P11. Each image is displayed so that RL1L is observed overlapping.

  Next, a mechanism in which the observer 1 recognizes a stereoscopic image SI (three-dimensional image) from the first image information P11 and the second image information P12 will be described. First, the observer 1 is in a predetermined position where the contour portion of the display target OBJ1 displayed by the first image information P11 and the contour portion of the display target OBJ2 displayed by the second image information P12 correspond (overlap). Observe these image information. Then, the observer 1 compares the brightness ratio between the contour portion of the display target OBJ1 displayed by the first image information P11 and the contour portion of the display target OBJ2 displayed by the second image information P12 (for example, the luminance ratio). The optical image IM to be displayed is perceived at a depth position corresponding to (). At this time, when a display object (for example, a square pattern) is observed, a step with a minute brightness that cannot be recognized on the retina image of the observer 1 is formed. In such a case, a virtual contour (edge) is perceived between steps of brightness (for example, luminance) and recognized as one object. At this time, the virtual contour is slightly shifted between the left eye L and the right eye R and perceived as binocular parallax, and the depth position changes. This mechanism will be described in detail with reference to FIGS.

  FIG. 13 is a schematic diagram illustrating an example of the optical image IM in the present embodiment. Here, the optical image IM is an image in which the first image information P11 and the second image information P12 are observed by the observer 1. First, the optical image IML observed by the left eye L of the observer will be described.

  As shown in FIG. 13, in the left eye L of the observer, an optical image IML formed by combining the first image information P11L and the second image information P12L is formed. Here, the 1st image information P11L is image information observed with the left eye L of the observer 1 among the 1st image information P11. The second image information P12L is image information observed by the left eye L of the observer 1 in the second image information P12. As described with reference to FIG. 11, in the left eye L, the contour portion RL2L is placed on the (−X) side (that is, outside the quadrilateral) of the quadrangular contour portion RL2L indicated by the first image information P11. An optical image IML in which the image shown and the contour portion RL1L are combined is formed. In the left eye L, the image indicating the contour portion RL2R and the contour portion RL1R are synthesized on the (−X) side (that is, inside the quadrilateral) of the quadrangular contour portion RL2R indicated by the first image information P11. The formed optical image IML is formed.

Next, the brightness distribution of the optical image IML observed by the left eye L in the case of FIG. 13 will be described with reference to FIG.
FIG. 14 is a graph showing an example of the brightness distribution of the optical image IM in the present embodiment. In FIG. 14, X coordinates X1 to X6 are X coordinates corresponding to the brightness change points of the optical image IM. As an example of the pixel value of the image information, the case of the luminance value BR will be described. Further, the brightness of the second image information P12L observed by the left eye L is described as zero here in the X coordinates X1 to X2. The brightness of the second image information P12L is a brightness value BR2 (for example, “63”) at the X coordinates X2 to X6. The brightness of the first image information P11L observed by the left eye L is a brightness value BR1 (for example, “61”) at the X coordinates X1 to X2 and the X coordinates X4 to X5, and the brightness at the X coordinates X2 to X4. The value BR2. Therefore, the brightness (for example, luminance) of the optical image IML observed by the left eye L becomes the luminance value BR1 at the X coordinates X1 to X2. Further, the brightness of the optical image IML is a luminance value BR4 (for example, “126”) at the X coordinates X2 to X4. The brightness of the optical image IML is a brightness value BR3 (for example, “124”) that is a brightness obtained by combining the brightness value BR1 and the brightness value BR2 at the X coordinates X4 to X5, and the X coordinates X5 to X6. The luminance value BR2 is obtained.

Next, a mechanism in which a contour portion is observed in the left eye L of the observer 1 will be described.
FIG. 15 is a graph showing an example of binocular parallax that occurs in the left eye L and the right eye R in the present embodiment. The distribution of brightness of the image recognized by the observer 1 by the optical image IML formed on the retina of the left eye L is as shown by a waveform WL in FIG. Here, the observer 1 is, for example, an object observing the position on the X-axis where the change in the brightness of the observed image is maximized (that is, the gradient of the waveform WL and the waveform WR is maximized). It is recognized that it is the outline part. In the case of the present embodiment, for example, the observer 1 observes the position of X _EL shown in FIG. 15 (that is, the position of the distance L _EL from the origin O of the X axis) for the waveform WL on the left eye L side. It is recognized as a contour portion on the left side of the rectangle.

Next, a difference between the optical image IMR observed by the observer's right eye R and the optical image IML will be described, and a mechanism for recognizing a stereoscopic image (three-dimensional image) based on the difference will be described.
As shown in FIG. 13, in the observer's right eye R, the first image information P11R observed by the right eye R and the second image information P12R observed by the right eye R are combined. An image IMR is formed.
As shown in FIG. 14, the brightness (for example, luminance) of the optical image IMR observed by the right eye R is the optical observed by the left eye L at the X coordinates X1 to X3 and the X coordinates X4 to X6. It is different from the brightness of the image IML.
The distribution of the brightness of the image recognized by the observer 1 by the optical image IMR synthesized on the retina of the right eye R is as shown by the waveform WR in FIG. Here, for example, the observer 1 observes the position of the _XER shown in FIG. 15 (that is, the position of the distance _LER from the origin O of the X axis) for the waveform WR on the right eye R side, for example. It is recognized as a part.
Thus, the observer 1 recognizes the position X _EL contour portion of square left eye L is observed, the position X _ER of contour of the square right eye R is observed as binocular parallax. Then, the observer 1 recognizes a square image as a stereoscopic image SI (three-dimensional image) based on the binocular parallax of the contour portion.

Next, the operation of the display device 10 will be described with reference to FIG.
FIG. 16 is a flowchart illustrating an example of the operation of the display device 10 according to the present embodiment. First, the contour correction unit 13 acquires a first image signal from the image information supply device 2 (step S10).

  Next, the contour correcting unit 13 extracts contour information from the acquired first image signal (step S20). Next, the contour correcting unit 13 extracts depth position information from the acquired first image signal (step S30).

  Next, the contour correction unit 13 performs a logical product operation of the extracted contour information and the extracted depth position information, and the contour position of the contour position in which the depth position information of the contour portion is set out of the depth position information. Depth position information is generated (step S40).

  Next, the contour correcting unit 13 generates correction information obtained by performing a predetermined calculation on the generated depth position information of the contour portion (step S50).

  Next, the contour correcting unit 13 extracts first pixel value information from the acquired first image signal, calculates (for example, subtracts) the extracted first pixel value information and the generated correction information, Outline correction information is generated (step S60).

  Next, the 1st display part 11 acquires the 3rd image signal containing the outline correction information which the outline correction part 13 produced | generated in step S60. In addition, the second display unit 12 acquires a second image signal from the image information supply device 2. Next, the first display unit 11 and the second display unit 12 display image information based on the acquired image signals (step S70).

  As described above, the display device 10 of this embodiment includes the contour correction unit 13. The contour correction unit 13 is two-dimensionally included in the first display unit 11 (or the first display surface 110 included in the first display unit 11) based on the depth position of the display target stereoscopically displayed at a predetermined position. Among the plurality of arranged pixels, the pixel value of the contour pixel that displays the contour portion to be displayed is corrected. Here, the first image information P11 refers to the first display unit 11 among the image information that stereoscopically displays a display target to be displayed on the first display unit 11 and the second display unit 12 at a predetermined position by binocular parallax. This is image information to be displayed. In general, the display device sets the pixel values of all the pixels for which the first display surface 110 displays the display target based on the depth position of the display target, so that the observer 1 observes the display target as the stereoscopic image SI. Image information that can be displayed. However, unless the pixel values of all the pixels on which the first display surface 110 displays the display target and the pixel values of all the pixels on which the second display surface 120 displays the display target are precisely associated with each other, The observer 1 may not be able to observe the display target as the stereoscopic image SI.

  On the other hand, the display device 10 corrects the pixel values of the pixels that display the contour portion of the display target, not the pixel values of all the pixels on the first display surface 110 that display the display target. Therefore, the display device 10 only needs to associate the pixel value of the pixel in the contour portion of the first display surface 110 with the pixel value of the pixel that displays the display target corresponding to the contour portion of the second display surface 120. That is, the display device 10 can reduce the pixel value to be corrected as compared with the case where the first display surface 110 corrects the pixel values of all the pixels that display the display target. Therefore, the display device 10 makes it easier to correct pixel values for stereoscopic display of the display target than when the first display surface 110 corrects the pixel values of all the pixels that display the display target. Can do.

  Further, in the display device 10 of the present embodiment, the pixel value is the luminance value of the pixel, and the contour correction unit 13 corrects the luminance value of the contour pixel based on the depth position of the display target to be stereoscopically displayed. To do. In addition to the luminance value, the pixel value includes various parameters such as the hue and saturation of the pixel. The display device 10 can set the depth position of the display target to be stereoscopically displayed by correcting the luminance value in the various parameters. Thereby, the display apparatus 10 can correct | amend the pixel value of an outline pixel with a simple structure compared with the case where various parameters are each corrected.

  In addition, the contour correction unit 13 included in the display device 10 of the present embodiment corrects the pixel value for each pixel of the contour pixel corresponding to each part of the display target, based on the depth position of each part of the display target that is stereoscopically displayed. . Here, as described above, the pixel value of the contour pixel is a value for setting a depth position at which the image information displayed by the contour pixel is observed by the observer 1 as the stereoscopic image SI. For example, as the brightness of the contour pixel is brighter, the depth position of the stereoscopic image SI based on the image information displayed by the contour pixel is displaced in the (+ Z) direction. On the other hand, as the brightness of the contour pixel is darker, the depth position of the stereoscopic image SI based on the image information displayed by the contour pixel is displaced in the (−Z) direction. That is, the depth position of the stereoscopic image SI based on the image information displayed by the contour pixel is displaced according to the brightness of the contour pixel. Therefore, the contour correcting unit 13 can set the depth position of each pixel for each pixel by correcting the pixel value for each pixel of the contour pixel corresponding to each part to be displayed. Thereby, the display apparatus 10 can set the depth position of the display target displayed in three dimensions precisely compared with the case where all the pixel values of the contour pixel are uniformly corrected.

  In addition, the contour correction unit 13 included in the display device 10 according to the present embodiment makes the brightness of the contour pixel darker than the brightness of the non-contour pixels other than the contour pixel among the pixels constituting the first image information P11. Thus, the pixel value of the contour pixel is corrected. Here, when the contour pixel is displayed brighter than the brightness of the non-contour pixel, the contour portion and the non-contour portion may be separated and observed by the observer 1. That is, when the first display unit 11 displays the contour pixels brighter than the brightness of the non-contour pixels, the contour portion becomes conspicuous, and it may be difficult for the observer 1 to observe the display target as the stereoscopic image SI. is there. On the other hand, when the contour pixel is displayed darker than the brightness of the non-contour pixel, the contour portion and the non-contour portion are not separated from each other and are observed by the viewer 1. It becomes easy to be observed as SI. That is, the display device 10 corrects the pixel value of the contour pixel by making the brightness of the contour pixel darker than the brightness of the non-contour pixel, thereby reducing the degree of difficulty in observing the display target OBJ as the stereoscopic image SI. can do. In addition, since the power consumption of the display device 10 increases as the pixel brightness increases, the power consumption is reduced by correcting the pixel value of the contour pixel to be darker than the brightness of the non-contour pixel. can do.

  In the present embodiment, the contour correction unit 13 displays each pixel of the first display unit 11 that displays the contour of the display target OBJ1 based on the first pixel value information, the depth position information, and the contour information. Although an example of correcting the pixel value is described, it is not limited thereto. For example, the contour correcting unit 13 corrects the pixel value of the contour pixel based on the brightness of the contour pixel and the brightness of the non-contour pixels other than the contour pixel among the pixels constituting the first image information P11. Also good. Specifically, the contour correction unit 13 displays a pixel (contour pixel) that displays a contour portion and a non-contour portion among the pixels constituting the first display surface 110 based on the acquired contour portion information. Identify a pixel (non-contour pixel). Next, the contour correction unit 13 calculates the brightness (for example, luminance value) of the identified contour pixel based on the acquired first pixel value information. Next, the contour correction unit 13 calculates the brightness (for example, luminance value) of the identified non-contour pixel based on the acquired first pixel value information. Next, the contour correction unit 13 generates second contour correction information obtained by further correcting the contour correction information generated by the above-described configuration based on the difference between the calculated brightness of the contour pixel and the brightness of the non-contour pixel. To do. Then, the contour correcting unit 13 generates a third image signal that includes the generated second contour correction information as contour correction information.

  Accordingly, the display device 10 sets the difference in brightness (for example, luminance) between the contour pixel and the non-contour pixel to an appropriate range in which stereoscopic display is possible (for example, by reducing the brightness difference). The image information with corrected pixels can be displayed. Therefore, the display device 10 can display the image information such that the contour pixels are not conspicuous with respect to the non-contour pixels. Note that the contour correction unit 13 may correct the pixel value of the contour pixel based on the brightness of the contour pixel and the non-contour pixel that are adjacent to each other among the contour pixel and the non-contour pixel. In this case, the image information obtained by correcting the contour pixel by reducing the difference in brightness (for example, luminance) between the contour pixel and the non-contour pixel can be displayed. Therefore, the display device 10 can display the image information such that the contour pixels are less conspicuous than the non-contour pixels.

  In the present embodiment, the contour correcting unit 13 makes the brightness of the contour pixel darker than the brightness of the non-contour pixels other than the contour pixel among the pixels constituting the first image information P11. Although an example of correcting the pixel value is described, the present invention is not limited to this. Specifically, the contour correcting unit 13 makes the brightness of the contour pixel brighter than the brightness of the non-contour pixels other than the contour pixel among the pixels constituting the first image information P11, so that the pixel of the contour pixel The value may be corrected. As a result, the contour correcting unit 13 can set the brightness of the contour pixel in a wider range than when the brightness of the contour pixel is set to be darker than the brightness of the non-contour pixel. Here, the brightness of the contour pixel is an element for setting the depth position of the display target to be stereoscopically displayed. Therefore, the display device 10 can set the depth position of the display target to be stereoscopically displayed in a wide range by setting the brightness of the contour pixel in a wide range. That is, the display device 10 can set the depth position of the display target to be stereoscopically displayed over a wide range, as compared with the case where the brightness of the contour pixel is set to be lower than the brightness of the non-contour pixel.

  In the present embodiment, the contour correcting unit 13 may correct the pixel value of the contour pixel so that the contour pixel is not displayed. For example, the contour correcting unit 13 may correct the brightness of the contour pixel to the darkest value (for example, zero) so that the contour pixel is not displayed. In this case, the contour correcting unit 13 may correct the brightness of the contour pixel to the darkest value (for example, zero) so that the contour pixel is not displayed for some of the contour pixels. Accordingly, the contour correcting unit 13 can set the brightness of the contour pixel in a wider range than when the brightness of the contour pixel is set only to a value larger than zero.

  Moreover, although the outline correction | amendment part 13 with which the display apparatus 10 of this embodiment is provided demonstrated the example which correct | amends the 1st image information P11, it is not restricted to this. Specifically, the contour correcting unit 13 may correct the second image information P12 in addition to the first image information P11. That is, the contour correction unit 13 is a pixel of a contour pixel corresponding to the contour portion of the display target among the pixels constituting the first image information P11 based on the depth position of the display target stereoscopically displayed at a predetermined position. Correct the value. Further, the contour correcting unit 13 corrects the pixel value of the contour pixel corresponding to the contour portion to be displayed among the pixels constituting the second image information P12. Here, the second image information P12 is image information to be displayed on the second display unit 12 among image information for stereoscopic display of a display target at a predetermined position by binocular parallax. Here, in the display device 10 of the present embodiment, the first image information P11 displayed on the first display surface 110 and the second image information P12 displayed on the second display surface 120 are overlapped by the observer 1. It is a display device to be observed. That is, the observer 1 observes image information having brightness obtained by adding the brightness of the first display surface 110 and the brightness of the second display surface 120. Therefore, by setting the brightness of the pixels of the first display surface 110 and the brightness of the pixels of the second display surface 120, respectively, compared to the case of setting only the brightness of the pixels of the first display surface 110, The brightness of the image information observed by the observer 1 can be set in a wide range. Here, the contour correcting unit 13 corrects the second image information P12 in addition to the first image information P11, so that the contour correcting unit 13 corrects only the first image information P11. Brightness can be set in a wide range. That is, the display device 10 can set the depth position of the display target to be stereoscopically displayed in a wide range by setting the brightness of the contour pixel in a wide range. That is, the display device 10 can set the depth position of the display target to be stereoscopically displayed over a wide range as compared with the case where only the first image information P11 is corrected.

  In the display device 10 of the present embodiment, the first display unit 11 and the second display unit 12 are arranged in the order of the first display unit 11 and the second display unit 12 in the (+ Z) direction. I can't. Specifically, in the display device 10, the first display unit 11 and the second display unit 12 may be arranged in the order of the second display unit 12 and the first display unit 11 in the (+ Z) direction. Even if comprised in this way, the display apparatus 10 can display the stereoscopic image SI of a display target. That is, even with this configuration, the display device 10 is a pixel for stereoscopically displaying the display target as compared to the case where the first display surface 110 corrects the pixel values of all the pixels that display the display target. Value correction can be simplified.

  In addition, at least one of the first display unit 11 and the second display unit 12 of the display device 10 of the present embodiment is capable of transmitting light corresponding to an image displayed on the other display unit. It is. Thereby, the display apparatus 10 of embodiment can be comprised in the state which accumulated the 1st display part 11 and the 2nd display part 12, and the display apparatus 10 can be reduced in size.

  Moreover, although the display apparatus 10 of this embodiment demonstrated as displaying each image information based on the 1st image signal and the 2nd image signal supplied from the image information supply apparatus 2, it is not restricted to this. . Specifically, the display device 10 generates second image information from the first image information supplied from the image information supply device 2, and supplies the supplied first image signal and each generated second image signal. Each image information may be displayed based on the above. Here, since the first image information and the second image information are the corresponding image information, the display device 10 obtains the second pixel value information based on the first pixel value information included in the first image information. Can be generated.

  In the display device 10 described above, the configuration in which the first display unit 11 and the second display unit 12 are arranged in parallel has been described as an example. However, the configuration is not limited thereto. For example, the display device 10 transmits the second light beam R12 based on the second image information P12 displayed on the second display surface 120 and the first light beam R11 based on the first image information P11 displayed on the first display surface 110. May be provided with an optical system (for example, a half mirror). Accordingly, the first image information P11 and the second image information P12 can be overlapped and displayed in the Z-axis direction regardless of the transmittance with which the second display unit 12 transmits light. That is, the display device 10 does not require the second display unit 12 to be a transmissive display unit, and thus the first display surface 110 and the second display surface 120 can be configured by the same display surface. Accordingly, the display device 10 can easily match the characteristics of the first display surface 110 and the second display surface 120, and can further simplify the setting of pixel values for stereoscopic display. Accordingly, the display device 10 can set the depth position for stereoscopic display of the display target with high accuracy.

  Further, the display device 10 has a configuration in which the first display unit 11 and the second display unit 12 are both transmissive display units and includes a backlight on the (−Z) direction side of the first display unit 11. May be. Accordingly, the display device 10 can easily match the characteristics of the first display surface 110 and the second display surface 120, and can further simplify the setting of pixel values for stereoscopic display. Accordingly, the display device 10 can set the depth position for stereoscopic display of the display target with high accuracy.

  The second display unit 12 of the display device 10 may be configured to project the second image information P12 from a projector onto a semi-transparent screen as the second display surface 120. Thereby, the display apparatus 10 can make the 2nd display surface 120 thin compared with the case where a liquid crystal display device etc. are used, for example. Similarly, the first display unit 11 of the display device 10 may be configured to project the first image information P11 from a projector onto a screen as the first display surface 110. Thereby, the display apparatus 10 can enlarge the 1st display surface 110 and the 2nd display surface 120 easily.

  Moreover, although the display apparatus 10 demonstrated the structure in which the 1st display part 11 and the 2nd display part 12 both display the optical image as a real image, it is not restricted to this. For example, the first display unit 11 may be configured to display an image as a virtual image. Here, the real image is an image displayed at the depth position of the display surface when the observer views the display surface. The virtual image is an image displayed at a position other than the depth position of the display surface (for example, a depth position between the observer and the display surface) when the observer looks at the display surface. Accordingly, the display device 10 can set the position of the optical image of the first image information P11 without being restricted by the position of the first display unit 11. Therefore, the display device 10 can set the position of the stereoscopic image SI recognized by the observer without being restricted by the position of the first display unit 11. Further, for example, the second display unit 12 may be configured to display an image as a virtual image, and observation is performed without being restricted by the position of the second display unit 12 in the same manner as the first display unit 11. The position of the stereoscopic image SI recognized by the person can be set.

  In the display device 10 described above, the contour correction unit 13 has been described as an example of a configuration in which the first pixel value information and the correction information are calculated (for example, subtracted) to generate the contour correction information. I can't. The contour correction unit 13 may acquire contour correction information corresponding to various depth positions stored in advance in a storage unit (not shown) from the storage unit based on the depth position. With this configuration, the display device 10 can further simplify the setting of pixel values for stereoscopic display of a display target.

  As mentioned above, although embodiment of this invention has been explained in full detail with reference to drawings, a concrete structure is not restricted to this embodiment and can be suitably changed in the range which does not deviate from the meaning of this invention. .

  The first display unit 11, the second display unit 12, and the contour correction unit 13 (hereinafter collectively referred to as a control unit) or each unit included in the control unit in the above embodiment are dedicated hardware. It may be realized by hardware, or may be realized by a memory and a microprocessor.

  Each unit included in the control unit includes a memory and a CPU (central processing unit), and a program for realizing the function of each unit included in the control unit is loaded into the memory and executed, thereby realizing the function. It may be a thing.

  In addition, by recording a program for realizing the function of each unit included in the control unit on a computer-readable recording medium, causing the computer system to read and execute the program recorded on the recording medium, the control unit You may perform the process by each part with which it is equipped. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  DESCRIPTION OF SYMBOLS 10 ... Display apparatus, 11 ... 1st display part, 12 ... 2nd display part, 13 ... Contour correction part, 110 ... 1st display surface, 120 ... 2nd display surface

Claims (10)

Based on the depth position of a display target that is stereoscopically displayed by binocular parallax of image information displayed on each of the first display surface and the second display surface, a plurality of pixels arranged in a two-dimensional array on the first display surface. A display device comprising: a contour correcting unit that corrects a pixel value of a contour pixel that displays the contour portion to be displayed. The pixel value is a luminance value of the pixel,
The contour correction unit
The display device according to claim 1, wherein the brightness value of the contour pixel is corrected based on a depth position of the display target that is stereoscopically displayed. The contour correction unit
The pixel value is corrected for each pixel of the contour pixel corresponding to each part of the display target based on the depth position of each part of the display target displayed in three dimensions. The display device described. The contour correction unit
The pixel value of the contour pixel is corrected based on the brightness of the contour pixel and the brightness of a non-contour pixel other than the contour pixel among the pixels of the first display surface. The display device according to claim 3. The contour correction unit
The brightness of the contour pixel is made darker than the brightness of non-contour pixels other than the contour pixel among the pixels of the first display surface, and the pixel value of the contour pixel is corrected. Item 5. The display device according to Item 4. The contour correction unit
The brightness of the contour pixel is made brighter than the brightness of non-contour pixels other than the contour pixel among the pixels of the first display surface, and the pixel value of the contour pixel is corrected. Item 5. The display device according to Item 4. The contour correction unit
Based on the depth position of the display target that is stereoscopically displayed, the pixel value of the contour pixel corresponding to the contour portion of the display target among the pixels of the first display surface is corrected, and the second display surface is 7. The display device according to claim 1, wherein a pixel value of a contour pixel corresponding to a contour portion of the display target is corrected among the pixels having the display device. A first display unit for displaying first image information;
A second display for displaying second image information;
Based on the depth position of the display target displayed stereoscopically by binocular parallax between the first image information displayed by the first display unit and the second image information displayed by the second display unit, A display device comprising: a contour correction unit that corrects a pixel value of a contour pixel that displays the contour portion to be displayed among the plurality of pixels arranged in a two-dimensional manner included in the first display unit. On the computer,
A plurality of display objects displayed on the first display surface and the second display surface are two-dimensionally arranged on the first display surface based on the depth position of the display object displayed stereoscopically by binocular parallax. A program for executing a contour correction procedure for correcting a pixel value of a contour pixel that displays a contour portion to be displayed among pixels. On the computer,
A first display procedure for displaying first image information indicating a display target;
A second display procedure for displaying second image information indicating the display object;
The display target in which the first image information displayed by the first display procedure and the display target indicated by the second image information displayed by the second display procedure are stereoscopically displayed by binocular parallax. A contour correction procedure for correcting a pixel value of a contour pixel that displays the contour portion to be displayed among a plurality of pixels arranged in a two-dimensional manner constituting the first image information based on a depth position of A program to be executed.

Images