WO2013146385A1

WO2013146385A1 - Display apparatus and program

Info

Publication number: WO2013146385A1
Application number: PCT/JP2013/057511
Authority: WO
Inventors: 英範栗林; 正樹大槻
Original assignee: 株式会社ニコン
Priority date: 2012-03-27
Filing date: 2013-03-15
Publication date: 2013-10-03

Abstract

This display apparatus is provided with: a first display unit, which displays a first image; and a second display unit that is a transmissive display unit, which is worn in front of the eyes of a user, and which is capable of passing through light inputted thereto, said second display unit passing through, in the light transmitting direction, light of the first image displayed by the first display unit, and displaying, in the light transmitting direction, a second image corresponding to the first image.

Description

Display device and program

The present invention relates to a display device and a program.

In recent years, for example, by displaying a plurality of images with a ratio of brightness (for example, luminance) corresponding to the depth position of a stereoscopic image (three-dimensional image) on a plurality of display surfaces having different depth positions, the plurality of images are displayed. There is known a display method for causing a viewer who has visually recognized the image to recognize a stereoscopic image (see, for example, Patent Document 1).

Japanese Patent No. 3464633

However, the display method as described above may limit the viewpoint from which the observer can recognize a stereoscopic image (three-dimensional image). In this case, the range that the observer can recognize as a stereoscopic image. There is a problem that it cannot be displayed in a wide range.

The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a display device that can display a wide range of a range that an observer can recognize as a stereoscopic image.

[1] A display device according to an aspect of the present invention includes a first display unit that displays a first image including a first subject, and transmits light of the first image displayed by the first display unit. A second display unit that is portable to the user, displays a second image including a second subject corresponding to the first subject, and displays the second image so that at least a part of the first subject and the second subject overlap each other. It is characterized by providing.

[2] In addition, the display device according to one embodiment of the present invention transmits the first light including light from the first subject and displays the second image including the second subject corresponding to the first subject. And a display unit that is portable for a user and that displays so that at least a part of the first subject and the second subject overlap each other.

[3] A program according to an aspect of the present invention is configured to transmit a first display unit that displays a first image including a first subject, and light of the first image displayed by the first display unit, At least one of the first subject and the second subject is displayed on a computer of a display device having a second display unit that is portable for a user and displays a second image including a second subject corresponding to the first subject. A display procedure for displaying a part so as to overlap is executed.

[4] A display device according to one embodiment of the present invention includes a mounting unit that is mounted on an observer's head and the mounting unit that transmits first light including light from the first subject. And a display unit that displays a second image corresponding to the first subject, wherein the display unit is configured for the observer who has observed the first subject and the second image via the display unit. Thus, a stereoscopic effect different from the case where the first subject is observed without using the display unit is visually recognized.

[5] A display device according to one embodiment of the present invention is a display device mounted on the head of an observer, and displays a first image by an eyepiece optical system and displays the first image displayed. A first display unit that transmits light of a second image indicating an edge portion in a direction in which the first image is displayed is provided.

[6] In addition, the display device according to one embodiment of the present invention displays a first image, detects a first display portion that transmits incident light, and a second image that indicates an edge portion of the first image. An image detection unit; a supply unit that supplies the second image detected by the image detection unit to a second display unit; a detection unit that detects a position of the first display unit with respect to the second display unit; and the supply A setting unit configured to set the second image indicating an edge portion of the first image based on the second image supplied by the unit and the position detected by the detection unit.

[7] A display device according to one embodiment of the present invention includes a supply unit that displays a first image and supplies the first image to a first display unit that transmits incident light, and the first display. A setting for setting a second image indicating an edge portion of the first image based on a detection unit for detecting a position of the part, the first image supplied by the supply unit, and the position detected by the detection unit And a second display unit that displays the second image set by the setting unit.

According to the present invention, it is possible to display a wide range that can be recognized as a stereoscopic image (three-dimensional image) by the observer.

It is a block diagram which shows an example of a structure of the display system which concerns on the 1st Embodiment of this invention. It is a perspective view which shows an example of a structure of the 2nd display part of this embodiment. It is a schematic diagram which shows an example of the 1st image in this embodiment. It is a schematic diagram which shows an example of the 2nd image in this embodiment. It is a schematic diagram which shows an example of the image displayed by the display apparatus in this embodiment. It is a schematic diagram which shows an example of the optical image in this embodiment. It is a graph which shows an example of the brightness distribution of the optical image in this embodiment. It is a graph which shows an example of the binocular parallax which arises in the left eye and right eye in this embodiment. It is a schematic diagram which shows an example of the parallax image for left eyes which concerns on the 2nd Embodiment of this invention. It is a schematic diagram which shows an example of the parallax image for right eyes in this embodiment. It is a block diagram which shows an example of a structure of the display system which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows an example of operation | movement of the display apparatus in this embodiment. It is a block diagram which shows an example of a structure of the display system which concerns on the 4th Embodiment of this invention. It is a schematic diagram which shows an example of the setting of the setting part in the modification of this embodiment. It is a block diagram which shows an example of a structure of the display system which concerns on the 5th Embodiment of this invention. It is a block diagram which shows an example of a structure of the display system which concerns on the 6th Embodiment of this invention. It is a schematic diagram which shows an example of the image displayed by the display apparatus in this embodiment. It is a block diagram which shows an example of a structure of the display system which concerns on the 7th Embodiment of this invention. It is a flowchart which shows an example of operation | movement of the display system in this embodiment. It is a block diagram which shows an example of a structure of the display system which concerns on the 8th Embodiment of this invention. It is a block diagram which shows an example of a structure of the display system which concerns on the 9th Embodiment of this invention. It is a block diagram which shows an example of a structure of the display system which concerns on the 10th Embodiment of this invention. It is a schematic diagram which shows an example of the depth position of the three-dimensional image in this embodiment. It is a block diagram which shows an example of a structure of the display system which concerns on the 11th Embodiment of this invention. It is a schematic diagram which shows an example of a structure of the display system in this embodiment.

[First Embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a configuration diagram illustrating an example of a configuration of a display system 100 according to the present embodiment.
The display system 100 of this embodiment includes an image information supply device 2 and a display device 10. The display device 10 includes a first display unit 11 and a second display unit 12.
Hereinafter, in the description of each drawing, an XYZ orthogonal coordinate system is set, and the positional relationship of each part will be described with reference to this XYZ orthogonal coordinate system. A direction in which the first display unit 11 displays an image is a positive direction of the Z axis, and orthogonal directions on a plane perpendicular to the Z axis direction are an X axis direction and a Y axis direction, respectively. Here, the X-axis direction is the horizontal direction of the first display unit 11, and the Y-axis direction is the vertical direction of the first display unit 11.

The image information supply device 2 supplies the first image information to the first display unit 11 and also supplies the second image information to the second display unit 12. Here, the first image information is information for displaying the first image P11 displayed on the first display unit 11. The second image information is information for displaying the second image P12 displayed on the second display unit 12, and is image information of the edge image PE generated based on the first image information. . The edge image PE is an image showing the edge portion E in the first image P11. The edge image PE will be described later with reference to FIG. The second image information includes image information indicating the left-eye image P12L and image information indicating the right-eye image P12R, as will be described later with reference to FIG.

As described above, the display device 10 includes the first display unit 11 and the second display unit 12, and based on the first image information acquired from the image information supply device 2, the first image P11 is displayed. While displaying, based on the 2nd image information acquired from the image information supply apparatus 2, the 2nd image P12 is displayed.

The first display unit 11 includes a first display surface 110 that displays an image in the (+ Z) direction. Based on the first image information acquired from the image information supply device 2, the first image P11 is displayed. Is displayed on the first display surface 110. The first light beam R11 emitted from the first image P11 displayed on the first display surface 110 is visually recognized as an optical image by the observer 1 (also referred to as a user in the following description) sitting on the chair 3. The This observer 1 sits on the chair 3 provided at a position away from the first display surface 110 in the (+ Z) direction by a predetermined distance, and observes the first display surface 110 in the −Z direction.

Next, the second display unit 12 will be described with reference to FIG.
FIG. 2 is a perspective view showing an example of the configuration of the second display unit 12 of the present embodiment. The 2nd display part 12 is a display part with which the transmissive head mount display 50 which can permeate | transmit incident light is provided. The second display unit 12 displays an image in front of the eyes of the observer 1 wearing the head mounted display 50. That is, the second display unit 12 is a portable transmissive display that is portable by the user. The second display unit 12 includes an optical system (not shown) such as a lens, and displays a virtual image to the observer 1. The second display unit 12 includes a left eye display unit 12L and a right eye display unit 12R. When the left eye display unit 12L of the second display unit 12 is attached to the viewer 1, the left eye image P12L included in the second image information supplied from the image information supply device 2 is displayed on the viewer 1. The left eye L is displayed so as to be visually recognized. Similarly, the right eye display unit 12R of the second display unit 12 displays the right eye image P12R included in the second image information so that the right eye R of the observer 1 can visually recognize it.

The second display unit 12 also emits the first light beam R11 (light) of the first image displayed by the first display unit 11 when the observer 1 sits on the chair 3 and observes the first display unit 11. Transmit in the transmission direction. Here, the transmission direction is the (+ Z) direction. That is, the left eye display unit 12L of the second display unit 12 transmits the left eye first light beam R11L of the incident first light beam R11. Similarly, the right eye display unit 12R of the second display unit 12 transmits the right eye first light beam R11R out of the incident first light beam R11. In this way, the left eye display unit 12L transmits the incident left eye first light beam R11L and emits the left eye second light beam R12L. The left eye second light beam R12L and the left eye first light beam R11L are visually recognized by the left eye of the observer 1 who is observing the (−Z) direction as corresponding optical images. Similarly, the right eye display unit 12R transmits the incident right eye first light beam R11R and emits the right eye second light beam R12R. That is, the right eye second light beam R12R and the right eye first light beam R11R are visually recognized by the right eye of the observer 1 who is observing the (−Z) direction as corresponding optical images.

Next, the first image P11 and the second image P12 of this embodiment will be described with reference to FIGS. Here, when an image is shown in the following drawings, a portion where the brightness of the image is bright (for example, high brightness) is shown thinly for convenience.
FIG. 3 is a schematic diagram illustrating an example of the first image P11 in the present embodiment. FIG. 4 is a schematic diagram illustrating an example of the second image P12 in the present embodiment. The first image P11 is, for example, an image showing a square pattern as shown in FIG. Here, in the quadrangular pattern indicated by the first image P11, the four sides constituting the quadrilateral can be edge portions, but in the following description, for the sake of convenience, the left side edge portion E1 indicating the left side of the quadrilateral and the right side The right-side edge portion E2 indicating the above is described as the edge portion E.

The second image P12 is, for example, an image including a left side edge image PE1 showing a left side edge part E1 of a square pattern and a right side edge image PE2 showing a right side edge part E2 as shown in FIG. Here, an edge portion (which may be simply expressed as an edge or an edge region) is a portion where the brightness (for example, luminance) of adjacent or neighboring pixels in the image changes suddenly. For example, the edge portion E is a portion including a high frequency component in the image (for example, the first image P11). For example, the edge portion E is a portion extracted by a filter (for example, a band pass filter) that allows a predetermined frequency component to pass through the image (for example, the first image P11). For example, the edge portion E indicates a theoretical line segment having no width on the left side or the right side of the quadrangle shown in FIG. 3 and, for example, around the edge having a finite width corresponding to the resolution of the second display unit 12. The area is also shown. The second image P12 includes a left eye image P12L displayed by the left eye display unit 12L of the second display unit 12, and a right eye image P12R displayed by the right eye display unit 12R of the second display unit 12. included. The left-eye image P12L is an image including a left-side edge image PE1L and a right-side edge image PE2L. This right-eye image P12R is an image including a left-side edge image PE1R and a right-side edge image PE2R. Since the left-eye image P12L and the right-eye image P12R are the same image, in the following description, the two images P12 will be collectively referred to unless otherwise distinguished.

Next, a configuration in which the display device 10 displays the first image P11 and the second image P12 in association with each other will be described with reference to FIG. FIG. 5 is a schematic diagram illustrating an example of an image displayed by the display device 10 according to the present embodiment.
The first display unit 11 displays the first image P11 as a virtual image in the (+ Z) direction so that the viewer 1 can visually recognize it. In addition, the second display unit 12 displays the second image P12 in the (+ Z) direction so that the viewer 1 can visually recognize it. The second image P12 is displayed at a position that is a predetermined distance Lp away from the position where the first image P11 is displayed in the (+ Z) direction. As described above, the second display unit 12 is a display unit included in the transmissive head mounted display 50 that transmits light. Therefore, the first image P11 displayed on the first display unit 11 and the second image P12 displayed on the second display unit 12 are visually recognized by the observer 1 so as to overlap each other. Here, the predetermined distance Lp is a distance between the depth position where the first image P11 is displayed and the depth position where the second image P12 is displayed. Here, the depth position is a position in the Z-axis direction. The predetermined distance Lp is determined in advance based on the depth position where the first image P11 is displayed and the depth position of the observer 1.

Here, the first image P11 displayed by the first display unit 11 and the second image P12 displayed by the second display unit 12 are images whose display timings are synchronized with each other. For example, when the first image P11 and the second image P12 are moving images, the second display unit 12 synchronizes with the display timing of the first image P11 displayed by the first display unit 11, and A second image P12 corresponding to the first image P11 is displayed.

Further, as shown in FIG. 5, the second display unit 12 is for the left eye edge portion E1 in the first image P11 displayed by the first display unit 11 and for the left eye corresponding to the edge portion. The left-eye image P12L is displayed so that the left-side edge image PE1L of the image P12L is visually recognized correspondingly. Similarly, the second display unit 12 includes the right side edge portion E2 in the first image P11 displayed by the first display unit 11, and the right side edge image of the right eye image P12R corresponding to the edge portion. The right-eye image P12R is displayed so that the PE2R is visually recognized correspondingly.

That is, the left eye display unit 12L of the second display unit 12 is visually recognized so that at least a part of the first image P11 and the left side edge image PE1L overlap the left eye L of the viewer 1. The left-eye image P12L as a virtual image is displayed. Further, the left eye display unit 12L is visually recognized so that at least a part of the first image P11 and the right side edge image PE2L of the left eye image P12L overlap the left eye L of the viewer 1. The left-eye image P12L as a virtual image is displayed. For example, when a person image is displayed in the first image P11 and an edge image PE indicating the contour of the person is displayed in the left eye image P12L, the left eye display unit 12L The left-eye image P12L is displayed so that the edge image PE is visually recognized only on the contour portion of the person's hand. In this case, the left eye display unit 12L may not display the edge image PE for a portion other than the hand of the person. In this case, the left-eye display unit 12L may not display the edge image PE displayed on the part other than the hand of the person so as to overlap the part other than the hand.

Specifically, the left eye display unit 12L of the second display unit 12 is connected to the left eye L of the viewer 1 on the (−X) side (that is, the (−X) side of the square left side edge portion E1 indicated by the first image P11). The left-eye image P12L as a virtual image is displayed so that the left-side edge portion E1 and the left-side edge image PE1L of the left-eye image P12L are visually recognized on the outside of the rectangle. Further, the left eye display unit 12L is connected to the left eye L of the observer 1 on the (−X) side (that is, inside the rectangle) of the right edge portion E2 of the quadrangle indicated by the first image P11. The left-eye image P12L as a virtual image is displayed so that E2 and the right-side edge image PE2L of the left-eye image P12L are visually recognized. Similarly, the right eye display unit 12R of the second display unit 12 is connected to the right eye R of the viewer 1 on the (+ X) side of the right edge portion E2 of the quadrangle indicated by the first image P11 (that is, outside the quadrangle). ), The right eye image P12R as a virtual image is displayed so that the right edge portion E2 and the right edge image PE2R of the right eye image P12R are visually recognized. In addition, the right eye display unit 12R is connected to the right eye R of the viewer 1 on the (+ X) side (that is, inside the rectangle) of the left edge portion E1 of the quadrangle shown by the first image P11. The right-eye image P12R as a virtual image is displayed so that the left-side edge image PE1R of the right-eye image P12R overlaps and is visually recognized. In this way, the second display unit 12 (display unit) transmits the light of the displayed first image P11 in the transmission direction and transmits the second image P12 corresponding to the first image P11. Display in the direction of.

Here, the first image P11 displayed by the first display unit 11 and the second image P12 displayed by the second display unit 12 are images having different sizes. Specifically, the interval between the left edge portion E1 and the right edge portion E2 of the first image P11 is different from the interval between the left edge image PE1L and the right edge image PE2L of the second image P12. For example, the interval (first interval) between the left edge portion E1 and the right edge portion E2 of the first image P11 is the interval (second interval) between the left edge image PE1L and the right edge image PE2L of the second image P12. The interval is wider than the interval. When the first display unit 11 and the second display unit 12 see the first image P11 and the second image P12 superimposed from the position of the left eye L of the user 1, the first display unit 11 and the second display unit 12 The first image P11 and the second image P12 are displayed such that the apparent intervals are the same. That is, the first display unit 11 and the second display unit 12 have the same apparent size when the first image P11 and the second image P12 are viewed from the position of the left eye L of the user 1. Thus, the first image P11 and the second image P12 are displayed. At this time, when the first display unit 11 and the second display unit 12 view the first image P11 and the second image P12 in an overlapping manner from the position of the left eye L of the user 1, the first image P11. May be displayed slightly larger than the apparent size of the second image P12. In addition, the first display unit 11 and the second display unit 12 display the first image P11 when the first image P11 and the second image P12 are viewed from the position of the left eye L of the user 1. The image may be displayed with the apparent size slightly smaller than the apparent size of the second image P12.

Next, a mechanism in which the observer 1 recognizes a stereoscopic image (three-dimensional image) from the first image P11 and the second image P12 will be described. First, the observer 1 observes the first image P11 and the edge image PE corresponding to the edge portion E of the first image P11 at a position where the corresponding portions of these images overlap. Thereby, the observer 1 perceives an image at a depth position between the display surfaces in accordance with the luminance ratio between the first image P11 and the edge image PE. For example, when the observer 1 observes a quadrilateral pattern, there is a minute brightness step that cannot be recognized on the retina image of the observer 1. In such a case, a virtual edge is perceived between steps of brightness (for example, luminance) and recognized as one object. At this time, the observer 1 seems to change the depth position of the image by causing a slight shift in the virtual edge recognized by the left eye L and the right eye R and perceiving it as binocular parallax. Recognized. Next, this mechanism will be described in detail with reference to FIGS.

FIG. 6 is a schematic diagram illustrating an example of the optical image IM in the present embodiment. Here, the optical image IM is an image in which the first image P11 and the second image P12 are visually recognized by the observer 1. The optical image IM includes an optical image IML visually recognized by the left eye L of the observer 1 and an optical image IMR visually recognized by the right eye R of the observer 1.
First, the optical image IML visually recognized by the left eye L of the observer 1 will be described. As shown in FIG. 6, in the left eye L of the viewer 1, the first image P11L visually recognized by the left eye L and the left eye image P12L among the second images P12 are combined. An image IML is formed. Specifically, as described with reference to FIG. 5, in the left eye L, on the (−X) side (that is, outside the rectangle) of the left edge portion E1 of the rectangle shown by the first image P11. Then, an optical image IML formed by combining the image indicating the left side edge portion E1 and the left side edge image PE1L is formed. In the left eye L, an image showing the right edge portion E2 and a right edge image PE2L on the (−X) side of the square right edge portion E2 shown by the first image P11 (that is, inside the rectangle) An optical image IML synthesized with is formed.

Next, the brightness distribution of the optical image IML visually recognized by the left eye L in the case of FIG. 6 will be described with reference to FIG. FIG. 7 is a graph showing an example of the brightness distribution of the optical image IM in the present embodiment. Here, the X coordinates X1 to X6 shown in FIG. 7 are the X coordinates corresponding to the brightness change points of the optical image IM. Here, the case of the brightness value BR will be described as an example of the brightness of the image. The first image P11L visually recognized by the left eye L will be described assuming that the brightness value BR is zero at the X coordinates X1 to X2. Further, the first image P11L has the luminance value BR2 at the X coordinates X2 to X6. The left-eye image P12L has the luminance value BR1 at the X coordinates X1 to X2 and the X coordinates X4 to X5, and zero at the X coordinates X2 to X4. Accordingly, the brightness (for example, luminance) of the optical image IML visually recognized by the left eye L becomes the luminance value BR1 at the X coordinates X1 to X2. The brightness of the optical image IML is the brightness value BR2 at the X coordinates X2 to X4 and the X coordinates X5 to X6, and the brightness obtained by combining the brightness value BR1 and the brightness value BR2 at the X coordinates X4 to X5. It becomes a certain luminance value BR3.

Next, a mechanism in which the edge portion is visually recognized by the left eye L of the observer 1 will be described.
FIG. 8 is a graph showing an example of binocular parallax that occurs in the left eye L and right eye R in the present embodiment. The distribution of brightness of the image recognized by the viewer 1 by the optical image IML formed on the retina of the left eye L is as shown by the waveform WL in FIG. Here, the observer 1 is, for example, the edge portion of the object viewing the position on the X-axis where the change in the brightness of the visually recognized image is maximized (that is, the inclination of the waveform WL is maximized). Recognize that In the present embodiment, the observer 1, for example, the waveform WL in the left eye L side, and viewing the position of the X _EL shown in FIG. 8 (i.e., the distance L _EL from the origin O of the X-axis position) It is recognized as an edge part on the left side of the rectangle.

So far, the optical image IML recognized by the left eye L of the observer 1 has been described. Next, the difference between the optical image IMR visually recognized by the right eye R of the observer 1 and the optical image IML will be described, and the mechanism for recognizing a stereoscopic image (three-dimensional image) based on the difference will be described again. 6 to 8 will be described. As shown in FIG. 6, in the right eye R of the observer, an optical image IMR formed by combining the first image P11R visually recognized by the right eye R and the right eye image P12R is formed. Further, as shown in FIG. 7, the brightness (for example, the luminance value BR) of the optical image IMR visually recognized by the right eye R is visually recognized by the left eye L at the X coordinates X1 to X3 and the X coordinates X4 to X6. This is different from the brightness of the optical image IML. With the optical image IMR synthesized on the retina of the right eye R, the brightness distribution of the image recognized by the observer 1 is as shown by the waveform WR in FIG. Here, for example, the observer 1 visually _recognizes the position of the _XER shown in FIG. 8 (that is, the position of the distance _LER from the origin O of the X axis) for the waveform WR on the right eye R side. Recognize that it is a part. Thus, the observer 1 recognizes the position X _EL of the edge portion of the square left eye L is viewing, and a position X _ER of the edge portion of the square right eye R is visually recognized as binocular parallax. Then, the observer 1 recognizes the quadrangular image as a stereoscopic image (three-dimensional image) based on the binocular parallax of the edge portion.

As described above, the display device 10 according to the present embodiment includes the first display unit 11 that displays the first image P11 and the second display unit 12 that displays the second image P12. The second display unit 12 is a transmissive display unit that is attached in front of the eyes of the observer 1 and is capable of transmitting incident light. The second display unit 12 includes a first image P11 displayed by the first display unit 11. The light is transmitted in the transmission direction, and the second image P12 corresponding to the first image P11 is displayed in the transmission direction. Thus, the display device 10 displays the second image P12 set according to the position of the observer 1 with respect to the first display unit 11 on the second display unit 12 that is the head mounted display 50. Thereby, the display apparatus 10 can set and display the 2nd image P12 for every position of the observer 1. FIG. Therefore, the display device 10 can display the second image P12 corresponding to the position of the observer 1 for each position of the observer 1. That is, the display device 10 can set a wide range that the observer 1 can recognize as a stereoscopic image.

In general, when the displayed image is a three-dimensional image (three-dimensional image) using binocular parallax, the thickness of the object to be displayed is less likely to be recognized by the observer 1, so-called “scribing effect” May occur. On the other hand, the display device 10 displays the first image P11 and the second image P12 according to the luminance ratio between corresponding pixels of the first image P11 and the second image P12, thereby allowing the viewer 1 to Display an image. That is, the display device 10 can display a stereoscopic image to the observer 1 even if the first image P11 and the second image P12 are both planar images (two-dimensional images). Thereby, the display apparatus 10 can display the three-dimensional image in which the thickness of the object to be displayed is easily recognized by the observer 1 by reducing the writing effect.

Furthermore, the display device 10 can display an image that allows the observer 1 to recognize a stereoscopic image even if the first display unit 11 is a two-dimensional display device. Therefore, the display device 10 can display the first image P11 as a planar image (two-dimensional image) on the first display unit 11 for an observer who is not wearing the second display unit 12. That is, the display device 10 simultaneously displays a stereoscopic image for the observer 1 wearing the head mounted display 50 and a planar image for the observer not wearing the head mounted display 50. be able to. Thereby, the display device 10 can simultaneously display (screen) a stereoscopic image and a planar image in a movie theater, for example.

Further, the second image P12 displayed by the second display unit 12 of the present embodiment includes an edge image PE indicating the edge portion E in the first image P11, and is displayed on the first display unit 11. The edge portion E in the image P11 and the edge image PE indicating the edge portion E are set so as to be viewed by the observer 1 in correspondence with each other. Thereby, the display apparatus 10 can display the edge image PE (that is, the edge portion) of the first image P11 and the second image P12 in an overlapping manner. In other words, the display device 10 according to the present embodiment affects the image other than the edge portion displayed on the first display portion 11 by the influence of the image (that is, the edge image PE) displayed on the second display portion 12. An image can be displayed without giving.

Here, if images having a ratio of brightness (for example, luminance) are displayed on the first display unit 11 and the second display unit 12, respectively, the first display unit 11 and the second display unit are displayed. 12 may affect the display accuracy of a three-dimensional image (three-dimensional image). In this case, in order to display a stereoscopic image (three-dimensional image) with high accuracy, display conditions (for example, brightness and color of the displayed image) of the first display unit 11 and the second display unit 12 are displayed. It is necessary to reduce the variation and to match the display conditions.

On the other hand, since the display device 10 of the present embodiment displays the edge image PE on the second display unit 12, the first display is performed even if the display conditions of the first display unit 11 and the second display unit 12 vary. The image other than the edge portion displayed on the portion 11 is not affected. Thereby, even if the display conditions of the first display unit 11 and the second display unit 12 do not exactly match, a stereoscopic image (three-dimensional image) can be displayed with high accuracy. That is, the display device 10 of the present embodiment can display a stereoscopic image (three-dimensional image) with high accuracy.

In addition, since the display device 10 according to the present embodiment only needs to display the edge image PE on the second display unit 12, as compared with the case where an image other than the edge image PE is also displayed on the second display unit 12. Power consumption can be reduced.

Further, as shown in FIG. 8, the observer 1 recognizes a step change in the brightness (for example, luminance) of the image as a smooth change in brightness such as the waveform WL and the waveform WR. For this reason, the display apparatus 10 of this embodiment can make the observer 1 recognize a stereoscopic image even when the definition of the edge image PE is low. Here, the definition is, for example, the number of pixels constituting an image. Thereby, the display device 10 of the present embodiment can reduce the definition of the second display unit 12 as compared with the definition of the first display unit 11. That is, the display device 10 of the present embodiment can configure the second display unit 12 with an inexpensive display device.

In addition, the display device 10 of the present embodiment is configured so that the edge portion in the first image P11 displayed by the first display unit 11 and the edge image PE are visually recognized correspondingly. P11 and the second image P12 are displayed. Thereby, each image displayed by the display device 10 of the present embodiment is visually recognized so that the edge portion in the first image P11 and the edge image PE are not separated by the observer 1. Therefore, the display device 10 of the present embodiment can display a stereoscopic image with high accuracy.

Further, the display device 10 of the present embodiment displays a stereoscopic image by displaying these images without reducing the contrast of the left-eye image P12L and the right-eye image P12R in the second image P12. It can be displayed with high accuracy. Further, in the display device 10 of the present embodiment, even if there is an overlapping range between the brightness range in which the left-eye image P12L is displayed and the brightness range in which the right-eye image P12R is displayed. These images can be displayed. For example, the display device 10 according to the present embodiment displays a stereoscopic image with high accuracy even when the brightness at which the left-eye image P12L is displayed matches the brightness at which the right-eye image P12R is displayed. be able to. That is, the display device 10 of the present embodiment can display a stereoscopic image with high accuracy without considering the relationship between the pixel values of the left-eye image P12L and the right-eye image P12R.

[Second Embodiment]
Hereinafter, a second embodiment of the present invention will be described with reference to FIGS. 9 and 10. In addition, about the same structure as 1st Embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.
FIG. 9 is a schematic diagram illustrating an example of the left-eye parallax image P12aL. FIG. 10 is a schematic diagram illustrating an example of the right-eye parallax image P12aR. The display device 10a displays the second image P12a on the second display unit 12. The second image P12a includes a left-eye image P12L and a right-eye image P12R that have binocular parallax with each other. The left-eye display unit 12L of the second display unit 12 of the display device 10a displays the left-eye parallax image P12aL as the left-eye image P12L, and the right-eye display unit 12R uses the right-eye parallax image P12aR for the right eye. Displayed as an image P12R. This left-eye image P12L is shifted in the (+ X) direction by a distance LaL from the left-side edge image PE1 and the right-side edge image PE2 indicated by the edge image PE included in the second image P12 described in the first embodiment. An edge image PE1aL and an edge image PE2aL are included. Similarly, the right-eye image P12R includes an edge image PE1aR and an edge image PE2aR that are shifted in the (−X) direction by a distance LaR from the left-side edge image PE1 and the right-side edge image PE2. In this way, the second display unit 12 displays the left-eye image P12L and the right-eye image P12R that have binocular parallax.

As described above, the second image P12a includes the left-eye parallax image P12aL and the right-eye parallax image P12aR that have binocular parallax, and the second display unit 12 displays the left eye L of the viewer 1 The left-eye parallax image P12aL is displayed on the right eye R, and the right-eye parallax image P12aR is displayed on the right eye R. Thereby, the display device 10a can set the depth position of the image of the edge image PEa visually recognized by the observer 1 with the second image P12a based on the binocular parallax of the second image P12a. In other words, the display device 10a displays a second image P12a with binocular parallax in the cross direction on the second display unit 12 so that a stereoscopic image visually recognized by the observer 1 is displayed on the first display unit 11 ( + Z) direction side. In addition, the display device 10a displays a second image P12a with binocular parallax in the non-intersecting direction on the second display unit 12 so that a stereoscopic image visually recognized by the observer 1 is displayed on the first display unit 11 ( -Z) Can be set on the direction side. As described above, the display device 10a can set the depth position of the stereoscopic image visually recognized by the observer 1 over a wide range, as compared with the case where the binocular parallax is not added to the second image P12a. That is, the display device 10a can enhance the stereoscopic effect of the stereoscopic image visually recognized by the observer 1.

[Third Embodiment]
Hereinafter, a third embodiment of the present invention will be described with reference to FIGS. 11 and 12. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.
First, an example of the configuration of the display device 10b will be described with reference to FIG. FIG. 11 is a configuration diagram illustrating an example of a configuration of a display system 100b including the display device 10b according to the present embodiment. The image information supply device 2 supplies the first image information to the display device 10b. Here, the first image information is information for displaying the first image P11 displayed by the first display unit 11 of the display device 10b.

The first image information includes depth position information indicating the depth position when the display device 10b displays the first image P11 in three dimensions. The display device 10b changes the position of the edge image PE indicating the edge portion based on the depth position information. Accordingly, the display device 10b sets the sense of depth of the first image P11 that is felt when the observer 1 sees the first image P11 and the second image P12 including the edge image PE in an overlapping manner. For example, the display device 10b sets the position of the edge image PE outside or inside the position of the edge portion of the first image P11. Thereby, the display device 10b sets binocular parallax of the edge portion, and sets a sense of depth that the viewer 1 feels when viewing the first image P11 and the second image P12 in an overlapping manner. Next, the setting of the feeling of depth by the display device 10b will be described.

The display device 10b includes a setting unit 13. The setting unit 13 sets the second image P12 corresponding to the first image P11 based on the first image information supplied from the image information supply device 2, and indicates the set second image P12. The second image information is supplied to the second display unit 12. Specifically, the setting unit 13 acquires first image information including the depth position information of the first image P11 from the image information supply device 2. Then, the setting unit 13 extracts an edge portion from the acquired first image information with a known configuration. Then, the setting unit 13 generates an edge image PE indicating the extracted edge portion, and supplies second image information indicating the generated edge image PE to the second display unit 12. Here, for example, the setting unit 13 extracts an edge portion by applying a differential filter such as a Laplacian filter to the acquired image information.

Next, the operation of the display device 10b in the present embodiment will be described with reference to FIG. FIG. 12 is a flowchart showing an example of the operation of the display device 10b in the present embodiment.
First, the first display unit 11 of the display device 10b acquires image information from the image information supply device 2 (step S110). The setting unit 13 of the display device 10b acquires image information from the image information supply device 2 (step S120). The first image information supplied by the image information supply device 2 includes position information indicating the depth position of the first image P11. Here, the position information indicating the depth position of the first image P11 is information added to the image information in order for the first image P11 to be recognized as a stereoscopic image by the observer 1, for example, left This is information for setting binocular parallax between the eye L and the right eye R. For example, when the depth position of the first image P11 is set from the position where the first image P11 is displayed (the position of the origin O of the Z axis) to the back direction (−Z direction), Position information that increases the binocular parallax compared to the binocular parallax at the position of the origin O is added to the image information.

Next, the setting unit 13 generates and generates the second image P12 including the edge image PE indicating the edge portion in the first image P11 based on the first image information acquired in step S120. Second image information indicating the second image P12 is output to the second display unit 12 (step S122).

Next, the 1st display part 11 produces | generates the 1st image P11 based on the 1st image information acquired in step S110, displays the produced | generated 1st image P11, and complete | finishes a process ( Step S113).
The second display unit 12 acquires the second image information output from the setting unit 13 in step S122 and displays the second image P12 based on the acquired second image information. The process ends (step S123) (the display procedure from step S110 to step S123 is described above).

As described above, the display device 10b includes the setting unit 13 that sets the second image P12 corresponding to the first image P11 based on the input image information of the first image P11. Thereby, the display device 10b of the present embodiment can display a stereoscopic image (three-dimensional image) without receiving the supply of the edge image PE from the image information supply device 2.

The setting unit 13 sets the relative position between the first image P11 and the second image P12 based on the pixel value of the pixel indicating the edge portion E in the first image P11, and the second image The image P12 may be set. Here, since the display device 10b displays the first image P11 and the second image P12 in an overlapping manner, the optical image IM that is an image in which the first image P11 and the second image P12 are overlapped is bright. May be too much. In this case, the optical image IM may be difficult to be recognized as a stereoscopic image because the edge portion E is conspicuous and is visually recognized by the observer 1. Therefore, the setting unit 13 determines the position of the edge image PE included in the second image P12 based on the pixel value (for example, the luminance value of the pixel) of the pixel indicating the edge portion E in the first image P11. The second image P12 is set by being shifted relative to the edge portion E in the first image P11. For example, when the sum of the luminance value of the pixel indicating the edge portion E in the first image P11 and the luminance value of the pixel of the edge image PE included in the second image P12 exceeds a predetermined threshold value Sets the second image P12 by shifting the position of the edge image PE by a predetermined distance. Thereby, the display apparatus 10b of this embodiment can reduce the discomfort of the observer 1 by only an edge part conspicuous, and can display a three-dimensional image (three-dimensional image) with high precision.

The setting unit 13 may be provided in the second display unit 12 or the image information supply device 2. In this case, since the display device 10 does not have to include the setting unit 13 independently, the configuration of the display device 10 can be simplified.

[Fourth Embodiment]
Hereinafter, a fourth embodiment of the present invention will be described with reference to FIG. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted. FIG. 13 is a configuration diagram illustrating an example of a configuration of a display system 100c including the display device 10c according to the present embodiment. The display system 100c includes a first display unit 11c and a setting unit 13c.
The first display unit 11 c includes a position detection unit 14. The position detection unit 14 includes a face detection sensor that detects the direction of the face of the observer 1, and the first display surface of the second display unit 12 included in the head-mounted display 50 worn by the observer 1. A face detection sensor detects the relative position of the display unit 11c to the display surface (first display surface 110). That is, the position detection unit 14 detects a relative position between the first display surface 110 on which the first image P11 is displayed and the display surface of the second display unit 12 on which the second image P12 is displayed.

As an example, the relative position is a depth position of the display surface of the second display unit 12 with the first display surface 110 as a reference position. In this example, the position detection unit 14 has a depth position on the display surface of the second display unit 12 on which the second image P12 is displayed with the first display surface 110 on which the first image P11 is displayed as a reference position. Is detected.

The setting unit 13c sets the second image P12 by setting the relative position between the first image P11 and the second image P12 based on the information indicating the relative position detected by the position detection unit 14. Specifically, the setting unit 13 corresponds to the first image P11 and the edge image PE based on the detection result obtained by detecting the relative position of the display surface of the second display unit 12 by the position detection unit 14. The second image P12 is set so as to be displayed.

More specifically, the setting unit 13c determines the distance between the first image P11 and the second image P12 based on information indicating the depth position of the display surface of the second display unit 12 detected by the position detection unit 14. Set the second image P12. That is, the setting unit 13 displays the first image P11 and the edge image PE in correspondence with each other based on the detection result obtained by detecting the depth position of the display surface of the second display unit 12 by the position detection unit 14. Thus, the second image P12 is set.

As described above, the display device 10c of the present embodiment has the setting unit 13c, the display surface of the first display unit 11c on which the first image P11 is displayed, and the second image P12 on which the second image P12 is displayed. A position detection unit 14 that detects a relative position of the display unit 12 to the display surface is provided. The setting unit 13c sets the second image P12 by setting the relative position between the first image P11 and the second image P12 based on the information indicating the relative position detected by the position detection unit 14. To do. Thereby, the display device 10c displays a stereoscopic image (three-dimensional image) not only for the observer 1 at a predetermined depth position but also for the observer 1 at a depth position other than the predetermined depth position. Can do. That is, the display device 10c can display a stereoscopic image (three-dimensional image) over a wide range.

Furthermore, when the depth position of the detected observer 1 moves, the display device 10 according to the present embodiment performs the first operation on the observer 1 at the moved depth position based on the detection result. The image P11 and the edge image PE can be displayed in correspondence with each other. That is, the display device 10 of the present embodiment can display a stereoscopic image following the depth position of the moving observer 1.

[Modification]
Next, a modification of the present embodiment will be described with reference to FIG.
FIG. 14 is a schematic diagram illustrating an example of setting of the setting unit 13c in a modification of the present embodiment. First, the relative position between the first display surface 110 and the display surface of the second display unit 12 detected by the position detection unit 14 will be described. The position detection unit 14 detects a distance Lp between the first display surface 110 and the display surface of the second display unit 12. Further, the position detection unit 14 detects an angle θ1 formed by a line segment CL connecting the reference point SP1 on the first display surface 110 and the reference point SP2 on the display surface of the second display unit 12 and the Z axis. Here, the reference point SP1 is a center point on the first display surface 110. The reference point SP2 is the center point on the display surface of the second display unit 12. Further, the position detection unit 14 detects an angle θ2 formed by the line segment CL and the normal line NV of the display surface of the second display unit 12. That is, the position detection unit 14 detects the distance Lp, the angle θ1 and the angle θ2 as relative positions between the first display surface 110 and the display surface of the second display unit 12.

The setting unit 13c, for example, based on the detection result (distance Lp, angle θ1, and angle θ) acquired from the position detection unit 14, the position of the edge image PE included in the second image P12, and the edge image PE The image conversion method (for example, projective conversion or affine conversion) is set. That is, the setting unit 13c sets the relative position based on the detection result so that the first image P11 and the edge image PE are visually recognized correspondingly. Further, the display state includes image conversion (for example, projective conversion or affine conversion) of the edge image PE, and the setting unit 13c corresponds to the first image P11 and the edge image PE based on the detection result. The image conversion method of the edge image PE is set so that it can be visually recognized.

As described above, the position detection unit 14 in the present modification has not only a relative position in the depth direction (Z-axis direction) but also a direction (X-axis direction and Y-axis) parallel to the display surface of the first display unit 11c. )) Relative position is detected. As a result, the setting unit 13c sets the relative position between the first image P11 and the second image P12 based on the information indicating the relative position detected by the position detection unit 14, and sets the second image P12. Set. As a result, the display device 10c provides not only the viewer 1 at the front position of the first display unit 11c but also the viewer 1 at a position other than the front of the first display unit 11c. Dimensional image) can be displayed. That is, the display device 10c can display a stereoscopic image (three-dimensional image) over a wide range.

Furthermore, when the position of the detected observer 1 moves, the display device 10 of the present modification example uses the first image P11 for the observer 1 at the moved position based on the detection result. And the edge image PE can be displayed in correspondence with each other. That is, the display device 10 of the present modification can display a stereoscopic image following the position of the moving observer 1.

In the present embodiment and its modification, the setting unit 13c sets the edge thickness of the edge image PE to a thickness corresponding to the relative position based on information indicating the relative position detected by the position detection unit 14. May be. The edge image PE may be recognized by the viewer 1 when the viewer 1 is at a position other than the front of the first display unit 11c. When the observer 1 recognizes the edge image PE, the first image P11 may not be visually recognized as a stereoscopic image. Therefore, the display device 10c sets the edge thickness of the edge image PE to a thickness corresponding to the relative position. Thereby, the display device 10c can prevent the observer 1 from visually recognizing the edge image PE even when the observer 1 is at a position other than the front of the first display unit 11c. That is, the display device 10c can display a stereoscopic image (three-dimensional image) over a wide range.

In addition, although the 2nd display part 12 demonstrated the example which displays the 2nd image P12 containing edge image PE, it is not restricted to this. The second display unit 12 has the pixel value of the pixel of the second image P12 visually recognized by the observer 1 corresponding to the pixel of the first image P11 at the depth position of the stereoscopic image visually recognized by the observer 1. The second image P12 set accordingly may be displayed. Here, the pixel value includes the luminance value of the pixel. The image visually recognized by the viewer 1 corresponding to the pixels of the first image P11 is an image obtained by projecting the first image P11 onto the display surface of the second display unit 12. In this case, the observer 1 projects the first image P11, and the second image P12 in which the pixel value of each pixel is set to a luminance different from the pixel value of each pixel of the first image P11. And the first image P11 are visually recognized. Thus, the 2nd display part 12 can display the 2nd image P12 from which the observer 1 can visually recognize a precise three-dimensional image. That is, the display device 10 can display a precise stereoscopic image.

It should be noted that the first display unit 11 of the display device 10 in the present embodiment and its modification may be a stereoscopic display device capable of stereoscopic display (three-dimensional display). In this case, the first display unit 11 displays a stereoscopic image of the first image P11 at a depth position corresponding to the input image information. That is, the display device 10 displays the edge portion in the first image P11 that is stereoscopically displayed and the edge image PE corresponding to the edge portion so as to be visually recognized by the observer 1. be able to. Thereby, the display apparatus 10 can set the depth position of the stereoscopic image recognized by the observer 1 in a wide range. That is, the display device 10 according to the present embodiment and the modification thereof can further enhance the stereoscopic effect recognized by the observer 1 from the stereoscopic image of the first image P11.

In each of the above-described embodiments and modifications thereof, the second image P12 is, for example, an image as illustrated in FIG. 4, but is not limited thereto. For example, the second image P12 may be a second image P12 including an edge image PE indicating upper and lower edge portions in addition to the left and right edge portions of the first image P11. The second image P12 may be an image showing an edge portion in which each side of the quadrangle indicated by the first image P11 is an edge portion. Further, the second image P12 may be an image including an edge image PE in which the edge portion is shown in a broken line shape. Further, the second image P12 may be an image including an edge image PE that shows an edge portion in a subjective contour shape. Here, the subjective contour is a contour that is recognized by the observer 1 so that the contour line exists even though the contour line does not exist. Thereby, the second display unit 12 of the display device 10 does not need to display all the images showing the edge portions, and can reduce power consumption compared to the case where the images showing all the edge portions are displayed. Can do.
The second image P12 may be displayed with a predetermined brightness (for example, luminance) inside the edge portion. Thereby, the display device 10 can increase the brightness of the first image P11 without changing the first image P11.

[Fifth Embodiment]
Hereinafter, a fifth embodiment of the present invention will be described with reference to FIG. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted. FIG. 15 is a block diagram showing an example of the configuration of a display system 100d according to the fifth embodiment of the present invention. The display system 100d includes a portable display device 50d as the display device 10d.

The portable display device 50d is a handheld display device that is portable by the observer 1, and includes a second display unit 12d, a setting unit 13d, and an imaging unit 15.

The imaging unit 15 includes a stereo video camera having a left light receiving unit 15L and a right light receiving unit 15R. The image capturing unit 15 captures an image that passes through the second display unit 12d as the first image P11, and the depth position of the captured image. Image information including information is generated. Specifically, the left light receiving unit 15L receives light of the first image P11L visually recognized by the left eye L of the first image P11. The right light receiving unit 15R receives the light of the first image P11R visually recognized by the right eye R of the first image P11. The imaging unit 15 generates depth position information of an image captured by a known configuration based on the light images received by the left light receiving unit 15L and the right light receiving unit 15R, and image information including the generated depth position information. Is generated.

The setting unit 13d sets a second image P12 corresponding to the first image P11 based on the image information generated by the imaging unit 15, and sets the second image information indicating the set second image P12. It supplies to the 2nd display part 12d. Specifically, the setting unit 13d acquires depth position information from information on an image captured by the imaging unit 15. Next, the setting unit 13d extracts an edge portion with a known configuration from the acquired first image information. Next, the setting unit 13d generates an edge image PE indicating the extracted edge portion, and supplies second image information indicating the generated edge image PE to the second display unit 12d. Here, for example, the setting unit 13d extracts an edge portion by applying a differential filter such as a Laplacian filter to the acquired image information. And the setting part 13d sets the display position of the extracted edge part based on the acquired depth position information, and sets the 2nd image P12.

The second display unit 12d includes a transmissive display capable of transmitting incident light, transmits the first image P11, and displays second image information indicating the second image P12 set by the setting unit 13d. Based on the above, the second image P12 is displayed. Here, the second display unit 12d displays a real image corresponding to the first image P11 as the second image P12.

As described above, the portable display device 50d as the display device 10d of the present embodiment includes the second display unit 12d, the setting unit 13c, and the imaging unit 15. Accordingly, the display device 10d can display the second image P12 with the position where the second image P12 is displayed positioned away from the eye of the observer 1. Therefore, the display device 10d can display the second image P12 in correspondence with the first image P11 without a configuration for displaying a virtual image. That is, the configuration of the second display unit 12 can be simplified as compared with the case where the second display unit 12 displays a virtual image.

Note that the imaging unit 15 may include a video camera having one of the left light receiving unit 15L and the right light receiving unit 15R. In this case, the setting unit 13d acquires information specifying the depth position input by the user, and based on information specifying the acquired depth position from among a plurality of preset depth position information. Select depth position information. Next, the setting unit 13d acquires the first image information from the imaging unit 15, and extracts an edge portion from the acquired first image information with a known configuration. Then, the setting unit 13d sets the display position of the extracted edge portion based on the selected depth position information, and sets the second image P12. Even with this configuration, the display device 10d can display the second image P12 without a configuration for displaying a virtual image. That is, the configuration of the second display unit 12 can be simplified as compared with the case where the second display unit 12 displays a virtual image.

[Sixth Embodiment]
Hereinafter, the sixth embodiment of the present invention will be described with reference to FIGS. 16 to 17. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 16 is a configuration diagram illustrating an example of a configuration of a display system 100e including the display device 10e according to the present embodiment. The display system 100e includes a first display unit 11e and a second display unit 12e. In the first embodiment described above, the second display unit 12 is a head mounted display, whereas in the display system 100e, the first display unit 11e is a head mounted display. Different from form. That is, in the display system 100e, the first display unit 11e, which is a head-mounted display, displays the first image P11, and the second display unit 12e displays the edge image PE.

The image information supply device 2 supplies the first image information to the first display unit 11e and also supplies the second image information to the second display unit 12e. Here, the first image information is information for displaying the first image P11 displayed on the first display unit 11e. The second image information is information for displaying the second image P12 displayed on the second display unit 12e, and is image information of the edge image PE generated based on the first image information. . This edge image PE is an image showing the edge portion E in the first image P11. As will be described later with reference to FIG. 17, the first image P11 includes image information indicating the left-eye image P11L and image information indicating the right-eye image P11R. 3 is different from the first image P11 shown in FIG. The edge image PE will be described later with reference to FIG. In the description so far, the first image P11L is the first image P11L visually recognized by the left eye L in the first image P11 shown in FIG. In the following description, the first image P11L is the left-eye image P11L shown in FIG. In the description so far, the second image P12 is the second image P12 shown in FIG. 4 and includes the left-eye image P12L and the right-eye image P12R. In the following description, the second image P12L is a second image P12L visually recognized by the left eye L by the left eye second light flux R12L in the second image P12, as shown in FIG. . In the following description, as shown in FIG. 17, the second image P12R is a second image P12R that is visually recognized by the right eye R by the right eye second light flux R12R in the second image P12. It is.

The second display unit 12e includes a display surface 120 that displays an image in the (+ Z) direction, and displays the second image P12 based on the second image information acquired from the image information supply device 2. Display on surface 120. The second light beam R12 emitted from the second image P12 displayed on the display surface 120 is visually recognized as an optical image by the observer 1 sitting on the chair 3. This observer 1 sits on the chair 3 provided at a position away from the display surface 120 in the (+ Z) direction by a predetermined distance, and observes the display surface 120 in the −Z direction. The chair 3 fixes the position where the observer 1 observes the second display unit 12e, that is, the relative position between the first display unit 11e and the second display unit 12e.

Next, the first display unit 11e will be described.
The 1st display part 11e is a display part with which the head mounted display 50e with which the observer's 1 head is mounted | worn is equipped. The first display unit 11e displays a virtual image of the supplied first image P11 by an eyepiece optical system (not shown) and transmits incident light in a direction in which the first image P11 is displayed. The first display unit 11e includes a left eye display unit 11L and a right eye display unit 11R. That is, the first display unit 11e is different from the head mounted display 50 described with reference to FIG. 2 in that the first image P11 is displayed instead of the second image P12.

When the observer 1 wears the head mounted display 50e, the left eye display unit 11L receives the first image information supplied from the image information supply apparatus 2 so as to be visually recognized by the left eye L of the observer 1. The left-eye image P11L shown is displayed. Similarly, the right eye display unit 11R of the second display unit 12e is an image for the right eye indicated by the first image information supplied from the image information supply device 2 so as to be visually recognized by the right eye R of the observer 1. P11R is displayed.

Further, the first display unit 11e emits the second light beam R12 (light) of the second image displayed by the second display unit 12e when the observer 1 sits on the chair 3 and observes the second display unit 12e. Transmit in the transmission direction. Here, the transmission direction is the (+ Z) direction. That is, the left eye display unit 11L of the first display unit 11e transmits the left eye second light beam R12L of the incident second light beam R12. Similarly, the right eye display unit 11R of the first display unit 11e transmits the right eye second light beam R12R out of the incident second light beam R12.

Thus, the left-eye display unit 11L transmits the incident left-eye second light beam R12L and displays the left-eye image P11L to emit the left-eye first light beam R11L. The left eye first light beam R11L and the left eye second light beam R12L are visually recognized by the left eye L of the observer 1 who is observing the second display unit 12e in the (−Z) direction as corresponding optical images. Similarly, the right eye display unit 11R transmits the incident right eye second light beam R12R, displays the right eye image P11R, and emits the right eye first light beam R11R. That is, the right eye first light beam R11R and the right eye second light beam R12R are visually recognized by the right eye R of the observer 1 who is observing the second display unit 12e in the (−Z) direction as a corresponding optical image. The

Next, the first image P11 and the second image P12 of this embodiment will be described. Here, when an image is shown in the following drawings, a portion where the brightness of the image is bright (for example, high brightness) is shown thinly for convenience.

1st image P11 is an image which shows the square pattern shown, for example in FIG. Here, in the quadrilateral pattern indicated by the first image P11, the four sides constituting the quadrilateral can each be the edge portion E, but in the following description, for the sake of convenience, the left side edge portion E1 indicating the left side of the quadrilateral and The right side edge portion E2 indicating the right side will be described as the edge portion E.

The first image P11 includes a left eye image P11L displayed by the left eye display unit 11L of the first display unit 11e and a right eye image P11R displayed by the right eye display unit 11R of the first display unit 11e. included. That is, the first image P11 of this embodiment includes the left-eye image P11L and the right-eye image P11R in that the first image P11 of the present embodiment includes the first image P11 with reference to FIG. Different from the first image P11 described. Since the left-eye image P11L and the right-eye image P11R are the same image, in the following description, the two images are collectively referred to as the first image P11 unless otherwise distinguished.

The second image P12 is, for example, an image including a left-side edge image PE1 indicating the left-side edge portion E1 of the square pattern and a right-side edge image PE2 indicating the right-side edge portion E2. That is, the second image P12 of this embodiment does not include the left-eye image P12L and the right-eye image P12R, and the second image P12 of this embodiment refers to FIG. This is different from the second image P12 described above. Here, the edge portion E (which may be simply expressed as an edge or an edge region) is, for example, a portion where the brightness (for example, luminance) of adjacent or neighboring pixels in the image changes suddenly. For example, the edge portion E indicates a theoretical line segment having no width on the left side or the right side of the quadrangle, and also indicates, for example, a region around the edge having a finite width corresponding to the resolution of the second display unit 12e. ing.

Next, a configuration in which the display device 10e displays the first image P11 and the second image P12 in correspondence with each other will be described with reference to FIG. FIG. 17 is a schematic diagram illustrating an example of an image displayed by the display device 10e according to the present embodiment.

The first display unit 11e displays the first image P11 as a virtual image in the (+ Z) direction so that the viewer 1 can visually recognize it. The second display unit 12e displays the second image P12 in the (+ Z) direction so that the viewer 1 can visually recognize it. Then, the first image P11 is displayed at a position that is a predetermined distance Lp away from the position where the second image P12 is displayed in the (+ Z) direction. As described above, the first display unit 11e is a display unit included in the transmissive head mounted display 50e that transmits light. Therefore, the first image P11 displayed on the first display unit 11e and the second image P12 displayed on the second display unit 12e are visually recognized by the observer 1. Here, the predetermined distance Lp is a distance between the depth position where the first image P11 is displayed and the depth position where the second image P12 is displayed. Here, the depth position is a position in the Z-axis direction. The predetermined distance Lp is determined in advance based on the depth position where the first image P11 is displayed and the depth position of the observer 1.

As shown in FIG. 17, the second display unit 12e includes a left side edge part E1 in the left eye image P11L displayed by the left eye display unit 11L of the first display unit 11e, and the left side edge part E1. The second image P12 is displayed so that the left-side edge image PE1 corresponding to is visually recognized. Similarly, the second display unit 12e includes a right side edge portion E2 in the right eye image P11R displayed by the right eye display unit 11R of the first display unit 11e, and a right side corresponding to the right side edge portion E2. The second image P12 is displayed so that the edge image PE2 is visually recognized correspondingly.

That is, the left-eye display unit 11L of the first display unit 11e is connected to the left eye L of the viewer 1 on the (−X) side of the left-side edge portion E1 of the quadrangle indicated by the left-eye image P11L (that is, outside the quadrangle ), The left-eye image P11L as a virtual image is displayed so that the left-side edge portion E1 and the left-side edge image PE1 of the second image P12 overlap each other. Further, the left eye display unit 11L is connected to the left eye L of the observer 1 on the (−X) side (that is, the inner side of the rectangle) of the right edge portion E2 of the rectangle indicated by the left eye image P11L. The left-eye image P11L as a virtual image is displayed so that E2 and the right-side edge image PE2 of the second image P12 are visually recognized. Similarly, the right eye display unit 11R is connected to the right eye R of the observer 1 on the (+ X) side (that is, outside the rectangle) of the right edge portion E2 of the rectangle indicated by the right eye image P11R. The right-eye image P11R as a virtual image is displayed so that E2 and the right-side edge image PE2 of the second image P12 are visually recognized. Further, the right eye display unit 11R is connected to the right eye R of the observer 1 on the (+ X) side (that is, inside the rectangle) of the left edge portion E1 of the quadrangle shown by the right eye image P11R. The right-eye image P11R as a virtual image is displayed so that the left-side edge image PE1 of the second image P12 can be visually recognized. In this way, the first display unit 11e displays the supplied first image P11 as a virtual image by the eyepiece optical system, and displays the incident light of the second image P12 in the first image P11 direction. Make it transparent.

Next, a mechanism in which the observer 1 recognizes a stereoscopic image (three-dimensional image) from the first image P11 and the second image P12 will be described. First, the observer 1 observes the first image P11 and the edge image PE corresponding to the edge portion E of the first image P11 at a position where the corresponding portions of these images overlap. Thereby, the observer 1 perceives an image at a depth position between the display surfaces in accordance with the luminance ratio between the first image P11 and the edge image PE. For example, when the observer 1 observes a quadrilateral pattern, there is a minute brightness step that cannot be recognized on the retina image of the observer 1. In such a case, a virtual edge is perceived between steps of brightness (for example, luminance) and recognized as one object. At this time, the observer 1 seems to change the depth position of the image by causing a slight shift in the virtual edge recognized by the left eye L and the right eye R and perceiving it as binocular parallax. Recognized. Next, this mechanism will be described in detail.

Here, the optical image IM is an image in which the first image P11 and the second image P12 are visually recognized by the observer 1. The optical image IM includes an optical image IML visually recognized by the left eye L of the observer 1 and an optical image IMR visually recognized by the right eye R of the observer 1.

First, the optical image IML visually recognized by the left eye L of the observer will be described. As described with reference to FIG. 6, in the left eye L of the observer, the left-eye image P11L and the second image P12L visually recognized by the left eye L of the second images P12 are combined. The formed optical image IML is formed. Specifically, in the left eye L, an image showing the left side edge portion E1 and the left eye on the (−X) side (that is, outside the square) of the left side edge portion E1 of the quadrangle shown by the first image P11. An optical image IML formed by combining the left side edge image PE1L visually recognized by L is formed. In the left eye L, an image showing the right side edge portion E2 and the left eye L are visually recognized on the (−X) side (that is, inside the square) of the right side edge portion E2 of the quadrangle shown by the first image P11. The optical image IML synthesized with the right edge image PE2L is formed. The optical image IML of this embodiment is different from the optical image IML described with reference to FIG. 6 in that the first image P11L is at a depth position closer to the observer than the second image P12L. Next, the brightness distribution of the optical image IML visually recognized by the left eye L will be described.

Here, the case of the brightness value BR will be described as an example of the brightness of the image. Further, the left-eye image P11L will be described assuming that the luminance value BR is zero at the X coordinates X1 to X2. The left-eye image P11L has the brightness value BR2 at the X coordinates X2 to X6. The second image P12L visually recognized by the left eye L has the brightness value BR1 at the X coordinates X1 to X2 and the X coordinates X4 to X5, and zero at the X coordinates X2 to X4. Accordingly, the brightness (for example, luminance) of the optical image IML visually recognized by the left eye L becomes the luminance value BR1 at the X coordinates X1 to X2. The brightness of the optical image IML is the brightness value BR2 at the X coordinates X2 to X4 and the X coordinates X5 to X6, and the brightness obtained by combining the brightness value BR1 and the brightness value BR2 at the X coordinates X4 to X5. It becomes a certain luminance value BR3. Note that the mechanism by which the edge portion E is visually recognized by the left eye L of the observer 1 is the same as the mechanism described with reference to FIG. Further, the difference between the optical image IMR visually recognized by the right eye R of the observer 1 from the optical image IML and the mechanism for recognizing a stereoscopic image (three-dimensional image) based on the difference are also shown in FIG. Since it is the same as the difference and mechanism demonstrated with reference to FIG. 8, the description is abbreviate | omitted.

As described above, the display system 100 of this embodiment includes the first display unit 11e and the second display unit 12e. The first display unit 11e is mounted on the head of the observer 1 and displays the supplied first image P11 using an eyepiece optical system, and transmits incident light in a direction in which the first image P11 is displayed. Let In addition, the second display unit 12e displays a second image P12 indicating the edge portion E of the first image P11 displayed by the first display unit 11e. In this way, the display system 100 displays the first image P11 set according to the position of the observer 1 with respect to the second display unit 12e on the first display unit 11e provided in the head mounted display 50e. Thereby, the display system 100 can set and display the first image P11 for each position of the observer 1. Therefore, the display system 100 can display the first image P11 corresponding to the position of the observer 1 for each position of the observer 1. That is, the display system 100 can set a wide range that the observer 1 can recognize as a stereoscopic image.

Further, the display system 100 displays the edge image PE on the first display unit 11e. For this reason, only the edge image PE is displayed for the observer 1 who observes only the first display unit 11e without passing through the second display unit 12e. In this way, the display system 100 displays the edge image PE, that is, a low-quality image whose contents are difficult to understand, for the observer 1 who observes only the first display unit 11e. On the other hand, the display system 100 displays the second image P12 in addition to the edge image PE for the observer 1 who observes the first display unit 11e through the second display unit 12e. That is, the display system 100 can display a high-quality image for the observer 1 who observes the first display unit 11e through the second display unit 12e.

In general, when the displayed image is a three-dimensional image (three-dimensional image) using binocular parallax, the thickness of the object to be displayed is less likely to be recognized by the observer 1, so-called “scribing effect” May occur. On the other hand, the display system 100 displays the first image P11 and the second image P12 according to the luminance ratio between corresponding pixels of the first image P11 and the second image P12, so that the viewer 1 can Display an image. That is, the display system 100 can display a stereoscopic image to the observer 1 even if both the first image P11 and the second image P12 are planar images (two-dimensional images). As a result, the display system 100 can display a stereoscopic image in which the viewer 1 can easily recognize the thickness of the object to be displayed by reducing the book splitting effect.

In addition, the second image P12 displayed by the second display unit 12e of the present embodiment includes an edge image PE showing the edge portion E in the first image P11, and is displayed on the first display unit 11e. The edge portion E in the image P11 and the edge image PE indicating the edge portion E are set so as to be viewed by the observer 1 in correspondence with each other. Thereby, the display system 100 can display the edge image PE (that is, the edge portion E) of the first image P11 and the second image P12 in an overlapping manner. In other words, the display system 100 according to the present embodiment affects the image other than the edge portion displayed on the first display portion 11e by the influence of the image displayed on the second display portion 12e (that is, the edge image PE). An image can be displayed without giving.

Here, if an image in which a ratio of brightness (for example, luminance) is set is displayed on the first display unit 11e and the second display unit 12e, respectively, the first display unit 11e and the second display unit are displayed. The variation in display conditions with 12e may affect the display accuracy of a stereoscopic image (three-dimensional image). In this case, in order to display a stereoscopic image (three-dimensional image) with high accuracy, the display conditions (for example, brightness and color of the displayed image) of the first display unit 11e and the second display unit 12e are used. It is necessary to reduce the variation and to match the display conditions.

On the other hand, since the display system 100 of the present embodiment displays the edge image PE on the second display unit 12e, the first display is performed even if the display conditions between the first display unit 11e and the second display unit 12e vary. The image other than the edge portion displayed on the portion 11e is not affected. Thereby, even if the display conditions of the first display unit 11e and the second display unit 12e do not exactly match, a stereoscopic image (three-dimensional image) can be displayed with high accuracy. That is, the display system 100 of the present embodiment can display a stereoscopic image (three-dimensional image) with high accuracy.

In addition, since the display system 100 of the present embodiment only needs to display the edge image PE on the second display unit 12e, compared to the case where an image other than the edge image PE is also displayed on the second display unit 12e. Power consumption can be reduced.

Further, as shown in FIG. 8, the observer 1 recognizes a step change in the brightness (for example, luminance) of the image as a smooth change in brightness such as the waveform WL and the waveform WR. For this reason, the display system 100 of this embodiment can make the observer 1 recognize a stereoscopic image even when the definition of the edge image PE is low. Here, the definition is, for example, the number of pixels constituting an image. Thereby, the display system 100 of this embodiment can reduce the definition of the 2nd display part 12e compared with the definition of the 1st display part 11e. That is, the display system 100 of the present embodiment can be configured with the second display unit 12e as an inexpensive display device.

Further, the display system 100 according to the present embodiment is configured so that the edge portion E in the first image P11 displayed by the first display unit 11e and the edge image PE are visually recognized correspondingly. The image P11 and the second image P12 are displayed. Thereby, each image displayed by the display system 100 of the present embodiment is visually recognized so that the edge portion E and the edge image PE in the first image P11 are not separated by the observer 1. Therefore, the display device 10e of the present embodiment can display a stereoscopic image with high accuracy.

[Seventh Embodiment]
Hereinafter, a seventh embodiment of the present invention will be described with reference to the drawings. In addition, about the same structure as 1st Embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 18 is a block diagram showing an example of the configuration of a display system 100f according to the seventh embodiment of the present invention. The display system 100 f includes an image information supply device 2 f and an image setting device 4. The image setting device 4 includes a detection unit 41, an extraction unit 42, and a setting unit 43, and sets the second image P12 to be displayed on the second display unit 12.

The image information supply device 2f includes an image distribution server, and supplies first image information that is information for displaying the first image P11 on the first display unit 11 and the extraction unit 42 of the image setting device 4. To do.

The detection unit 41 includes a position sensor that detects the position of the first display unit 11, and detects the position of the first display unit 11. Here, the detection unit 41 is fixed in the vicinity of the second display unit 12 so that the relative position between the detection unit 41 and the second display unit 12 does not change. The detection unit 41 detects the position of the first display unit 11 with respect to the second display unit 12 by detecting the position of the first display unit 11. That is, the detection unit 41 detects the relative position between the first display unit 11 and the second display unit 12.

The extraction unit 42 acquires the first image information supplied from the image information supply device 2f, and extracts the edge portion E of the first image P11 from the acquired first image information with a known configuration. Specifically, the extraction unit 42 generates an edge image PE by applying an edge extraction filter such as a Laplacian filter to the acquired first image information. Next, the extraction unit 42 outputs the generated edge image PE to the setting unit 43.

The setting unit 43 deforms the edge portion E extracted by the extraction unit 42 based on the relative position detected by the detection unit 41, and converts the image showing the deformed edge portion E into the edge portion E of the first image P11. The corresponding second image P12 is set.

Specifically, the setting unit 43 acquires the position of the first display unit 11 detected by the detection unit 41. Next, the setting unit 43 reads the relative position between the detection unit 41 and the second display unit 12 from a storage unit (not illustrated) that stores the relative position between the detection unit 41 and the second display unit 12 in advance. Next, the setting unit 43 sets the first display unit 11 and the second display unit based on the detected position of the first display unit 11 and the read relative position between the detection unit 41 and the second display unit 12. The relative position with respect to 12 is calculated. In addition, the setting unit 43 acquires the edge image PE generated by the extraction unit 42.

Next, the setting unit 43 stores the deformation vector of the image associated with the relative position that matches the calculated relative position from a storage unit (not illustrated) that stores the relative position and the deformation vector of the image in association with each other. read out. Here, the image deformation vector is information indicating the direction and amount of deformation of the first image P11 for each pixel of the first image P11. The direction and amount of deformation of the first image P11 are the same as the first image P11 displayed by the first display unit 11 when the observer 1 observes the second display unit 12 via the first display unit 11. Is projected on the second display unit 12 and the first image P11 observed by the observer 1 is set. For example, when the observer 1 observes the center of the second display unit 12 from the front via the first display unit 11, the first image P <b> 11 is radially projected from the center of the second display unit 12. Is done. In this case, the deformation vector of the image is set to an amount corresponding to the distance between the observer 1 and the second display unit 12 and to a direction spreading radially from the center of the second display unit 12.

Further, for example, when the observer 1 observes the second display unit 12 from the oblique lateral direction via the first display unit 11, the first image P <b> 11 spreads in a trapezoidal shape on the second display unit 12. And projected. In this case, the deformation vector of the image is set to an amount corresponding to the distance between the observer 1 and the second display unit 12 and a direction spreading in a trapezoidal shape on the second display unit 12. Thus, the deformation vector of the image is the first image P11 displayed on the first display unit 11 when the observer 1 observes the second display unit 12 via the first display unit 11, and This is information in which the direction and amount of deformation are set so as to correspond to the second image P12.

Next, the setting unit 43 deforms the edge image PE generated by the extraction unit 42 by using the deformation vector of the read image. Further, the setting unit 43 sets the deformed edge image PE as the second image P12 and outputs it to the second display unit 12. That is, the setting unit 43 sets the first image P11 or the second image P12 when the light of the second image P12 displayed by the second display unit 12 is transmitted through the first display unit 11. Here, the setting unit 43 sets the first image P11 or the first image P11 so that the edge portion E of the first image P11 displayed by the first display unit 11 corresponds to the edge portion E indicated by the second image P12. The second image P12 is set.

Next, the operation of the display system 100f in this embodiment will be described with reference to FIG. FIG. 19 is a flowchart showing an example of the operation of the display system 100f in the present embodiment.

First, the detection unit 41 of the image setting device 4 detects the position of the first display unit 11 (step S10). The setting unit 43 calculates the relative position between the first display unit 11 and the second display unit 12 based on the detected position of the first display unit 11.

Next, the extraction unit 42 of the image setting device 4 acquires the first image information supplied from the image information supply device 2f (step S20).

Next, the extraction unit 42 generates an edge image PE from which the edge portion E of the first image P11 is extracted from the acquired first image information (step S30). The extraction unit 42 outputs the generated edge image PE to the setting unit 43.

Next, the setting unit 43 of the image setting device 4 deforms the edge image PE extracted in step S30 based on the position of the first display unit 11 detected in step S10 (step S40).

Further, the setting unit 43 sets the deformed edge image PE as the second image P12, and outputs the set second image P12 to the second display unit 12 (step S50). The second display unit 12 displays the second image P12 set in this way. On the other hand, the first display unit displays the first image P11 supplied from the image information supply device 2f.

As described above, in the display system 100f of the present embodiment, when the light of the second image P12 displayed by the second display unit 12 is transmitted through the first display unit 11, the first image P11 or the second image P12 is displayed. A setting unit 43 for setting the image P12 is provided. The setting unit 43 sets the first image P11 or the second image so that the edge portion E of the first image P11 displayed by the first display unit 11 corresponds to the edge portion E indicated by the second image P12. An image P12 is set. In this case, the display system 100f performs the first image according to the relative position between the first display unit 11 and the second display unit 12 (that is, the position of the observer 1 wearing the head mounted display 50). P11 or the second image P12 is set. Thereby, even if the position of the observer 1 changes, the display system 100f can set the second image P12 according to the position of the observer 1. That is, the display system 100f can display a wide range that the observer 1 can recognize as a stereoscopic image.

In addition, the display system 100f extracts a detection unit 41 that detects a relative position between the first display unit 11 and the second display unit 12, and an edge portion E of the first image P11 displayed by the first display unit 11. And an extraction unit 42. Further, the setting unit 43 of the display system 100f deforms the edge portion E extracted by the extraction unit 42 based on the relative position detected by the detection unit 41. Further, the setting unit 43 sets an image showing the deformed edge portion E as the second image P12 corresponding to the edge portion E of the first image P11. Thereby, the display system 100f generates second image information from the first image information. In this case, the display system 100f displays the second image P12 according to the relative position between the first display unit 11 and the second display unit 12 (that is, the position of the observer 1 wearing the head mounted display 50). The second image information indicating is generated. Thereby, even if the position of the observer 1 changes, the display system 100f can generate the second image information indicating the second image P12 according to the position of the observer 1. That is, the display system 100f can display a wide range that the observer 1 can recognize as a stereoscopic image.

Furthermore, the display system 100f can display the second image P12 corresponding to the first image P11 on the second display unit 12 without acquiring the second image information from the image information supply device 2f. That is, the display system 100f can receive supply of image information from the general-purpose image information supply device 2f that supplies only the first image information.

In the display system 100f, the head mounted display 50 may include the image setting device 4. In the display system 100f, the second display unit 12 may include the image setting device 4. With this configuration, the display system 100f can incorporate the image setting device 4 in any of the devices, and thus the display system 100f can be downsized.

[Eighth Embodiment]
Hereinafter, an eighth embodiment of the present invention will be described with reference to the drawings. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 20 is a block diagram showing an example of the configuration of a display system 100g according to the eighth embodiment of the present invention. The display system 100g includes an image setting device 4g. The image setting device 4g includes a determination unit 44, and sets the second image P12 based on the supplied first image P11.

The determination unit 44 determines whether or not the observer 1 is at a position where the second display unit 12 can be observed via the first display unit 11. When the determination unit 44 determines that the observer 1 is in a position where the second display unit 12 can be observed via the first display unit 11, the determination unit 44 displays the second image P12 set by the setting unit 43 as the second display unit. 12 is supplied. That is, in the determination unit 44, when the second display unit 12 displays the second image P12, the detection unit 41 detects whether or not the light of the second image P12 is incident on the first display unit 11. The determination is made based on the relative position. Specifically, the determination unit 44 calculates the relative position between the first display unit 11 and the second display unit 12 in the same manner as the setting unit 43 described above. Next, the determination unit 44 determines whether or not the first display unit 11 is within the preset display range of the second display unit 12 based on the calculated relative position. Next, when the determination unit 44 determines that the first display unit 11 is within the display range of the second display unit 12, the determination unit 44 displays the second image P <b> 12 set by the setting unit 43. Is output to the second display unit 12. On the other hand, if the determination unit 44 determines that the first display unit 11 is not within the display range of the second display unit 12, the determination unit 44 displays the second image P12 set by the setting unit 43. The image information is not output to the second display unit 12.

As described above, the display system 100g of the present embodiment determines whether or not the light of the second image P12 enters the first display unit 11 when the second display unit 12 displays the second image P12. The determination unit 44 is configured to make a determination based on the relative position detected by the detection unit 41. The second display unit 12 of the display system 100g displays the second image P12 when the determination unit 44 determines that the light of the second image P12 is incident on the first display unit 11. Here, the second image P12 is an image showing the edge portion E of the first image P11. For this reason, when the observer 1 who does not wear the head mounted display 50 observes the second image P12, the observer 1 observes an image whose contents are difficult to understand. The observer 1 may feel uncomfortable when observing an image showing the edge portion E where it is difficult to understand the content. The display system 100g does not display the second image P12 on the second display unit 12 when the observer 1 wearing the head mounted display 50 and observing the second display unit 12 is not present. Therefore, the display system 100g can reduce discomfort felt by the observer 1 who is not wearing the head mounted display 50 by observing the second image P12 (that is, an image whose contents are difficult to understand). . Furthermore, in this case, the display system 100g can reduce power consumption by not displaying the second image P12.

[Ninth Embodiment]
The ninth embodiment of the present invention will be described below with reference to the drawings. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 21 is a block diagram showing an example of the configuration of a display system 100h according to the ninth embodiment of the present invention. The display system 100h includes an image information supply device 2h and an image setting device 4h. The image information supply device 2h supplies the first image information for displaying the first image P11 to the first display unit 11 and the image setting device 4h. The image information supply device 2h supplies third image information for displaying the third image P13 to the image setting device 4h. Here, the third image P13 is an image displayed on the second display unit 12 and is an image different from the second image P12. This third image P13 is not an image in which it is difficult to understand the content displayed like the edge image PE when the observer 1 who is not wearing the head mounted display 50 observes. Is an easy image. That is, the third image P13 is an image that is less likely to cause the observer 1 to feel uncomfortable than when the observer 1 observes the second image P12. Note that the third image P13 may be the same image as the first image P11. The image setting device 4h includes a determination unit 44h.

When the determination unit 44h determines that the light of the second image P12 does not enter the first display unit 11, the determination unit 44h supplies the third image P13 to the second display unit 12. Specifically, in the same manner as the determination unit 44, the determination unit 44 h determines whether or not the observer 1 wearing the head mounted display 50 is at a position where the second display unit 12 can be observed via the first display unit 11. Determine. Next, when the determination unit 44h determines that the first display unit 11 is within the display range of the second display unit 12, the determination unit 44h displays a second image P12 for displaying the second image P12 set by the setting unit 43. Is output to the second display unit 12. On the other hand, when the determination unit 44h determines that the first display unit 11 is not within the display range of the second display unit 12, the determination unit 44h displays third image information for displaying the supplied third image P13. This is supplied to the second display unit 12.

As described above, when the determination unit 44h of the display system 100h according to the present embodiment determines that the light of the second image P12 does not enter the first display unit 11, the third image P13 is displayed on the second display unit. 12 is supplied. The second display unit 12 displays a third image different from the second image P12 when the determination unit 44h determines that the light of the second image P12 does not enter the first display unit 11. . Thereby, the display system 100h replaces the second image P12 with the second display unit 12 when the observer 1 wearing the head mounted display 50 is not observing the second display unit 12. A third image P13 can be displayed. Here, the second image P12 is an image showing the edge portion E of the first image P11. For this reason, when the observer 1 who does not wear the head mounted display 50 observes the second image P12, the observer 1 observes an image whose contents are difficult to understand. Further, as described above, the third image P13 is an image different from the second image P12, and when the observer 1 who does not wear the head mounted display 50 observes, the content is easy to understand. It is an image. For example, the third image P13 is the same image as the first image P11. In the display system 100h, when there is no observer 1 who is wearing the head-mounted display 50 and observing the second display unit 12, the display system 100h understands the content instead of displaying an image whose content is difficult to understand. Can display the third image P13. Thereby, the display system 100h can reduce discomfort felt by the observer 1 who is not wearing the head mounted display 50 by observing the second image P12 (that is, an image whose contents are difficult to understand). it can.

It should be noted that the second display unit 12 may display the second image P12 so as to overlap the third image P13. In addition, when the second display unit 12 displays the second image P12 so as to overlap the third image P13, the brightness (for example, luminance) of the second image P12 is determined based on the brightness of the third image P13. These images may be displayed at a reduced level. Even with this configuration, the display system 100h can display the first image P11 and the second image P12 in correspondence with each other, so that the observer 1 wearing the head-mounted display 50 can display it. Thus, a stereoscopic image can be displayed over a wide range. Accordingly, the display system 100h is different from the second image P12 while reducing the discomfort felt by the observer 1 who is not wearing the head mounted display 50 by observing the second image P12. 3 images P13 can be displayed.

[Tenth embodiment]
Hereinafter, a tenth embodiment of the present invention will be described with reference to the drawings. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 22 is a block diagram showing an example of the configuration of a display system 100j according to the tenth embodiment of the present invention. The display system 100j includes an image information supply device 2j and an image setting device 4j. The image information supply device 2j supplies the first image information including the depth position information of the stereoscopic image to the image setting device 4j. That is, the first image information is image information for displaying a stereoscopic image. The image setting device 4j includes a parallax setting unit 45.

The parallax setting unit 45 sets the range of the depth position of the three-dimensional image set by the binocular parallax to the range of the depth position including the depth position where the second display unit 12 displays the second image P12. Set the parallax. Specifically, the parallax setting unit 45 calculates the relative position between the first display unit 11 and the second display unit 12 in the same manner as the setting unit 43. Next, the parallax setting unit 45 acquires first image information for displaying the first image P11 from the image information supply device 2j. Next, the parallax setting unit 45 calculates the depth position of the second display unit 12 with respect to the first display unit 11 based on the calculated relative position. The depth position of the second display unit 12 calculated by the parallax setting unit 45 will be described with reference to FIG.

FIG. 23 is a schematic diagram illustrating an example of the depth position of the three-dimensional image in the present embodiment. The parallax setting unit 45 calculates the distance Lp between the first display unit 11 and the second display unit 12 as the depth position of the second display unit 12 with respect to the first display unit 11. Next, the parallax setting unit 45 sets the range of the distance Lip in the depth direction around the calculated distance Lp as the range of the depth position where the stereoscopic image is displayed. Next, the parallax setting unit 45 sets the left-eye image P11L within the set depth position range (that is, the distance Lip range) based on the depth position information of the stereoscopic image included in the acquired first image information. And binocular parallax of the right-eye image P11R. That is, the parallax setting unit 45 causes the binocular parallax of the left-eye image P11L and the right-eye image P11R so that the stereoscopic image is displayed in the range of the depth position including the depth position where the second image P12 is displayed. Set. In this way, the first display unit 11 displays the stereoscopic image IP11 corresponding to the first image P11 at the depth position within the range of the distance Lip for the observer 1 who observes the first image P11.

As described above, the first display unit 11 of the display system 100j of the present embodiment includes the left eye display unit 11L that displays the left-eye image P11L on the left eye of the viewer 1, and the right eye of the viewer 1 on the right side. A right-eye display unit 11R that displays the eye image P11R. Further, the first image P11 includes a left-eye image P11L and a right-eye image P11R that have binocular parallax. Thereby, the display system 100j can improve the stereoscopic effect of the stereoscopic image observed by the observer 1 as compared with the case of displaying the first image P11 having no binocular parallax.

Furthermore, the display system 100j changes the depth position range of the three-dimensional image set by binocular parallax to a depth position range including the depth position at which the second display unit 12 displays the second image P12. A parallax setting unit 45 for setting eye parallax is provided. Accordingly, the display system 100j brings the depth position of the stereoscopic image due to binocular parallax included in the first image P11 close to the depth position of the second image P12 indicating the edge portion E of the first image P11. Display each image. Here, when the depth position of the stereoscopic image due to the binocular parallax included in the first image P11 and the depth position of the second image P12 are not close to each other, the first image P11 observed by the observer 1 is The second image P12 may become difficult to correspond. For example, the position of the edge portion of the first image P11 and the position of the edge image PE of the second image P12 may be difficult to match. On the other hand, the display system 100j brings the depth position of the stereoscopic image due to binocular parallax and the depth position of the second image P12 close to each other, whereby the first image P11 and the second image P12 that the observer 1 observes. And make it easier to deal with. That is, the display system 100j can reduce a sense of incongruity that occurs when the observer 1 observes the first image P11 having the binocular parallax and the second image P12.

[Eleventh embodiment]
The eleventh embodiment of the present invention will be described below with reference to the drawings. In addition, about the structure same as each embodiment mentioned above, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

FIG. 24 is a block diagram showing an example of the configuration of a display system 100k according to the eleventh embodiment of the present invention. The display system 100k includes an image information supply device 2k, an image setting device 4k, and a head mounted display 50k. The image information supply device 2k supplies image information to the image setting device 4k and the head mounted display 50k.

The image setting device 4k sets the second image information based on the input image information and the detected relative positions of the first display unit 11 and the second display unit in the same manner as the image setting device 4.

The head mounted display 50k includes an image detection unit 51 and an image setting unit 52.

The image detection unit 51 includes an image sensor (not shown), and detects the second image P12 displayed by the second display unit 12 by the image sensor. Further, the image detection unit 51 outputs image information indicating the detected second image P12 to the image setting unit 52.

The image setting unit 52 acquires image information indicating the second image P12 detected by the image detection unit 51. Next, the image setting unit 52 selects an image corresponding to the detected second image P12 from the images supplied by the image information supply device 2k, and sets the image information of the selected image as the image information supply device. Get from 2k. Next, the image setting unit 52 outputs the image information acquired from the image information supply device 2k to the first display unit 11 as the first image information indicating the first image P11. In this way, the first display unit 11 displays the first image P11 set by the image setting unit 52. The second display unit 12 displays the second image P12 set by the image setting device 4k.

An example of a specific configuration of the display system 100k will be described with reference to FIG. FIG. 25 is a schematic diagram illustrating an example of the configuration of the display system 100k in the present embodiment.

The image information supply device 2k includes an image server that is operated by an image distributor. The image information supply device 2k supplies the plurality of image information stored in the image server to the image setting device 4k via the antenna A1 and the antenna A2.

The image setting device 4k and the second display unit 12 are, for example, a digital signage system installed in a station premises. The image setting device 4k displays image information indicating an image to be displayed on the second display unit 12 as the second image P12 among the plurality of pieces of image information acquired from the image information supply device 2k via the antenna A1 and the antenna A2. select. Then, as described above, the image setting device 4k extracts the edge portion E of the image included in the selected image information, sets the second image P12, and displays the set second image P12. Is supplied to the second display unit 12. The second display unit 12 displays the second image P12 based on the second image information supplied from the image setting device 4k.

On the other hand, the image information supply device 2k supplies a plurality of image information stored in the image server to the head mounted display 50k worn by the observer 1 via the network 5 and the antenna A3. The head mounted display 50k includes an antenna (not shown), and receives a plurality of pieces of image information supplied from the image information supply device 2k via the network 5 and the antenna A3.

Here, the observer 1 wearing the head mounted display 50k observes the second display unit 12. The detection unit 41 of the image setting device 4 k detects the relative position of the first display unit 11. As described above, the setting unit 43 of the image setting device 4k sets the second image P12 obtained by deforming the edge portion E based on the detected relative position.

On the other hand, the image detection unit 51 of the head mounted display 50k detects the second image P12 displayed by the second display unit 12. Next, the image setting unit 52 selects image information corresponding to the detected second image P12 from among a plurality of pieces of image information supplied from the image information supply device 2k. Then, the image setting unit 52 supplies the selected image information to the first display unit 11 as first image information indicating the first image P11. The first display unit 11 displays the first image P11 based on the supplied image information.

In this way, the display system 100k uses the image displayed by the digital signage system, that is, the image corresponding to the second image P12 displayed by the second display unit 12 as the first image P11. Displayed on the first display unit 11.

As described above, the display system 100k includes the image detection unit 51 and the image setting unit 52. The image detection unit 51 detects the second image P12 displayed by the second display unit 12. The image setting unit 52 sets the first image P11 based on the second image P12 detected by the image detection unit 51, and supplies the set first image P11 to the first display unit 11. Furthermore, the image setting unit 52 of the display system 100k selects an image to be displayed as the first image P11 from among a plurality of input images based on the second image P12 detected by the image detection unit 51. Thus, the first image P11 is set. Thereby, the display system 100k can set the first image P11 based on the second image P12 displayed on the second display unit 12. That is, the display system 100k can set the first image P11 to be displayed on the first display unit 11 by using the second image P12.

For example, in the digital signage system as described above, the display system 100k displays an image indicating the edge portion E of the signage image on the second display unit 12. Here, when the observer 1 wearing the head mounted display 50k observes the second display unit 12, the signage image is displayed on the first display unit 11 provided in the head mounted display 50k worn by the observer 1. Is displayed. Thereby, since the display system 100k displays the signage image in response to the observation of the second display unit 12 with respect to the observer 1, the signage image having a strong impression can be displayed. That is, the display system 100k can improve the degree of impression received by the observer 1 when the observer 1 observes the displayed image.

Note that the image setting unit 52 may set the first image P11 by generating the first image information. In this case, the image setting unit 52 supplies the generated first image information to the first display unit 11. Even if comprised in this way, the display system 100k can display the 1st image P11 corresponding to the 2nd image P12. Accordingly, the display system 100k can display the first image P11 on the first display unit 11 even if the head mounted display 50k does not include the antenna A3.

The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and appropriate modifications can be made without departing from the spirit of the present invention. . Moreover, you may combine embodiment mentioned above suitably.

The first display unit 11, the second display unit 12, the setting unit 13, the position detection unit 14, the detection unit 41, the extraction unit 42, the setting unit 43, the determination unit 44, the parallax setting unit 45, and the image in the above embodiment. The detection unit 51, the image setting unit 52 (hereinafter collectively referred to as the control unit CONT) or each unit included in the control unit CONT may be realized by dedicated hardware. It may be realized by a memory and a microprocessor.

Each unit included in the control unit CONT includes a memory and a CPU (central processing unit), and the function is realized by loading a program for realizing the function of each unit included in the control unit CONT into the memory and executing the program. It may be realized.

Further, by recording a program for realizing the function of each unit included in the control unit CONT on a computer-readable recording medium, causing the computer system to read and execute the program recorded on the recording medium, the control unit You may perform the process by each part with which CONT is provided. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM or a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

DESCRIPTION OF SYMBOLS 1 ... Observer 10 ... Display apparatus 11 ... 1st display part 12 ... 2nd display part 13 ... Setting part 14 ... Position detection part 41 ... Detection part 42 ... Extraction part 43 ... Setting part, 44 ... determination unit, 45 ... parallax setting unit, 51 ... image detection unit, 52 ... image setting unit

Claims

A first display for displaying a first image including a first subject;
Transmitting light of the first image displayed by the first display unit, displaying a second image including a second subject corresponding to the first subject, and at least one of the first subject and the second subject. A display device comprising: a second display unit that is displayed so as to overlap the unit and is carried by a user.
The second display unit
The display device according to claim 1, wherein a virtual image as the second image is displayed.
The second image is
The pixel value of the pixel of the second image visually recognized corresponding to the pixel of the first image by the user is set according to the depth position of the stereoscopic image to be visually recognized by the user. Item 3. A display device according to item 1 or item 2.
The second subject includes an edge portion of the first subject, and is included in the edge portion of the first subject displayed on the first display unit and the second subject displayed on the second display unit. The display device according to any one of claims 1 to 3, wherein the display device is set so that the edge portion of the first subject is visually recognized by the user.
The first subject includes an edge portion of the second subject, and is included in the edge portion of the second subject displayed on the second display unit and the first subject displayed on the first display unit. The display device according to any one of claims 1 to 3, wherein the display device is set so that the edge portion of the second subject is visually recognized by the user.
The second image is
A left-eye image and a right-eye image having binocular parallax with each other,
The second display unit
6. The display device according to claim 1, wherein the left eye image is displayed on the left eye of the user and the right eye image is displayed on the right eye.
7. The apparatus according to claim 1, further comprising: a setting unit configured to set the second image corresponding to the first image based on image information of the input first image. The display device described.
A display surface of the first display unit on which the first image is displayed;
A detection unit for detecting a relative position with respect to a display surface of the second display unit on which the second image is displayed,
The setting unit sets the second image by setting a relative position between the first image and the second image based on information indicating the relative position detected by the detection unit. The display device according to claim 7.
Determining whether the light of the second image is incident on the first display unit based on the relative position detected by the detection unit when the second display unit displays the second image With parts
The second display unit
The display device according to claim 8, wherein the second image is displayed when the determination unit determines that the light of the second image is incident on the first display unit.
The second display unit
10. The display according to claim 9, wherein when the determination unit determines that the light of the second image does not enter the first display unit, a third image different from the second image is displayed. apparatus.
The setting unit sets the second image by setting a relative position between the first image and the second image based on a pixel value of a pixel indicating an edge portion in the first image. The display device according to claim 7, wherein the display device is characterized.
A mounting unit mounted on the head of an observer who observes the second image displayed by the second display unit;
The display device according to any one of claims 1 to 11, wherein the second display unit displays the second image by an eyepiece optical system.
Parallax setting for setting the binocular parallax by setting the range of the depth position of the three-dimensional image set by binocular parallax to a range of depth positions including the depth position at which the second display unit displays the second image The display device according to claim 12, further comprising: a unit.
An image detection unit for detecting the second image displayed by the second display unit;
An image setting unit that sets the first image based on the second image detected by the image detection unit and supplies the set first image to the first display unit. The display device according to any one of claims 11 to 13.
The image setting unit
The first image is set by selecting an image to be displayed as the first image from a plurality of input images based on the second image detected by the image detection unit. The display device according to claim 14.
Transmitting a first light including light from the first subject, displaying a second image including a second subject corresponding to the first subject, wherein at least a part of the first subject and the second subject is A display device comprising: a display unit that is displayed so as to be superposed and carried by a user.
The display device according to claim 16, wherein the display unit displays a virtual image as the second image.
A first display unit that displays a first image including the first subject; and a second image that transmits light of the first image displayed by the first display unit and includes a second subject corresponding to the first subject. In a computer of a display device having a second display unit that is portable to the user,
A program for executing a display procedure for displaying so that at least a part of the first subject and the second subject overlap each other.
A mounting part to be mounted on the observer's head;
A display unit that is provided in the mounting unit and transmits first light including light from the first subject and displays a second image corresponding to the first subject;
The display unit is a three-dimensional object different from the case of observing the first subject without the display unit for the observer who has observed the first subject and the second image through the display unit. A display device characterized by visually recognizing a feeling.
A display device mounted on the observer's head,
A first display unit configured to display the first image by an eyepiece optical system and to transmit light of a second image indicating an edge portion of the displayed first image in a direction in which the first image is displayed. Display device.
An image detection unit for detecting the second image;
Based on the second image detected by the image detection unit, when light of the second image is transmitted through the first display unit, an edge portion indicated by the second image and an edge portion of the first image The display device according to claim 20, further comprising: a setting unit that sets the first image so as to correspond to each other and supplies the set first image to the first display unit.
A first display for displaying a first image and transmitting incident light;
An image detection unit for detecting a second image indicating an edge portion of the first image;
A supply unit for supplying the second image detected by the image detection unit to a second display unit;
A detection unit for detecting a position of the first display unit with respect to the second display unit;
A setting unit configured to set the second image indicating an edge portion of the first image based on the second image supplied by the supply unit and the position detected by the detection unit. Display device.
A supply unit that displays the first image and supplies the first image to a first display unit that transmits incident light;
A detection unit for detecting a position of the first display unit;
A setting unit configured to set a second image indicating an edge portion of the first image based on the first image supplied by the supply unit and the position detected by the detection unit;
And a second display unit that displays the second image set by the setting unit.