JP6841715B2 - Display devices, display systems, and mobiles - Google Patents

Description

The present disclosure relates to display devices, display systems, and mobiles.

Conventionally, in order to perform a three-dimensional display, optics in which a part of the image light emitted from the image display panel reaches the right eye and the other part of the image light emitted from the image display panel reaches the left eye. A display device including an element is known (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2004-343290

In the above-mentioned display device, phenomena such as crosstalk and reverse vision that hinder normal image recognition are known. When the above-mentioned display device is used as a head-up display, even if the position of the user's eyes moves from a predetermined position, if the phenomena such as crosstalk and reverse vision can be suppressed, the three-dimensional image is visually recognized. Increased comfort.

An object of the present disclosure is to provide a display device, a display system, and a moving body that enhance the comfort when viewing a three-dimensional image on a head-up display.

The display device of the present disclosure includes a display element having a display surface having a plurality of subpixels arranged in a grid pattern along a first direction and a second direction substantially orthogonal to the first direction, and a display element on the display surface. An optical element that defines the light ray direction of the image light emitted from the subpixel and the image light whose light ray direction is defined by the optical element for each of the plurality of strip-shaped regions extending in the second direction are displayed on the display surface. A projection optical system that projects so as to form a virtual image, and a driver that displaces the display surface and the optical element along the normal direction of the display surface with their relative positional relationships fixed to each other. A communication unit that receives position information indicating the position of the user's eye, and a controller that displaces the display surface and the optical element by the driver based on the position of the eye received by the communication unit. ..

The display system of the present disclosure includes an imaging device that images a user, a communication unit that receives position information indicating the position of the user's eyes imaged by the imaging device, and abbreviated in a first direction and the first direction. A display element having a display surface having a plurality of subpixels arranged in a grid pattern along a second direction orthogonal to each other, and a plurality of strip-shaped regions extending in the second direction on the display surface are ejected from the subpixels. An optical element that defines the ray direction of the image light to be formed, a projection optical system that projects the image light whose ray direction is defined by the optical element so as to form a virtual image of the display surface, and the display surface. And the driver that displaces the optical element along the normal direction of the display surface in a state where the relative positional relationship with each other is fixed, and the driver based on the position of the eye received by the communication unit. and a display device including a controller for displacing the display surface and the optical element by.

The moving body of the present disclosure includes an imaging device that images a user, a communication unit that receives position information indicating the position of the user's eyes imaged by the imaging device, and abbreviated in a first direction and the first direction. A display element having a display surface having a plurality of subpixels arranged in a grid pattern along a second direction orthogonal to each other, and a plurality of strip-shaped regions extending in the second direction on the display surface are ejected from the subpixels. An optical element that defines the ray direction of the image light to be formed, a projection optical system that projects the image light whose ray direction is defined by the optical element so as to form a virtual image of the display surface, and the display surface. And the driver that displaces the optical element along the normal direction of the display surface in a state where the relative positional relationship with each other is fixed, and the driver based on the position of the eye received by the communication unit. Provided is a display system including a display device comprising the display surface and a controller that displaces the optical element.

According to one embodiment of the present disclosure, it is possible to enhance the comfort when visually recognizing a three-dimensional image on a head-up display.

FIG. 1 is a diagram showing a display system mounted on a mobile body according to an embodiment of the present invention. FIG. 2 is a diagram showing a schematic configuration of the display device shown in FIG. FIG. 3 is a view of the display panel shown in FIG. 2 as viewed from the normal direction of the display surface. FIG. 4 is a view of the parallax barrier shown in FIG. 2 as viewed from the normal direction of the light-shielding surface. FIG. 5 is a view of the display panel and the parallax barrier shown in FIG. 2 as viewed from the parallax barrier side. 6A and 6B are schematic views for explaining the subpixels of the first virtual image visually recognized by the eye, FIG. 6A is a schematic view when the eye is in the reference position, and FIG. 6B is Paralux. It is a schematic diagram when the distance from the barrier to the eye is shorter than the distance at the reference position, and FIG. 6C is a schematic diagram when the distance from the paralux barrier to the eye is longer than the distance at the reference position. FIG. 7 is a schematic view for explaining the subpixels of the first imaginary image visually recognized by the eye, and FIG. 7A is a schematic view when the eye moves in the horizontal direction by 1/2 of the inter-eye distance from the reference position. 7 (b) is a schematic view when the eye moves from the reference position to the inter-eye distance and in the horizontal direction, and FIG. 7 (c) shows the eye moves from the reference position to the inter-eye distance and in the horizontal direction. However, it is a schematic diagram when the positions of the right eye image and the left eye image are changed, and FIG. 7 (d) is a schematic diagram when the eye moves from the reference position in the horizontal direction twice the distance between the eyes. Is FIG. 8 is a processing flow diagram of a process in which the control unit displaces the display device. FIG. 9 is a processing flow diagram showing details of the first processing. FIG. 10 is a processing flow diagram showing details of the second processing.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the drawings. The figures used in the following description are schematic, and the dimensional ratios and the like on the drawings do not always match the actual ones.

As shown in FIG. 1, the display system 1 according to the present embodiment includes a detection device 2 and a projection device 3. The projection device 3 is mounted on the moving body 4. For example, the projection device 3 is housed in the dashboard of the moving body 4.

Here, the "mobile body" includes, but is not limited to, automobiles, railroad vehicles, industrial vehicles, and living vehicles. For example, the "moving body" may include an airplane traveling on the runway. Automobiles include, but are not limited to, passenger cars, trucks, buses, motorcycles, trolley buses and the like, and may include other vehicles traveling on the road. Track vehicles include, but are not limited to, locomotives, freight cars, passenger cars, trams, guided track railroads, ropeways, cable cars, maglev trains, and monorails, and may include other vehicles traveling along the track. Industrial vehicles include industrial vehicles for agriculture and construction. Industrial vehicles include, but are not limited to, forklifts and golf carts. Industrial vehicles for agriculture include, but are not limited to, tractors, cultivators, transplanters, binders, combines, and mowers. Industrial vehicles for construction include, but are not limited to, bulldozers, scrapers, excavators, cranes, dump trucks, and road rollers. Living vehicles include, but are not limited to, bicycles, wheelchairs, prams, wheelbarrows, and electric standing two-wheeled vehicles. Vehicle power engines include, but are not limited to, diesel engines, gasoline engines, and internal combustion engines, including hydrogen engines, as well as electric engines, including motors. "Vehicle" includes a vehicle that runs manually. The classification of "moving bodies" is not limited to the above. For example, an automobile may include an industrial vehicle capable of traveling on a road, and the same vehicle may be included in a plurality of classifications.

The detection device 2 detects the position of the eye of the user U and transmits the detected eye position to the projection device 3. The detection device 2 may include, for example, an image pickup device. The image pickup device included in the detection device 2 may capture a captured image with the eye of the user U as a subject. The detection device 2 may detect the position of the eye of the user U from the captured image. The detection device 2 may detect the position of the eye of the user U as the coordinates in the three-dimensional space from one captured image. The detection device 2 is configured to include two or more imaging devices, and may detect the position of the eye of the user U as coordinates in three-dimensional space from the captured images captured by each imaging device.

The detection device 2 does not include an image pickup device and may be connected to the image pickup device. The detection device 2 may include an input terminal for inputting a signal from the image pickup device. In this case, the imaging device may be directly connected to the input terminal. The detection device 2 may be indirectly connected to the input terminal via a shared network. The detection device 2 may detect the position of the eye of the user U from the video signal input to the input terminal.

The detection device 2 may include, for example, a sensor. The sensor may be an ultrasonic sensor, an optical sensor, or the like. The detection device 2 may detect the position of the head of the user U by a sensor and detect the position of the eyes of the user U based on the position of the head. The detection device 2 may detect the position of the eye of the user U as the coordinates in the three-dimensional space by two or more sensors.

The projection device 3 functions as a part of a head-up display that allows the user U of the moving body 4 to visually recognize the virtual image 50 of the desired image, for example. In one embodiment, the projection device 3 emits image light, which will be described later, toward a predetermined region of the optical member 4a included in the moving body 4. The emitted image light is reflected in a predetermined region of the optical member 4a and reaches the eyes of the user U. As a result, the projection device 3 functions as a head-up display. In one embodiment, the optical member 4a may be a windshield. In other embodiments, the optical member 4a may be a combiner.

The projection device 3 according to the embodiment will be described in detail with reference to FIG. The projection device 3 includes a housing 10, a projection optical system 20, and a display device 30.

The housing 10 houses the projection optical system 20 and the display device 30. The housing 10 defines an opening 10a through which the image light emitted from the display device 30 passes in order to emit the image light to the outside.

The projection optical system 20 projects the image light emitted from the display device 30 to reach the outside of the projection device 3. The image light that has reached the outside of the projection device 3 reaches a predetermined region of the optical member 4a included in the moving body 4 as shown in FIG. The projection optical system 20 may include one or more mirrors and lenses. When the projection optical system 20 includes a mirror, for example, the mirror included in the projection optical system 20 may be a concave mirror. In FIG. 2, the projection optical system 20 is displayed as one mirror, but the projection optical system 20 may be configured by combining one or more mirrors, lenses, and other optical elements. In the arrow A indicated by the alternate long and short dash line shown in FIG. 2, a part of the image light emitted from the display device 30 is reflected by the projection optical system 20 and passes through the opening 10a provided in the housing 10 of the projection device 3. The path reaching the outside of the projection device 3 is shown.

The display device 30 is arranged inside the housing 10 and emits image light. The display device 30 includes an irradiator 31, a display panel 32 which is a display element, a parallax barrier 33 as an optical element, a communication unit 34, a controller 35, and a driver 36.

The irradiator 31 is arranged on one surface side of the display panel 32 and irradiates the display panel 32 surface-wise. The irradiator 31 may include a light source, a light guide plate, a diffusion plate, a diffusion sheet, and the like. The irradiator 31 emits irradiation light from a light source, and makes the irradiation light uniform in the surface direction of the display panel 32 by a light guide plate, a diffusion plate, a diffusion sheet, or the like. Then, the irradiator 31 emits the uniformed light toward the display panel 32.

As the display panel 32, for example, a transmissive liquid crystal display panel or the like can be adopted. As shown in FIG. 3, the display panel 32 is arranged in a grid pattern along the first direction and the second direction substantially orthogonal to the first direction on the display surface 321 which is a plate-like surface. Has a parcel area. The first direction and the second direction correspond to the horizontal direction and the vertical direction when the virtual image of the display panel 32 is visually recognized by the user U, respectively. The grid pattern means that they are regularly arranged in a plane along two directions that are substantially orthogonal to each other. Each partition area corresponds to one subpixel.

Each subpixel corresponds to each color of R, G, and B, and one pixel can be configured by combining the three subpixels of R, G, and B as a set. One pixel can be called one pixel. The first direction is, for example, a direction in which a plurality of subpixels constituting one pixel are arranged. The second direction is, for example, the direction in which subpixels of the same color are lined up. The display panel 32 is not limited to the transmissive liquid crystal panel, and other display panels such as organic EL can also be used. When a self-luminous display panel is used as the display panel 32, the irradiator 31 becomes unnecessary.

In the display panel 32 of the present embodiment, as shown in FIG. 3, sub-pixels of a plurality of rows in which the left eye image is displayed, which are continuously arranged in the second direction, are arranged in every other row in the first direction. Will be done. Further, the subpixels of the plurality of columns on which the right eye image is displayed, which are adjacent to each of the plurality of columns, are arranged every other row. In FIG. 3, the subpixel displaying the left eye image is illustrated by L, and the subpixel displaying the right eye image is illustrated by R. In the present embodiment, as shown in FIG. 3, the image pitch, which is the sum of the arrangement intervals of the left eye images, that is, the length of the left eye image in the first direction and the length of the right eye image in the first direction is k. explain. Further, since the left eye image and the right eye image are alternately arranged in the first direction, the image pitch k is also the arrangement interval of the right eye image.

The parallax barrier 33 is an optical element that defines the direction in which the image light emitted from the subpixel is propagated. As shown in FIG. 4, the parallax barrier 33 has a plurality of opening regions 33b extending in the second direction on the display device 30. The aperture region 33b defines the light ray direction, which is the propagation direction of the image light emitted from each subpixel. The range of the image light emitted from the subpixel that can be seen by the right eye and the left eye is determined by the parallax barrier 33. In one embodiment, the parallax barrier 33 is located on the opposite side of the irradiator 31 with respect to the display panel 32, as shown in FIG. The parallax barrier 33 may be located on the illuminator 31 side of the display panel 32.

Specifically, the parallax barrier 33 has a light-shielding surface 33a extending in a band shape in the second direction. The light-shielding surface 33a forms a light-shielding region of the parallax barrier 33. The light-shielding surface 33a blocks a part of the image light emitted from the subpixel. The light-shielding surface 33a can block the portion of the image light emitted from the subpixel displaying the left-eye image toward the right eye of the user U. The light-shielding surface 33a can block the portion of the image light emitted from the subpixel displaying the right-eye image toward the left eye of the user U. The plurality of light-shielding surfaces 33a define an opening region 33b between the light-shielding surfaces 33a adjacent to each other. The opening region 33b has a higher light transmittance than the light-shielding surface 33a.

The opening region 33b is a portion that transmits light incident on the parallax barrier 33. The opening region 33b may transmit light in the visible light region with a transmittance of the first predetermined value or more. The first predetermined value may be, for example, 100% or a value smaller than 100%. The light-shielding surface 33a is a portion that blocks and does not transmit light in the visible light region incident on the parallax barrier 33. In other words, the light-shielding surface 33a blocks the image displayed on the display device 30. The light-shielding surface 33a may block light with a transmittance of 2 or less predetermined values. The second predetermined value may be, for example, 0% or a value close to 0%. For example, the first predetermined value can be a value of 50% or more, and the second predetermined value can be a value of 10% or less.

The opening region 33b and the light-shielding surface 33a are alternately arranged in the first direction. The opening region 33b defines the light ray direction of the image light emitted from the subpixel for each of the plurality of strip-shaped regions extending in the second direction on the display surface 321.

The parallax barrier 33 may be made of a film or plate-like member having a transmittance of less than the second predetermined value. In this case, the light-shielding surface 33a is made of the film or plate-shaped member. The opening region 33b is composed of an opening provided in the film or plate-shaped member. The film may be made of resin or may be made of other materials. The plate-shaped member may be made of resin, metal, or the like, or may be made of another material. The parallax barrier 33 is not limited to the film or plate-shaped member, and may be composed of other types of members. In the parallax barrier 33, the base material may have a light-shielding property, or the base material may contain an additive having a light-shielding property.

The parallax barrier 33 may be composed of a liquid crystal shutter. The liquid crystal shutter can control the light transmittance according to the applied voltage. The liquid crystal shutter is composed of a plurality of pixels, and the light transmittance in each pixel may be controlled. The liquid crystal shutter may form a region having a high light transmittance or a region having a low light transmittance into an arbitrary shape. When the parallax barrier 33 is composed of a liquid crystal shutter, the opening region 33b may be a region having a transmittance of the first predetermined value or more. When the parallax barrier 33 is composed of a liquid crystal shutter, the light-shielding surface 33a may be a region having a transmittance of 2 or less predetermined values.

The parallax barrier 33 transmits the image light emitted from a part of the subpixels through the opening region 33b and propagates to the position of the left eye of the user U. The parallax barrier 33 transmits the image light emitted from some of the other subpixels through the opening region 33b and propagates to the position of the right eye of the user U. As shown in FIG. 2, the parallax barrier 33 is arranged at a distance g (hereinafter, referred to as “gap g”) from the display surface 321 of the display panel 32.

A part of the image light emitted from the display surface 321 of the display panel 32 passes through the parallax barrier 33 and reaches the optical member 4a via the projection optical system 20. Further, the image light is reflected by the optical member 4a and reaches the eyes of the user U. As a result, the eyes of the user U recognize the first virtual image 51, which is a virtual image of the display panel 32, in front of the optical member 4a. In the present application, the front is the direction of the optical member 4a as viewed from the user U. The front is the direction in which the moving body 4 normally moves. Further, the parallax barrier 33 creates a second virtual image 52 in front of the optical member 4a and on the optical member 4a side of the first virtual image 51. As shown in FIG. 5, the user U visually recognizes the image as if the display panel exists at the position of the first virtual image 51 and the parallax barrier exists at the position of the second virtual image 52. sell. FIG. 5 shows each subpixel of the first virtual image 51 of the display panel 32 that can be observed by the user U. The subpixels with the reference numeral L display the left eye image, and the subpixels with the reference numeral R display the right eye image. Further, FIG. 5 shows the opening region 522 and the light-shielding surface 521 of the second virtual image 52 observed from the left eye of the user U. The left eye of the user U visually recognizes a subpixel that displays a left-eye image with a reference numeral L overlapping the opening region 522, and a subpixel that displays a right-eye image with a reference numeral R overlapping the light-shielding surface 521. Do not see. On the other hand, when observed from the right eye of the user U, the opening region 522 overlaps the subpixel displaying the right eye image with the reference numeral R, and the light-shielding surface 521 displays the left eye image with the reference numeral L. Overlaps subpixels. As a result, the right eye of the user U visually recognizes the right eye image and does not visually recognize the left eye image.

Here, refer to FIG. 6 regarding the apparent optimum viewing distance D (hereinafter, simply referred to as “appropriate viewing distance D”) between the second virtual image 52, which is a virtual image of the parallax barrier 33, and the eyes of the user U. I will explain. FIG. 6 can be said to be an apparent optical system from the first virtual image 51, which is a virtual image of the display panel 32, to the user U. FIG. 6 shows the first virtual image 51, the second virtual image 52, and the eyes of the user U. For convenience of explanation, the following description will be made using the positional relationship shown in FIG. 6, but the eyes of the second virtual image 52 and the user U with respect to the actual distance between the first virtual image 51 and the second virtual image 52. The distance ratio of is much larger than the distance ratio shown in FIG.

The suitable viewing distance D is between the second virtual image 52 and the eye of the user U in a state where the image light emitted from the left eye image is arranged so as to pass through the opening region 33b and reach the left eye. Is the distance. As shown in FIG. 6, the suitable viewing distance D is the inter-eye distance E of the user U, the pitch Bpv of the second virtual image 52, and the distance gv between the second virtual image 52 and the first virtual image 51 (hereinafter, “virtual image”). It can be determined by the relationship between the gap gv) and the image pitch kv of the first virtual image 51.

If the distance d between the second virtual image 52 and the eyes of the user U is not the proper viewing distance D, the image recognized by the eyes of the user U may be inappropriate.

For example, as shown in FIG. 6B, when the distance d between the second virtual image 52 and the eyes of the user U is smaller than the appropriate viewing distance D, on the first virtual image 51 which is a virtual image of the display panel 32. The region 511 that can be visually recognized through the opening region 522 of the second virtual image 52, which is a virtual image of the parallax barrier 33, is wider than the region 511 that can be visually recognized through the opening region 522 of the second virtual image 52 shown in FIG. 6 (a). Therefore, the light emitted from at least a part of the right eye image reaches the left eye. As a result, crosstalk occurs in the eyes of the user U.

Further, as shown in FIG. 6C, when the distance d between the display panel 32 and the eyes of the user U is larger than the optimum viewing distance D, on the first virtual image 51 which is a virtual image of the display panel 32, The region 511 that can be visually recognized through the opening region 522 of the second virtual image 52, which is a virtual image of the paralux barrier 33, is narrower than the region 511 that can be visually recognized through the opening region 522 of the second virtual image 52 shown in FIG. 6 (a). Therefore, the amount of image light that reaches the eyes of the user U is reduced. Also in this case, a part of the right eye image is mixed with the light ray observed by the left eye, and a part of the left eye image is mixed with the light ray observed by the right eye.

In the present embodiment, the controller 35 displaces the position of the display device 30 in order to suppress the occurrence of such crosstalk. The details of the processing by the controller 35 will be described in detail later.

Returning to FIG. 2, the communication unit 34 is a communication interface that receives position information indicating the position of the eye from the detection device 2. As the communication unit 34, a physical connector and a wireless communication device can be adopted. Physical connectors include electrical connectors that support transmission by electrical signals, optical connectors that support transmission by optical signals, and electromagnetic connectors that support transmission by electromagnetic waves. The electrical connectors include IEC60603 compliant connector, USB standard compliant connector, RCA terminal compatible connector, EIAJ CP-1211A S terminal compatible connector, and EIAJ RC-5237 D terminal. The connector includes a connector corresponding to HDMI, a connector conforming to the HDMI® standard, and a connector corresponding to a coaxial cable including BNC. Optical connectors include various connectors according to IEC 61754. Wireless communication equipment includes wireless communication equipment conforming to each standard including Bluetooth (registered trademark) and IEEE 802.11. The wireless communication device includes at least one antenna.

The controller 35 is connected to the driver 36 and controls the driver 36. The controller 35 is configured as, for example, a processor. The controller 35 may include one or more processors. The processor may include a general-purpose processor that loads a specific program and performs a specific function, and a dedicated processor that is specialized for a specific process. The dedicated processor may include an application specific integrated circuit (ASIC). The processor may include a programmable logic device (PLD). The PLD may include an FPGA (Field-Programmable Gate Array). The controller 35 may be either a SoC (System-on-a-Chip) in which one or a plurality of processors cooperate, and a SiP (System In a Package). The controller 35 includes a storage unit, and the storage unit may store various types of information, a program for operating each component of the display system 1, and the like. The storage unit may be composed of, for example, a semiconductor memory or the like. The storage unit may function as a work memory of the controller 35.

As described above, the controller 35 displaces the display device 30 based on the position of the eyes of the user U in order to suppress the occurrence of crosstalk. When the communication unit 34 receives the position information, the controller 35 displaces the display device 30 based on the position of the eye in the ray direction of the image light reaching the eye of the user U (hereinafter, referred to as “depth direction”). Perform the first process. Here, the first process will be described in detail.

The controller 35 controls the driver 36 so as to suppress the occurrence of crosstalk, and displaces the positions of the first virtual image 51 of the display panel 32 and the second virtual image 52 of the parallax barrier 33. Therefore, the controller 35 displaces the display device 30 along the normal direction of the display surface 321. At this time, the display device 30 may be displaced with the relative positional relationship between the display panel 32 and the parallax barrier 33 fixed. In the present embodiment, the displacement of the display device 30 indicates that at least the display panel 32 and the parallax barrier 33 are displaced.

Specifically, when the eye of the user U is displaced in the direction approaching the optical member 4a, the controller 35 controls the driver 36 to displace the display device 30 so as to be separated from the projection optical system 20. Since the first virtual image 51 and the second virtual image 52 are magnified by the projection optical system 20, the displacement amount of the first virtual image 51 and the second virtual image 52 that are displaced with the displacement of the display panel 32 and the parallax barrier 33 is determined. It is larger than the displacement amount of the display panel 32 and the parallax barrier 33. Therefore, the controller 35a projects the display device 30 with a displacement amount smaller than the displacement amount of the user U's eye so that the distance between the user U's eye and the second virtual image 52 is an apparent optimum viewing distance. Displace away from 20.

Further, when the eyes of the user U are displaced in the direction away from the optical member 4a, the controller 35 controls the driver 36 to displace the display device 30 so as to approach the projection optical system 20. At this time, the controller 35 projects the display device 30 with a displacement amount smaller than the displacement amount of the user U's eye in a direction in which the distance between the user U's eye and the second virtual image 52 maintains an apparently suitable viewing distance. It is displaced so as to approach the optical system 20.

The driver 36 displaces the display device 30 based on the control of the controller 35 described above. As shown in FIG. 2, the driver 36 includes, for example, a stage 36a, a motor (driving element) 36b, and the like. The stage 36a is arranged in the housing 10 at a position that does not obstruct the optical path of the image light. At least the display panel 32 and the parallax barrier 33 are fixedly attached to the stage 36a. The motor 36b drives the stage 36a so that the stage 36a is displaced along the normal direction of the display surface 321. As a result, the display panel 32 and the parallax barrier 33 fixed to the stage 36a are displaced with the displacement of the stage 36a.

Further, the controller 35 performs a second process of displaying either the right eye image or the left eye image on each subpixel based on the position of the eye in the plane perpendicular to the depth direction. Here, the second process will be described in detail.

The controller 35 uses the horizontal displacement of the user U's eye detected by the detection device 2 in the plane perpendicular to the depth direction from the reference position to display the left eye image. , And the subpixels to display the right eye image, respectively. In the case of the left eye, the reference position means that the image light from the left eye image on the display panel 32 reaches the left eye and the right eye is in a state where the display panel 32 and the paralux barrier 33 are in a predetermined positional relationship. This is a position where the image light from the image is blocked by the paralux barrier 33 and does not reach the left eye. Further, in the case of the right eye, the image light from the right eye image on the display panel 32 reaches the right eye, and the image light from the left eye image is blocked by the paralux barrier 33 and does not reach the right eye. .. Hereinafter, the reference position of the left eye is referred to as the left reference position LSP, and the reference position of the right eye is referred to as the right reference position RSP.

In the following description, a method will be described in which the controller 35 determines the subpixel to display the left eye image based on the displacement of the left eye position from the left reference position LSP. The same applies to the method in which the controller 35 uses the displacement of the position of the right eye from the right reference position RSP to determine the subpixel to display the right eye image.

A virtual image recognized when the left eye of the user U is displaced horizontally from the left reference position LSP will be described. As already described with reference to FIG. 3, the left-eye image is displayed in each of the sub-pixels of a plurality of columns arranged consecutively in the second direction every other column, and the right-eye image is adjacent to each of the plurality of columns. It is displayed in each of the sub-pixels of multiple columns arranged every other column. Further, the left eye image is displayed on the adjacent sub pixel on the opposite side of the sub pixel on which the right eye image is displayed, and this is repeated. Hereinafter, a predetermined row and a row arranged every other row in the predetermined row will be referred to as a first row group. Further, a row arranged adjacent to the first row group is referred to as a second row group. In FIG. 3, the left eye image is displayed in the subpixels of the first column group, and the right eye image is displayed in the subpixels of the second column group.

When the left eye of the user U is in the left reference position LSP, the image light emitted from the left eye image passes through the opening region 33b of the paralux barrier 33, is reflected by the optical member 4a, and reaches the left eye. .. As a result, as shown in FIG. 6A, the left eye of the user U visually recognizes the virtual image of the left eye image indicated by the reference numeral L. Similarly, the image light emitted from the right eye image passes through the opening region 33b of the paralux barrier 33, is reflected by the optical member 4a, and reaches the right eye. As a result, the right eye of the user U visually recognizes the virtual image of the right eye image indicated by the reference numeral R.

As shown in FIG. 7A, when the left eye of the user U is displaced by 1/2 of the intereye distance E from the left reference position LSP, the left eye image displayed in the first row group is displayed. The image light emitted from a part and the image light emitted from a part of the right eye image displayed in the second row group reach the left eye. Similarly, the image light emitted from a part of the left eye image displayed in the first row group and the image light emitted from a part of the right eye image displayed in the second row group are transmitted to the right eye. To reach. As a result, the left eye of the user U visually recognizes a part of the virtual image of the right eye image indicated by the reference numeral R and a part of the virtual image of the left eye image indicated by the reference numeral L. That is, crosstalk occurs, and it becomes difficult for the user U to recognize a normal stereoscopic image.

As shown in FIG. 7B, when the left eye of the user U is displaced by the intereye distance E from the left reference position LSP, the image ejected from the left eye image displayed in the first row group. Passes through the opening region 33b of the paralux barrier 33 and reaches the right eye. Further, the image ejected from the right eye image ejected from the left eye image displayed in the second row group passes through the opening region 33b of the paralux barrier 33 and reaches the left eye. As a result, the left eye of the user U visually recognizes the virtual image of the right eye image indicated by the reference numeral R, and the right eye visually recognizes the virtual image of the left eye image indicated by the reference numeral L. That is, a state of so-called reverse vision occurs, and it becomes difficult for the user U to recognize a normal stereoscopic image.

Therefore, the controller 35 causes the subpixels of the first row group of the display surface 321 to display the right eye image, and causes the subpixels of the second row group to display the left eye image. As a result, the image ejected from the left eye image passes through the opening region 33b of the parallax barrier 33 and reaches the left eye. Further, the image ejected from the right eye image passes through the opening region 33b of the parallax barrier 33 and reaches the right eye. In this case, as shown in FIG. 7C, the left eye of the user U visually recognizes the virtual image of the left eye image indicated by the reference numeral L, and the right eye visually recognizes the virtual image of the right eye image indicated by the reference numeral R. Therefore, the state of reverse vision is eliminated, and the user U can recognize a normal stereoscopic image.

Further, as shown in FIG. 7D, when the left eye of the user U is displaced from the left reference position LSP by twice the intereye distance E, the left eye image displayed in the first row group. The image ejected from the paralux barrier 33 passes through the opening region 33b and reaches the left eye. Further, the image ejected from the right eye image ejected from the left eye image displayed in the second row group passes through the opening region 33b of the paralux barrier 33 and reaches the left eye. As a result, the left eye of the user U visually recognizes the virtual image of the left eye image indicated by the reference numeral L, and the right eye visually recognizes the virtual image of the right eye image indicated by the reference numeral R. At this time, crosstalk does not occur, and the user U can recognize a normal stereoscopic image.

Therefore, the controller 35 determines whether to display the left eye image or the right eye image on each subpixel of the display panel 32 based on the position of the eye of the user U in order to suppress crosstalk and reverse vision. To do. Hereinafter, a method in which the controller 35 displays an image based on the position of the left eye will be described, but the same applies to a method in which the controller 35 displays an image based on the position of the right eye.

When the left eye is located at a position where the image light from the second row group reaches more than the image light from the first row group, the controller 35 causes the second row group to display the left eye image.

Specifically, when the position of the left eye is a position displaced in the horizontal direction from the reference position by a distance of E / 2 or more and less than 3E / 2, the left eye image is ejected from the subpixels of the second row group. The image light reaches more than the image light emitted from the subpixels of the first row group. Therefore, the controller 35 causes the subpixels of the second row group to display the left eye image and the subpixels of the first row group to display the right eye image.

When the position of the left eye is 3E / 2 or more and less than 5E / 2 from the reference position and is displaced in the horizontal direction, the image light emitted from the subpixels of the first row group is included in the left eye image. , Reach more than the image light emitted from the subpixels of the second row group. Therefore, the controller 35 causes the subpixels of the first row group to display the left eye image and the subpixels of the second row group to display the right eye image.

Similarly, when the position of the left eye is a position displaced in the horizontal direction within a predetermined distance range from the reference position, the image light emitted from the subpixels of the second row group is included in the left eye image. It reaches more than the image light emitted from the subpixels in a row. The predetermined distance range is (4k-3) × E / 2 or more and (4k-1) × less than E / 2 (k is an integer). In this case, the controller 35 causes the subpixels of the second row group to display the left eye image and the subpixels of the first row group to display the right eye image.

Similarly, when the position of the left eye is a distance not within a predetermined distance range from the reference position and a position displaced in the horizontal direction, the image light emitted from the subpixels of the first row group is included in the left eye image. Reach more than the image light emitted from the subpixels of the second row group. In this case, the controller 35 causes the subpixels of the first row group to display the left eye image and the subpixels of the second row group to display the right eye image.

Subsequently, the process in which the controller 35 of the present embodiment displaces the display device 30 will be described with reference to FIG. When the communication unit 34 receives the position information indicating the position of the eyes of the user U, the controller 35 starts this process.

First, the controller 35 acquires the position information detected by the detection device 2 and received by the communication unit 34 (step S1).

When the position information is acquired in step S1, the controller 35 performs the first process based on the position of the left eye in the depth direction (step S2). Here, the details of the first process will be described with reference to FIG.

In the first process, the controller 35 of the display device 30 is based on the direction from the reference position and the amount of displacement of the position of the eye of the user U in the ray direction of the image light reaching the eye of the user U. The displacement direction and the displacement amount are determined (step S21). The controller 35 may store an appropriate displacement amount of the display device 30 according to the position of the user's eye in the depth direction as a table in advance in the memory, and determine the displacement amount based on this table.

When the displacement direction of the display device 30 is determined in step S21, the controller 35 controls the driver 36 to displace the display device 30 in the determined direction with the determined displacement amount (step S22).

When the first process is performed in step S2, the controller 35 performs the second process based on the position of the eye in the plane perpendicular to the depth direction (step S3). The details of the second process will be described below with reference to FIG.

In the second process, the controller 35 determines whether or not the position of the left eye is within a predetermined distance range from the reference position (step S31).

In step S31, when the position of the left eye is within a predetermined distance range from the reference position, the controller 35 causes the subpixels of the first row group to display the right eye image, and the subpixels of the second row group display the left eye. Display the image (step S32).

In step S31, if the position of the left eye is not within the distance range from the reference position, the controller 35 causes the subpixels of the first row group to display the left eye image and the subpixels of the second row group to display the right eye image. (Step S33).

When the second process is performed in step S3, the controller 35 returns to step S1 to acquire the position information received by the communication unit 34 again, and repeats the subsequent processes.

As described above, according to the present embodiment, the display device 30 displaces the display panel 32 and the parallax barrier 33 along the normal direction of the display surface 321 while maintaining the relative positional relationship. Therefore, it is possible to suppress crosstalk that occurs when the user U moves in the depth direction.

Further, according to the present embodiment, the display panel 32 and the parallax barrier 33 are displaced by the driver 36 based on the position of the eyes. Therefore, it is possible to surely reduce the crosstalk without increasing it.

Further, according to the present embodiment, it is determined whether to display the right eye image or the left eye image in each of the plurality of subpixels based on the position of the eye in the plane perpendicular to the depth direction. Therefore, the right eye image can be displayed on the subpixels viewed by the right eye of the user U, and the left eye image can be displayed on the subpixels viewed by the left eye, thereby suppressing the occurrence of crosstalk and reverse vision. Can be done.

Although the above embodiments have been described as representative examples, it will be apparent to those skilled in the art that many modifications and substitutions can be made within the spirit and scope of the present disclosure. Therefore, the present disclosure should not be construed as being limited by the embodiments described above, and various modifications and modifications can be made without departing from the scope of the claims. For example, it is possible to combine the plurality of constituent blocks described in the embodiment into one, or to divide one constituent block into one.

Further, in the above-described embodiment, the controller 35 performs the first process and then the second process, but the present invention is not limited to this. For example, the controller 35 may perform the first process after performing the second process. Further, the controller 35 may perform only one of the first process and the second process.

Further, in the above-described embodiment, the optical element that defines the light ray direction of the image light emitted from the subpixel is not limited to the paralux barrier, and a lenticular lens or the like can be used. The lenticular lens may have a structure in which cylindrical lenses extending in the second direction are arranged in the first direction. The "plurality of strips extending in the second direction" may include a portion extending in the first direction. "A plurality of strip-shaped regions extending in the second direction" are not included when they are parallel to the first direction. The "plurality of strips extending in the second direction" can extend diagonally with respect to the second direction.

1 Display system 2 Detection device 3 Projection device 4 Moving body 4a Optical member 10 Housing 10a Aperture 20 Projection optical system 30 Display device 31 Irradiator 32 Display panel 321 Display surface 33 Parallax barrier 33a Light-shielding surface 33b Aperture area 34 Communication unit 35 Controller 36 Driver 36a Stage 36b Motor 50 Virtual image 51 First virtual image 52 Second virtual image

Claims (7)

A display element having a display surface having a plurality of subpixels arranged in a grid pattern along a first direction and a second direction substantially orthogonal to the first direction.
An optical element that defines the light ray direction of the image light emitted from the subpixel for each of the plurality of strip-shaped regions extending in the second direction on the display surface.
A projection optical system that projects the image light whose ray direction is defined by the optical element so as to form a virtual image of the display surface.
A driver that displaces the display surface and the optical element along the normal direction of the display surface in a state where the relative positional relationship with each other is fixed.
A communication unit that receives location information indicating the position of the user's eyes,
A controller that displaces the display surface and the optical element by the driver based on the position of the eye received by the communication unit.
A display device comprising. The driver includes a stage on which the display surface and the optical element are fixed, and a driving element that drives the stage in the normal direction of the display surface.
The display device according to claim 1, wherein the controller displaces the display surface and the optical element by driving the stage by the drive element. The controller displaces the display surface and the optical element along the normal direction of the display surface by the driver based on the position of the eye in the ray direction of the image light reaching the user's eye. The display device according to claim 2. The controller makes each of the plurality of subpixels visually recognizable to the left eye based on the position of the eye in a plane perpendicular to the ray direction of the image light reaching the user's eye. The display device according to claim 3, wherein one of the right eye images to be visually recognized by the right eye is to be displayed. The controller displays an image of either the right-eye image or the left-eye image on the sub-pixels of the plurality of rows arranged consecutively in the second direction every other row among the plurality of sub-pixels. Then, the sub-pixels of the plurality of columns arranged in every other row adjacent to the plurality of columns are provided with an image that is either the right-eye image or the left-eye image and is different from the one image. The display device according to claim 4, wherein the display is displayed. An imaging device that captures the user and
A communication unit that receives position information indicating the position of the user's eyes imaged by the image pickup device, and a communication unit.
A display element having a display surface having a plurality of subpixels arranged in a grid pattern along a first direction and a second direction substantially orthogonal to the first direction, and a plurality of display elements extending in the second direction on the display surface. An optical element that defines the light ray direction of the image light emitted from the subpixel for each band-shaped region and the image light whose light ray direction is defined by the optical element are formed so that a virtual image of the display surface is formed. Received by the communication unit and a driver that displaces the projection optical system to be projected, the display surface and the optical element along the normal direction of the display surface in a state where the relative positional relationship with each other is fixed. A controller that displaces the display surface and the optical element by the driver based on the position of the eye.
A display system including , and a display system. An imaging device that captures the user and
A communication unit that receives position information indicating the position of the user's eyes imaged by the image pickup device, and a communication unit.
A display element having a display surface having a plurality of subpixels arranged in a grid pattern along a first direction and a second direction substantially orthogonal to the first direction, and a plurality of display elements extending in the second direction on the display surface. An optical element that defines the light ray direction of the image light emitted from the subpixel for each band-shaped region and the image light whose light ray direction is defined by the optical element are formed so that a virtual image of the display surface is formed. Received by the communication unit and a driver that displaces the projection optical system to be projected, the display surface and the optical element along the normal direction of the display surface in a state where the relative positional relationship with each other is fixed. A display device having a controller that displaces the display surface and the optical element by the driver based on the position of the eye.
A mobile body with a display system that includes.

Images