JPH10221639A - Display device and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve presence obtained by means of observing virtual image by forming the virtual images corresponding a perceptive image for permitting a user to perceive distance till the virtual image corresponding to a reception image or the size of the virtual image. SOLUTION: Data of the optimum perceptive image which is selected by a control part 13 is read from a perceptive image ROM 11 and supplied to RAM 12. Data of the optimum perceptive image is stored in the address of a corresponding area except an audito-visual program range in the storage area. Then, the audito-visual program image stored in RAM 12 and data of the optimum perceptive image are read from there and supplied to a display pannel 2. Thus, the image displayed in the display pannel 2 is enlarged by a lens and made incident to the eyeballs of the user so that the virtual image corresponding to the optimum perceptive image is observed together with the virtual image corresponding to the audio-visual program image in the left eye and the right eye of the user.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device and a display method, and more particularly to a user perceiving, for example, a virtual image corresponding to an image which the user intends to view, and a distance and a size (size) to the virtual image. TECHNICAL FIELD The present invention relates to a display device and a display method capable of improving a sense of reality obtained by observing a virtual image by forming a virtual image corresponding to a perceived image to be displayed.

[0002]

2. Description of the Related Art Recently, for example, HMD (Head Mount Dis
A virtual image display device, which is a display device that provides a user with a virtual image, such as play).

[0003] Here, a virtual image is formed on the object side when the object is located closer to the lens than the focal length, and its formation principle is described in, for example, "Introduction to Lens Science (above)", The details are described in Ogura Toshibu, Asahi Sonorama, "Optics", Kazumi Murata, Science, etc.

[0004]

Factors that cause a human to perceive the position (distance to the object) and the size (size) of the object in space are, for example, the degree of convergence of both eyes and the degree of focus adjustment. And the size (viewing angle, angle of view) of the image of the object (retinal image) formed on the retina.

Therefore, it is conceivable that a virtual image display device forms a virtual image with a sense of reality based on these factors.

FIG. 19 is a top view showing an example of the configuration of a virtual image display device that forms a virtual image with a sense of reality based on the above factors.

[0007] The display panels 2L and 2R are made of, for example, liquid crystal or the like, and display images for the left eye or the right eye, respectively. Display panel 2L
Alternatively, light as an image displayed on 2R is transmitted through lens 1L.
Or 1R, respectively, where it is magnified and incident on the left or right eye of the user. Display panel 2
L or 2R is arranged at a position closer to the focus of the lens 1L or 1R (position closer to the lens 1L or 1R), whereby the image is enlarged by the lens 1L or 1R with the left or right eye of the user. Each virtual image formed by the observation is observed.

The virtual image display apparatus shown in FIG. 19 has a lens 1L as an optical system for the left eye and a lens 1R as an optical system for the right eye, that is, has two optical axes. It is called a two-optical axis type (in contrast, for example, an image displayed on one display panel is
A virtual image is formed by enlarging with one lens, and this virtual image is also referred to as a single optical axis type in which the virtual image can be observed with one eye or both eyes).

In such a two-optical axis type virtual image display device, observation is performed with the left eye or the right eye of the user depending on the positional relationship between the lens 1L and the display panel 2L and the positional relationship between the lens 1R and the display panel 2R. The distance from the user (the position where the virtual image is formed) (the virtual image forming position) at which the virtual image to be formed is formed can be changed.

Therefore, by adjusting the positional relationship between the lens 1L and the display panel 2L and the positional relationship between the lens 1R and the display panel 2R, the degree of convergence and focus adjustment of both eyes can be changed. , The position of the virtual image (the distance from the user to the virtual image)
It can be perceived by the user.

Further, as shown in FIG. 20, when the size of the retinal image is constant, the user perceives that the larger the distance to the virtual image, the larger the virtual image. Therefore, the size of the virtual image perceived by the user can be changed by adjusting the above-described positional relationship and changing the position where the virtual image is formed. Conversely, if the distance to the virtual image is constant,
By changing the size of the retinal image, the size of the virtual image perceived by the user can be changed.

By the way, among the virtual image display devices, there is a so-called see-through type in which external light can enter, and in this case, the user needs only a virtual image (virtual image screen) (virtual image space). There is no external scenery (situation) (real space).

For this reason, depending on the environment of the real space, a virtual image with a sense of reality may not be obtained.

That is, the position and size of an object in a space perceived by a human being are greatly influenced by the degree of adjustment of the convergence and focus of both eyes, the size of the retinal image, and the effect of visual psychology. give. In other words, the virtual image space is
In the case where the virtual image can be viewed together with the real space, the psychological effect obtained by comparing the object existing in the real space with the virtual image greatly affects the position and the size of the virtual image perceived by a human.

Specifically, for example, as shown in FIG. 21, when there is an object (obstacle) existing in the real space between the user and the virtual image, the obstacle is in front of the virtual image.
Originally, the entire obstacle should be visible as shown in FIG.

However, in the virtual image display device shown in FIG. 19, since the field of view is blocked by the display panels 2L and 2R, as shown in FIG. Disappears.

As described above, a phenomenon that is impossible in a real space in which an obstacle in front of the virtual image is hidden behind the virtual image and cannot be seen occurs. Due to such contradictions, the position and size of the virtual image are reduced. May not be perceived correctly, and as a result, a virtual image with a sense of reality may not be obtained.

Therefore, there is a method of constructing a virtual image display device so as to block external light so that a user cannot see an external scene (real space).

However, if external light is blocked and the effect of visual psychology that greatly affects the position and size of the object perceived by humans is not used, that is, the object to be compared with the virtual image cannot be seen. In this case, the position and size of the virtual image are not correctly perceived, and as a result, a realistic virtual image may not be obtained.

SUMMARY OF THE INVENTION The present invention has been made in view of such a situation, and allows a user to correctly perceive the position and size of a virtual image, thereby providing a virtual image with a sense of reality. It is.

[0021]

According to a first aspect of the present invention, there is provided a display device, comprising: a storage unit for storing a perceived image for allowing a user to perceive a distance to a virtual image corresponding to a received image or a size of the virtual image. A magnifying optical system that forms a virtual image by enlarging the received image displayed on the display means,
A virtual image corresponding to the perceived image is also formed.

A display method according to a tenth aspect is characterized in that a virtual image corresponding to a perceived image for causing a user to perceive a distance to a virtual image corresponding to a received image or a size of the virtual image is formed.

In the display device according to the first aspect, the storage means stores a perceived image for allowing a user to perceive a distance to a virtual image corresponding to the received image or a size of the virtual image, and a magnifying optical system. Are configured to form a virtual image corresponding to the perceived image.

In the display method according to the tenth aspect,
A virtual image corresponding to a perceived image for allowing a user to perceive the distance to the virtual image corresponding to the received image or the size of the virtual image is formed.

[0025]

FIG. 1 shows an appearance of a first embodiment of a virtual image display apparatus to which the present invention is applied, and FIG. 2 shows a right side thereof (a right side as viewed from a user).
2 shows a cross section of FIG.

As shown in FIG. 1, the virtual image display device is covered with a light-shielding film (a hatched portion in FIG. 1) for shielding light. During use, the user cannot see the real space (external situation, scenery).

The optical configuration of the virtual image display device (FIG. 2) is, for example, the same as that in FIG. 19, and a description thereof will be omitted.

FIG. 3 shows an example of a usage form of the virtual image display device.

FIG. 3A shows a virtual image display device.
As shown in (1), a belt or the like to be worn on the head is provided, so that it can be worn on the head and used. Further, as shown in FIG. 2B, the virtual image display device can be fixed to a stand or the like, and can be used in a form in which a user can peek. Further, as shown in FIG. 3C, the virtual image display device can be configured to be small in size for convenience in carrying, and used in a form held by a user. Further, as shown in FIG. 3D, a rotatable hood that covers the user's head is attached to a sofa or the like, and the virtual image display device is fixed inside the hood. Can also. However, in this case, it is desirable that the hood be configured to block external light.

The example of use shown in FIG. 3 is an example,
The form of use of the virtual image display device is not particularly limited.

Next, FIG. 4 shows an electrical configuration example of the first embodiment of the virtual image display device.

Perceptual image ROM (Read Only Memory) 1
1 (storage means) stores data of a perceived image which is an image suitable for allowing a user to perceive the distance to the virtual image and the size (size) of the virtual image. Specifically, for example, the size in the real space is empirically recognized,
In addition, images of people whose size is almost constant no matter who sees them, specific flora and fauna, cigarette boxes, etc., which can be perceived as the distance and size to the virtual image by comparing with the virtual image Is stored as a perceptual image.
Further, the perceived image ROM 11 stores perceived images of various sizes even if they are the same.

The RAM (Random Access Memory) 12
For example, an image (for example, a movie or the like) that the user intends to view (for example, a movie) such as an image signal (display video signal) output from a tuner or a playback device (not shown) (hereinafter, appropriately referred to as a viewing program image) (received image) Is received, temporarily stored, and output to the display panel 2 (2L and 2R) (display means). Also, RAM
Reference numeral 12 also temporarily stores a perceived image read from the perceived image ROM 11 and outputs it to the display panel 2.

The control unit 13 controls reading of the perceived image data from the perceived image ROM 11.

In the virtual image display apparatus configured as described above, the data of the viewing program image is stored in the RAM 12 in units of one screen (one frame or one field).
And stored.

Here, the storage capacity of the RAM 12 is assumed to be larger than the data amount of one screen of the viewing program image. That is, when the width × length of one screen of the viewing program image is composed of, for example, 640 × 480 pixels, RA
M12 has a capacity capable of storing, for example, data of 800 × 600 pixels.

In the RAM 12, data of a viewing program image for one screen is displayed in, for example, a predetermined range such as a central portion of the display panel 2 (hereinafter, appropriately referred to as a viewing program range). Stored at the address.

On the other hand, in the control unit 13, a ROM
Of the perceived images stored in the RAM 11
The data having an optimal size for perceiving the distance and the size to the virtual image corresponding to the viewing program image supplied to the user (hereinafter, appropriately referred to as an optimal perceived image) is selected.

That is, for example, when the user operates the control unit 13 based on the distance and the size to the virtual image corresponding to the viewing program image, the control unit 13 selects the optimal perceived image according to the operation. You. Further, for example, the data of the viewing program image includes information indicating the distance and the size to the virtual image corresponding to the image, and the control unit 13 selects the optimal perceived image according to the information. . Alternatively, as described above, the position at which a virtual image is formed is determined by the positional relationship between the lens 1 (magnifying optical system) and the display panel 2. A perceived image is selected.

The data of the optimal perceptual image selected by the control unit 13 is read out from the perceptual image ROM 11,
The data is supplied to the RAM 12. In the RAM 12, the data of the optimum perceived image is stored at an address of an area corresponding to the area other than the viewing program range in the storage area. That is,
For example, it is stored in the display panel 2 at an address displayed on the left and right of the viewing program image. However, the data of the optimal perceptual image can be stored in the display panel 2 at an address that is displayed on the display panel 2 so as to be superimposed on the viewing program image.

The data of the viewing program image and the optimal perceived image stored in the RAM 12 are read therefrom and supplied to the display panel 2. This allows
On the display panel 2, the viewing program image is displayed at the center thereof, and the optimum perceived image is displayed on the left and right sides.

As described above, the image displayed on the display panel 2 is magnified by the lens 1 and enters the user's eyeball, so that the left and right eyes of the user, for example, as shown in FIG. Thus, together with the virtual image corresponding to the viewing program image, the virtual image corresponding to the optimal perceived image is observed.

Accordingly, the user compares the viewing program image with the optimal perceived image, and correctly perceives the position and size of the virtual image corresponding to the viewing program image from the visual psychological effect obtained thereby, and as a result, You can enjoy a certain virtual image.

As the perceived image, for example, an image using a method of expressing a sense of depth such as perspective or texture gradient can be used. In this case, the user
The position and size of the virtual image corresponding to the viewing program image can be correctly perceived also from the psychological effect due to the sense of depth obtained from the perceived image.

The perceived image may be either a moving image or a still image.

When the perceived image is a moving image, the moving image is
What gives a sense of depth by perspective (for example, a moving image displaying a star flowing from the periphery toward the center gives a sense of depth such that the star flows from the user side toward the virtual image) Again, from the psychological effect due to the sense of depth, it becomes possible for the user to correctly perceive the position and size of the virtual image corresponding to the viewing program image.
However, when the perceived image is a moving image, it is necessary to rewrite the data of the perceived image stored in the RAM 12 in accordance with the motion of the moving image.

On the other hand, when the perceived image is a still image, once the perceived image data is written to the RAM 12 once, for example, the power of the apparatus is not turned off or the perceived image is not changed to another one. As long as the rewriting is not necessary, the perceptual image data need not be rewritten. Therefore, in this case, it is only necessary to rewrite the data of the viewing program image thereafter.

When the virtual image corresponding to the perceived image is always presented together with the virtual image corresponding to the viewing program image, the perceived image is noticeable and cannot be concentrated or immersed in the viewing program image. Can be considered.

FIG. 6 shows the configuration of a virtual image display apparatus according to a second embodiment of the present invention. In the figure, the same reference numerals are given to portions corresponding to the case in FIG. That is, this virtual image display device is configured in the same manner as in FIG. 4 except that a timing controller 21 is newly provided.

Timing controller 21 (control means)
Controls the timing of reading the data of the optimal perceived image from the perceived image ROM 11 and writing the data to the RAM 12 (hereinafter referred to as write timing as appropriate). Further, the timing controller 21 controls a period during which the data of the optimum perceived image is stored in the RAM 12 (hereinafter, appropriately referred to as a storage period).

The write timing and the storage period can be set by the user, for example, by operating the timing controller 21. The write timing and the storage period are
For example, it is also possible to superimpose the data on the viewing program image.

In the virtual image display device configured as described above, the user operates the timing controller 21 to set the write timing and the storage period, or the write timing and the storage superimposed on the data of the viewing program image. Upon receiving the period, the timing controller 21 reads the data of the optimal perceived image from the perceived image ROM 11 according to the write timing, and writes the data to the RAM 12. After that, when the storage period elapses, the writing of the data of the optimally perceived image to the RAM 12 is stopped.
12 is deleted.

Therefore, in this case, since the virtual image corresponding to the optimally perceived image is formed (presented) only for the storage period from the writing timing, the user can respond to the optimally perceived image only for a desired time from a desired time. The virtual image can be observed, and as a result, it is possible to prevent the user from being unable to concentrate or immerse in the viewing program image.

Next, FIG. 7 shows a configuration of a third embodiment of a virtual image display apparatus to which the present invention is applied. In the figure, the same reference numerals are given to portions corresponding to the case in FIG. That is, in this virtual image display device, the RAM 12 is deleted and the switch 3
The configuration is the same as that in FIG. 4 except that the controller 2 and the controller 33 are newly provided.

The switch 32 selects one of the terminals a and b under the control of the controller 33. The terminal a is supplied with an optimal perceived image from the perceived image ROM 11, and the terminal b is supplied with a viewing program image.

The controller 33 is supplied with a program reproduction instruction signal for instructing the start of the viewing program image. The controller 33 controls the switch 32 in response to the program reproduction instruction signal. Has been made. The controller 33 includes:
The switch 32 can be controlled in response to a user operation.

In the virtual image display device configured as described above, when the user performs an operation to start displaying the viewing program image, the controller 3 is activated.
3 is supplied with a program reproduction instruction signal. When receiving the program reproduction instruction signal, the controller 33 controls the switch 32 to select the terminal a. As a result, the optimal perceptual image read from the perceptual image ROM 11 is supplied to the display panel 2 via the switch 32 and displayed. Therefore, in this case, only a virtual image corresponding to the optimal perceived image is formed.

When the optimum perceived image is a still image, the controller 33, for example, operates for a predetermined time after the still image is displayed (for example, the user operates the controller 33 to operate the controller 33 for a predetermined time). After the setting has elapsed, the switch 32 is controlled to select the terminal b. Further, when the optimal perceived image is a moving image, for example, when the moving image ends, the controller 33 controls the switch 32 to select the terminal b. As a result, the viewing program image supplied to the terminal b is supplied to the display panel 2 via the switch 32 and displayed. Therefore, in this case, only a virtual image corresponding to the viewing program image is formed.

As described above, according to the third embodiment, only immediately before the display of the viewing program image is started,
Since the optimum perceived image is displayed, it is possible to prevent the optimum perceived image from hindering the user from viewing the viewing program image.

That is, when the user starts watching the viewing program image, the user is immersed in the viewing program image, and his / her psychological interest in the distance and size to the virtual image is weakened, and the user desires to always watch only the viewing program image. In such a case, displaying the optimum perceived image together with the viewing program image, even temporarily, hinders the user from viewing the viewing program image.

Therefore, as described above, the optimum perceived image is displayed only once immediately before the display of the viewing program image is started, thereby preventing the user from viewing the viewing program image. Further, it is possible for the user to accurately recognize the distance and the size to the virtual image corresponding to the viewing program image.

In this case, since the viewing program image and the optimum perceived image are not simultaneously displayed on the display panel 2, the optimum perceived image is displayed as the viewing program image as shown in FIG. It does not need to be displayed outside the area to be displayed. That is, the optimal perceived image is, for example,
It can be displayed in the same area as the area where the viewing program image is displayed.

Further, when the optimum perceived image is displayed in the same area as the area where the viewing program image is displayed, the number of pixels of the display panel 2 can be reduced. That is, as in the case of the first and second embodiments, when the optimum perceived image is displayed outside the region where the viewing program image is displayed simultaneously with the viewing program image, the display panel 2 It is necessary to have an image having at least the number of pixels that can simultaneously display the optimum perceptual image and the viewing program image. On the contrary,
Do not display the optimal perceived image at the same time as the viewing program image,
In addition, when the optimum perceptual image is displayed in the same area as the area where the viewing program image is displayed, the display panel 2 only needs to have at least the number of pixels capable of displaying the viewing program image. .

Here, in the embodiment of FIG. 7, as in the case of FIG. 4 and FIG.
The RAM 12 is not provided in the preceding stage because the viewing program image and the optimum perceived image are not displayed at the same time, so that it is not necessary to combine the two. However, depending on the relationship between the signal method (video signal method) of the viewing program image or the optimal perceived image and the driving method of the display panel 2 as a display device, the data of the viewing program image or the optimal perceived image may be converted. In some cases, a memory such as a RAM is required before the display panel 2.

Incidentally, as the perceived image, a three-dimensional stereoscopic image other than a two-dimensional planar image can be used. The stereoscopic image can be formed using, for example, binocular parallax and convergence change.

That is, when the virtual image display device is configured as a two-optical axis type as shown in FIG. 19, the left and right eyes of the user can observe independent virtual images. Therefore, for example, if the virtual image observed by the left eye or the right eye of the user is referred to as a left-eye virtual image or a right-eye virtual image, respectively, as shown in FIG. When the virtual image for the right eye is formed on the right side or the left side in the same plane, the user sees a stereoscopic image that appears on the near side (user side) of the plane.

Then, when the virtual image for the left eye or the virtual image for the right eye is moved left or right from the state in FIG. 8A, the stereoscopic video moves in a direction away from the user. Further, even after the virtual image for the left eye or the virtual image for the right eye matches in the same plane, the virtual image for the left eye or the virtual image for the right eye is moved to the left or right, respectively.
As shown in (B), the user observes a three-dimensional image that emerges farther from the plane.

Also, for example, when the virtual image for the left eye or the virtual image for the right eye is moved to the right or left from the state in FIG. 8B, the stereoscopic image becomes opposite to the case described above. It moves in the direction approaching the user.

Therefore, by moving the position where the left-eye virtual image and the right-eye virtual image are formed in the left-right direction within the same plane, a three-dimensional image moving away from the user or a three-dimensional image approaching the user can be displayed. Can be formed.

By using such a stereoscopic image as a perceptual image, the user can correctly recognize the distance and the size to the virtual image corresponding to the viewing program image.

The use of a three-dimensional image as a perceived image is applicable to any of the above-described embodiments.

However, in the stereoscopic vision based on the binocular parallax as described above, the convergence of the user's both eyes is adjusted in the direction of the stereoscopic image, but the focus adjustment is not a stereoscopic image but a virtual image for the left eye. And the virtual image for the right eye. As described above, since the focus adjustment is not performed on the stereoscopic image, watching the stereoscopic image by the binocular parallax for a long time leads to fatigue.

Therefore, when a stereoscopic image utilizing binocular parallax is used as a perceived image, it is desirable that the perceived image should not be viewed by the user for an excessively long time.

Next, a stereoscopic image as a perceptual image can be formed as follows, for example, in addition to using binocular parallax.

FIG. 9 shows the configuration of the fourth embodiment of the virtual image display apparatus to which the present invention is applied.

In this embodiment, a display panel 2 (display panels 2L and 2R) for displaying a viewing program image and a lens 1 (lenses 1L and 1R) for enlarging the viewing program image to form a virtual image are provided. A display panel 41 for displaying a perceived image and a hemispherical mirror 42 (forming means) for forming a three-dimensional image by reflecting light as the perceived image.

Then, light as a three-dimensional image of the perceived image formed by the hemispherical mirror 42 (hereinafter, appropriately referred to as a perceived three-dimensional image) is enlarged by the lens 1,
The light enters the user's eyeball, whereby the user can view a virtual image corresponding to the perceived stereoscopic image on the user's eyeball.

That is, in this embodiment, the user views a virtual image corresponding to the viewing program image formed by enlarging the viewing program image displayed on the display panel 2 with the lens 1. Can be. Note that, as described above, the distance to the virtual image corresponding to the viewing program image and the size thereof are determined by the lens 1.
Is determined by the positional relationship between
At this time, the user views a virtual image of such a distance and size.

Further, in this case, the user can also obtain a virtual image corresponding to a perceived three-dimensional image formed by reflecting a perceived image displayed on a display panel 41 different from the display panel 2 by a hemispherical mirror 42. It can be observed through the lens 1.

Here, it is known that an image (here, a perceived stereoscopic image) formed (projected) by reflecting light on the hemispherical mirror 42 appears to float in space. Therefore, according to such a virtual image corresponding to the perceived stereoscopic image, the user can have a great sense of depth.

In FIG. 9, the perceived stereoscopic image is formed on the display panel 2 on which the viewing program image is displayed, in front of the user, that is, at a position close to the lens 1 side. Accordingly, the virtual image corresponding to the perceived stereoscopic image is formed by the lens 1 before the virtual image corresponding to the viewing program image. Further, in FIG. 9, the perceived stereoscopic image is
Display panel 2 on which viewing program images are displayed
The virtual image corresponding to the perceived stereoscopic image is formed by the lens 1 below the virtual image corresponding to the viewing program image. ing.

Accordingly, when an image in which, for example, a seat in a movie theater is displayed is used as the perceived image,
As shown in FIG. 10, together with the virtual image corresponding to the viewing program image, a virtual image with a sense of depth corresponding to a perceived stereoscopic image in which a seat of a movie theater or the like is displayed in front of the virtual image can be viewed. .

Therefore, in this case, the user can correctly recognize the distance and the size to the virtual image corresponding to the viewing program image by the psychological effect of the virtual image corresponding to the perceived stereoscopic image.
It is also possible to feel a sense of presence as if watching the viewing program image.

The distance and the size to the virtual image corresponding to the viewing program image are determined by the lens 1 as described above.
The distance and the size to the virtual image can be made variable by changing this positional relationship because it is determined by the positional relationship between the virtual image and the display panel 2. further,
The size of the virtual image can be changed, for example, by changing the size of the image displayed on the display panel 2. Therefore, in the virtual image display device capable of changing the distance and the size to the virtual image in this way, a plurality of perceived images are prepared, and the distance and the size to the virtual image corresponding to the viewing program image are prepared. Can be used to determine the perceived image to be used. In this case, it is possible to obtain a sense of reality under various circumstances.

Next, FIG. 11 shows a cross section (FIG. 11A) and an appearance (FIGS. 11B to 11E) of the virtual image display device of FIG.

In the embodiment shown in FIG. 9, since a display panel 41 for displaying a perceived image and a hemispherical mirror 42 for forming a perceived stereoscopic image are provided below the lens 1 and the display panel 2, a portion thereof is provided. Are also covered with a light shielding film.

When a virtual image corresponding to the perceived stereoscopic image is formed, for example, as shown in the sectional view of FIG. 12A, the display panel 41 and the hemispherical mirror 42 are replaced with the lens 1 and the display panel 2. It is also possible to provide it on the upper part of. Here, the external configuration of the virtual image display device in this case is shown in FIG.
(B) to FIG. 12 (E).

As described above, when the virtual light corresponding to the viewing program image is provided by blocking the external light, the virtual image corresponding to the perceived image is also provided (presented). Visual psychology, which is an important aid for perceiving the distance to the virtual image corresponding to the viewing program image and its size, while preventing inconsistencies such as the object being hidden behind the virtual image and being invisible, By effectively utilizing the information, the user can correctly recognize the distance and the size, and can provide a realistic virtual image.

By the way, in the embodiment of FIG.
As shown in (2), the display of the perceived image is started at the same time as the start of the viewing program image, and thereafter, the perceived image is displayed until the viewing program image ends.

Further, in the embodiment of FIG. 6, as shown in FIG. 14, the display of the perceived image is started, for example, at the same time as the start of the viewing program image, and thereafter, the perceived image is displayed for a predetermined time (as described above). When the time corresponding to the storage period elapses, the data is erased. In addition, as an application of such a method of displaying a perceived image, for example, after deleting the perceived image, the display of the perceived image is started again at a predetermined timing, and further deleted after a predetermined time has elapsed. Is also possible. That is, the perceived image can be displayed periodically as shown in parentheses in FIG.

Further, in the embodiment of FIG. 7, as shown in FIG. 15, first, only the perceived image is displayed, and thereafter, only the viewing program image is displayed. That is,
Both the viewing program image and the perceived image are displayed independently, and the perceived image is displayed only immediately before the display of the viewing program image is started.

By the way, in the above embodiment,
I didn't specifically mention the size of the perceived image,
According to an experiment performed by the inventor of the present invention, a result was obtained in which the larger the display area of the perceived image, the more correctly the user perceives the sense of distance and the like. Therefore, from the viewpoint of giving a sense of distance or the like, the larger the visual image, the better. However, if the visual image remains large, it hinders the user from viewing the viewing program image.

Therefore, the viewing program image and the perceived image can be displayed, for example, as shown in FIG.

That is, initially, the viewing program image is displayed small (for example, reduced to a small display area) and the perceived image is displayed large (for example, both reduction and enlargement are performed for a large display area). Without displaying). Specifically, for example, the viewing program image or the perceived image is displayed in a size of about 20% or 80% of the entire display area, respectively.

Thereafter, as time passes, the viewing program image is enlarged and the perceived image is decreased. Specifically, for example, in about 10 to 20 seconds, the viewing program image or the
Each size is changed so that the size is about% or 40%.

Then, from the start of display, for example, 1 to 5
After a lapse of a predetermined time such as minutes, only the viewing program image is displayed.

As described above, when the display area of the viewing program image and the perceived image is changed, the effect of the perceived image to the user can be adjusted. It is possible to efficiently provide and prevent the viewing of the viewing program image from being hindered.

Note that the display area of the viewing program image and the perceived image is determined by, for example, in the embodiment of FIG.
Can be easily changed by electrically enlarging or reducing the viewing program image and the perceived image stored in the storage device (the display area of the viewing program image and the perceived image can be changed optically). To let
This requires optical components and the like, which is not easy).

FIG. 17 shows a display example when the display area is changed as described above using an image of the interior of a movie theater as a perceived image. In this case, the user can perceive the distance to the viewing program image and the size thereof, and can also feel the realism as if he were actually in a movie theater.

When the virtual image display device is of a two-optical axis type, the seats and walls of the cinema displayed in the perceived image are made to have parallax between the left and right eyes. Since the seats and walls are recognized three-dimensionally, the sense of distance to the viewing program image can be further emphasized.

Further, the perceived image is not limited to a movie theater, and may be a moving image or a still image.

As a method of changing the display area (size) of the viewing program image and the perceived image, for example, as shown in FIG. 18B, or as shown in FIG. 18 (B), only the viewing program image is enlarged, thereby relatively increasing the size of the viewing program image. A method of reducing the size of the perceived image may be used. Further, it is possible to reduce only the perceived image, thereby relatively increasing the size of the viewing program image and reducing the size of the perceived image.
However, in this case, since the absolute size of the viewing program image does not change, it is difficult to display the viewing program image with high definition. That is, since the overall display area is constant, in order to finally display the viewing program image with high definition, at least the absolute size of the viewing program image should be increased. desirable.

Further, in FIG. 16, although both the viewing program image and the perceived image are displayed from the beginning, it is also possible to display only the perceived image initially.

In FIG. 16, the perceived image is finally deleted and only the viewing program image is displayed. However, the perceived image finally has a small display area and is displayed together with the viewing program image. It is also possible to leave it displayed.

In this embodiment, the virtual image formed by enlarging the image displayed on the display panel 2 by the lens 1 is viewed. It is also possible to watch the reflected virtual image reflected by a half mirror or the like.

In the present embodiment, the lens 1 which is a convex lens is used as the magnifying optical system for forming a virtual image. However, a concave mirror or the like can be used as the magnifying optical system. .

Further, in this embodiment, the virtual image display device is of the two-optical axis type. However, the present invention is also applicable to, for example, a one-optical axis type virtual image display device. .

In the present embodiment, the perceived image is displayed on the left, right, or below the viewing program image.
The display position of the perceived image is not particularly limited.

[0109]

According to the display device of the first aspect and the display method of the tenth aspect, the distance to the virtual image corresponding to the received image or the size of the virtual image is converted into a perceived image for the user to perceive. A corresponding virtual image is formed. Therefore, it is possible for the user to correctly recognize the distance or the size to the virtual image corresponding to the received image, and as a result, it is possible to improve the sense of reality obtained by observing the virtual image.

[Brief description of the drawings]

FIG. 1 is a diagram showing an external configuration of a first embodiment of a virtual image display device to which the present invention is applied.

FIG. 2 is a sectional view of the virtual image display device of FIG. 1;

FIG. 3 is a diagram for explaining a usage pattern of the virtual image display device of FIG. 1;

FIG. 4 is a block diagram illustrating an example of an electrical configuration of the virtual image display device of FIG. 1;

FIG. 5 is a diagram for explaining a virtual image that can be observed by the virtual image display device of FIG. 1;

FIG. 6 is a block diagram showing an electrical configuration of a virtual image display device according to a second embodiment of the present invention;

FIG. 7 is a block diagram showing an electrical configuration of a virtual image display device according to a third embodiment of the present invention;

FIG. 8 is a diagram for explaining a stereoscopic image using binocular parallax.

FIG. 9 is a diagram illustrating an optical configuration of a virtual image display device according to a fourth embodiment of the present invention;

10 is a diagram for explaining a virtual image that can be observed by the virtual image display device of FIG. 9;

11 is a diagram showing a cross section and an external configuration of the virtual image display device of FIG. 9;

FIG. 12 is a diagram showing a cross section and an external configuration of a fifth embodiment of a virtual image display device to which the present invention is applied.

FIG. 13 is a diagram showing a first temporal change in display of a perceived image.

FIG. 14 is a diagram illustrating a second temporal change in the display of a perceived image.

FIG. 15 is a diagram showing a third temporal change in the display of a perceived image.

FIG. 16 is a diagram illustrating a fourth temporal change in the display of the perceived image.

FIG. 17 is a diagram showing a perceived image in which the interior of a movie theater is displayed.

FIG. 18 is a diagram for explaining how to change the display area of the viewing program image and the perceived image.

FIG. 19 is a top cross-sectional view illustrating an optical configuration example of a two-optical axis type virtual image display device.

FIG. 20 is a diagram showing the relationship between the size of a retinal image and the distance to a virtual image.

FIG. 21 is a diagram illustrating a state in which an object (obstacle) existing in a real space exists between a user and a virtual image.

FIG. 22 is a diagram illustrating a case where an obstacle is visible before a virtual image and a case where an obstacle is not visible.

[Explanation of symbols]

1 (1L, 1R) lens, 2 (2L, 2R) display panel, 11 ROM for perceived image (Read Onl
y Memory), 12 RAM (Random AccessMemor)
y), 13 control units, 21 timing controllers, 32 switches, 33 controllers, 41
Display panel, 42 hemispherical mirror

Claims (10)

[Claims] A display unit configured to display a received image received by the display unit; a magnifying optical system configured to form a virtual image by enlarging the received image displayed on the display unit; The display device further provides a storage unit that stores a perceived image for causing a user to perceive the distance to the virtual image corresponding to the received image or the size of the virtual image, wherein the magnifying optical system includes: A display device, wherein a virtual image corresponding to the perceived image is also formed. 2. The display means displays the perceived image around the received image, and the magnifying optical system forms a virtual image corresponding to the received image and the perceived image displayed on the display means. The display device according to claim 1, wherein: 3. The display device according to claim 1, further comprising control means for controlling a timing or a period for presenting a virtual image corresponding to the perceived image. 4. The display device according to claim 3, wherein the control unit performs control such that a virtual image corresponding to the perceived image is periodically presented. 5. The apparatus according to claim 3, wherein the control unit also controls a display area of the received image or the perceived image.
The display device according to claim 1. 6. The display device according to claim 5, wherein the control unit increases the display area of the received image after starting presentation of a virtual image corresponding to the received image. 7. The display device according to claim 5, wherein, after starting presentation of a virtual image corresponding to the perceived image, the control unit reduces the display area of the perceived image. 8. The apparatus according to claim 1, wherein the magnifying optical system forms a virtual image corresponding to the perceived image only immediately before the display of the received image by the display unit is started.
The display device according to claim 1. 9. The apparatus according to claim 1, further comprising a forming unit configured to form a stereoscopic image obtained by stereoscopically transforming the perceived image, wherein the magnifying optical system forms a virtual image corresponding to the stereoscopic image. Display device. 10. A display method of a display device for providing a virtual image by forming a virtual image by enlarging a received image received and blocking external light, wherein a distance to a virtual image corresponding to the received image is provided. Or a virtual image corresponding to a perceived image for allowing a user to perceive the size of the virtual image.