JPH10153749A - Display device and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a virtual image in a form suitable for video. SOLUTION: When a video is a motion picture, a drama, etc., of a high-vision broadcast with a 16:9 aspect ratio, a large virtual image is formed on the display device 4 at a position which is, for example, approximately 15m far away from a user. When the video is a television signal of the NTSC system with a 4:3 aspect ratio, a virtual image of intermediate size is formed on the display device 4 at a relatively close position on, for example, approximately 3m. It is decided whether the video is one of the high-vision broadcast or NTSC system based on, for example, the synchronizing signal of the television signal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device and a display method, and more particularly, to providing a virtual image of an image by changing a distance, a size, or a direction to the virtual image in accordance with the image. The present invention relates to a display device and a display method capable of providing a virtual image in a form suitable for the video.

[0002]

2. Description of the Related Art As a display device for providing a virtual image to a user, for example, an HMD (Head Mounted Display) has been realized.

[0003] Here, a virtual image is formed on the object side when the object is located closer to the lens than the focal length, and its formation principle is described in, for example, "Introduction to Lens Science (above)", The details are described in Ogura Toshibu, Asahi Sonorama, "Optics", Kazumi Murata, Science, etc.

An HMD includes, for example, as shown in FIG. 9, a lens for enlarging an image to form a virtual image, and a display panel (for example, a liquid crystal display) disposed at a position closer than the focal length of the lens. It consists of. The user wears the HMD on his / her head and sees the image displayed on the display panel through the lens, so that the virtual image can be viewed.

[0005] In addition to a HMD, a display device capable of viewing a virtual image is, for example, a HUD (Head Up Diode).
splay) and video cameras.

However, in the HUD, necessary information is provided as a virtual image while performing some work such as driving a car or operating an aircraft. Therefore, the HUD cannot be said to be suitable for purely watching video such as a movie.

In a video camera, for example, FIG.
By looking through the viewfinder, a virtual image formed by enlarging the display of the built-in display panel with an eyepiece can be seen as shown in FIG. However, in the viewfinder, a virtual image can be viewed only with one eye, so the video camera, like the HUD,
It is not suitable for purely watching video such as movies.

[0008]

When a user views a virtual image, for example, the distance from the user at which the virtual image is formed is preferably changed depending on the image.

That is, for example, for a video having an aspect ratio of 4: 3, such as an NTSC television signal, the virtual image is placed at a position close to the user.
For a horizontally long image with an aspect ratio of 16: 9, such as a so-called high-definition television signal,
Forming the virtual image at a position far from the user can make the user feel more realistic,
The feeling of fatigue caused by watching the virtual image is reduced.

[0010] The present invention has been made in view of such a situation, and it is an object of the present invention to provide a virtual image in a form suitable for an image.

[0011]

According to a first aspect of the present invention, there is provided a display device, comprising: a distance changing means for changing a distance of a virtual image formed by an enlargement optical system from a user;
Control means for controlling the distance changing means.

A display method according to a sixth aspect is characterized in that a distance of a virtual image formed by the magnifying optical system from a user is changed in accordance with an image.

According to a seventh aspect of the present invention, there is provided a display device comprising: a size changing means for changing a size of a virtual image formed by the magnifying optical system; and a control means for controlling the size changing means in accordance with an image. It is characterized by having.

A display method according to a twelfth aspect is characterized in that the size of a virtual image formed by the magnifying optical system is changed in accordance with an image.

According to a thirteenth aspect of the present invention, the display device comprises: a direction changing means for changing a direction of a virtual image formed by the magnifying optical system; and a control means for controlling the direction changing means in accordance with an image. Features.

A display method according to claim 18 is characterized in that the direction of a virtual image formed by the magnifying optical system is changed in accordance with an image.

In the display device according to the first aspect, the distance changing means changes the distance of the virtual image formed by the magnifying optical system from the user, and the control means controls the distance changing means in accordance with the image. Has been made to control.

In the display method according to the sixth aspect, the distance of the virtual image formed by the magnifying optical system from the user is changed in accordance with the image.

In the display device according to the present invention, the size changing means changes the size of the virtual image formed by the magnifying optical system, and the control means controls the size changing means in accordance with the image. Has been made to control.

In the display method according to the twelfth aspect,
The size of the virtual image formed by the magnifying optical system is changed according to the image.

In the display device according to the thirteenth aspect,
The direction changing means changes the direction of the virtual image formed by the magnifying optical system, and the control means controls the direction changing means in accordance with the image.

[0022] In the display method according to the eighteenth aspect,
The direction of the virtual image formed by the magnifying optical system is changed according to the image.

[0023]

FIG. 1 shows a configuration of an embodiment of a virtual image providing system to which the present invention is applied. In this virtual image providing system, a virtual image with a sense of reality is provided in a form suitable for the video, and the user can view the virtual image in a relaxed state.

That is, the user holding mechanism 1 holds the user in a sitting state, for example, on a chair or a sofa, so that the user can be held in a relaxed state by sitting on the user.

Further, on the upper part of the backrest of the user holding mechanism 1, there is provided, for example, a hemispherical device fixing portion 2 configured to cover the head of the user when the user sits there. ing. The device fixing portion 2 is supported by the user holding mechanism 1 by a rotating pin 3, and is configured to rotate vertically about the rotating pin 3. In addition, the device fixing unit 2
Are locked at a predetermined position when turned upward, and at a position where they do not come into contact with the user's head held by the user holding mechanism 1 when turned downward. Locking).

Therefore, the user can easily sit on the user holding mechanism 9 by rotating the device fixing section 2 upward. Further, the user can easily stand up from the user holding mechanism 9.

A display device 4 is incorporated inside (inside) the device fixing section 2. That is, the display device 4 is positioned substantially in front (in front of) the user when the device fixing unit 2 is rotated downward and locked in a state where the user is held by the user holding mechanism 1. , Are incorporated inside the device fixing unit 2.

The display device 4 displays an image,
Small display panel 14 (14L and 14R) composed of, for example, a liquid crystal display (display means)
And a lens as an enlargement optical system that forms a virtual image by enlarging an image displayed on the display panel 14 and arranges the virtual images observed by the left and right eyes of the user at the same position in space. 13 (13L and 13R), whereby a virtual image obtained by enlarging a predetermined image is provided to the user.

The operation unit 5 is composed of various buttons and levers, and is operated when the system performs a predetermined process.

That is, for example, the device fixing unit 2
(Electrochromic Display) and other devices with variable light transmittance (hereinafter referred to as variable transmittance devices as appropriate), or a liquid crystal shutter incorporated in a transparent member. The operation unit 5 is operated when controlling the transmittance variable element, the liquid crystal shutter, and the like. Therefore, the user changes the transmittance of the device fixing unit 2 by operating the operation unit 5, so that the user can view the external scenery (situation) or prevent the external scenery from being seen. And so on.

The operation unit 5 is also operated when setting the distance, the size, and the direction of the virtual image formed by the display device 4 from the user.

In the virtual image providing system configured as described above, for example, when the user operates the operation unit 5 while being held by the user holding mechanism 1, for example, a TV (Television) tuner (not shown) receives the data. NTSC
A television signal of a system, a television signal of a high-definition broadcast, or a video signal output from a computer is supplied to the display device 4, and the corresponding video is displayed on the display panels 14L and 14R.

The image displayed on the display panel 14L or 14R is enlarged by the lens 13L or 13R, respectively, and the light as the enlarged image is incident on the left eye or the right eye of the user. Thereby, the virtual image of the image displayed on the display panel 14L or 14R is observed by the left eye or the right eye of the user, respectively.

At this time, the display device 4 changes the distance and size of the virtual image from the user in accordance with the video supplied thereto. That is, if the video has an aspect ratio of 16: 9 by, for example, high-definition broadcasting.
In the case of the movie or drama, a large virtual image is formed on the display device 4 at a position distant from the user, for example, about 15 m.

The video is, for example, of the NTSC system,
In the case of a television signal having an aspect ratio of 4: 3, the display device 4 receives, for example, 3
An intermediate size virtual image is formed at a relatively close position of about m. At this time, the display device 4 is provided with a virtual image by changing the aspect ratio of the video from 4: 3 to 16: 9 as in a so-called wide television (wide television receiver). It is also possible.

Further, when the video is, for example, an output screen of an information processing apparatus such as a computer, a relatively small virtual image is formed on the display device 4 at a position very close to, for example, about 0.5 m from the user. You.

As described above, a virtual image is generated for the user.
It is provided in a form suitable for the image.

That is, for a video such as a movie or a drama by a high-definition broadcast, a virtual image is formed at a position far from the user and large, thereby providing a sense of presence, a sense of distance, and a powerful image. Can be.

For a video such as a television signal having an aspect ratio of 4: 3 in the NTSC system, a virtual image is formed at a position relatively close to the user and at an intermediate size, so that the user can obtain a virtual image. Thus, it is possible to provide an image that does not cause a sense of strangeness visually. As a result, for example,
It is possible to reduce the degree of eye strain.

Further, for a video such as an output screen of an information processing apparatus such as a computer, the virtual image is formed at a position very close to the user and relatively small, so that the user can operate the computer or the like. Easy images can be provided. As a result, for example, it is possible to improve work efficiency.

In this embodiment, since the user is held in the user holding mechanism 1, the user can enjoy the virtual image in a very relaxed state.

Further, as described above, the user can change the transmittance of the device fixing unit 2 covering the head by operating the operation unit 5. Therefore, for example, when the transmittance is reduced, most of the external light is blocked, so that the user can be immersed in the virtual image space. In addition, when the transmittance is increased, the user can observe a virtual image while checking the surrounding situation, that is, can observe (confirm) the surrounding situation (scenery) superimposed on the virtual image. Furthermore, by setting the transmittance to an appropriate value,
It is possible to observe the virtual image with balanced brightness and the outside scenery. Then, in this case, the user can view the virtual image without feeling anxiety (a feeling of blockage) due to the inability to see the outside (giving the user a sense of openness). On the other hand, for example, when the transmittance is gradually reduced, the user can enjoy a feeling of immersing in the virtual image space from the real world.

Note that a speaker (not shown) is provided inside the apparatus fixing section 2, and if there is audio accompanying the video supplied thereto, the audio is output from the speaker. It has been done.

Here, the description of the voice will be omitted.

Next, FIG. 2 shows the display device 4 of FIG.
2 shows a configuration example of the optical system of FIG. FIG. 2 shows a configuration example when the display device 4 is viewed from above the user held by the user holding mechanism 1.

In the embodiment shown in FIG. 2, the display device 4 is an optical system for the left eye having a different optical axis as an enlargement optical system for forming a virtual image by enlarging an image. It has a lens 13L and a lens 13R that is an optical system for the right eye.

That is, the lens 13R or 13L has the same characteristic for providing the right or left eye with a virtual image R or L obtained by enlarging an image displayed on the display panel 14R or 14L, respectively. These are convex lenses, which are arranged on the same plane. That is, the lenses 13R and 13L are arranged such that their main planes coincide with each other.

Here, in FIG. 2, O1 or O2
Represents the principal point of the lens 13R or 13L, respectively, and F1 or F2 represents the focal point of the lens 13R or 13L, respectively. O is the principal points O1 and O
2 represents the midpoint between the two.

Display panel 14R or 14L
Is the center point (for example, the display panel 14R,
In the case where 14L has a rectangular shape, the intersection of diagonal lines of the rectangle, etc.) is defined by the middle point O and the focal point F1 or F2.
They are located on a straight line OF1 or OF2 connecting them, respectively, and are arranged such that they are located on the same plane.

According to the display device 4 configured as described above, the image displayed on the display panel 14R or 14L is enlarged by the lens 13R or 13L, and the light corresponding to the enlarged image is transmitted to the right eye or the right eye. When the light enters the left eye, a virtual image corresponding to the image is observed by the right eye or the left eye. That is, the lens 13
A virtual image R or L formed by R or 13L is
Observed with right eye or left eye respectively.

According to the configuration of FIG. 2, the virtual images observed by the right eye or the left eye are formed by the lenses 13R or 13L, which are separate optical systems, respectively.
In the dimensional space, they are arranged at the same position. That is, the virtual images observed by the left and right eyes of the user are arranged at the same position in space.

This is for the following reason. That is, for example, the direction from the principal point O2 to O1 is now the d axis, and the optical axis direction of the lens 13L (from the principal point O2 to the focal point F2).
Direction) is the s-axis. And the display panel 1
The center point of 4L is M1, the coordinates on the sd plane are (s1, d1), the center point of the virtual image L formed by the lens 13L is M1 ', and the coordinates on the sd plane are (s1', d1 '). ). Further, the midpoint between the focal points F1 and F2 is defined as O ′.

In this case, as described above, since the display panel 14R or 14L is on the same plane and the center point is on the straight line OF1 or OF2, the display panels 14R and 14L are connected to the lens 13R.
And 13L are equidistant from the main plane (also in the same plane as described above). Therefore, since the virtual images R and L are also on the same plane, if the center points of the virtual images R and L are on a straight line OO 'connecting the midpoints O and O', the virtual images R and L are the same. Will be in position.

Therefore, now, the display panel 14L
Is located on the straight line OF2, the following equation is established.

D1 = L / 2−L × s1 / (2 × f) (1) where L represents the distance between the principal points O1 and O2, and f represents the focal length of the lens 13L. .

On the other hand, the following equation is established by the imaging formula.

1 / f = 1 / s1-1 / s1 ′ (2)

The principal point O2 and the center points M1 and M1 'are
Since they are on a straight line, the following equation holds.

S1 / s1 ′ = d1 / d1 ′ (3)

From the equations (1) to (3), the equation d1 '= L / 2 (4) is obtained.

From equation (4), the center point M1 'of the virtual image L is
It is on the straight line OO '.

The optical system formed by the lens 13L and the optical system formed by the lens 13R are symmetric with respect to the straight line OO ', and therefore, the center point of the virtual image R is also on the straight line OO'.

As described above, virtual images R and L are on the same plane, and their center points are
Since they are on O ', the virtual images R and L are at the same position.

Therefore, the user can observe the virtual image in a state where the convergence and adjustment of both eyes are matched, that is, in a relaxed state (without difficulty).

In the display device 4, each of the display panels 14R and 14L moves synchronously on the straight line OF1 or OF2 so as to be included in the same plane.
The position where the virtual images R and L are formed is moved from near the user to infinity (the distance from the user to the virtual images R and L is changed). The movement of the display panels 14R and 14L is performed by a virtual image distance control motor 25 (FIGS. 3 and 5) configured by, for example, a stepping motor. Further, each of the display panels 14R or 14L moves in a range closer to the lens 13R or 13L than the focal point F1 or F2. This is, as mentioned above,
This is because in order to observe a virtual image of an object, the object needs to be at a position closer to the lens than the focal length.

The display panels 14L and 1L
By moving the 4R to a position near or far from the lenses 13L and 13R, the virtual images L and R move to a position near or far from the user, respectively.

Furthermore, since the distance from the user to the virtual images R and L can be changed theoretically by the distance between the lenses 13L and R and the display panels 14L and R, the display panels 14L and 14R Instead, it can be changed by moving the lenses 13L and 13R.

FIG. 2 shows a lens 1 which is a convex lens.
Although 3L and 13R are used as the magnifying optical system, the display device 4 may be configured using, for example, a concave mirror in addition to the convex lens.

Further, in FIG. 2, the virtual image observed by the left eye is formed independently by the lens 13L and the display panel 14L, and the virtual image observed by the right eye is formed independently by the lens 13R and the display panel 14R. Therefore, according to the display device 4, 2
In addition to a dimensional (planar) virtual image, a three-dimensional virtual image can be provided. That is, for example, by displaying a left-eye image or a right-eye image of a stereoscopic image using binocular parallax on the display panel 14L or 14R, a user can be provided with a stereoscopic virtual image. it can.

Next, FIG. 3 is a perspective view showing a configuration example of the display device 4.

The lenses 13L and 13R are attached to the bottom panel 16 at intervals such that the distance between their optical axes (principal points) is, for example, the average distance between the left and right eyes of a human. I have. The bottom panel 16 is fixed to the lower left frame spacer 11C and the lower right frame spacer 11D.

In addition to these frame spacers 11C and 11D, a front panel 12 and a rear panel 15 are provided so as to sandwich the upper left frame spacer 11A and the upper right frame spacer 11B. In the upper center between panel 15
A motor mounting portion 24 for fixing a virtual image distance control motor 25 is provided, and is fixed to the front panel 12 and the rear panel 15. The virtual image distance control motor 25 is
By rotating, the threaded motor shaft 26 is moved up and down.

In FIG. 3, the front panel 12,
Although the back panel 15 and the bottom panel 16 are made transparent, this is for illustrating the configuration of the display device 4, and these need not necessarily be made of transparent members.

The space between front panel 12 and rear panel 15 includes display panels 14L and 14R.
A panel holder 18 to which is attached is provided.

That is, the panel holder 18 has panel attachment portions 19L and 19R, and the display panel 14 is attached to the panel attachment portions 19L or 19R.
L or 14R is attached so that the display screen faces the lens 13L or 13R, respectively.
Then, the panel mounting portion 19L or 19R is arranged along the shaft 20L or 20R of the panel holder 18,
The predetermined range on the left or right side is defined as the horizontal direction (in FIG. 3, the direction parallel to the main plane of the lenses 13L and 13R).
Each is made to be able to move.

Further, the panel mounting portion 19L or 1
A pin 23L or 23R is provided on the front side of the 9R, respectively, and the pin 23L or 23R is provided in the frame groove 21L or 21R provided in the front panel 12.
Has been passed through each.

Here, the frame groove 21L or 21R
Are provided in a direction of rising left (downward right) or in a direction of rising right (downward left) along the straight line OF2 or OF1 described in FIG.

The rear panel 15 has a frame groove 22 similar to the frame groove 21L or 21R of the front panel 12.
L or 22R is provided, respectively. A pin 2 is provided on the back side of the panel mounting portion 19L or 19R.
Pins (not shown) are provided similarly to 3L or 23R, respectively, and panel mounting portions 19L or 19R.
Are respectively passed through the frame grooves 22L or 22R of the rear panel 15.

Therefore, when the panel holder 18 moves upward as a whole, the panel mounting portion 19L or 19L
R means that the pin 23L or 23R has the frame groove 21L (2
By moving along 2L) or 21R (22R), respectively, along the shaft 20L or 20R,
Move left or right respectively. Panel holder 1
When the whole 8 moves downward, the panel mounting portion 19L or 19R moves along the shaft 20L or 20R by the pin 23L or 23R moving along the frame groove 21L (22L) or 21R (22R), respectively. Move left or right, respectively.

As a result, in conjunction with the vertical movement of the panel holder 18, the display panel 14L or 14L
R is the frame groove 21L (22L) or 21R (22
R), that is, as described with reference to FIG. 2, on the straight line OF2 or OF1, respectively, so as to be included in the same plane.

In the center of the panel holder 18, a center plate 27
The center plate 27 is provided with one end of a motor shaft 26. Therefore, the panel holder 18 moves up and down together with the motor shaft 26. That is, when the virtual image distance control motor 25 rotates, the display panel 14L or 14R moves on the straight line OF2 or OF1 so as to be included in the same plane.

In the embodiment shown in FIG. 3, the half mirror 17 is fixed to the boundary between the rear panel 15 and the bottom panel 16 so as to be oblique to the rear panel. The half mirror 17 has a reflection surface on the front surface.

In the display device 4 configured as described above, the display panel 14L or 14R
Are displayed on the screen, and are enlarged by the lenses 13L and 13R, respectively. The enlarged image obtained by the lens 13L or 13R is reflected by the half mirror 17 and enters the user's left eye or right eye, respectively. Thereby, a virtual image is observed in the user's eyeball. In addition, light from the outside is incident on the left eye and the right eye of the user by transmitting through the surface on the opposite side of the reflection surface of the half mirror 17, whereby the external scene is observed in the user's eyeball. You.

Then, the virtual image distance control motor 25 rotates, whereby the display panel 14L or 14L is driven.
As R moves on the straight line OF2 or OF1, respectively, virtual images observed by the user are formed at various distances from the user as described with reference to FIG.

In FIG. 3, the enlarged image obtained by the lenses 13L and 13R is reflected by the half mirror 17 and is incident on the user's eyeball. The enlarged images obtained at 13L and 13R can be directly incident on the user's eyeball. However, in this case, the display panels 14R and 14L are located in front of the user. Therefore, even if the device fixing portion 2 (FIG. 1) transmits light, the display panels 14R and 14L
Since the field of view is blocked by the camera, it is difficult to confirm an external situation (landscape) corresponding to the range of the blocked field of view.

Next, FIG. 4 shows the principle of making the size of the virtual image variable.

As shown in FIG. 10A, the display panel 14 (14L and 14R) has a sufficiently large display area, and the size of the image displayed there is changed to the size shown in FIGS. The size of the virtual image is changed by increasing or decreasing the size as indicated by a shadow in the parentheses.

As described above, by moving the position of the display panel 14 (FIG. 3) and changing the size of the image displayed on the display panel 14 (FIG. 4), as described with reference to FIG. On the other hand, it is possible to provide the virtual image at a position at an appropriate distance from the user and at an appropriate size (angle of view).

That is, when the video is a high-definition broadcast, for example, the display panel 14 is moved to a position away from the lens 13 and the video is displayed on the display as shown in FIG. Panel 1
4, if it is displayed on the whole, as shown in FIG.
A large virtual image having a width-to-length ratio of 16: 9 can be formed. If the video is, for example, an NTSC television signal, the display panel 14 is moved to a position close to the lens 13 and the video is displayed on the display as shown in FIG. When displayed on a part of the central portion of the panel 14, as shown in FIG. 5, a relatively small virtual image having a narrow angle of view and a horizontal to vertical ratio of 4: 3 can be formed.

Next, FIG. 6 shows an example of the electrical configuration of the virtual image providing system of FIG.

The video signal processing computer 41 (control means) receives the video signal, performs signal processing, and
The video signal is, for example, a high-definition broadcast signal, N
It is designed to recognize whether it is a TSC television signal or a computer signal. Then, the video signal processing computer 41 responds to the recognition result by a virtual image distance signal for controlling the distance of the virtual image to be formed from the user or a size control signal for controlling the size of the virtual image. Is generated and supplied to the virtual image distance control computer 42 or the display control unit 44, respectively. Further, the video signal processing computer 41 supplies the received video signal to the display control unit 44.

The video signal processing computer 41
Is basically configured to generate and output left-eye and right-eye video signals from a received video signal. Are received, these video signals are output as they are.

The virtual image distance control computer 42 receives the virtual image distance signal from the video signal processing computer 41, and responds to the virtual image distance signal to generate a motor drive circuit 43.
To generate a virtual image distance control signal as a control signal to be applied to the image data. This virtual image distance control signal is transmitted from the virtual image distance control computer 42 to the motor drive circuit 43.
To be supplied.

The motor drive circuit 43 operates according to a virtual image distance control signal from the virtual image distance control computer 42.
The virtual image distance control motor 25 (distance changing means) is rotationally driven. Further, the motor drive circuit 43
Is driven to rotate the virtual image distance control motor 25 in accordance with an operation signal supplied by operating the operation unit 5. The motor drive circuit 43
When both the virtual image distance control signal and the operation signal are supplied, one of them, for example, the operation signal is prioritized.

The display control section 44 (size changing means) (direction changing means) controls the left eye similarly supplied from the video signal processing computer 41 in accordance with the size control signal supplied from the video signal processing computer 41. The horizontal and vertical lengths of the video signal for the right and left eyes are limited (enlarged or reduced) and supplied to the display panels 14L and 14R for display. Further, the display control unit 44 enlarges or reduces the video signal in accordance with an operation signal supplied when the operation unit 5 is operated. Note that the display control unit 44 also
Similarly to the motor drive circuit 43, when both the magnitude control signal and the operation signal are supplied, one of them is
For example, an operation signal is prioritized.

Next, referring to the flowchart of FIG.
The operation will be described. Note that the flowchart of FIG. 7 shows the processing of the video signal processing computer 41 of FIG.

Upon receiving the video signal, the video signal processing computer 41 determines in step S1, S3, or S5 whether the video signal is of the NTSC system, of high-definition broadcasting, or of a computer. A determination is made, and in steps S2, S4, S6 and S7, control corresponding to the determination result is performed.

Here, steps S1, S3, and S5
Is determined, for example, by detecting a horizontal synchronizing signal or a vertical synchronizing signal included in the video signal and based on what Hz the horizontal synchronizing frequency or the vertical synchronizing frequency is.

That is, first, in step S1, it is determined whether the received video signal is of the NTSC system. In step S1, the video signal is NTS
If it is determined that the signal is of the C type, the process proceeds to step S2, and a virtual image distance signal or a size control signal corresponding to the NTSC system is output to the virtual image distance control computer 42 or the display control unit 44, respectively. The video signals for the left eye and the right eye are output to the display control unit 44, and the process ends.

The virtual image distance control computer 42 recognizes the distance at which the virtual image is formed at the present time (hereinafter, referred to as the current distance), and upon receiving the virtual image distance signal, calculates the distance corresponding to the virtual image distance signal and the current distance. Calculate the difference with Then, when the difference value is not 0, a virtual image distance control signal corresponding to the rotation amount of the virtual image distance control motor 25 required to move the virtual image by the difference value is generated,
It is supplied to the motor drive circuit 43. In the motor drive circuit 43, the virtual image distance control motor 25 is rotationally driven in accordance with the virtual image distance control signal, whereby the display panels 14L and 14R are moved to predetermined positions (from the user,
(A position separated by a distance corresponding to the virtual image distance signal).

On the other hand, the display control section 44 enlarges or reduces the left-eye or right-eye video signal in accordance with the magnitude control signal, and outputs the enlarged or reduced image signal to the display panel 14L or 14L.
R.

Thus, a virtual image is formed at a position away from the user by a distance corresponding to the virtual image distance signal and at a size corresponding to the size control signal. That is, in this case, since the virtual image distance signal and the size control signal correspond to the NTSC system, as described with reference to FIG.
The virtual image is formed at a position relatively close to the user and at a medium size.

On the other hand, if it is determined in step S1 that the video signal is not of the NTSC system, the process proceeds to step S3, where it is determined whether the video signal is of a high-definition broadcast. If it is determined in step S3 that the video signal is from a high-definition broadcast, the process proceeds to step S4, where the virtual image distance signal or the size control signal corresponding to the high-definition broadcast is transmitted to the virtual image distance control computer 42 or the display control unit 44. And the video signals for the left eye and the right eye are output to the display control unit 44, and the process ends.

In this case, as in the case described above, the virtual image is formed at a position away from the user by a distance corresponding to the virtual image distance signal and at a size corresponding to the size control signal. That is, in this case, since the virtual image distance signal and the size control signal correspond to the high-definition broadcasting, the virtual image is formed at a position far from the user and large as described with reference to FIG.

If it is determined in step S3 that the video signal is not from a high-definition broadcast,
Proceeding to step S5, it is determined whether the video signal is for a computer. If it is determined in step S5 that the video signal is for a computer, the process proceeds to step S6, where the virtual image distance signal or the size control signal corresponding to the computer is transmitted to the virtual image distance control computer 42 or the display control unit 44. The video signals for the left eye and the right eye are output to the display control unit 4.
4 and the process ends.

Also in this case, as in the case described above, the virtual image is formed at a position away from the user by a distance corresponding to the virtual image distance signal and at a size corresponding to the size control signal. That is, in this case, since the virtual image distance signal and the size control signal correspond to the computer,
As described in FIG. 1, the virtual image is formed at a position very close to the user and small.

If it is determined in step S5 that the video signal is not for a computer, the process proceeds to step S7, where the default virtual image distance signal or size control signal is output to the virtual image distance control computer 42 or the display control unit. At the same time, the video signals for the left eye and the right eye are output to the display control unit 44, and the process ends.

Here, the default virtual image distance signal or the size control signal is, for example, the same as that corresponding to the NTSC system. Therefore, in this case, the virtual image is located at a position relatively close to the user. And a medium size.

As described above, since the virtual image is provided in a form suitable for the video, it is possible to give the user a sense of realism, and it is possible to reduce the feeling of fatigue caused by watching the virtual image. .

In the above, the present invention has been described for a case where the display device 4 for forming a virtual image is applied to a virtual image providing system integrated with a user holding mechanism 1 for holding a user. The present invention is applicable to an apparatus that provides an image by using an HMD or another virtual image.

In this embodiment, the distance and the size at which the virtual image is formed are changed in accordance with the video synchronization signal. The direction of the virtual image that changes) can be changed, for example, in accordance with the content of the video. That is, for example, by performing pattern recognition (image recognition) on an image, it is possible to continuously recognize whether the image displays a landscape or a person. Form a large virtual image, in the case of a person,
For example, it is possible to form a virtual image of a certain size at a relatively close position. In this case, for example, in a scene of a landscape, a virtual image of the landscape is largely formed at a distant position, and it is possible to give the user a feeling of being surrounded in the landscape as if he were actually there. Furthermore, for example, in a scene in which a person is displayed in an up position, a virtual image of the person is formed in a relatively close position with a certain size, and it is possible to clearly confirm the expression of the person. Become.

It is also possible to detect the aspect ratio of a video image and change the distance at which a virtual image is formed, etc., according to the detection result. That is, for example, when the aspect ratio is 16: 9, a large virtual image is formed at a distant position, and when the aspect ratio is 4: 3, a medium virtual image is formed at a relatively close position. It is possible.

The image displayed on the display panel 14 can be enlarged or reduced as a whole, or only a part thereof can be enlarged or reduced. Furthermore, it is also possible to enlarge or reduce only one of the horizontal and vertical directions of the video, thereby converting the aspect ratio of the video to a desired value. For example, in the case where the image displays a landscape, only the horizontal direction is enlarged to form a horizontally long virtual image, so that the above-described feeling of surroundings can be given to the user.

Further, in the present embodiment, the distance to the virtual image and the size thereof are changed in accordance with the image. However, for example, the direction in which the virtual image is formed also corresponds to the image. Can be changed. This is achieved, for example, by changing the position of a region (a hatched portion in FIG. 8) for displaying an image on the display panel 14 by the display control unit 44 as shown in FIG. Can be realized.

Changing the direction in which the virtual image is formed in accordance with the image in this way is useful, for example, when watching the virtual image while performing some work.

Specifically, for example, in the case where the present invention is applied to an HMD, when actually cooking while watching a virtual image of a cooking program, the direction in which the virtual image is formed is changed from the center to the upper left, By changing to the upper right, lower left, lower right, or the like, the user can reliably work in the front direction while viewing a recipe or the like, which is a virtual image. That is, by moving the virtual image from the front direction (center), the visibility in the front direction is improved, and the work can be performed safely and reliably.

Whether the program is a cooking program can be determined, for example, by causing the video signal processing computer 41 to pattern-recognize whether or not a video includes characters such as a cooking name. Alternatively, the sound associated with the video is recognized by voice, and the result of the voice recognition is used to determine whether or not the name of the dish or its ingredients are included. Further, the content of the program is described in the television signal of the program. It is possible to superimpose the information to be broadcast and make a decision based on the information. Then, in the case of a cooking program, for example, the display control unit 44 is controlled so that the video signal processing computer 41 displays the video in a direction other than the front direction of the user, such as the upper left direction. Just do it.

Further, in the present embodiment, the distance to the virtual image and the like are changed according to the video, but this is changed by the user operating the operation section 5 as described above. It is also possible to make it.

Further, the relationship between the image and the distance at which the virtual image is formed is not limited to that described with reference to FIG.

[0120]

According to the display device of the first aspect and the display method of the sixth aspect, the distance of the virtual image formed by the magnifying optical system from the user is changed in accordance with the image. . According to the display device described in claim 7 and the display method described in claim 12, the size of the virtual image formed by the magnifying optical system is changed according to the image. Furthermore, according to the display device described in claim 13 and the display method described in claim 18, the direction of the virtual image formed by the magnifying optical system is changed corresponding to the image. Therefore, it is possible to provide a virtual image in a form suitable for a video.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an appearance of a virtual image providing system according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration example of an optical system of the display device 4 of FIG.

FIG. 3 is a perspective view showing a configuration example of the display device 4 of FIG.

FIG. 4 is a diagram for explaining the principle of making the size of a virtual image variable.

FIG. 5 is a diagram for explaining the principle of making the size of a virtual image variable.

FIG. 6 is a block diagram illustrating an example of an electrical configuration of the virtual image providing system of FIG. 1;

FIG. 7 is a flowchart for explaining the operation of the video signal processing computer 41 of FIG. 6;

FIG. 8 is a diagram for explaining a method of changing a direction in which a virtual image is formed.

FIG. 9 is a diagram illustrating a configuration of an example of an HMD system.

FIG. 10 is a diagram illustrating a configuration of an example of a video camera.

[Explanation of symbols]

1 user holding mechanism, 2 device fixing part, 3 rotating pin, 4 display device, 5 operation unit, 11A
To 11D frame spacer, 12 front panel,
13L, 13R lens, 14L, 14R display panel, 15 back panel, 16 bottom panel, 17 half mirror, 18 panel holder,
19L, 19R Panel mounting part, 20L, 20R
Shaft, 21L, 21R, 22L, 22R frame groove, 23L, 23R pin, 24 motor mounting part, 25 virtual image distance control motor, 26 shaft, 27 center plate, 41 video signal processing computer, 42 virtual image distance control computer, 43
Motor drive circuit, 44 Display control unit

Continuation of the front page (72) Inventor Yoshire Tanaka 6-7-35 Kita Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation

Claims (18)

[Claims] A display unit that displays an image, an enlargement optical system that forms a virtual image by enlarging the image displayed on the display unit, and a virtual image that is formed by the enlargement optical system. A display device comprising: a distance changing unit that changes a distance; and a control unit that controls the distance changing unit in accordance with the image. 2. The display device according to claim 1, wherein the control unit controls the distance changing unit in response to the video synchronization signal. 3. The display device according to claim 1, wherein the control unit controls the distance changing unit in accordance with the content of the video. 4. The display device according to claim 1, further comprising an operation unit operated to change a distance of the virtual image formed by the magnifying optical system from a user. 5. The display device according to claim 1, wherein the magnifying optical system arranges the virtual images observed by a left eye and a right eye of a user at the same position in space. 6. A display method for a display device, comprising: display means for displaying an image; and an enlargement optical system that forms a virtual image by enlarging the image displayed on the display means. And changing a distance of the virtual image formed by the magnifying optical system from a user. 7. A display unit for displaying an image, an enlargement optical system for forming a virtual image by enlarging the image displayed on the display unit, and changing the size of the virtual image formed by the enlargement optical system. A display device comprising: a size changing unit that controls the size changing unit in accordance with the image. 8. The display device according to claim 7, wherein the control unit controls the size changing unit in response to the video synchronization signal. 9. The display device according to claim 7, wherein the control unit controls the size changing unit according to the content of the video. 10. The display device according to claim 7, further comprising an operation unit operated when changing the size of the virtual image formed by the magnifying optical system. 11. The display device according to claim 7, wherein the magnifying optical system arranges the virtual images observed by a left eye and a right eye of a user at the same position in space. 12. A display method for a display device, comprising: display means for displaying an image; and an enlargement optical system that forms a virtual image by enlarging the image displayed on the display means. And changing the size of the virtual image formed by the magnifying optical system. 13. A display means for displaying an image, an enlargement optical system for forming a virtual image by enlarging the image displayed on the display means, and a direction of the virtual image formed by the enlargement optical system is changed. A display device comprising: a direction changing unit; and a control unit that controls the direction changing unit in accordance with the image. 14. The display device according to claim 13, wherein the control unit controls the direction changing unit in accordance with the video synchronization signal. 15. The display device according to claim 13, wherein the control unit controls the direction changing unit in accordance with the content of the video. 16. The display device according to claim 13, further comprising operating means operated when changing a direction of the virtual image formed by the magnifying optical system. 17. The display device according to claim 13, wherein the magnifying optical system arranges the virtual images observed by a left eye and a right eye of a user at the same position in space. 18. A display method for a display device, comprising: display means for displaying an image; and an enlargement optical system that forms a virtual image by enlarging the image displayed on the display means. Changing the direction of the virtual image formed by the magnifying optical system.