JP6411229B2 - Video display device, video display method, and program - Google Patents

Description

  The present invention relates to a video display device, a video display method, and a program for displaying a video on a lens portion of glasses.

  In recent years, information terminals are sometimes developed for the purpose of making them wearable. For example, the development of eyeglass-type terminals that can display images is underway. In such a glasses-type terminal, a holographic optical element (hereinafter also referred to as HOE) may be used to obtain a bright image. Examples of eyeglass-type terminals using HOE include, for example, a video display device and a head-mounted display disclosed in Patent Document 1. The video display device and the head mounted display disclosed in Patent Document 1 guide video light from a video display element by entering the eyepiece optical system including an eyepiece prism and totally reflecting the image light incident on the eyepiece prism. To the HOE attached to the eyepiece prism. The image light that is reflected and refracted in the HOE enters the user's observation pupil (for example, see FIG. 12 of the same document).

JP 2012-13908 A

  In the video display device and the head mounted display of Patent Document 1, it is necessary to guide the video light while totally reflecting the inside of the eyepiece prism. Therefore, the arrangement position of the video display element (display) is limited, and the degree of design freedom is increased. Few. Moreover, since the light incident on the side surface to which the HOE is not attached cannot be used as an image, there is a problem that the angle of view of the image is reduced. Therefore, an object of the present invention is to provide an image display device that can increase the degree of freedom in design and can display an image with a large angle of view on the lens portion of the glasses.

  The video display device of the present invention includes a video output unit, a first holographic optical element, and a second holographic optical element.

  The video output unit is fixed at a predetermined position of the glasses and outputs a video.

  The first holographic optical element is connected to the video output unit and transmits and refracts light output from the video output unit in a predetermined direction. The second holographic optical element is fixed to the lens and refracts and reflects the light transmitted and refracted by the first holographic optical element in a direction determined based on the virtual light source position or the eyeball position of the spectacle wearer.

  According to the video display device of the present invention, the degree of freedom in design can be increased, and video can be displayed at a large angle of view on the lens portion of the glasses.

1 is a perspective view illustrating a configuration of a video display device according to Embodiment 1. FIG. FIG. 2 is a plan view illustrating a configuration of a video display device according to the first embodiment. The figure which represented typically the relationship between the track | orbit of the image light refracted | refracted and refracted / reflected by HOE of Example 1, and a virtual light source position. 3 is a flowchart showing the operation of the video display apparatus according to the first embodiment. The figure which represented typically the relationship between the track | orbit of image light and the virtual light source position which are refracted | refracted and refracted and reflected by HOE of Example 2. FIG. 10 is a flowchart illustrating the operation of the video display device according to the second embodiment. FIG. 10 is a diagram schematically illustrating a relationship between a trajectory of image light that is transmitted and refracted and refracted and reflected by the HOE of Example 3 and a virtual light source position. 10 is a flowchart showing the operation of the video display apparatus according to the third embodiment.

  Hereinafter, embodiments of the present invention will be described in detail. In addition, the same number is attached | subjected to the structure part which has the same function, and duplication description is abbreviate | omitted.

  Hereinafter, the configuration of the video display apparatus according to the first embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a perspective view showing a configuration of a video display device 1 of the present embodiment, and FIG. 2 is a plan view thereof. The video display device 1 according to the present embodiment is connected to the video output unit 10 fixed to an arbitrary position other than the glasses lens (for example, the temple 92 of the glasses as shown in FIGS. 1 and 2) and the video output unit 10. The first holographic optical element 11 and the second holographic optical element 12 fixed to the lens 94 are included. The video output unit 10 can be, for example, a micro display using a MEMS (Micro Electro Mechanical Systems) mirror array system, a MEMS scanning system, or a laser light source. The MEMS mirror reflects and scans RGB (red, green, and blue) laser beams from a laser beam output unit (not shown) in the video output unit 10 while changing the tilt of the micro mirror. The mirror is driven by a piezoelectric element or a coil or magnet. About the drive method of a mirror, you may depend on another well-known method. Use of a laser light source is preferable because the directivity of image light can be increased, transmission / refraction and refraction / reflection can be easily controlled in the HOE, and the obtained image becomes clear. In addition, since the hologram is a material with high wavelength selectivity, if the laser beam has a narrow wavelength band, the light use efficiency is high, and a brighter and brighter image can be generated compared to other light sources. However, the light source may be a light source other than a laser, for example, an LED. Further, the video output unit 10 may be configured with a liquid crystal display. 1 is configured to display the video only to the right eye, the present invention is not limited thereto, and the video display device 1 may be configured to display the video only to the left eye. Then, the video display device 1 may include two video output units 10, two first holographic optical elements 11, and two second holographic optical elements 12 so that the video can be displayed on both eyes.

  As shown in FIG. 1, the video output unit 10 and the first holographic optical element 11 may be formed integrally with each other. As will be described later, the first holographic optical element 11 needs to transmit and refract the image light from the image output unit 10, so that the image light from the image output unit 10 is incident without loss. It is desirable to be connected to the output unit 10.

  The lens 94 may be provided with a liquid crystal shutter. If the liquid crystal shutter is controlled to be closed when displaying an image, the image can be brightened by a contrast effect, and the visibility of the image can be improved. The video display device 1 may be connected to a remote controller for operating an object displayed on the video. By connecting a remote controller to the video display device 1, an object displayed on the video can be operated, and the video display device 1 can be used as an information terminal.

  Hereinafter, with reference to FIG. 3 and FIG. 4, the details of each component of the video display device 1 of the present embodiment and the operation of the video display device 1 will be described. FIG. 3 is a diagram schematically showing the relationship between the trajectory of the image light transmitted and refracted and refracted and reflected by the HOE of this embodiment and the position of the virtual light source. FIG. 4 is a flowchart showing the operation of the video display apparatus 1 of the present embodiment.

  The image light output coordinates ia, ib, and ic shown in FIG. 3 are the three image light output coordinates of the rear end, the center, and the front end of the image light output coordinates of the image output unit 10 and are all the other image light output coordinates. This is a point extracted as a representative. The transmission and refraction coordinates pa, pb, and pc represent coordinates on the first holographic optical element 11 that transmits and refracts the image light output from the above-described image light output coordinates ia, ib, and ic. The virtual light source coordinates va, vb, vc represent the coordinates of the virtual light source corresponding to the video light output coordinates ia, ib, ic of the video output unit 10. Refractive and reflective coordinates a, b, and c are second holographic optical elements that refract and reflect video light that is output from the above-described video light output coordinates ia, ib, and ic and is refracted through transmission and refraction coordinates pa, pb, and pc. The coordinates on 12 are represented. The eyeball position coordinate x represents the coordinates of the eyeball position of the eyeball wearer (in the present embodiment, the coordinates of the center of the cornea are set).

  As shown in FIG. 4, the video output unit 10 outputs a video (S10). The first holographic optical element 11 transmits and refracts the light output from the video output unit 10 in a direction determined from the positional relationship between the first holographic optical element 11 and the second holographic optical element 12 (S11). Specifically, the first holographic optical element 11 has a second holographic function with respect to a rear coordinate sequence (for example, a coordinate sequence including transmission refractive coordinates pa) of the first holographic optical element 11 as viewed from the spectacle wearer. A coordinate sequence on the nose side of the optical element 12 as viewed from the spectacle wearer (for example, a coordinate sequence including the refractive reflection coordinates a) corresponds to a coordinate sequence forward of the first holographic optical element 11 as viewed from the spectacle wearer (for example, The image output so that the coordinate sequence on the ear side of the second holographic optical element 12 (for example, the coordinate sequence including the refractive reflection coordinate c) corresponds to the coordinate sequence including the transmission refraction coordinate pc). The light output from the unit 10 is transmitted and refracted (S11). The light beam transmitted and refracted in the first holographic optical element 11 travels substantially parallel in the vertical direction, and the vertical relationship thereof does not change in the refracted and reflected light of the second holographic optical element 12.

  The second holographic optical element 12 refracts and reflects light transmitted and refracted by the first holographic optical element 11 in a direction determined based on a virtual light source position or a preset eyeball position of the spectacle wearer (S12). ). Specifically, the second holographic optical element 12 treats the light refracted by the first holographic optical element 11 as if it were incoming light from the virtual light source coordinates corresponding to the transmission refracting coordinates. Refracted and reflected. For example, the second holographic optical element 12 travels light incident upon being transmitted and refracted at the transmission / refraction coordinate pa of the first holographic optical element 11 on a straight line passing through the corresponding virtual light source coordinate va and refraction / reflection coordinate a. Then, the light is refracted and reflected (S12). Since the virtual light source position is determined based on the eyeball position coordinate x, the light refracted and reflected in step S12 reaches the preset eyeball position coordinate x. Alternatively, the second holographic optical element 12 travels light incident upon being transmitted and refracted at the transmission / refraction coordinate pa of the first holographic optical element 11 on a straight line passing through the refraction / reflection coordinate a and the eyeball position coordinate x. Is refracted and reflected (S12). At this time, the spectacle wearer perceives the light as coming from the virtual light source coordinate va.

  As described above, according to the video display device 1 of the present embodiment, since the two holographic optical elements are used, the video light can be easily controlled and the degree of design freedom can be increased. For example, the video output unit 10 and the first holographic optical element 11 fixed to the temple 92 of the glasses in this embodiment may be attached to other places, for example, the rim 93 and the bridge 96 of the glasses. In addition, since the holographic optical element can be a film having a thickness of about 20 μm, for example, the apparatus can be downsized as compared with the case of using an eyepiece prism. In addition, since the video display device 1 of the present embodiment does not perform light guide by the eyepiece prism, the video display device 1 can display a video with a larger angle of view on the lens portion of the glasses than in the past.

  Hereinafter, with reference to FIGS. 5 and 6, the video display apparatus according to the second embodiment improved so as to increase the degree of freedom of the arrangement position of the video output unit 10 in the video display apparatus 1 according to the first embodiment will be described. FIG. 5 is a diagram schematically showing the relationship between the trajectory of video light transmitted and refracted and refracted and reflected by the HOE of this embodiment and the position of the virtual light source. FIG. 6 is a flowchart showing the operation of the video display device 2 of the present embodiment. As shown in FIG. 5, the video display apparatus 2 of the present embodiment includes a video output unit 10 fixed at an arbitrary position other than the glasses lens (for example, a temple 92 of glasses as shown in FIG. 5), and a video output. The first holographic optical element 21 connected to the unit 10 and the second holographic optical element 12 fixed to the lens 94 are included, and the configuration requirements other than the first holographic optical element 21 are the same as those in the first embodiment. is there.

  As shown in FIG. 5, the video output unit 10 outputs a video (S10). The first holographic optical element 21 corresponds to the second holographic optical element 12 with respect to a rearward coordinate sequence of the first holographic optical device 21 as viewed from the spectacle wearer (for example, a coordinate sequence including the transmission refraction coordinate pa). The ear-side coordinate sequence (for example, the coordinate sequence including the refractive reflection coordinate c) corresponds to the eyeglass wearer, and the first holographic optical element 21 has the front coordinate sequence (for example, the transmission refraction coordinate pc) as viewed from the eyeglass wearer. Output from the video output unit 10 so that the nose side coordinate sequence (for example, the coordinate sequence including the refractive reflection coordinates a) of the second holographic optical element 12 as viewed from the eyeglass wearer corresponds to the coordinate sequence including The transmitted light is refracted (S21). The light beam transmitted and refracted in the first holographic optical element 21 travels substantially parallel in the vertical direction, and the vertical relationship thereof is not changed in the refracted and reflected light of the second holographic optical element 12. In step S21, by reversing the image light, as shown in FIG. 5, a region R (region surrounded by a dashed ellipse) that does not pass through the light flux is newly generated as compared with the case of the first embodiment. . Even if the cheeks, eyelashes, etc. of the spectacle wearer enter the region R, the image light is not blocked by these. Therefore, the degree of freedom in designing the video display device 2 is increased by the region R. By reversing the image light in step S21, the image observed by the spectacle wearer in the first embodiment and the image observed by the spectacle wearer in the present embodiment may be reversed left and right. When the image light is inverted as in the present embodiment, it is necessary to adjust the image using software or another optical system.

  The second holographic optical element 12 refracts and reflects the light transmitted and refracted by the first holographic optical element 21 in a direction determined based on a virtual light source position or a preset eyeball position of the spectacle wearer (S12). ). For example, the second holographic optical element 12 travels light incident upon being transmitted and refracted at the transmission and refraction coordinate pa of the first holographic optical element 21 on a straight line passing through the corresponding virtual light source coordinate va and refraction and reflection coordinate c. Then, the light is refracted and reflected (S12). Alternatively, the second holographic optical element 12 travels light incident upon being transmitted and refracted at the transmission / refraction coordinate pa of the first holographic optical element 21 on a straight line passing through the refraction / reflection coordinate c and the eyeball position coordinate x. Is refracted and reflected (S12). Step S12 is the same as that in the first embodiment.

  In the first and second embodiments, the eyeball position coordinate x is determined as one point, and the image light is transmitted and refracted and refracted and reflected as if the image light is incident on the eyeball position coordinate x from each of the virtual light source coordinates. It was. However, when the eyeball position coordinate x is fixed at one point, if the eyeball position moves from a predetermined position, the image light may not be incident on the retina of the spectacle wearer and the image may not be observed. . In view of this, the video display apparatus according to the third embodiment has improved this point, and is configured so that even when the eyeball moves, the video can be viewed well when the movement remains within the preset allowable range of eyeball movement. . Hereinafter, the video display apparatus according to the third embodiment in which the video visibility is improved will be described with reference to FIGS. FIG. 7 is a diagram schematically showing the relationship between the trajectory of video light transmitted and refracted and refracted and reflected by the HOE of this embodiment and the position of the virtual light source. FIG. 8 is a flowchart showing the operation of the video display device 3 of the present embodiment.

  As shown in FIG. 7, the video display device 3 according to the present embodiment is connected to the video output unit 10 fixed to an arbitrary position (for example, the temple 92 of the glasses) other than the glasses lens, and the video output unit 10. The first holographic optical element 31 and the second holographic optical element 32 fixed to the lens 94 are included, and the configuration requirements other than the first holographic optical element 31 and the second holographic optical element 32 are as in Example 1. Similar to the second embodiment. The first holographic optical element 31 is output from the video output unit 10 at a diffusion angle and direction determined based on an eyeball movement allowable range set in advance as a movement allowable range of the eyeball of the spectacle wearer and a virtual light source position. The light to be transmitted is refracted (S31). Specifically, the first holographic optical element 31 determines the degree of diffusion of the transmitted refracted light from the transmitted refractive coordinate pa as follows. For example, as shown in FIG. 7, the eye movement allowable range is a range from x1 to x2 where the coordinate x1 is the nose side end and the coordinate x2 is the ear side end. The coordinate of the intersection point of the straight line passing through the virtual light source coordinate va corresponding to the transmitted refraction coordinate pa and the coordinate x1 of the eye movement allowable range and the refractive reflection surface of the second holographic optical element 32 is defined as a coordinate a1. Similarly, the coordinate of the intersection of the straight line passing through the virtual light source coordinate va and the coordinate x2 of the eye movement allowable range and the refractive reflection surface of the second holographic optical element 32 is defined as a coordinate a2. At this time, the first holographic optical element 31 transmits, refracts, and refracts the image light from the image output unit 10 so that the transmitted refracted light from the transmitted refraction coordinate pa is diffused in the range from the coordinates a1 to the coordinates a2. Spread.

  Similarly, the coordinates of the intersection of the straight line passing through the virtual light source coordinate vb and the coordinate x1 corresponding to the transmission refraction coordinate pb and the refractive reflection surface of the second holographic optical element 32 are the coordinates b1, and the virtual light source coordinates vb and the coordinates x2 The coordinate of the intersection point of the straight line passing through and the refractive reflection surface of the second holographic optical element 32 is set as a coordinate b2, and the first holographic optical element 31 transmits the transmitted refracted light from the transmission refraction coordinate pb to the coordinates b1 to coordinates. The image light from the image output unit 10 is transmitted, refracted, and diffused so as to diffuse into the range up to b2.

  Similarly, the coordinates of the intersection of the straight line passing through the virtual light source coordinate vc corresponding to the transmission refraction coordinate pc and the coordinate x1 and the refractive reflection surface of the second holographic optical element 32 are the coordinate c1, and the virtual light source coordinate vc and the coordinate x2 The coordinate of the intersection of the straight line passing through and the refractive reflection surface of the second holographic optical element 32 is set as a coordinate c2, and the first holographic optical element 31 transmits the transmitted refracted light from the transmission refraction coordinate pc to the coordinates c1 to c1. The image light from the image output unit 10 is transmitted, refracted, and diffused so as to diffuse into the range up to c2. By providing the first holographic optical element 31 itself with the refraction and diffusion functions at the same time, the light that is refracted through transmission can be diffused at a predetermined angle.

  FIG. 7 is a diagram in which a light diffusion function is added to the holographic optical element 31 based on the first embodiment. However, the present invention is not limited to this, and a similar diffusion function may be added based on the second embodiment. . In this case, in order to invert the image light, the first holographic optical element 31 causes the image output unit 10 to transmit the refracted light from the transmission refraction coordinate pa to a range from the coordinate c1 to the coordinate c2, for example. Transmits, refracts, and diffuses the image light.

  Next, the second holographic optical element 32 refracts and reflects light transmitted and refracted by the first holographic optical element 31 in a direction determined based on the eye movement allowable range and the virtual light source position (S32). Specifically, the second holographic optical element 32 refracts and reflects the light incident on the coordinate a1 from the transmission refraction coordinate pa so as to be incident on x1 which is the coordinate of the nose side end of the eye movement allowable range. (S32). Further, the second holographic optical element 32 refracts and reflects the light incident on the coordinate a2 from the transmission refraction coordinate pa so as to be incident on x2 which is the coordinate of the ear-side end of the eyeball movement allowable range (S32). .

  Thus, for example, even when the light incident on the coordinate x1 that is the nose side end of the eye movement allowable range forms an image with the retina of the spectacle wearer, the light from the virtual light source coordinates va, vb, vc is used. Therefore, the spectacle wearer can visually recognize the video. On the other hand, for example, even when the light incident on the coordinate x2 that is the ear-side end of the eye movement allowable range forms an image at the retina of the spectacle wearer, the light comes from the virtual light source coordinates va, vb, and vc. Therefore, the spectacle wearer can visually recognize the image. Therefore, according to the video display device 3 of the present embodiment, even if the eyeball of the spectacle wearer moves, the video is good when the motion remains within the preset eye movement allowable range (x1 to x2). Visible to.

<Supplementary note>
The apparatus of the present invention includes, for example, a single hardware entity as an input unit to which a keyboard or the like can be connected, an output unit to which a liquid crystal display or the like can be connected, and a communication device (for example, a communication cable) capable of communicating outside the hardware entity. Can be connected to a communication unit, a CPU (Central Processing Unit, may include a cache memory or a register), a RAM or ROM that is a memory, an external storage device that is a hard disk, and an input unit, an output unit, or a communication unit thereof , A CPU, a RAM, a ROM, and a bus connected so that data can be exchanged between the external storage devices. If necessary, the hardware entity may be provided with a device (drive) that can read and write a recording medium such as a CD-ROM. Physical entities having such hardware resources include general-purpose computers, microcomputers, and microcontrollers.

  The external storage device of the hardware entity stores a program necessary for realizing the above functions and data necessary for processing the program (not limited to the external storage device, for example, reading a program) It may be stored in a ROM that is a dedicated storage device). Data obtained by the processing of these programs is appropriately stored in a RAM or an external storage device.

  In the hardware entity, each program stored in an external storage device (or ROM or the like) and data necessary for processing each program are read into a memory as necessary, and are interpreted and executed by a CPU as appropriate. . As a result, the CPU realizes a predetermined function (respective component requirements expressed as the above-described unit, unit, etc.).

  The present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the spirit of the present invention. In addition, the processing described in the above embodiment may be executed not only in time series according to the order of description but also in parallel or individually as required by the processing capability of the apparatus that executes the processing. .

  As described above, when the processing functions in the hardware entity (the apparatus of the present invention) described in the above embodiments are realized by a computer, the processing contents of the functions that the hardware entity should have are described by a program. Then, by executing this program on a computer, the processing functions in the hardware entity are realized on the computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. As the computer-readable recording medium, for example, any recording medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory may be used. Specifically, for example, as a magnetic recording device, a hard disk device, a flexible disk, a magnetic tape or the like, and as an optical disk, a DVD (Digital Versatile Disc), a DVD-RAM (Random Access Memory), a CD-ROM (Compact Disc Read Only). Memory), CD-R (Recordable) / RW (ReWritable), etc., magneto-optical recording medium, MO (Magneto-Optical disc), etc., semiconductor memory, EEP-ROM (Electronically Erasable and Programmable-Read Only Memory), etc. Can be used.

  The program is distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing the process, the computer reads a program stored in its own recording medium and executes a process according to the read program. As another execution form of the program, the computer may directly read the program from a portable recording medium and execute processing according to the program, and the program is transferred from the server computer to the computer. Each time, the processing according to the received program may be executed sequentially. Also, the program is not transferred from the server computer to the computer, and the above-described processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and result acquisition. It is good. Note that the program in this embodiment includes information that is used for processing by an electronic computer and that conforms to the program (data that is not a direct command to the computer but has a property that defines the processing of the computer).

  In this embodiment, a hardware entity is configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware.

DESCRIPTION OF SYMBOLS 1 Video display apparatus 10 Video output part 11 1st holographic optical element 12 2nd holographic optical element 2 Video display apparatus 21 1st holographic optical element 3 Video display apparatus 31 1st holographic optical element 32 2nd holographic optics Element 91 Modern 92 Temple 93 Rim 94 Lens 95 Nose pad 96 Bridge

Claims (3)

A video output unit, a first holographic optical element, and a second holographic optical element;
The video output unit
It is fixed at a predetermined position of the glasses, outputs the video,
The first holographic optical element includes:
The light that is connected to the video output unit and is incident forward of the first holographic optical element as viewed from the spectacle wearer is closer to the nose side of the second holographic optical element as viewed from the spectacle wearer. The light output from the video output unit is incident so that the light incident rearward when viewed from the spectacle wearer is incident on the ear side of the second holographic optical element as viewed from the spectacle wearer. Refract the light
The second holographic optical element includes:
Video display device that refracts and reflects light fixed to the lens and transmitted and refracted by the first holographic optical element in a direction determined based on a virtual light source position or a preset coordinate of the center of the cornea of a spectacle wearer . An image display device including an image output unit fixed at a predetermined position of the glasses, a first holographic optical element connected to the image output unit, and a second holographic optical element fixed to the lens is executed. An image display method,
The video output unit
Execute the step of outputting video,
The first holographic optical element includes:
The light that enters the front of the first holographic optical element as viewed from the spectacle wearer is incident on the nose side of the second holographic optical element as viewed from the spectacle wearer. The step of transmitting and refracting the light output from the video output unit so that the light incident rearward when viewed is incident on the ear side of the second holographic optical element when viewed from the spectacle wearer. Run,
The second holographic optical element includes:
Executes the step of refracting and reflecting the light fixed to the lens and transmitted and refracted by the first holographic optical element in a direction determined based on a virtual light source position or a preset coordinate of the eyeglass wearer's cornea Yes Video display method. A computer, a program for executing the steps of claim 2.

Images