WO2017133564A1

WO2017133564A1 - Head-mounted reality-augmented smart display device

Info

Publication number: WO2017133564A1
Application number: PCT/CN2017/072320
Authority: WO
Inventors: 陈超平; 张仲霖; 杨晓
Original assignee: 上海群英软件有限公司
Priority date: 2016-02-03
Filing date: 2017-01-24
Publication date: 2017-08-10
Also published as: CN105572877A; CN105572877B

Abstract

A head-mounted reality-augmented smart display device, comprising a head-mountable frame (104), wherein the frame comprises: a display module used for emitting light carrying image information; an optical projection module used for projecting the light emitted by the display module to a film-coated lens; the film-coated lens (102) used for correcting vision and diffracting the light emitted by the optical projection module, so that the light of an external real environment and the light of a projected virtual scene simultaneously enter eyes and are clearly imaged on retinas. The film-coated lens comprises an optically transparent substrate (301), a single-layer or multilayer holographic film (302) formed thereon, and a transparent protective film (303) formed on the outermost layer. The display module and the optical projection module together constitute an integrated display assembly (101). This smart display device has a simple structure and light weight, and satisfies the use requirements of consumer groups suffering from eye diseases such as myopia, hyperopia, and astigmatism.

Description

Head mounted augmented reality intelligent display device

Field of invention

The present invention relates to the field of intelligent display technologies, and in particular, to a head mounted augmented reality intelligent display device.

Background technique

In today's era, the number of people suffering from vision problems is increasing. In terms of myopia, a common eye disease, only China's myopia patients have more than 300 million people, and the incidence of myopia in teenagers is as high as 50%. At the same time, the incidence of myopia in China is still rising rapidly year by year, and most of its patients are students. In key high schools and universities, the proportion of myopia has reached 90%. In addition, people working in institutions, research institutes, and primary and secondary schools have a high probability of close reading, and the probability of developing myopia has reached 80%. At the same time, the number of people with myopia and hyperopia in the world also maintains a high number of people, so there is a huge market space in this group of people with myopia and hyperopia, but the augmented reality of the current listing The intelligent display device does not give sufficient consideration and satisfaction to the use requirements of users suffering from such ophthalmic diseases.

At present, most of the augmented reality intelligent display devices with mature technology are developed in the form of smart glasses, and most products of smart glasses need to be fixed externally on the basis of glasses frames or existing corrective medical glasses. Equipment, such as the smart glasses released by Google in 2013, the optical display part of its main function is placed outside the corrective lens, which increases the weight of the nearsighted or far-sighted person, which affects the comfortable use of the smart display device to some extent. Degree, hindering the user experience. Therefore, it is very necessary to develop an augmented reality display device which is simple in structure, light and comfortable, and integrates the augmented reality display and the vision correction function.

Projection display technology includes various projection chip technologies such as digital micromirrors (DMD), liquid crystal on silicon (LCoS), organic light emitting diodes (OLED), laser projection, and the like. With the rapid development of projection technology, high-resolution projection chips have become the mainstream, which laid the foundation for the realization of augmented reality technology using high-resolution projection chips.

Image acquisition technology is a method of imaging an object through an optical lens such as a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS), etc., and forming a digital image.

Holographic technology, also known as holographic three-dimensional display technology, uses the principle of interference of light to record and reproduce objects. A technique for recording and reproducing real three-dimensional images. The first step is to record the light field information of the object by using interference exposure. This is the shooting process: the object forms a diffused object beam under laser irradiation; the other part of the laser is used as a reference beam to illuminate the hologram film. The beam superposition produces interference, transforming the phase and amplitude of each point on the object light wave into a spatially varying intensity, thereby recording all the information of the object light wave by using the contrast and spacing between the interference fringes, thereby becoming a hologram, or It is called hologram; the second step is to use the principle of diffraction to reproduce the light wave information of the object. This is the imaging process: the hologram is like a combination of multiple gratings. Under the coherent laser illumination, the diffraction light of a linearly recorded sinusoidal hologram is generally Two images, the original image (also known as the initial image) and the conjugate image, can be given. The reproduced image has a strong stereoscopic effect and has a real visual effect.

In addition to the above-mentioned requirements for the use of users suffering from such ophthalmic diseases, the augmented reality intelligent display device currently on the market does not give sufficient consideration to the use requirements of the above-mentioned technologies, and on the other hand, does not comprehensively utilize the above technology to propose a more ideally applicable intelligence. Display device.

Summary of invention

The present invention is directed to the above technical problems existing in the prior art, and proposes an augmented reality display device which is simple and light in structure and based on holography technology, and can simultaneously satisfy the use needs of a consumer group suffering from visual diseases such as myopia, hyperopia and astigmatism.

The technical solution adopted by the present invention to solve the technical problem thereof is: a head-mounted augmented reality intelligent display device comprising a head-mountable frame on which:

a display module for emitting light carrying image information;

a projection optical module, configured to project light emitted from the display module to the coated lens;

The coated lens is used for vision correction and diffracting the light emitted by the projection optical module, so that the external real environment and the projected virtual scene light enter the human eye at the same time and are clearly imaged in the retina;

The coated lens comprises an optically transparent substrate and a single or multi-layer holographic film formed thereon and a transparent protective film formed on the outermost layer; the display module and the projection optical module together constitute an integrated display assembly.

As an improvement to the technical solution of the present invention, the wearable frame is in the shape of glasses or the like, or a helmet or a helmet-like shape having a buckle attached to the head.

As an improvement to the technical solution of the present invention, the display module is one or more of an organic light emitting diode display, a quantum dot light emitting display, a digital micro mirror display, and a silicon based liquid crystal display.

As an improvement to the technical solution of the present invention, the projection optical module is a single optical lens or a combination of a plurality of optical elements.

As an improvement to the technical solution of the present invention, the optically transparent substrate of the coated lens is one or more of a plane mirror, a concave lens, a convex lens, and a cylindrical mirror.

As an improvement to the technical solution of the present invention, the display module and the projection optical module are placed at one or more positions directly above, obliquely above, and laterally rearward of the coated lens.

As an improvement to the technical solution of the present invention, the holographic film is a reflective holographic grating or a transmissive holographic grating.

As an improvement to the technical solution of the present invention, the method further includes:

a camera module, configured to acquire a real scene image in a first viewing angle direction, which includes one or more of a visible light camera, an infrared camera, and a depth camera;

A microphone for collecting the user's voice.

As an improvement to the technical solution of the present invention, the method further includes a head tracking module, configured to acquire a head posture and a motion track of the user, and include one or more of a sensor such as a gyroscope, an accelerometer, and a magnetometer. .

As an improvement to the technical solution of the present invention, a wireless communication module is further included for wirelessly transmitting data.

The head-mounted augmented reality intelligent display device provided by the invention has a simple and light structure, and is an augmented reality display device based on holographic technology, and simultaneously meets the use requirements of a consumer group suffering from visual diseases such as myopia, hyperopia and astigmatism.

DRAWINGS

The present invention will be further described below in conjunction with the accompanying drawings and embodiments, in which:

1 is a schematic structural diagram of a head mounted augmented reality intelligent display device according to a first embodiment of the present invention;

2 is a schematic diagram of an optical path in a head mounted augmented reality intelligent display device according to a first embodiment of the present invention;

3a is a schematic structural view of a coated lens in a head-mounted augmented reality intelligent display device according to a first embodiment of the present invention;

3b is another schematic structural view of a coated lens in a head mounted augmented reality intelligent display device according to a first embodiment of the present invention;

4 is a schematic structural diagram of a projection optical module integrated in a display module in a head mounted augmented reality intelligent display device according to a first embodiment of the present invention;

5 is a schematic structural view of the inside of a temple in a head-mounted augmented reality intelligent display device according to a first embodiment of the present invention;

6 is a schematic structural diagram of a head-mounted augmented reality intelligent display device according to a second embodiment of the present invention;

7 is a schematic diagram of an optical path in a head mounted augmented reality intelligent display device according to a second embodiment of the present invention;

8 is a schematic structural diagram of a head mounted augmented reality intelligent display device according to a third embodiment of the present invention;

Fig. 9 is a schematic diagram of an optical path in a head mounted augmented reality intelligent display device according to a third embodiment of the present invention.

Detailed description of the invention

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

First embodiment

1 is a schematic structural view of a head-mounted augmented reality intelligent display device according to a first embodiment of the present invention, and FIG. 2 is a schematic diagram of an optical path in a head-mounted augmented reality intelligent display device according to a first embodiment of the present invention, and FIG. A schematic structural view of a coated lens in a head-mounted augmented reality intelligent display device according to a first embodiment of the present invention, and FIG. 3b is another schematic structural view of a coated lens in a head-mounted augmented reality intelligent display device according to a first embodiment of the present invention. 4 is a schematic structural view of a projection optical module integrated in a display module in a head mounted augmented reality intelligent display device according to a first embodiment of the present invention, and FIG. 5 is a head mounted augmented reality smart according to the first embodiment of the present invention. A schematic view of the structure inside the temple in the display device.

As shown in FIG. 1, the head-mounted augmented reality intelligent display device of the present embodiment includes a head-mountable frame (the frame 104 in this embodiment), and has:

a display module for emitting light carrying image information;

a projection optical module for projecting light emitted from the display module to the coated lens;

The coated lens 102 is used for vision correction and diffracting the light emitted by the projection optical module, so that the external real environment and the projected virtual scene light enter the human eye at the same time, and are clear in the retina Imaging

1 to 5, in a specific embodiment of the present invention, the coated lens 102 includes an optically transparent substrate 301 and a single or multi-layer holographic film 302 formed thereon and a transparent protective film 303 formed on the outermost layer; a display module and The projection optics modules collectively form an integrated display assembly 101. In this embodiment, the integrated display assembly 101 is obliquely placed on the inner side of the temple behind the coated lens 102, the projection aperture 403 is oriented toward the coated lens 102; the camera is placed in the center of the front frame 104 of the smart glasses; and the hologram is selected for the coated lens 102. The film 302 is a reflective holographic grating.

As shown in FIG. 2, when the smart glasses display virtual information, the display module inside the integrated display component 101 acts as a light source, and loads image information to project light. The projection optical module adjusts the optical path of the light beam loaded with the image information, such as beam expansion and collimation, and causes it to be directed to the coated lens 102 on the side in the right direction. The coated lens 102 coated with a reflective holographic grating diffracts obliquely incident light so that the emitted light is successfully incident on the human eye 201 for imaging. Since the reflective holographic grating has wavelength selectivity, it only produces a diffraction effect on light of a specific spectral band. When a color image needs to be displayed, the coated lens 102 must be plated with a three-layer reflective holographic grating, each of which is diffracted for three colors of red, green, and blue, and finally the color image information is synthesized into the human eye 201. At the same time, part of the external light will be diffracted by the holographic grating, and the rest can enter the human eye 201 through the coated lens 102 of the smart glasses almost without damage, ensuring that the user can see the surrounding real while viewing the virtual image. The scene achieves the effect of augmented reality.

The main function of the projection optical module is to control the emission direction of the light beam emitted by the display module, and adjust the direction of light propagation to the angle and position to be projected. The structure of the module is flexible, and can be designed according to actual conditions. The display module is an organic light emitting diode (OLED). For example, the OLED has self-illuminating characteristics, and an additional light source can be omitted. Therefore, the simplest projection optical module can be just an optical lens and placed obliquely with the display module to align the coated lens 102. The selection of the lens can also be determined according to the specific design of the projection optical path. For example, when the area of the projection area is small, the convex lens can be selected, and when the area of the projection area is large, the concave lens is selected. If it is necessary to appropriately enlarge the size of the display image, it is also possible to add a beam expander to the projection light path to enlarge the image. The projection optical module can be a combination of multiple lenses or a plurality of other optical elements when it is desired to compensate for the spherical aberration and dispersion of the lens.

The coated lens 102 can take on two main configurations, as shown in Figures 3A and 3B, respectively. In the picture In 3A, the coated lens 102 has an optically transparent substrate 301 as a base portion of the lens, and the substrate may be an ordinary planar lens. In this case, the transparent substrate does not change the exit direction of the incident light, and is only used as a substrate for coating; The optical lens of the vision correction function, in which the transparent substrate can also provide a suitable diopter to help the human eye suffering from vision diseases to see external objects. On the side of the transparent substrate facing the user's human eye 201, a single layer or a plurality of holographic films 302 are plated, which are reflective holographic gratings, each of which can diffract the beam of a specific frequency band to cause the person to enter Eye 201. On the innermost hologram film 302, a transparent protective film 303 is plated, and all the hologram films 302 are sandwiched together with the optically transparent substrate 301 to prevent the hologram film 302 from being scratched.

FIG. 3B is another implementation of the coated lens 102, which is also composed of an optically transparent substrate 301, one or more holographic films 302, and a transparent protective film 303. The difference from the first structure is that the holographic film 302 is plated on the side of the transparent optical substrate away from the human eye 201, and the transparent protective film 303 is also plated on the outermost holographic film 302, together with the transparent substrate. Sandwiched in the middle.

4 is a schematic structural view of a projection optical module inside the integrated display assembly of the present example. As indicated above, this figure shows the simplest type of projection path, the combined optical path of an OLED and a single convex lens. In FIG. 4, the organic light emitting diode 401 functions as a display module to emit light outwardly, and the front convex lens 402 converges and collimates the emitted light to pass the light carrying the image information through the projection aperture 403 on the integrated display assembly 101. And projected onto the coated lens.

In this embodiment, as shown in FIG. 5, a plurality of modules, such as a head tracking module 501, a microphone 502, a wireless communication module 503, and the like are integrated inside the temples of the smart glasses, and these modules have respective uses for enriching intelligence. The function of the device is displayed, but the order and structure can be customized according to the user's needs, or can be optimized according to the actual application scenario.

In this embodiment, the transparent protective film 303 is made of an optically transparent material. Preferably, the material is a silicon dioxide or a silicon nitride film, but is not limited thereto, and other materials having the same strength and transparency can be used. In this embodiment, the frame that can be worn is a pair of glasses, but it is not limited to the second one. It can also be modified according to actual needs, and may adopt other eyeglass-like structures or a helmet or a helmet-like shape having a buckle attached to the head. The display module in this embodiment may be one or more of an organic light emitting diode display, a quantum dot light emitting display, a digital micro mirror display, and a liquid crystal display; the projection optical module is a single optical lens or a combination of multiple optical components. The optically transparent substrate of the coated lens 102 is one or more of a plane mirror, a concave lens, a convex lens, and a cylindrical mirror; the display module and the projection optical module are placed on the coating One or more of the positions directly above, obliquely above, and rearward of the lens 102 may be any position as long as it is a placement position that satisfies the principle of the optical path of the present invention and is convenient to use; the holographic film 302 is reflective. Holographic grating or transmissive holographic grating.

In this embodiment, the camera module 103 is configured to acquire a real scene image in a first viewing angle direction, which includes one or more of a visible light camera, an infrared camera, and a depth camera; and a microphone for collecting voice of the user. In this embodiment, the head tracking module may be further configured to acquire a head posture and a motion track of the user, and include one or more of a sensor such as a gyroscope, an accelerometer, and a magnetometer; and A wireless communication module for wirelessly transmitting data.

Second embodiment

6 is a schematic structural diagram of a head-mounted augmented reality intelligent display device according to a second embodiment of the present invention; FIG. 7 is a schematic diagram of an optical path in a head-mounted augmented reality intelligent display device according to a second embodiment of the present invention; 7 , the embodiment is also in the form of smart glasses, and its similarities with the first embodiment are not described again. Different from the first embodiment, in this example, the integrated display component 601 is placed on the coated lens 102, and The coated lens 102 is placed obliquely so that light emitted by the display module can be tilted into the lens and reflected.

As shown in FIG. 7, when the smart glasses display virtual information, the light projected by the integrated display component 601 is obliquely incident on the underlying coated lens 102. The coated lens 102 coated with the reflective holographic grating diffracts the incident light, so that the emitted light is successfully incident on the human eye 201 for imaging. The other processes are basically the same as those of the first embodiment, and will not be described again. Similar to the coated lens 102 of the first embodiment, the lens of the present embodiment may also adopt the structure shown in FIG. 3a and FIG. 3b, which is different from the first embodiment in that the originally vertically placed lens is rotated by a certain angle.

Third embodiment

8 is a schematic structural view of a head mounted augmented reality intelligent display device according to a third embodiment of the present invention; and FIG. 9 is a schematic diagram of an optical path in a head mounted augmented reality smart display device according to a third embodiment of the present invention. As shown in FIG. 8 , the embodiment is also in the form of smart glasses, and is composed of an integrated display component 801 , a coated lens 102 , a camera module 103 , and an external frame 104 . The structure is substantially the same as that of the second embodiment, and the integrated display component 801 is placed on the same. Above the coated lens 102, the difference is that the coated lens 102 is selected The holographic film 302 is a transmissive holographic grating, and the coated lens 102 is tilted inwardly such that the integrated display assembly 801 is located on the side of the coated lens 102 that is remote from the human eye 201.

As shown in FIG. 9, when the smart glasses display virtual information, the integrated display unit 801 located above projects light to the underlying coated lens 102. The coated lens 102 plated with the transmissive holographic grating diffracts the obliquely incident light so that the emitted light is successfully incident on the human eye 201 for imaging. Since the transmissive hologram has angular selectivity and transmits light to a light incident at a specific angle, it is necessary to adjust the projection direction of the outgoing light by the projection optical module. Since the transmissive hologram does not have wavelength selectivity, when the color information is displayed, only a single holographic film 302 can be plated on the lens, so that the color image information is completely transmitted and incident on the human eye 201.

Similar to the coated lens 102 of the first embodiment and the second embodiment, the lens of the third embodiment can also adopt the structure shown in FIG. 3a and FIG. 3b, and the tilting direction of the lens in the third embodiment is compared with the second embodiment. Differently, and since the holographic film 302 is a transmissive holographic grating, the holographic film 302 in the structure has only one layer, and other structures are the same as those of the first two embodiments, and will not be described again.

The invention utilizes a holographic film instead of a large optical component, which can ensure that the light of the external real environment can be normally observed by the user, and can also modulate the light of the virtual scene projected by the display module, thereby greatly simplifying the intelligence. The optical structure of the display device reduces the weight of the product, expands the application range of the augmented reality intelligent display device, greatly increases the portability and comfort of the product, and greatly improves the user experience.

At the same time, the base of the optical lens of the smart display device can be a common plane mirror or a lens with vision correction function, so that the smart display device can satisfy the needs of the users suffering from myopia, hyperopia and astigmatism diseases with only one pair of lenses. The consumer suffering from certain ophthalmic diseases can enjoy a more comfortable consumption experience when using the smart display device, and the number of consumers suffering from ophthalmic diseases of the smart display device is increased to some extent.

It is to be understood that those skilled in the art will be able to make modifications and changes in accordance with the above description, and all such modifications and variations are intended to be included within the scope of the appended claims.

Claims

A head mounted augmented reality intelligent display device, comprising: a head mountable frame having:

a display module for emitting light carrying image information;

a projection optical module, configured to project light emitted from the display module to the coated lens;

The coated lens is used for vision correction and diffracting the light emitted by the projection optical module, so that the external real environment and the projected virtual scene light enter the human eye at the same time and are clearly imaged in the retina;

The coated lens comprises an optically transparent substrate and a single or multi-layer holographic film formed thereon and a transparent protective film formed on the outermost layer; the display module and the projection optical module together constitute an integrated display assembly.
The head mounted augmented reality intelligent display device according to claim 1, wherein the wearable frame is in the shape of glasses or the like, or is a helmet or a helmet-like body having a buckle attached to the head. shape.
The head mounted augmented reality intelligent display device according to claim 1, wherein the display module is one or more of an organic light emitting diode display, a quantum dot light emitting display, a digital micro mirror display, and a liquid crystal display. Kind.
The head mounted augmented reality intelligent display device according to claim 1, wherein the projection optical module is a single optical lens or a combination of a plurality of optical elements.
The head mounted augmented reality intelligent display device according to claim 1, wherein the optically transparent substrate of the coated lens is one or more of a plane mirror, a concave lens, a convex lens, and a cylindrical mirror.
The head mounted augmented reality intelligent display device according to claim 1, wherein the display module and the projection optical module are placed directly above, obliquely above, and side of the coated lens One or more locations in the rear position.
The head mounted augmented reality intelligent display device according to claim 1, wherein the holographic film is a reflective holographic grating or a transmissive holographic grating.
The head-mounted augmented reality intelligent display device according to claim 1, further comprising:

a camera module, configured to acquire a real scene image in a first viewing angle direction, which includes one or more of a visible light camera, an infrared camera, and a depth camera;

A microphone for collecting the user's voice.
The head mounted augmented reality intelligent display device according to claim 8, further comprising a head tracking module for acquiring a head posture and a motion track of the user, including a gyroscope, an accelerometer, a magnetometer, and the like. One or more of the sensors.
The head mounted augmented reality intelligent display device according to claim 8, further comprising a wireless communication module for wirelessly transmitting data.