WO2016101861A1

WO2016101861A1 - Head-worn display device

Info

Publication number: WO2016101861A1
Application number: PCT/CN2015/098157
Authority: WO
Inventors: 宋海涛; 黄琴华
Original assignee: 成都理想境界科技有限公司
Priority date: 2014-12-26
Filing date: 2015-12-22
Publication date: 2016-06-30

Abstract

A head-worn display device, comprising: a housing (1) and an optical system mounted in the housing; the optical system comprises an image display screen (2), a first optical amplifying lens group (3) and a first light-reflecting/light-transmitting lens (4); the image display screen is located above the first optical amplifying lens group, and the first light-reflecting/light-transmitting lens is located below the first optical amplifying lens group; and image light information sent by the image display screen is transmitted by the first optical amplifying lens group so as to be reflected by the first light-reflecting/light-transmitting lens to human eyes (21), and external environment light information is transmitted by the first light-reflecting/light-transmitting lens to the human eyes. The head-worn display device has a simple structure, and is comfortable to wear, such that a user can conveniently enjoy a visual experience having an augmented reality (AR) effect.

Description

Head mounted display device

Cross-reference to related art

This application claims the priority of the following patent application: Chinese patent application CN201410831356.X, entitled "Head-mounted display device", submitted on December 26, 2014, and the name submitted on December 26, 2014: "Head The Chinese patent application CN201420849726.8 of the wearable display device, and the Chinese patent application CN201420847586.0 entitled "Head-mounted display device" submitted on December 26, 2014 and the name submitted on December 26, 2014 are: Chinese Patent Application No. CN201420847516.5, the disclosure of which is incorporated herein by reference.

Technical field

The present invention relates to the field of optical and image display technologies, and in particular to a head mounted display device.

Background technique

Augmented Reality (AR) is a technology that uses virtual objects or information to enhance the reality of real scenes. Augmented reality technology is usually based on real physical environment images obtained by an image acquisition device such as a camera. The computer system recognizes and analyzes and retrieves the virtual extended extended information or virtual scene display such as text content, image content or image model associated with the computer system. In the real physical environment image, the user can obtain the extended information such as the annotation, description and the like of the real object in the real physical environment in the body or experience the stereoscopic and emphasized enhanced visual effect of the real object in the real physical environment. . By fully integrating the virtual object with the real environment, the augmented reality technology can effectively provide users with extended information or image display effects that recognize the surrounding real environment, and at the same time realize the information interaction between the user and the surrounding real environment.

The existing augmented reality systems can be divided into video perspective and optical perspective according to the display implementation. With an optical perspective augmented reality system, light from the real environment can reach the user's eyes through the optical lens group, so the user can directly observe the surrounding real environment, thereby effectively improving the real environment image in the video perspective augmented reality system. The virtual environment information is superimposed and merged to display the delay phenomenon.

However, due to the complicated optical system structure of the optical see-through augmented reality system, the optical see-through enhanced display system has problems of fixed system structure and large volume, which also becomes a development and popularization process of the optical perspective augmented reality device technology. Technical problems to be solved.

Summary of the invention

The present invention is to provide a head-mounted display device that is simple in structure and convenient to carry, and provides a user with an augmented reality effect. In order to achieve the above object, an embodiment of the present invention first provides a head mounted display device, the head mounted display device comprising: a housing and a set of optical systems mounted in the housing; wherein

The optical system includes: an image display screen, a first optical magnifying lens group and a first reversible lens, the image display screen is located above the first optical magnifying lens group, and the first reversible lens is located at the Below the first optical magnifying lens group;

The optical path of the optical system is: the image light information emitted by the image display screen is transmitted through the first optical magnifying lens group, and then reflected by the first reversible lens to the human eye; and the head mounted display Ambient light information external to the device is transmitted through the first reversible lens to the human eye.

According to an embodiment of the present invention, the head mounted display device further includes a pixel shielding layer, the pixel shielding layer is located at a side of the first reversible lens away from the human eye for displaying according to the image display screen The image content is at a projection position in the first reversible lens, and the light transmittance of the corresponding region of the pixel shielding layer is adjusted.

According to an embodiment of the invention, the first optical amplifying lens group is composed of one or more Fresnel lenses, or consists of one or more spherical lenses and/or aspherical lenses, or one or more Philippine lenses A Neel lens and a spherical lens and/or an aspheric lens.

The present invention also provides a head mounted display device, the head mounted display device comprising: a housing and a set of optical systems mounted in the housing; wherein

The optical system includes: an image display screen, a first reversible lens and a concave mirror, the image display screen is located above the first reversible lens, and the concave mirror is located at the first reversible Below the lens;

The optical path of the optical system is: the image light information emitted by the image display screen is transmitted by the first reversible lens and then reflected by the concave mirror to the first reversible lens, A reversible lens is reflected to the human eye; and ambient light information outside the head mounted display device is transmitted to the human eye through the first reversible lens.

According to an embodiment of the invention, the head mounted display device further comprises:

a second optical magnifying lens group disposed between the image display screen and the first reversible lens, the second optical magnifying lens group being composed of one or more Fresnel lenses, or by an OR Multiple spherical lenses and/or non The spherical lens consists of or consists of one or more Fresnel lenses and a spherical lens and/or an aspheric lens.

The optical system includes an image display screen, a first reversible lens and a second reversible lens, the image display screen being located above the first reversible lens, the second reversible lens being located The first reversible lens is away from the side of the human eye;

The optical path of the optical system is: after the image optical information emitted by the image display screen is reflected by the first reversible lens to the second reversible lens, is reflected by the second reversible lens to The first reversible lens is transmitted to the human eye via the first reversible lens; and ambient light information outside the head mounted display device sequentially passes through the second reversible lens and the first A reversible lens is transmitted to the human eye.

According to an embodiment of the present invention, the head mounted display device further includes a pixel shielding layer, the pixel shielding layer is located on a side of the second reversible lens away from the human eye for displaying according to the image display screen The image content is at a projection position in the second reversible lens, and the light transmittance of the corresponding region of the pixel shielding layer is adjusted.

a second optical magnifying lens group disposed between the image display screen and the reversible lens, the second optical magnifying lens group being composed of one or more Fresnel lenses, or one or more The spherical lens and/or the aspherical lens are composed of one or more Fresnel lenses and spherical lenses and/or aspherical lenses.

An image acquisition module for acquiring an external image of the head mounted display device, the image acquisition module including one or more cameras.

According to an embodiment of the invention, the image acquisition module comprises a depth of field camera for acquiring an external depth image of the head mounted display device.

According to an embodiment of the invention, the image acquisition module further comprises a line of sight tracking module for determining human eye line of sight information by detecting a human eye movement state, the line of sight tracking module comprising a camera that captures a human eye image.

According to an embodiment of the invention, the head mounted display device further comprises an interaction control module, the interaction control module comprising one or a combination of the following:

a gesture interaction unit, configured to be connected to the image acquisition module, configured to identify a gesture interaction instruction according to the gesture image acquired by the image acquisition module;

An eye movement interaction unit, configured to be connected to the line of sight tracking module, for identifying an eye movement interaction instruction according to the eye movement state of the human eye acquired by the line of sight tracking module;

a somatosensory interaction unit for collecting body motion information by a sensor, according to the acquired limb motion Information, identifying and determining a somatosensory interaction instruction;

The voice interaction unit is configured to collect voice information through a microphone, and identify and determine a voice interaction instruction according to the obtained voice information.

According to an embodiment of the present invention, the head mounted display device further includes a power supply module, and the power supply module is connected to the image display screen, the image acquisition module, the line of sight tracking module, and the interaction control module through a circuit, and is configured to be built in Or an external power source supplies power to the head mounted display device.

According to an embodiment of the invention, the image display screen displays the image content in a split screen.

According to an embodiment of the invention, the head mounted display device further includes a headband or a support frame coupled to the housing.

With the head-mounted display device provided by the present invention, the user's eyes are located behind the lens in the optical system (ie, at the exit of the optical system), and the user can receive the image light from the image display screen through the optical system. The information can in turn receive ambient light information outside the head mounted display device through the reversible lens. After the two sets of optical information are transmitted through the optical path of the optical system, the images are superimposed on the user's binocular retina.

At the same time, the head-mounted display device can recognize and analyze the environment and the object image in front of the head-mounted display device acquired by the image acquisition module, and can display the related content through the image display screen and superimpose and fuse the image into the real environment image, thereby realizing the user to pass When the head-mounted display device of the present invention observes the real environment and the object, the extended information related to the real environment and the object and other virtual object images can be fused and displayed in the visual field of the user, and the image with the augmented reality effect is presented.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained according to these drawings for those skilled in the art without any creative work:

1 is a first schematic structural view of a head mounted display device according to an embodiment of the present invention;

2 is a second schematic structural view of a head mounted display device according to an embodiment of the present invention;

3 is a first schematic structural view showing an optical system of a head mounted display device according to an embodiment of the present invention;

4 is a second schematic structural view of an optical system of a head mounted display device according to an embodiment of the present invention;

FIG. 5 is a third schematic structural diagram of an optical system of a head mounted display device according to an embodiment of the present invention; FIG.

6 is a fourth schematic structural view of an optical system of a head mounted display device according to an embodiment of the present invention;

FIG. 7 is a fifth schematic structural diagram of an optical system of a head mounted display device according to an embodiment of the present invention; FIG.

FIG. 8 is a sixth structural diagram showing an optical system of a head mounted display device according to an embodiment of the present invention; FIG.

FIG. 9 is a view showing a seventh structural diagram of an optical system of a head mounted display device according to an embodiment of the present invention; FIG.

FIG. 10 is a view showing an eighth structural diagram of an optical system of a head mounted display device according to an embodiment of the present invention; FIG.

Figure 11 is a view showing a ninth structure of an optical system of a head mounted display device according to an embodiment of the present invention;

12 is a tenth structural diagram of an optical system of a head mounted display device according to an embodiment of the present invention;

FIG. 13 is a block diagram showing an eleventh structure of an optical system of a head mounted display device according to an embodiment of the present invention; FIG.

FIG. 14 is a view showing a twelfth structure of an optical system of a head mounted display device according to an embodiment of the present invention; FIG.

15 is a view showing a thirteenth structural diagram of an optical system of a head mounted display device according to an embodiment of the present invention;

16 is a view showing a fourteenth structural diagram of an optical system of a head mounted display device according to an embodiment of the present invention;

Fig. 17 is a view showing a third configuration of a head mounted display device according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail below with reference to the drawings and specific embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but this is only a few embodiments of the invention, and the invention may be practiced in other ways than those described herein. The scope of protection is not limited by the specific embodiments disclosed below.

FIG. 1 is a schematic view showing a first structure of a head mounted display device according to the embodiment.

As shown in FIG. 1 , the head mounted display device provided in this embodiment includes a housing 1 , a set of optical systems mounted in the housing 1 , and an image acquisition module. The image acquisition module is configured to acquire an external image of the head mounted display device, and specifically may include one or more cameras. As shown in FIG. 1 , in this embodiment, the image acquisition module includes a camera 51 and a camera 52 , both of which are RGB cameras. The head-mounted display device can collect an environment image outside the head-mounted display device through the camera 51 and the camera 52, and acquire ambient light information and position distance information of the object by analyzing the environment image.

It should be noted that in other embodiments of the present invention, the image acquisition module may also include an RGB camera or a depth of field camera. For example, in an embodiment of the present invention, the camera 51 is an RGB camera, and the camera 52 is a depth-of-field camera, so that the head-mounted display device can perform an external environment image of the head-mounted display device by the cooperation of the RGB camera and the depth-of-field camera. The acquisition, in addition to the environmental object to measure, obtain a three-dimensional image of the object and capture the user's gestures.

In this embodiment, according to the environment image information acquired by the image acquisition module, the head mounted display device can pass the map. Image recognition is performed to obtain information content related to the environment or object (the content includes ambient light information, object position and depth of field information, etc.), and the information content is sent to the image display screen for display. For example, the head-mounted display device may transmit the above-mentioned introduction content to the image display screen for display after recognizing the building included in the environment image and acquiring the introduction content related to the building in the environment image.

At the same time, the head-mounted display device can further acquire images or text content that can be displayed in combination with the environment image according to the environmental image information and the object depth information, and send the images or text content to the image display screen for display. For example, the external environment image of the head mounted display device is a vast sea surface, and the head mounted display device transmits a huge ship image that can be merged thereto to the image display screen for display.

In addition, the head-mounted display device may further display the display interface of the function application and/or the user interaction interface and the environment image according to the color information of the environment image, the brightness information, and the like. For example, the head mounted display device displays the call interface, the mail interface, the short message interface, and/or the schedule reminder interface through the image display screen.

The head-mounted display device provided in this embodiment can form two optical paths through the optical system, and the image of the external environment and the display image in the image display screen can be respectively transmitted to the eyes of the user through the two optical paths, and are used. The superimposed fusion on the retina of both eyes enables the user of the head-mounted display device to view the real environment of the outside world with a normal view, and also obtain the content related to the real environment image displayed by the image display screen or other environment capable of interacting with the external environment. The content of the image fusion is superimposed and displayed with augmented reality.

According to actual needs, the head mounted display device provided by the embodiment may further include a line of sight tracking module for determining human eye line of sight information by detecting a human eye movement state. Wherein, in the embodiment, the gaze tracking module preferably includes a camera that collects an image of the human eye.

Specifically, as shown in FIG. 2, in the embodiment, the line-of-sight tracking module in the head-mounted display device includes a camera 61 and a camera 62, so that the line-of-sight tracking module can separately collect the left and right eyeballs of the user through the camera 61 and the camera 62. An image of the nearby area.

When the user's eyes look at objects in different directions or at different distances, the eyes produce subtle changes that produce extractable eye features. Therefore, the line-of-sight tracking module can extract the eye image features by image recognition (such as pupil positioning, eye point detection, etc.) to perform positioning tracking of the human eye and motion state analysis of the eyeball, thereby estimating the direction of the user's line of sight according to the line of sight model, and simultaneously The position of the target object that the user is looking at is calculated according to the angle of the line of sight of the eyes.

The gaze tracking module can also continuously acquire infrared rays reflected from the cornea and pupil of the human eye through the camera 61 and the camera 62 to record the change of the line of sight. Specifically, the line-of-sight tracking module may illuminate the human face with an infrared-assisted light source to form a reflective bright spot on the surface of the cornea of the human eye. When the human eye is looking at different positions, the eyeball will rotate accordingly. The line-of-sight tracking module can determine the person according to the change of the relative position of the reflected bright spot on the cornea of the human eye and the center point of the pupil of the human eye. The change of the line of sight and the position of the gaze, thereby achieving the purpose of gaze tracking.

The head-mounted display device provided in this embodiment may further include an interaction control module, where the interaction control module includes: a gesture interaction unit, an eye movement interaction unit, a somatosensory interaction unit, and a voice interaction unit. It should be noted that, in other embodiments of the present invention, the interaction control module may further include only one or more of the items listed above, and the present invention is not limited thereto.

The gesture interaction unit is connected to the image acquisition module, and is configured to acquire a gesture image by using the image acquisition module, and identify and determine the gesture interaction instruction according to the gesture image acquired by the image acquisition module. The eye movement interaction unit is connected to the gaze tracking module for acquiring the eye movement state image of the human eye through the gaze tracking module, and identifying and determining the eye movement interaction instruction according to the eye movement state image acquired by the gaze tracking module. The somatosensory interaction unit is configured to collect body motion information of the human body through the sensor, and identify and determine the somatosensory interaction instruction according to the acquired limb motion information. The voice interaction unit is configured to collect voice information through a microphone, and identify and determine a voice interaction instruction according to the acquired voice information.

The head-mounted display device provided by the embodiment can acquire an interaction control instruction of the user through the interaction control module (the interaction control instruction includes: a gesture interaction instruction, an eye movement interaction instruction, a somatosensory interaction instruction, and/or a voice interaction instruction), This also allows the user to control and operate the head mounted display device according to the interactive control command (for example, adjusting the brightness of the image display screen, controlling the switching adjustment of the image display screen display content, and according to the user interaction displayed in the image display screen. Interface interaction, etc.).

In addition, in this embodiment, the head mounted display device further includes a power supply module. The power supply module is connected to the image display screen, the image acquisition module, the line of sight tracking module and the interactive control module through a circuit, and can supply power to the above modules of the head mounted display device through a built-in or external power source.

In an embodiment of the invention, the near-eye side of the head mounted display device may also be provided with a diopter adjustment structure. Wherein, the diopter adjustment structure can adjust the diopter of the optical system within a certain range, so that the user of the head mounted display device can normally use the head mounted display device without wearing glasses.

It should be noted that, in different embodiments of the present invention, the image acquisition module, the interaction control module, the power supply module, and the diopter adjustment structure described above may also be selected according to actual needs. Of course, the specific implementation form of the above function module Other reasonable forms are also possible, and the invention is not limited thereto.

It can be seen from the above description that the head-mounted display device provided by the embodiment can accurately determine the user's gaze according to the external image acquired by the image acquisition module and the object depth information, combined with the human eye line of sight information acquired by the gaze tracking module. An object in a real environment. The head mounted display device is further capable of controlling the image display screen to display the content related to the object currently viewed by the user at the corresponding position through image recognition and information acquisition, and transmitting through the optical path of the optical system of the head mounted display device. After that, the content displayed in the image display screen is displayed in the real field of view of the user, so that the user can simultaneously view the real environment object (such as a real object). Nearby areas) Viewing content related to real-world objects, with augmented reality display.

It should be noted that in various embodiments of the present invention, the optical system in the head mounted display device can be implemented in different structural forms. In order to more clearly illustrate the purpose, principle and advantages of the present invention, the following combinations are respectively different. The embodiment is described to illustrate an optical system in a head mounted display device.

Embodiment 1:

Fig. 3 is a view showing the structure of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 3, in the present embodiment, the optical system includes an image display screen 2, a first optical magnifying lens group 3, and a first reversible lens 4. The image display screen 2 is located above the first optical magnifying lens group 3, and the first reversible lens 4 is located below the first optical magnifying lens group 3.

During the operation, the image light information emitted from the image display screen 2 is transmitted to the human eye 21 by the first reversible lens 4 after being transmitted through the first optical magnifying lens group 3. At the same time, ambient light information outside the head mounted display device is transmitted to the human eye 21 through the first reversible lens 4.

In the embodiment, the first reversible lens 4 is located below the first optical magnifying lens group 3 and is at an angle of 30 degrees to 60 degrees with the image display screen 2. During the working process, the image light information emitted by the image display screen 2 is transmitted through the first optical magnifying lens group 3, and then reflected by the first reversible lens 4 to the human eye 21, thereby forming an enlarged image on the retina of the human eye. Virtual image.

It should be noted that, in different embodiments of the present invention, the first optical amplifying lens group 3 of the head mounted display device may be a combination of a single Fresnel lens or a plurality of Fresnel lenses, according to actual needs. It may also be a spherical lens, an aspherical lens or a combination of a plurality of spherical and/or aspherical lenses, or a combination of a Fresnel lens and a spherical lens and/or an aspherical lens, and the invention is not limited thereto.

Embodiment 2:

Fig. 4 is a view showing the structure of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 4, the optical system provided in this embodiment further includes a pixel shielding layer 7 compared to the optical system in the head mounted display device provided in Embodiment 1. The pixel shielding layer 7 is located on a side of the first reversible lens 4 away from the eye of the person 21 . The image display device can adjust the light transmittance of the region corresponding to the pixel shielding layer 7 according to the projection position of the image content displayed on the image display screen 2 in the first reversible lens 4. Specifically, the pixel shielding layer 7 may be a dimming liquid crystal screen or a dimming liquid crystal film, and the pixel shielding layer 7 changes the arrangement order of the liquid crystal droplets under the action of an applied electric field, thereby achieving pixel level transmittance adjustment.

For the head mounted display device provided in this embodiment, since the pixel shielding layer 7 is located on the side of the first reversible lens 4 that is away from the human eye 21, the ambient light information is transmitted through the pixel shielding layer 7. The first can be reversed Mirror 4. The head-mounted display device adjusts the position corresponding to the position in the pixel shielding layer 7 according to the projection position of the image content displayed by the image display screen 2 after being transmitted through the first optical magnifying lens group 3 in the first reversible lens 4 Transmittance.

Specifically, when the ambient light is strong, the transmittance of the corresponding area in the pixel shielding layer 7 is reduced, thereby reducing the amount of light transmitted in the position area; when the ambient light is weak, the corresponding area in the pixel shielding layer 7 is The light transmittance is increased to increase the amount of light transmitted in the positional region. In this way, the pixel shielding layer 7 can also adjust the light intensity of the corresponding position of the corresponding area in the pixel shielding layer in the first reversible lens 4, so that the content displayed on the image display screen 2 and the user's real When the visual image is fused, the influence of the external ambient light caused by the excessive or weak external ambient light on the visibility and display effect of the displayed content in the image display screen 2 is reduced.

Embodiment 3:

Fig. 5 is a view showing the structure of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 5, compared with the optical system in the head mounted display device shown in FIG. 3, the first reversible lens in the optical system provided in this embodiment employs two glued right angle prisms 41 and The right angle prism 42 is realized. The inclined surface of the right angle prism 41 or the right angle prism 42 is plated with a reverse permeable membrane, and the inclined surface of the right angle prism plated with the reverse permeable membrane is at an angle of 30 degrees to 60 degrees with the image display screen 2.

Embodiment 4:

Fig. 6 is a view showing the structure of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 6, the optical system provided in this embodiment further includes a light transmitting mirror 81 and a light transmitting mirror 82, as compared with the optical system of the head mounted display device shown in FIG. The light-transmitting mirror 81 and the light-transmitting mirror 82 are respectively disposed on the side of the human-eye display device and away from the human eye side. In this embodiment, the light transmitting mirror 81 and the light transmitting mirror 82 are preferably optical quartz sheets, and the surfaces of the two transparent sheets are flat or curved. The light transmitting mirror 81 and the light transmitting mirror 82 enable the optical system to have good light transmittance while also forming a relatively closed space to protect the optical elements in the optical system.

Embodiment 5:

Fig. 7 is a view showing the structure of an optical system in the head mounted display device of the embodiment.

As shown in FIG. 7, the optical system in the head mounted display device provided by the embodiment includes an image display screen 2, a first reversible lens 4, and a concave mirror 5. The image display screen 2 is located above the first reversible lens 4, and the concave mirror 5 is located below the first reversible lens 4.

During operation, the image light information emitted by the image display screen 2 is transmitted through the first reversible lens 4 and then reflected by the concave mirror 5 to the first reversible lens 4, and then reflected by the first reversible lens 4. To the human eye 21. At the same time, head-mounted Ambient light information outside the display device is transmitted to the human eye 21 through the first reversible lens 4.

In the present embodiment, the first reversible lens 4 is located below the image display screen 2, which is at an angle of 30 degrees to 60 degrees with the image display screen 2. The concave mirror 5 is located below the first reversible lens 4, and one side of the near image display 2 is plated with a total reflection film, so that the image light information emitted by the image display screen 2 can be transmitted through the first reversible lens 4. Thereafter, it is reflected by the concave mirror 5 to the first reversible lens 4, and then reflected by the first reversible lens 4 to the retina of the human eye to form an enlarged virtual image.

It should be noted that in other embodiments of the present invention, in order to make the content in the image display screen 2 exhibit a wider field of view, a second may be installed between the image display screen 2 and the first reversible lens 4. Optical magnifying lens set. The second optical amplifying lens group and the concave reflecting mirror 5 together constitute an optical amplifying structure for amplifying the image content displayed in the image display screen 2.

At the same time, it should be pointed out that the second optical amplifying lens group may be a single Fresnel lens or a plurality of Fresnel lens combinations, or a spherical lens, an aspheric lens or a plurality of spherical surfaces, and according to actual needs. The combination of the aspherical lens may also be a combination of a Fresnel lens and a spherical lens and/or an aspherical lens, and the invention is not limited thereto.

Example 6:

Fig. 8 is a view showing the structure of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 8, the optical system provided in this embodiment further includes a pixel shielding layer 7 compared to the optical system in the head mounted display device provided in the fifth embodiment. The pixel shielding layer 7 is located on a side of the first reversible lens 4 away from the human eye, and is used for adjusting the pixel shielding layer according to the projection position of the image content of the image display screen 2 in the first reversible lens 4. 7 transmittance of the corresponding area. Specifically, the pixel shielding layer 7 may be a dimming liquid crystal screen or a dimming liquid crystal film, and the pixel shielding layer 7 changes the arrangement order of the liquid crystal droplets under the action of an applied electric field, thereby achieving pixel level transmittance adjustment.

For the head-mounted display device provided in this embodiment, since the pixel shielding layer 7 is located on the side of the first reversible lens 4 that is away from the human eye, the ambient light information passes through the pixel shielding layer 7 and reaches the first A reversible lens 4 can be used. The head mounted display device adjusts the light transmittance of the pixel shielding layer 7 corresponding to the position in accordance with the projection position of the image content displayed on the image display screen 2 in the reversible lens.

When the external ambient light is strong, the transmittance of the corresponding region in the pixel shielding layer 7 is reduced, thereby reducing the amount of light transmitted in the position region; and when the ambient light is weak, the transmittance of the corresponding region in the pixel shielding layer 7 Increased to increase the amount of light transmitted in the location area. In this way, the pixel shielding layer 7 can also adjust the light intensity of the corresponding position of the corresponding area in the pixel shielding layer in the first reversible lens 4, so that the content displayed on the image display screen 2 and the user's real When the visual image is fused, the external ambient light caused by the excessive or weak external light intensity is reduced. The effect of the line on the image display 2 shows the visibility and display effect of the content.

Example 7:

Fig. 9 is a view showing the structure of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 9, compared with the optical system of the head mounted display device shown in FIG. 7, the first reversible lens in the optical system provided in this embodiment employs two glued right angle prisms 41 and right angles. The prism 42 is implemented. Wherein, the inclined surface of the right-angle prism 41 or the right-angle prism 42 is plated with a reverse permeable membrane, and the inclined surface of the right-angle prism plated with the anti-permeable membrane is at an angle of 30 degrees to 60 degrees with the image display screen.

Example 8:

Fig. 10 is a view showing the structure of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 10, compared with the optical system of the head mounted display device shown in FIG. 7, the first reversible lens in the optical system provided in this embodiment employs two glued right angle prisms 41 and right angles. The prism 42 is implemented. The right angle prism 42 and the concave mirror are integrated. The inclined surface of any one of the two right-angle prisms is plated with a reverse permeable membrane, and the angle of the right-angle prism coated with the anti-permeable membrane is at an angle of 30 degrees to 60 degrees with the image display screen, and the concave surface of the right-angle prism 42 Plated with a total reflection film.

Example 9:

Fig. 11 is a view showing the configuration of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 11, the optical system provided in this embodiment further includes a light transmitting mirror 81 and a light transmitting mirror 82, as compared with the optical system of the head mounted display device shown in FIG. The light-transmitting mirror 81 and the light-transmitting mirror 82 are respectively disposed on the side of the human-eye display device and away from the human eye side. In this embodiment, the light transmitting mirror 81 and the light transmitting mirror 82 are preferably optical quartz sheets, and the surfaces of the two transparent sheets are flat or curved. The light transmitting mirror 81 and the light transmitting mirror 82 enable the optical system to have good light transmittance while also forming a relatively closed space to protect the optical elements in the optical system.

Example 10:

Fig. 12 is a view showing the configuration of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 12, the optical system in the head mounted display device provided by the embodiment includes an image display screen 2, a first reversible lens 4, and a second reversible lens 6. The image display screen 2 is located above the first reversible lens 4, and the second reversible lens 6 is located on the side of the first reversible lens 4 away from the human eye 21.

During operation, the image light information emitted by the image display screen 2 is reflected by the first reversible lens 4 to the second reversible lens 6 and is reflected by the second reversible lens 6 to the first reversible lens. 4, and then transmitted to the human eye 21 via the first reversible lens 4. At the same time, the ambient light information outside the head mounted display device is sequentially transmitted to the human eye through the second reversible lens 6 and the first reversible lens 4.

In this embodiment, the first reversible lens 4 is located below the image display screen, and is at an angle of 30 degrees to 60 degrees with the image display screen 2. The second reversible lens 6 is located on the side of the first reversible lens 4 away from the human eye, and the second reversible lens 6 is a concave mirror, and the side of the first reversible lens 4 is plated with a reverse permeable membrane. The image light information emitted by the image display screen 2 is reflected by the first reversible lens 4 to the second reversible lens 6 , and then reflected by the second reversible lens 6 to the first reversible lens 4 , and then passed through the first The reversible lens 4 is transmitted to the retina of the human eye to form an enlarged virtual image.

Example 11:

Fig. 13 is a view showing the configuration of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 13, in order to make the content in the image display screen 2 exhibit a wider field of view, the optical system can also be on the image display screen 2 and the first reversible lens based on the optical system shown in the tenth embodiment. A second optical magnifying lens group 9 is mounted between 4. The second optical magnifying lens group 9 is capable of magnifying the image content displayed in the image display screen 2.

It should be noted that, according to actual needs, the second optical amplifying lens group 9 may be a single Fresnel lens or a plurality of Fresnel lens combinations, or may be a spherical lens, an aspheric lens or a plurality of spheres and/or The combination of the aspherical lenses may also be a combination of a Fresnel lens and a spherical lens and/or an aspherical lens, and the present invention is not limited thereto.

Example 12:

Fig. 14 is a view showing the configuration of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 14, the optical system provided in this embodiment further includes a pixel shielding layer 7 compared to the optical system provided in the tenth embodiment. Wherein, the pixel shielding layer is located on a side of the second reversible lens 6 away from the human eye 21 for adjusting the pixel shielding according to the projection position of the image content displayed by the image display screen 2 in the second reversible lens 6. The transmittance of the corresponding area of layer 7 is. Specifically, the pixel shielding layer 7 may be a dimming liquid crystal screen or a dimming liquid crystal film, and the pixel shielding layer 7 changes the arrangement order of the liquid crystal droplets under the action of an applied electric field, thereby achieving pixel level transmittance adjustment.

For the head-mounted display device provided in this embodiment, since the pixel shielding layer 7 is located on the side of the second reversible lens 6 that is away from the human eye, the ambient light information passes through the pixel shielding layer 7 and reaches the first The second reversible lens 6. The head mounted display device reflects the image content displayed by the image display screen 2 through the first reversible lens 4 The projection position in the second reversible lens 6 adjusts the light transmittance of the pixel shielding layer 7 corresponding to the position.

When the external ambient light is strong, the transmittance of the corresponding region in the pixel shielding layer 7 is reduced, thereby reducing the amount of light transmitted in the position region; and when the ambient light is weak, the transmittance of the corresponding region in the pixel shielding layer 7 Increased to increase the amount of light transmitted in the location area. In this way, the pixel shielding layer 7 can also adjust the light intensity of the corresponding position of the corresponding area in the pixel shielding layer in the first reversible lens 4, so that the content displayed on the image display screen 2 and the user's real When the visual image is fused, the influence of the external ambient light caused by the excessive or weak external ambient light on the visibility and display effect of the displayed content in the image display screen 2 is reduced.

Example 13:

Fig. 15 is a view showing the configuration of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 15, compared with the optical system of the head mounted display device shown in FIG. 12, the first reversible lens in the optical system provided in this embodiment employs two glued right angle prisms 41 and right angles. The prism 42 is implemented. Wherein, the inclined surface of the right-angle prism 41 or the right-angle prism 42 is plated with a reverse permeable membrane, and the angled prism of the right-angle prism plated with the anti-permeable membrane is at an angle of 30 degrees to 60 degrees with the image display screen.

Embodiment 14:

Fig. 16 is a view showing the configuration of an optical system in a head mounted display device in this embodiment.

As shown in FIG. 16, the optical system provided in this embodiment further includes a light transmitting mirror 81 and a light transmitting mirror 82, as compared with the optical system of the head mounted display device shown in FIG. The light-transmitting mirror 81 and the light-transmitting mirror 82 are respectively disposed on the side of the human-eye display device and away from the human eye side. In this embodiment, the light transmitting mirror 81 and the light transmitting mirror 82 are preferably optical quartz sheets, and the surfaces of the two transparent sheets are flat or curved. The light transmitting mirror 81 and the light transmitting mirror 82 enable the optical system to have good light transmittance while also forming a relatively closed space to protect the optical elements in the optical system.

It should be noted that the head-mounted display device provided by each embodiment of the present invention can have different reflective transmittances according to the need of superimposing and merging the display content of the image display screen with the real field of view of the user. Specifically, the reversible lens may be coated with a translucent film having different reflection transmittance ratios on the surface, and the light transmission and reflection ratio may be adjusted through different reversible films. For example, the reversible lens may be a semi-reflex lens. .

At the same time, according to actual needs, the image display screen of the head-mounted display device of the present invention can display the image on the left and right screens, and the left and right screen images displayed on the split screen are transmitted by the optical path of the optical system, respectively, and are respectively received by the left and right eyes of the user. . The split screen displayed in the image display screen may be a left and right split screen image with the same format, or may be a left and right split screen image with a preset parallax. Specifically, when the image displayed by the split screen in the image display screen is in the same format, the left and right points are When the screen image is displayed, the user sees a planar image; when the image displayed by the split screen in the image display screen is a left and right split screen image with a preset parallax, the user sees a stereoscopic image having a 3D effect.

The image display screen of the head mounted display device of the present invention may also be two independent image display screens corresponding to the eyes of the user, the image content is respectively displayed in the two image display screens, and the image content displayed in the two image display screens. After being transmitted through the optical path of the optical system, they are respectively received by the left and right eyes of the user. The images displayed on the two image display screens may be images with the same format, or may be images with preset parallax. Specifically, when the images in the same format are displayed in the two image display screens, the user sees a planar image; when the images in the two image display screens display the preset parallax, the user sees It is a stereoscopic image with a 3D effect.

In addition, as shown in FIG. 17, the reversible lens of the head mounted display device provided by the present invention may be composed of two independent reversible lenses respectively corresponding to the left and right eyes, or may be a reversible lens. Shared with both eyes.

It should be noted that, in different embodiments of the present invention, the head-mounted display device can be connected and fixed to the user's head by wearing a telescopic belt, a support frame, a helmet bracket or a hat according to actual needs. 1 and 2 show a schematic structural view of a head mounted display device fixed to a user's head by wearing a telescopic belt 9.

According to various embodiments of the present invention, according to the needs of mounting and fixing optical components, a variety of support and fixing structures can be designed inside the casing according to specific conditions, and the optical components are mounted and fixed to form a corresponding optical system. There is no limitation here, and the shape of the casing can also be designed and adjusted as needed, and only needs to meet the requirements of accommodating and fixing the optical components of the head mounted display device of the embodiment of the invention.

Again, all features disclosed in this specification, or steps in all methods or processes disclosed, can be combined in any manner other than mutually exclusive features and/or steps.

Any feature disclosed in the specification, including any additional claims, abstract and drawings, may be replaced by other equivalents or alternative features, unless otherwise stated. That is, unless specifically stated, each feature is only one example of a series of equivalent or similar features.

The invention is not limited to the specific embodiments described above. The invention can be extended to any new feature or any new combination disclosed in this specification, as well as any novel method or process steps or any new combination disclosed.

Claims

A head mounted display device, wherein the head mounted display device comprises: a housing and a set of optical systems mounted in the housing; wherein

The optical system includes: an image display screen, a first optical magnifying lens group and a first reversible lens, the image display screen is located above the first optical magnifying lens group, and the first reversible lens is located at the Below the first optical magnifying lens group;

The optical path of the optical system is: the image light information emitted by the image display screen is transmitted through the first optical magnifying lens group, and then reflected by the first reversible lens to the human eye; and the head mounted display Ambient light information external to the device is transmitted through the first reversible lens to the human eye.
The head mounted display device of claim 1 , wherein the head mounted display device further comprises a pixel shielding layer, wherein the pixel shielding layer is located at a side of the first reversible lens away from the human eye, Adjusting a transmittance of a corresponding region of the pixel shielding layer according to a projection position of the image content displayed by the image display screen in the first reversible lens.
The head mounted display device according to claim 1 or 2, wherein the first optical magnifying lens group is composed of one or more Fresnel lenses, or one or more spherical lenses and/or aspheric lenses Composition, or consists of one or more Fresnel lenses and spherical lenses and / or aspherical lenses.
A head mounted display device, wherein the head mounted display device comprises: a housing and a set of optical systems mounted in the housing; wherein

The optical system includes: an image display screen, a first reversible lens and a concave mirror, the image display screen is located above the first reversible lens, and the concave mirror is located at the first reversible Below the lens;

The optical path of the optical system is: the image light information emitted by the image display screen is transmitted by the first reversible lens and then reflected by the concave mirror to the first reversible lens, A reversible lens is reflected to the human eye; and ambient light information outside the head mounted display device is transmitted to the human eye through the first reversible lens.
The head-mounted display device of claim 4, wherein the head-mounted display device further comprises a pixel shielding layer, the pixel shielding layer is located at a side of the first reversible lens away from the human eye, Adjusting a transmittance of a corresponding region of the pixel shielding layer according to a projection position of the image content displayed by the image display screen in the first reversible lens.
The head-mounted display device according to claim 4 or 5, wherein the head-mounted display device further comprises:

a second optical magnifying lens group disposed between the image display screen and the first reversible lens, the second optical magnifying lens group being composed of one or more Fresnel lenses, or by an OR It consists of a plurality of spherical lenses and/or aspherical lenses, or consists of one or more Fresnel lenses and spherical lenses and/or aspherical lenses.
A head mounted display device, wherein the head mounted display device comprises: a housing and a set of optical systems mounted in the housing; wherein

The optical system includes an image display screen, a first reversible lens and a second reversible lens, the image display screen being located above the first reversible lens, the second reversible lens being located The first reversible lens is away from the side of the human eye;

The optical path of the optical system is: after the image optical information emitted by the image display screen is reflected by the first reversible lens to the second reversible lens, is reflected by the second reversible lens to The first reversible lens is transmitted to the human eye via the first reversible lens; and ambient light information outside the head mounted display device sequentially passes through the second reversible lens and the first A reversible lens is transmitted to the human eye.
The head-mounted display device of claim 7, wherein the head-mounted display device further comprises a pixel shielding layer, wherein the pixel shielding layer is located on a side of the second reversible lens away from the human eye, Adjusting a transmittance of a corresponding region of the pixel shielding layer according to a projection position of the image content displayed by the image display screen in the second reversible lens.
The head-mounted display device according to claim 7 or 8, wherein the head-mounted display device further comprises:

a second optical magnifying lens group disposed between the image display screen and the reversible lens, the second optical magnifying lens group being composed of one or more Fresnel lenses, or one or more The spherical lens and/or the aspherical lens are composed of one or more Fresnel lenses and spherical lenses and/or aspherical lenses.
The head-mounted display device according to any one of claims 1 to 9, wherein the head-mounted display device further comprises:

An image acquisition module for acquiring an external image of the head mounted display device, the image acquisition module including one or more cameras.
The head mounted display device of claim 10, wherein the image acquisition module comprises a depth of field camera for acquiring an external depth image of the head mounted display device.
The head mounted display device of claim 11, wherein the image acquisition module further comprises a line of sight tracking module for determining human eye line of sight information by detecting a human eye movement state, the sight line tracking module comprising collecting a human eye The image of the camera.
The head mounted display device of claim 12, wherein the head mounted display device further comprises an interaction control module, the interaction control module comprising one or a combination of:

a gesture interaction unit, configured to be connected to the image acquisition module, configured to identify a gesture interaction instruction according to the gesture image acquired by the image acquisition module;

An eye movement interaction unit connected to the line of sight tracking module for the person acquired according to the line of sight tracking module An eye movement state, the identification determines an eye movement interaction instruction;

a somatosensory interaction unit, configured to collect human body motion information by using a sensor, and identify and determine a somatosensory interaction instruction according to the acquired human body motion information;

The voice interaction unit is configured to collect voice information through a microphone, and identify and determine a voice interaction instruction according to the obtained voice information.
The head-mounted display device according to claim 13, wherein the head-mounted display device further comprises a power supply module, the power supply module and the image display screen, the image acquisition module, the line-of-sight tracking module, and the interactive control through the circuit A module connection for powering the head mounted display device via a built-in or external power source.
The head mounted display device according to any one of claims 1 to 14, wherein the image display screen performs split screen display on image content.
The head mounted display device according to any one of claims 1 to 15, wherein the head mounted display device further comprises a headband or a support frame coupled to the housing.