WO2017071458A1

WO2017071458A1 - Diopter self-adaptive head-mounted display device

Info

Publication number: WO2017071458A1
Application number: PCT/CN2016/101554
Authority: WO
Inventors: 覃政
Original assignee: 北京蚁视科技有限公司
Priority date: 2015-10-26
Filing date: 2016-10-09
Publication date: 2017-05-04
Also published as: CN105929534A

Abstract

A diopter self-adaptive head-mounted display device (110), comprising a display screen (103) facing human eyes, an optical lens (102) located between the display screen (103) and the human eyes, and an eyeball tracking module (101), wherein the display screen (103) is used to present a picture towards the human eyes, and the distance to the centre of the optical lens (102) is an object distance u; the optical lens (102) is used to focus the picture of the display screen (103) into an image which can be clearly seen by the human eyes, a virtual image of the image and the human eyes are respectively located at two sides of the display screen (103), the distance between the virtual image and the centre of the optical lens (102) is an image distance v, and the optical lens (102) also has a focal distance f; the eyeball tracking module (101) is used to detect the gazing direction of both eyes in real time to position a viewpoint position of a user and to adjust a relative position of the display screen (103) with respect to the optical lens (102) according to the viewpoint position; and the display screen (103) and the optical lens (102) are configured to be capable of moving independently or jointly relative to each other along an optical axis direction and to adjust the distance between the centre of the optical lens (102) and the display screen (103) according to the viewpoint position acquired by the eyeball tracking module (101), so that the adjusted object distance u satisfies a condition 1/f = 1/u-1/v.

Description

Diopter adaptive head-mounted display device

Technical field

The present invention relates to a head mounted display device, and more particularly to a diopter adaptive head mounted display device that can be adapted to the human eye.

Background technique

The display screen of the head-mounted display device is within ten centimeters of the eyeball, so that the near image is conventionally invisible to the human eye. For the three-dimensional image displayed by the head-mounted display device, since the image has three-dimensional spatial space, the wearer actively adjusts the line of sight direction of the eye and the focal length of the eye lens in real time for the fast three-dimensional dynamic picture, due to the long-term eye-to-eye Adjustments made by the department can cause eye strain in the wearer and affect the visual experience of the device. The device invents an adaptive diopter head-mounted display device by adjusting the display screen and the optical lens, thereby preventing the wearer from actively adjusting the line of sight direction of the eye and the focal length of the eye lens. Enhance the user experience.

Summary of the invention

According to an aspect of the present invention, a diopter adaptive head mounted display device includes a display screen facing the human eye, an optical lens between the display screen and the human eye, and an eyeball tracking module: Presenting a picture toward the human eye, the distance from the center of the optical lens is an object distance u; the optical lens is used to focus the picture of the display screen into an image that can be seen by the human eye, the virtual image of the image and the person The eyes are respectively located on two sides of the display screen, the distance between the virtual image and the center of the optical lens is the image distance v, and the optical lens further has a focal length f; the eyeball tracking module is used for real-time detection of binocular line of sight direction for positioning Positioning the user's observation point, adjusting the relative position of the display screen and the optical lens according to the position of the observation point; the display screen and the optical lens are arranged to be independently or collectively movable in the optical axis direction, respectively, and Adjusting a distance between the center of the optical lens and the display according to the position of the observation point acquired by the eyeball tracking module, so that the adjusted object distance u satisfies the condition 1/f =1/u-1/v.

Preferably, the relative movement of the display screen and the optical lens is set such that the optical lens is fixed, and the display screen moves in the optical axis direction.

Preferably, the relative movement of the display screen and the optical lens is further set to be fixed by the display screen, and the optical lens moves in the optical axis direction.

Preferably, the relative movement of the display screen and the optical lens is further configured to move the display screen and the optical lens in cooperation with each other in the optical axis direction.

Preferably, the optical lens is provided with an ultrasonic motor for controlling the movement of the optical lens in the optical axis direction.

Preferably, the optical lens is arranged as an array optical lens.

Preferably, the display screen is provided with a power driver for controlling the movement of the display screen in the direction of the optical axis.

Preferably, the display screen is configured as an LCD display or an LED display.

According to another aspect of the present invention, a method of diopter adaptive head mounted display device is provided, the device comprising a display screen facing the human eye, an optical lens between the display screen and the human eye, and an eyeball tracking module The method comprises the steps of: a) detecting a binocular line of sight position by an eye tracking module; b) calculating a distance of the image point from the center of the optical lens according to a position of the binocular line of sight, ie, an image distance v; c) adjusting according to the image distance v The distance between the center of the optical lens and the display, that is, the object distance u; d) is such that the image distance v satisfies the first condition by adjusting the object distance u, that is, 1/f=1/u-1/v; e) In steps a) to d), the relative position of the display and the center of the optical lens is adjusted in real time so as to satisfy 1/f=1/u-1/v.

According to the diopter adaptive head-mounted display device of the present invention, the relative distance between the display screen and the optical lens can be adjusted by the device, instead of the wearer's initiative, the eye line direction and the eye lens focal length are adjusted, which helps to protect. Eyes, avoid visual fatigue; the device is small in size, easy to install, comfortable to wear, and its wide range of passes, suitable for 3D visual experience.

It is to be understood that the foregoing general descriptions

DRAWINGS

Further objects, functions, and advantages of the present invention will be realized by the present invention with reference to the accompanying drawings. The following description of the mode of implementation is illustrated, wherein:

Figure 1 (a) is a view schematically showing a state of use of a diopter adaptive head mounted display device according to the present invention;

Figure 1 (b) is a view schematically showing the main structure of a diopter adaptive head mounted display device according to the present invention;

2 is a view schematically showing the relationship between the relative movement of the display screen and the optical lens of the diopter adaptive head mounted display device and the optical path diagram according to the present invention;

Fig. 3 is a schematic flow chart showing the operation of a diopter adaptive head mounted display device in accordance with the present invention.

4(a)-4(b) schematically illustrate an embodiment of a diopter adaptive head mounted display device in accordance with the present invention;

5(a)-5(b) schematically illustrate an embodiment of a diopter adaptive head mounted display device in accordance with the present invention;

6(a)-6(b) schematically illustrate an embodiment of a diopter adaptive head mounted display device in accordance with the present invention.

detailed description

Objects and functions of the present invention, and methods for achieving the objects and functions will be clarified by referring to the exemplary embodiments. However, the invention is not limited to the exemplary embodiments disclosed below; it can be implemented in various forms. The essence of the description is merely to assist those skilled in the relevant art to understand the specific details of the invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same reference numerals are used to refer to the same or similar parts.

1(a) is a view showing a state of use of a diopter adaptive head mounted display device according to the present invention; as shown in FIG. 1(a), a viewer wears the head mounted display device 110 to view an ambient image 120.

1(b) is a view schematically showing the main structure of a diopter adaptive head mounted display device according to the present invention; as shown in FIG. 1(b), the head mounted display device 110 includes a display screen 103 facing the human eye and is located on the display screen. The optical lens 102 between the 103 and the human eye, and the eyeball tracking module 101 and the optical axis 104.

The display screen 103 is used to present a picture toward the human eye, and the distance from the center of the optical lens is the object distance u;

According to an embodiment of the invention, the display screen 103 is provided with a power driver for controlling the movement of the display screen in the direction of the optical axis.

According to an embodiment of the invention, the display screen 103 is provided as an LCD display or an LED display.

The optical lens 102 is used to focus the image of the display screen 103 into an image that can be seen by the human eye. The virtual image of the image and the human eye are respectively located on both sides of the display screen 103, and the distance between the virtual image and the center of the optical lens is the image distance v, the optical lens. 102 also has a focal length f;

According to an embodiment of the invention, the optical lens 102 is provided with an ultrasonic motor for controlling the movement of the optical lens in the optical axis direction.

According to an embodiment of the invention, the optical lens is arranged as an array of optical lenses.

The eyeball tracking module 101 is configured to detect the direction of the line of sight of the eyes in real time to locate the position of the user's observation point, and adjust the relative position of the display screen 103 and the optical lens 102 according to the position of the observation point;

The display screen 103 and the optical lens 102 are disposed to be independently or collectively movable in the optical axis direction, respectively, and adjust the distance between the center of the optical lens 102 and the display according to the position of the observation point acquired by the eyeball tracking module 101, so that the adjusted object distance u satisfies Condition 1/f=1/u-1/v.

2 is a view schematically showing the relationship between the relative movement of the display screen and the optical lens and the optical path of the diopter adaptive head mounted display device according to the present invention; as shown in FIG. 2, the optical lens 201 has a focal length f, the first image 202a. Having an object distance u1, the second image 202b has an object distance u2, and the first image 202a and the second image 202b are respectively images having different spatial positions in the three-dimensional picture in the display screen; as shown in the optical path diagram in FIG. 2, the first image 202a and the second image 202b are concentrated by the optical lens 201. The virtual images presented in the eye are the first virtual image 203a and the second virtual image 203b, respectively, and the first virtual image 203a and the second virtual image 203b have an image distance v1 and an image distance v2, respectively; Therefore, since the object distance u changes in real time, the image distance v of the virtual image presented in the eye also changes in real time. Since the focal length f of the optical lens 201 is a fixed characteristic, the viewer can actively adjust the line of sight direction of the eye and the focal length of the eye lens according to the object distance u to view the image of the next moment, thus causing fatigue to the human eye.

The diopter adaptive head mounted display device of the present invention adjusts the relative distance between the optical lens and the display screen in the direction of the optical axis 204 such that objects having different object distances u are in the eye The virtual image presented has an image distance v that does not change or varies within a certain range, and satisfies the first condition 1/f=1/u-1/v, which can eliminate or reduce the fatigue of the human eye.

According to the diopter adaptive head mounted display device of the present invention, there are three ways to adjust the relative distance between the optical lens and the display screen in the direction of the optical axis 204, respectively:

a) the relative movement of the display screen and the optical lens is set to be fixed by the optical lens, the display screen is moved in the optical axis direction, as described in Embodiment 1 of FIG. 4;

b) the relative movement of the display screen and the optical lens is also set to the display screen fixed, the optical lens moves in the optical axis direction, as described in Embodiment 2 of FIG. 5;

c) The relative movement of the display screen and the optical lens is further arranged such that the display screen and the optical lens move in cooperation with each other in the optical axis direction, as described in Embodiment 3 of FIG.

3 is a flow chart showing the operation of a diopter adaptive head mounted display device according to the present invention: a diopter adaptive head mounted display device diopter adaptive head mounted display device, the device including a human eye-oriented display a screen, an optical lens between the display screen and the human eye, and an eyeball tracking module, the method comprising the steps of:

Step 301: detecting a binocular line of sight position by an eyeball tracking module;

Step 302: Calculate the distance between the image point and the center of the optical lens according to the position of the line of sight of the binocular, that is, the image distance v;

Step 303: Adjust the distance between the center of the optical lens and the display according to the image distance v, that is, the object distance u;

Step 304: The image distance v is satisfied by adjusting the object distance u, that is, 1/f=1/u-1/v;

Step 305: Cycle steps 301-304 to adjust the relative position of the display and the center of the optical lens in real time so as to satisfy 1/f=1/u-1/v.

Example 1

4 schematically illustrates an embodiment of a diopter adaptive head mounted display device in accordance with the present invention in which the relative movement of the display screen and optical lens 401 is set to be fixed by the optical lens 401, the display screen being on the optical axis 404 The direction is moved such that the adjusted object distance u2, the image distance v3, and the focal length f satisfy the first condition 1/f=1/u2-1/v3.

As shown in FIG. 4(a), the current image 402 in the display screen has an object distance u1, and the optical lens shown has a focal length f. The current image 402 is concentrated by the optical lens 401 and the current virtual image 403a presented in the eye has an image distance v1. The virtual image 403b of the image at the previous moment has an image distance v2, in order to avoid The viewer avoids actively adjusting the eyesight direction of the eye and the eye lens focal length to generate fatigue. The present invention takes the position of the display screen, that is, adjusts the object distance u1, so that the virtual image 403a of the current image 402 in the display screen 402 also has the same image. From v2.

As shown in FIG. 4(b), by adjusting the relative position of the display screen in the direction of the optical axis 404 to the optical lens 401, the optical lens 401 is fixed in position to adjust the position of the display screen when the display screen is When the original object distance u1 of the current image 402 is adjusted to the object distance u2, the image distance of the virtual image 403a of the current image 402 is also changed from the original image distance v1 to the image distance v3, and v2=v3, that is, the image distance v3 and The image of the virtual image 403b of the previous moment image is equal to v2. And the displacement of the display screen in the direction of the optical axis 404 satisfies the first condition, that is, 1/f=1/u2-1/v3: that is, the current image 402 is concentrated in the eye through the optical lens 401 The position of the virtual image 403a is the same as the position of the virtual image 403b of the image of the previous moment, so that the viewer does not have to actively adjust the line of sight direction of the eye and the focal length of the eye lens, which can reduce or eliminate eye fatigue.

Example 2

Figure 5 is a schematic illustration of an embodiment of a diopter adaptive head mounted display device in accordance with the present invention: the relative movement of the display screen and optical lens 501 is also set to the optical lens 501 fixed, the display screen being on the optical axis The direction of movement in the direction 504 is such that the adjusted object distance u2, the image distance v3, and the focal length f satisfy the first condition 1/f=1/u2-1/v3.

As shown in FIG. 5(a), the current image 502 in the display screen has an object distance u1, and the optical lens shown has a focal length f. The current image 502 is concentrated by the optical lens 501. The current virtual image 503a presented in the eye has an image distance v1. The virtual image 503b of the image at the previous moment has an image distance v2. In order to prevent the viewer from actively adjusting the line of sight direction of the eye and the focal length of the eye lens, the present invention adopts adjusting the position of the display screen, that is, adjusting the object distance u1, so that the display screen is in the display screen. The virtual image 503a of the current image 502 also has the same image distance v2.

As shown in FIG. 5(b), by adjusting the relative position of the display screen in the direction of the optical axis 504 to the optical lens 501, the position of the display screen is fixed, and the position of the optical lens 501 is adjusted, when the display screen is When the original object distance u1 of the current image 502 is adjusted to the object distance u2, the image distance of the virtual image 503a of the current image 502 is also changed from the original image distance v1 to the image distance v3, and v2=v3, that is, the image distance v3 and The image distance v2 of the virtual image 503b of the image at the previous moment is equal. And the displacement of the display screen in the direction of the optical axis 504 satisfies the first condition, that is, 1/f=1/u2-1/v3: that is, the current image 502 is concentrated by the optical lens 501 and is present in the eye. The position of the virtual image 503a is the same as the position of the virtual image 503b of the image of the previous moment, so that the viewer does not have to actively adjust the eye. The direction of the line of sight and the focal length of the lens of the eye can reduce or eliminate eye fatigue.

Example 3

Figure 6 is a schematic illustration of one embodiment of a diopter adaptive head mounted display device in accordance with the present invention: the relative movement of the display screen and optical lens 601 is also set such that the display screen and the optical lens are in the direction of optical axis 604 The upper ones cooperate with each other so that the adjusted object distance u2, the image distance v3, and the focal length f satisfy the first condition 1/f=1/u2-1/v3.

As shown in FIG. 6(a), the current image 602 in the display screen has an object distance u1, the optical lens 601 has a focal length f, and the current image 602 is concentrated by the optical lens 601. The current virtual image 603a presented in the eye has an image distance v1. The virtual image 603b of the image at the previous moment has an image distance v2. In order to prevent the viewer from actively adjusting the line of sight direction of the eye and the focal length of the eye lens, the present invention adopts an adjustment of the relative orientation of the display screen and the optical lens 601 in the direction of the optical axis 604. The position, i.e., the adjustment object distance u1, causes the virtual image 603a of the current image 602 in the display screen to also have the same image distance v2.

As shown in FIG. 6(b), by adjusting the relative position of the display screen in the direction of the optical axis 604 to the optical lens 601, the display screen and the optical lens 601 are mutually in the direction of the optical axis 604. With the movement, when the original object distance u1 of the current image 602 of the display screen becomes the object distance u2, the image distance of the virtual image 603a of the current image 602 is also changed from the original image distance v1 to the image distance v3, and v2=v3, That is, the image distance v3 is equal to the image distance v2 of the virtual image 603b of the previous time image. And the movement displacement of the display screen and the optical lens 601 in the direction of the optical axis 604 satisfies the first condition, that is, 1/f=1/u2-1/v3: that is, the current image 602 passes through the optical lens 601. The position of the current virtual image 603a presented in the eye is the same as the position of the virtual image 603b of the image of the previous moment, so that the viewer does not have to actively adjust the line of sight direction of the eye and the focal length of the eye lens, which can reduce or eliminate eye fatigue.

The drawings are only schematic and are not drawn to scale. Although the present invention has been described in connection with the preferred embodiments, it is understood that the scope of the invention is not limited to the embodiments described herein.

Other embodiments of the invention will be apparent to those skilled in the <RTIgt; The description and the examples are to be considered as illustrative only, and the true scope and spirit of the invention are defined by the claims.

Claims

A diopter adaptive head-mounted display device includes a human-facing display screen, an optical lens between the display screen and the human eye, and an eyeball tracking module:

The display screen is used to present a picture toward the human eye, and the distance from the center of the optical lens is the object distance u;

The optical lens is configured to focus a picture of the display screen into an image viewable by a human eye, the virtual image of the image and the human eye are respectively located on two sides of the display screen, the virtual image and the optical lens center The distance is the image distance v, and the optical lens also has a focal length f;

The eyeball tracking module is configured to detect a binocular line of sight direction in real time to locate a user's viewpoint position, and adjust a relative position of the display screen and the optical lens according to a position of the observation point;

The display screen and the optical lens are disposed to be independently or collectively movable in the optical axis direction, and adjust a distance between the optical lens center and the display according to a position of the observation point acquired by the eyeball tracking module, so that The adjusted object distance u satisfies the condition 1/f=1/u-1/v.
The diopter adaptive head mounted display device according to claim 1, wherein the relative movement of the display screen and the optical lens is set such that the optical lens is fixed, and the display screen moves in the optical axis direction.
The diopter adaptive head mounted display device according to claim 1, wherein the relative movement of the display screen and the optical lens is further set such that the display screen is fixed, and the optical lens moves in the optical axis direction.
The diopter adaptive head-mounted display device according to claim 1, wherein the relative movement of the display screen and the optical lens is further set such that the display screen and the optical lens cooperate with each other in the optical axis direction. mobile.
The diopter adaptive head mounted display device according to claim 1, wherein said optical lens is provided with an ultrasonic motor for controlling movement of said optical lens in the optical axis direction.
The diopter adaptive head mounted display device according to claim 1, wherein the optical lens is provided as an array type optical lens.
A diopter adaptive head mounted display device according to claim 1, wherein said display screen is provided with a power driver for controlling the movement of said display screen in the direction of the optical axis.
The diopter adaptive head mounted display device according to claim 1, wherein the display screen is set as an LCD display or an LED display.
A method of diopter adaptive head mounted display device, the device comprising a display screen facing the human eye, an optical lens between the display screen and the human eye, and an eyeball tracking module, the method comprising the steps of:

a) detecting the position of the line of sight of the eyes through the eye tracking module;

b) calculating the distance between the image point and the center of the optical lens according to the position of the line of sight of the binocular, that is, the image distance v;

c) adjusting the distance between the center of the optical lens and the display according to the image distance v, that is, the object distance u;

d) by adjusting the object distance u such that the image distance v satisfies the first condition, ie 1/f=1/u-1/v;

e) Cycling steps a) to d) adjust the relative position of the display to the center of the optical lens in real time such that it satisfies 1/f = 1/u-1/v.