TWI683135B - Head-mounted display device and adjusting method for the same - Google Patents

Abstract

A head-mounted display device and an adjusting method for the same are provided. The adjusting method includes the following steps. An eye position of a user is detected by an eye detecting device. An eye information is obtained according to the eye position. A comparison between the eye information and the optically transmissive lens is obtained. The position of the optically transmissive lens is adjusted according to the comparison.

Description

Head-mounted display device and its adjusting method

The present invention relates to a head-mounted display device and an adjustment method used therefor, and particularly relates to a head-mounted display device capable of adjusting the position of a light-transmitting lens and an adjustment method used therefor.

Virtual Reality (VR) and Augmented Reality (AR) technologies can be applied to head-mounted display devices to provide users with a better video experience and presence.

However, with the difference in the interpupillary distance (IPD) of human eyes, the viewing experience of VR devices and AR devices is also different. For example, for a VR device, since the IPDs of different users may be different, some users are prone to dizziness when wearing this type of device. For AR devices, the viewer may not be able to obtain the complete image information in the mirror, which will affect the viewing quality.

The invention relates to a head-mounted display device and an adjustment method for the same, which can automatically adjust the position of the transparent lens according to different users, so that the user can obtain better viewing quality.

According to one aspect of the present invention, a head-mounted display device is proposed. The head-mounted display device includes a carrier, a transparent lens, an eyeball detection device, a driver, and a controller. The transparent lens is movably arranged on the carrier. The eyeball detection device is disposed on the light-transmitting lens, and is used to detect a user's eyeball position. The driver is used to drive the transparent lens to move. The controller is coupled to the eyeball detection device and the driver, and is used to obtain eyeball information according to the eyeball position, obtain a comparison result between the eyeball information and the transparent lens, and instruct the driver to adjust the position of the transparent lens according to the comparison result.

According to another aspect of the present invention, an adjustment method for adjusting the position of a light-transmitting lens of a head-mounted display device is proposed. The adjustment method includes the following steps. First, an eyeball detection device is used to detect a user's eyeball position. Next, obtain eyeball information according to the eyeball position. Next, obtain a comparison result between the eyeball information and the transparent lens. Finally, adjust the position of the transparent lens according to the comparison result.

In order to have a better understanding of the above and other aspects of the present invention, the following examples are specifically described in conjunction with the accompanying drawings as follows:

10.30‧‧‧Adjustment method

100‧‧‧Head-mounted display device

110‧‧‧Controller

120‧‧‧Eye detection device

130‧‧‧Drive

131‧‧‧ First driver

132‧‧‧ Second drive

140‧‧‧Infrared camera device

141‧‧‧First infrared camera device

142‧‧‧Second infrared camera device

150‧‧‧Ambient light sensor

151‧‧‧The first ambient light sensor

152‧‧‧Second ambient light sensor

160‧‧‧Carrier

170‧‧‧Transparent lens

171‧‧‧First lens

172‧‧‧Second lens

C‧‧‧Central Line

D1‧‧‧First direction

D2‧‧‧Second direction

E1, E2‧‧‧Eyeball

S12, S14, S16, S18, S22, S222, S224, S226, S32, S322, S323, S324, S325, S3251, S3252, S326, S34, S36, S38

FIG. 1 is a block diagram of a head-mounted display device according to an embodiment of the invention.

FIG. 2 is a schematic diagram of the head-mounted display device of FIG. 1.

FIG. 3 is a flowchart of an adjustment method for a head-mounted display device according to an embodiment of the invention.

FIG. 4 is a flowchart illustrating the steps of detecting the position of the user’s eyeball according to another embodiment of the present invention.

FIG. 5 shows a flowchart of an adjustment method for a head-mounted display device according to yet another embodiment of the invention.

6A to 6C are schematic diagrams illustrating an example of adjusting the position of the light-transmitting lens.

FIG. 1 is a block diagram of a head-mounted display device 100 according to an embodiment of the invention, and FIG. 2 is a schematic diagram of the head-mounted display device 100 of FIG. 1.

Please refer to FIGS. 1 and 2, the head-mounted display device 100 is, for example, a head-mounted virtual reality device, such as an augmented reality device. The head-mounted display device 100 includes a controller 110, an eyeball detection device 120, a driver 130, a projector (not shown), a carrier 160, and a translucent lens 170. The transparent lens 170 may include a first lens 171 and a second lens 172, and the projector may include a first projector and a second projector (not shown). The first projector and the second projector can project the image to the first lens 171 and the second lens 172, respectively, to combine the image with the environmental scenery to form an augmented reality.

The transparent lens 170 is movably disposed on the carrier 160. In an embodiment, the first lens 171 and the second lens 172 can independently move relative to the carrier 160.

The eyeball detection device 120 is disposed on the light-transmitting lens 170 and can move together with the light-transmitting lens 170 to detect the position of the user's eyeball. The controller 110 is coupled to the eye detection device 120 and the driver 130. The driver 130 is, for example, a micro motor for driving the light-transmitting lens 170 to move. The driver 130 may include a first driver 131 and a second driver 132, respectively used to drive the first lens 171 and the second lens 172 of the transparent lens 170 to move, so that the first lens 171 and the second lens 172 are independently relative to the load The shelf 160 moves.

FIG. 3 is a flowchart of an adjustment method 10 for a head-mounted display device 100 according to an embodiment of the invention.

Please refer to FIGS. 1 to 3, in step S12, the eyeball detection device 120 detects the eyeball position of the user. For example, the eyeball detection device 120 may use infrared or other band electromagnetic wave detection devices, which is not limited by the present invention.

In step S14, the controller 110 obtains eyeball information according to the eyeball position. For example, the controller 110 may calculate an eyeball area according to the eyeball position to obtain information related to the eyeball.

In step S16, the controller 110 obtains the comparison result between the eyeball information and the transparent lens 170. For example, the controller 110 may compare the relative position between the eyeball-related information and the transparent lens 170 to obtain a comparison result.

In step S18, the controller 110 instructs the driver 130 to adjust the position of the transparent lens 170 according to the comparison result. For example, the controller 110 may instruct the driver 130 to adjust the position of the transparent lens 170 according to the mutual position between the eyeball-related information and the transparent lens 170.

FIG. 4 is a flowchart of step S22 of detecting the position of the user's eyeball according to another embodiment of the present invention.

Please refer to FIG. 1, FIG. 2 and FIG. 4. In an embodiment, the eye detection device 120 may include an infrared camera device 140. In step S222, the infrared camera 140 emits an incident light to the user's eyeball. For example, the infrared camera device 140 may include a first infrared camera device 141 and a second infrared camera device 142, which are respectively disposed on the first lens 171 and the second lens 172 of the translucent lens 170 to respectively emit incident light to use Eyeball E1 and eyeball E2.

In step S224, the infrared camera 140 receives the reflected light of the incident light reflected from the eyeball. For example, the first infrared imaging device 141 and the second infrared imaging device 142 receive the reflected light reflected from the eyeball E1 and the eyeball E2, respectively.

In step S226, the infrared camera 140 detects the eyeball position based on the reflected light. For example, the first infrared camera 141 can detect the coordinates of the eyeball E1 according to the reflected light reflected from the eyeball E1; the second infrared camera device 142 can rely on the reflected light reflected from the eyeball E2 to The coordinates of the eyeball E2 are detected in a dotted outline.

FIG. 5 shows a flowchart of an adjustment method 30 for a head-mounted display device 100 according to yet another embodiment of the invention.

Please refer to FIG. 1, FIG. 2 and FIG. 5. In one embodiment, the eye detection device 120 may further include an ambient light sensor 150 for detecting the ambient light intensity. Since the light-transmitting lens 170 is a light-transmissive material, the human eye may be affected by the ambient light source to affect the reflected light intensity reflected from the eyeball, resulting in a low reflected light intensity of the reflected light, which cannot be detected by the eyeball detection device 120. Detected. Therefore, in step S32, in the step of detecting the user's eyeball position with the eyeball detection device, the factor of the ambient light intensity needs to be further considered.

In step S322, similar to step S222, the infrared camera 140 emits an incident light to the user's eyeball. I will not repeat them here.

In step S323, the ambient light sensor 150 detects the ambient light intensity of the user's current environment. For example, the ambient light sensor 150 may include a first ambient light sensor 151 and a second ambient light sensor 152, which are respectively disposed on the first lens 171 and the second lens 172 of the transparent lens 170, to Detect the ambient light intensity near the first lens 171 and the second lens 172, respectively.

The sequence of the above step S322 and step S323 may be executed sequentially or simultaneously, and the present invention does not limit this.

In step S324, similar to step S224, the infrared camera 140 receives the reflected light of the incident light reflected from the eyeball. I will not repeat them here.

In step S325, the controller 110 further adjusts the incident light intensity of the incident light of the infrared camera device 140 according to the reflected light intensity of the reflected light detected by the infrared camera device 140 and the ambient light intensity detected by the ambient light sensor 150 .

In detail, in step S3251, when the reflected light intensity of the reflected light is lower than a preset value, it means that the reflected light at this time is too weak to be received by the infrared camera 140 because the reflected light intensity is too weak, so that the infrared camera 140 Unable to detect eye position. In this case, as in step S3252, the controller 110 provides a compensation value to enhance the incident light intensity of the incident light.

For example, the controller 110 may adjust the incident light intensity of the incident light according to (Equation 1).

Wherein IR _E is the incident light intensity of incident light; the ALS ambient light intensity; IR _R is the reflected light intensity of reflected light; IR _C is a compensation value which is related to the ambient light intensity. Through (Equation 1), whenever the reflected light intensity of the reflected light is lower than a preset value, the controller 110 provides a compensation value, for example, a look-up table to obtain the compensation value to change the incidence of incident light The light intensity allows the reflected light to be received by the infrared camera 140.

When the reflected light can be received by the infrared camera 140, step S326 is executed. In step S326, similar to step S226, the infrared camera 140 detects the eyeball position based on the reflected light. I will not repeat them here.

Next, in step S34, the controller 110 calculates an eyeball area according to the eyeball position, and uses the eyeball area as eyeball information.

In step S36, the controller 110 determines whether the area of the eyeball is within a standard range, so as to obtain a comparison result between the eyeball information and the transparent lens 170. For example That is to say, please refer to FIGS. 6A to 6C, which are schematic diagrams illustrating an example of adjusting the position of the light transmitting lens (such as the second lens 172). As shown in FIGS. 6A and 6C, FIG. 6A shows that the entire eyeball area is located at the center of the second lens 172 (such as the center line C) toward the first direction D1, and FIG. 6C shows that the entire eyeball area is located The center of the second lens 172 (such as the center line C) is oriented in the second direction D2.

The eyeball area referred to herein may refer to the eyeball area of eyeball E2. The controller 110 may compare the relative positions of the eyeballs of the eyeball E2 and the second lens 172 to determine whether they are located within the standard range. If the area of the eyeballs located on both the left (such as the first direction D1) and the right (such as the second direction D2) of the center line C of the second lens 172 is about 55% or less, as shown in FIG. 6B, it is determined It is located within the standard range. At this time, it is not necessary to adjust the position of the second lens 172. Then, it returns to step S325 in FIG. 5, and then determines whether to adjust the incident light of the infrared camera device 140 according to the current environment of the user Incident light intensity.

Please refer to Figure 1, Figure 2, Figure 5, Figure 6A, and Figure 6C. In Figure 6A, about 70% of the eyeball E2's eye area is located in the direction of the center line C of the second lens 172 toward the first direction D1; in Figure 6C, the eyeball E2's eyeball has about 80% of the area The central line C of the second lens 172 is oriented in the second direction D2. In both cases, the controller 110 determines that it is not within the standard range. At this time, step S38 is executed, and the controller 110 instructs the driver 130 to move the transparent lens 170.

For example, in the example of FIG. 6, the controller 110 instructs the second driver 132 to move the second lens 172 in the first direction D1, so that the eye area of the eyeball E2 is within the standard range; in the example of FIG. 6C , The controller 110 instructs the first The second driver 132 moves the second lens 172 in the second direction D2 so that the eyeball area of the eyeball E2 is within the standard range.

Through the head-mounted display device and the adjustment method used therefor, the position of the transparent lens can be automatically adjusted according to different users, so that the user can obtain better viewing quality. In addition, in different environments, the problem of difficult eye detection can be solved according to the current environmental conditions.

In summary, although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Those with ordinary knowledge in the technical field to which the present invention belongs can make various modifications and retouching without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be deemed as defined by the scope of the attached patent application.

10‧‧‧Adjustment method

S12, S14, S16, S18

Claims (10)

A head-mounted display device includes: a carrier; a light-transmitting lens, which is movably arranged on the carrier; an eyeball detection device, which is arranged on the light-transmitting lens, for detecting a user's An eyeball position; a driver for driving the transparent lens to move; and a controller, coupled to the eyeball detection device and the driver, for obtaining an eyeball area according to the eyeball position, obtaining the eyeball area and the A comparison result between the transparent lenses, and instructing the driver to adjust the position of the transparent lenses according to the comparison result. The head-mounted display device as described in item 1 of the patent application scope, wherein the eyeball detection device includes an infrared camera device for emitting an incident light to an eyeball of the user and receiving the incident light to be reflected from the eyeball A reflected light and detect the eyeball position based on the reflected light, the controller further calculates the eyeball area based on the eyeball position. The head-mounted display device as described in item 2 of the patent application scope, wherein the eyeball detection device further includes: an ambient light sensor for detecting an ambient light intensity; wherein the controller further depends on the reflected light The intensity of the reflected light and the intensity of the ambient light adjust the intensity of the incident light of the incident light. The head-mounted display device as described in item 3 of the patent application scope, wherein, when the reflected light intensity of the reflected light is lower than a preset value, the controller further provides a compensation value to enhance the incident light of the incident light Intensity, the compensation value is related to the ambient light intensity. The head-mounted display device as described in item 2 of the patent application scope, wherein, when the eyeball area is entirely located in the center of the light-transmitting lens toward a first direction, the controller instructs the driver to move in the first direction The light-transmitting lens; and when the entire eyeball area is located at the center of the light-transmitting lens toward a second direction, the controller instructs the driver to move the light-transmitting lens toward the second direction. An adjustment method for adjusting the position of a light-transmitting lens of a head-mounted display device includes: detecting an eyeball position of a user with an eyeball detection device; obtaining an eyeball area according to the eyeball position; obtaining the eyeball A comparison result between the area and the transparent lens; and adjusting the position of the transparent lens according to the comparison result. The adjustment method as described in item 6 of the patent application scope, in which The steps of detecting the user's eyeball position with the eyeball detection device include: emitting an incident light to an eyeball of the user; receiving a reflected light reflected by the incident light from the eyeball; and detecting based on the reflected light Measuring the eyeball position; the step of obtaining the eyeball area according to the eyeball position includes: calculating the eyeball area according to the eyeball position. The adjustment method as described in item 7 of the patent application scope, wherein the step of detecting the eyeball position of the user by the eyeball detection device further comprises: detecting an ambient light intensity; and the reflected light intensity according to the reflected light And the ambient light intensity, adjust the incident light intensity of the incident light. The adjustment method as described in item 8 of the patent application scope, wherein the step of adjusting the incident light intensity of the incident light according to the reflected light intensity of the reflected light and the ambient light intensity includes: when the reflected light intensity of the reflected light is less than one At a preset value, a compensation value is provided to enhance the incident light intensity of the incident light, and the compensation value is related to the ambient light intensity. The adjustment method as described in item 7 of the patent application scope, wherein the step of adjusting the position of the transparent lens according to the comparison result includes: When the entire area of the eyeball is located in the center of the transparent lens toward a first direction, the transparent lens is moved toward the first direction; and when the entire area of the eyeball is located in the central direction of the transparent lens toward a second direction , Move the transparent lens towards the second direction.

Images