WO2022218148A1 - 头戴显示设备及其控制方法 - Google Patents

头戴显示设备及其控制方法 Download PDF

Info

Publication number
WO2022218148A1
WO2022218148A1 PCT/CN2022/083829 CN2022083829W WO2022218148A1 WO 2022218148 A1 WO2022218148 A1 WO 2022218148A1 CN 2022083829 W CN2022083829 W CN 2022083829W WO 2022218148 A1 WO2022218148 A1 WO 2022218148A1
Authority
WO
WIPO (PCT)
Prior art keywords
head
display device
mounted display
user
nose
Prior art date
Application number
PCT/CN2022/083829
Other languages
English (en)
French (fr)
Inventor
朱蓓蓓
袁海林
蔡雅倩
王实现
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022218148A1 publication Critical patent/WO2022218148A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays

Definitions

  • the present application relates to the field of smart wear, and in particular, to a head-mounted display device and a control method of the head-mounted display device.
  • head-mounted display devices With the development of virtual reality technology (Virtual Reality, VR) and augmented reality technology (Augmented Reality, AR), head-mounted display devices have gradually gained popularity.
  • the head-mounted display device is usually fixed on the user's head, and is mounted on the bridge of the user's nose to achieve accurate positioning with the user's eyes, thereby ensuring the user's observation effect.
  • the purpose of the present application is to provide a head-mounted display device and a control method thereof, so as to ensure relatively good observation effects when used by different users.
  • This application includes the following technical solutions:
  • the present application relates to a method for controlling a head-mounted display device, comprising the following steps:
  • the head-mounted display device control method of the present application first identifies the user's gaze direction through the eye tracking technology, and then can calculate the included angle between it and the head-mounted display device's head-up direction based on the gaze direction.
  • the user's line of sight direction and the preset head-up direction tend to be consistent, that is, when the angle between the user's line of sight direction and the head-up direction of the head-mounted display device is within the preset angle range, the user can be guaranteed observation effect.
  • it is determined that the angle between the user's line of sight and the head-mounted display device's head-up direction exceeds the preset angle range it can be determined that the wearing posture of the head-mounted display device is high or low, which may affect the user's observation experience. .
  • control method of the present application also drives the head-mounted display device to move relative to the bridge of the user's nose by adjusting the shape of the nose pad of the head-mounted display device, so that the head-mounted display device's head-up direction is close to the user's line of sight, thereby ensuring that the user's Observe the effect.
  • the head-mounted display device control method of the present application can ensure that users with different face shapes can obtain a relatively consistent observation experience, and by periodically recognizing the user's line of sight direction during the user's continuous use of the head-mounted display device, the head-mounted display device can also be continuously displayed. The device is adjusted to ensure the user's long-term experience.
  • the shape of the nose pad of the head-mounted display device is adjusted so that after the head-mounted display device is moved relative to the bridge of the user's nose, the angle between the user's line of sight and the head-up direction of the head-mounted display device is in the within the angle range.
  • the included angle between the user's line of sight and the head-mounted display device's head-up direction is within the angular range, so that the user's line of sight can be adjusted to be consistent with the preset head-up direction, so as to achieve more good observation.
  • the head mounted display device is further configured to detect the activation instruction.
  • control method of the head-mounted display device is applied to its start-up use or use process, so the control method also needs to be implemented and carried out after the start-up instruction is detected.
  • the head-mounted display device includes a housing, and the nose pad includes an adjustment member, and the adjustment member can be retracted outward relative to the housing to adjust the shape of the nose pad of the head-mounted display device, including:
  • the telescopic amount of the adjusting piece relative to the housing is controlled to change the shape of the nose pads.
  • an adjusting member is provided in the nose pad, and the adjusting member can be extended and retracted outwardly relative to the housing of the head-mounted display device, so as to change the shape of the nose pad, thereby changing the relative relationship between the nose pad and the bridge of the user's nose. high.
  • the relative height between the casing of the head-mounted display device and the user's eyes can also be adjusted, so that the display device of the head-mounted display device can be moved up and down relative to the bridge of the user's nose, and the head-mounted display device can be adjusted toward the direction of the user's line of sight. .
  • the number of adjustment members is two, and the two adjustment members are respectively attached to the two sides of the bridge of the nose of the user, and the telescopic amount of the adjustment member relative to the housing is controlled to change the shape of the nose pads, and further includes: :
  • the telescopic amount of the at least one adjustment piece relative to the housing is controlled to change the shape of the nose pads.
  • the adjustment of the shape of the nose pads by the adjusting member can be realized by the way that two adjusting parts are extended and retracted at the same time, or can be realized by the way of extending and retracting a single adjusting part.
  • the function of improving the user's observation effect can also be achieved by only adjusting the expansion and contraction of one side of the adjustment member.
  • the method further includes:
  • the angle between the gaze direction of the left eyeball and the gaze direction of the right eyeball and the head-up direction of the head-mounted display device are obtained respectively.
  • the adjustment member includes a first adjustment member close to the user's left eyeball, and a second adjustment member close to the user's right eyeball. If the sight direction of the left eyeball is different from that of the right eyeball, adjust the head Nose pad shape for wearing display devices, also including:
  • the adjustment amounts of the two adjustment members are also set differently, which can better adjust the head-mounted display device to its corresponding posture and ensure the observation of the user's eyes. Effect.
  • adjusting the shape of the nose pad of the head-mounted display device further includes:
  • the first adjusting member is controlled relative to the housing. amount of expansion and contraction to change the shape of the nose pads; or
  • the second adjusting member is controlled relative to the housing. amount of expansion and contraction to change the shape of the nose pads.
  • the included angle on one side of the first adjusting member when the included angle on one side of the first adjusting member is relatively large, only the first adjusting member can be adjusted independently, so as to change the shape of the nose pad and improve the user's observation effect.
  • the included angle on one side of the second adjustment member is also adjusted accordingly, so the adjustment operation of the second adjustment member may be omitted, and the control logic of the method is simplified.
  • the included angle on one side of the second adjusting member is relatively large, it is also possible to adjust only the telescopic amount of the second adjusting member, that is, the effect of adjusting both the included angles is achieved.
  • the nose pad further includes a motor, one end of the adjusting member is rotatably connected to the housing, the other end of the adjusting member is drivingly connected to the motor, and the adjusting member further includes an arc surface connected between the opposite ends, The curved surface is used to fit the user's nose bridge, adjust the shape of the nose pad of the headset, and also include:
  • a specific structure of a nose pad is provided.
  • the telescopic amount of the adjusting piece is adjusted by the rotation of the motor, so that the arc surface of the adjusting piece cooperating with the user's nose bridge can expand and contract relative to the casing, so as to achieve the effect of adjusting the shape of the nose pads.
  • the motor is located between the two adjusting members, the motor is provided with an output shaft facing the two adjusting members respectively, and is respectively drive-connected to the two adjusting members, and the motor is controlled to rotate around the first rotation direction, including :
  • Controlling the two output shafts of the motor to rotate around the first rotation direction synchronously; and controlling the motor to rotate around the second rotation direction including:
  • the two output shafts of the control motor rotate synchronously around the second rotational direction.
  • the motor is arranged between the two adjusting members, and the motors are arranged with output shafts extending toward the two adjusting members respectively.
  • the rotation of one motor can control the telescopic adjustment of the two adjusting members synchronously.
  • the present application also relates to a head-mounted display device, including:
  • An eye tracking device used to identify the user's gaze direction using eye tracking technology
  • Nose pads which are used to contact the user's nose bridge and support the head-mounted display device, and the nose pads can be automatically deformed;
  • the control device is used to obtain the included angle between the line of sight direction and the head-mounted display device's head-up direction, and when the included angle exceeds a preset angle range, adjust the shape of the nose pads so that the head-mounted display device is relative to the user's The bridge of the nose moves, and the head-up direction of the head-mounted display device is closer to the line of sight.
  • the head-mounted display device of the present application can use the eye tracking device to identify the user's line of sight direction; then use the control device to calculate the angle between the line of sight direction and the head-mounted display device's head-up direction, And when the included angle exceeds the preset angle range, the shape of the nose pad is adjusted, and the head mounted display device is driven to move relative to the bridge of the user's nose, so that the head-mounted display device's head-up direction is close to the line of sight.
  • the head-mounted display device of the present application can also adjust the user's line of sight direction to be consistent with its head-up direction, thereby ensuring the user's observation effect.
  • the head-mounted display device includes a casing
  • the nose pad includes an adjusting member and a motor
  • the adjusting member is telescopically connected to the casing
  • the motor is drive-connected to the adjusting member
  • the motor is used to adjust the relative position of the adjusting member to the adjusting member.
  • control device can drive the adjusting member to move by driving the motor in the nose pad, so as to realize the outward expansion and contraction of the adjusting member relative to the housing, thereby realizing the effect of changing the shape of the nose pad.
  • the adjusting member and the housing are slidably connected and/or rotationally connected.
  • the adjusting member when the adjusting member is slidably connected to the housing, the adjusting member can slide and extend relative to the housing to adjust the shape of the nose pads; when the adjusting member is rotatably connected to the housing, the adjusting member can rotate relative to the housing Extend to adjust the shape of the nose pads. Both methods can achieve the effect of adjusting the shape of the nose pads. It can be understood that the adjusting member can also be slidably and rotatably connected to the housing at the same time, and can adjust the shape of the nose pads in two ways at the same time.
  • the number of the adjustment parts is two, the two adjustment parts are respectively attached to the two sides of the bridge of the user's nose, and the motor is located between the two adjustment parts.
  • the motor is arranged between the two adjusting members, and the two adjusting members can be driven simultaneously by the motor, so as to realize the telescopic action of the two adjusting members relative to the casing at the same time, which simplifies the structure of the nose pads, and Reduce the production cost of head-mounted display devices.
  • the adjusting member includes opposite first ends and second ends, the first end is drivingly connected to the motor, the second end is rotatably connected to the housing, and the motor drives the adjusting member to rotate relative to the housing to change the The shape of the nose pads.
  • a mechanism implementation manner of an adjustment member in a head-mounted display device is provided.
  • the displacement amount of the adjusting member can be controlled to be relatively small, which is beneficial to the precision control of the motor and achieves a more accurate adjustment effect.
  • the number of motors is two, and each motor is drive-connected to one adjusting member respectively.
  • two motors are used to adjust the telescopic actions of the two adjusting members respectively, so that the operation of adjusting the telescopic amount of a single adjusting member can be realized.
  • the expansion and contraction of the two adjustment parts are controlled individually to improve the user's observation effect.
  • the eye tracking device includes a photosensitive unit and an infrared unit, the infrared unit is used to emit infrared light to the user's eyes, and the photosensitive unit tracks the user's gaze direction based on the position of the collected infrared light on the eye.
  • the line of sight of the user's eyes can be detected, and then the direction of the user's line of sight can be identified through the eye tracking technology.
  • FIG. 1 is a schematic diagram of an application scenario of a head-mounted display device provided by the present application
  • FIG. 2 is a schematic diagram of the internal component frame of the head-mounted display device provided by the present application.
  • FIG. 3 is a schematic structural diagram of a housing and a nose pad in the head-mounted display device provided by the present application;
  • 4a, 4b and 4c are schematic diagrams of different application scenarios of the head-mounted display device provided by the present application.
  • FIG. 5 is a flowchart of a method for controlling a head-mounted display device provided by the present application.
  • FIG. 6 is a schematic diagram of the control logic of the head-mounted display device provided by the present application.
  • FIG. 7 is a schematic diagram of an exploded structure of a nose pad in the head-mounted display device provided by the present application.
  • FIG. 8 is a schematic partial structural diagram of an embodiment of a head-mounted display device provided by the present application.
  • FIG. 9 is a schematic structural diagram of the adjusting member of the nose pad in the head-mounted display device provided by the present application.
  • FIG. 10 is a schematic diagram of the motor structure of the nose pad in the head-mounted display device provided by the present application.
  • FIG. 11 is a schematic diagram of a fitting state of nose pads in the head-mounted display device provided by the present application.
  • FIG. 12 is a schematic diagram of another matching state of the nose pads in the head-mounted display device provided by the present application.
  • FIG. 13 is a schematic diagram of a working state of a nose pad in the head-mounted display device provided by the present application.
  • FIG. 14 is a schematic structural diagram of another embodiment of a nose pad in the head-mounted display device provided by the present application.
  • 15 is a schematic diagram of another working state of the nose pad in the head-mounted display device provided by the present application.
  • FIG. 16 is a schematic diagram of another working state of nose pads in the head-mounted display device provided by the present application.
  • 17 is a schematic diagram of another working state of the nose pad in the head-mounted display device provided by the present application.
  • FIG. 18 is a schematic diagram of another application scenario of the head-mounted display device provided by the present application.
  • FIG. 19 is a schematic diagram of another control logic of the head-mounted display device provided by the present application.
  • FIG. 1 illustrates an application scenario of the head-mounted display device 200 involved in the present application.
  • the head-mounted display device 200 includes a display part 210 and a fixing part 220 .
  • the fixing part 220 is used to hold the display part 210 on the user's head, and the display part 210 is positioned at the position of the user's eyes to achieve a display effect.
  • the fixing portion 220 takes the form of a strap.
  • the fixing portion 220 may also be in the form of a temple of glasses, or in the form of a helmet to hold the display portion 210 on the user's head.
  • the fixing part 220 and the display part 210 may also adopt an integrally formed structure.
  • FIG. 2 illustrates the internal components of the display part 210 in the head-mounted display device 200 involved in the present application.
  • the display unit 210 may include a housing 211 , a display device 212 , a control device 213 , an eye tracking device 214 and a nose pad 100 .
  • the casing 211 is used to provide the external structure of the display portion 210 , and other components are accommodated in the casing 211 and protected by the casing 211 .
  • the display device 212 is used to provide a user with a display screen.
  • the control device 213 is electrically connected to the display device 212 and is used to control the screen displayed by the display device 212 .
  • the eye-tracking system 214 is also electrically connected to the control device 213 for identifying the user's gaze direction by using the eye-tracking technology.
  • the control device 213 may include a part electrically connected to the display device 212 and a part electrically connected to the eye tracking system 214 , and the two parts are arranged inside the housing 211 independently of each other.
  • the control device 213 may also be a whole, and the specific implementation manner of the control device 213 is not particularly limited in the present application.
  • FIG. 3 is a schematic diagram illustrating the cooperation between a part of the structure of the housing 211 and the nose pad 100 .
  • the nose pad 100 is located in the lower part of the middle of the housing 211 for matching with the user's nose bridge, that is, the head-mounted display device 200 can be erected on the user's nose bridge through the nose pad 100 . Because the positions of the nose bridge and the eyes are relatively close, and the positions of the nose bridge and the eyes are relatively fixed, it is convenient to control the relative position between the head mounted display device 200 and the user's eyes through the cooperation of the nose pad 100 and the nose bridge.
  • the nose pad 100 is at least partially movably connected with the housing 211 and can protrude out of the housing 211 , that is, the part of the nose pad 100 extending out of the housing 211 is a deformable structure. It can be understood that, because the nose pad 100 fits the user's nose bridge, when the shape of the nose pad 100 changes, it can change the posture of the housing 211 relative to the user's nose bridge, and then can be adjusted to match the head mounted display device 200 of the present application and the user's eye. The relative position of the part can be adjusted to realize the effect of adjusting the viewing angle of the user.
  • the head-mounted display device 200 is preset with a head-up direction A0 , and the head-up direction A0 is set corresponding to the display device 212 of the head-mounted display device 200 .
  • the display effect of the display device 212 received by the user is better.
  • the line of sight direction A1 of the user's eyes is also marked, and because the display device 212 in FIG.
  • the head-up directions A0 coincide with each other.
  • the display device 212 of the head-mounted display device 200 is located above and below the user's eyes, respectively.
  • the user's line of sight direction A1 is still directed toward the display device 212, but because the display device 212 has a The position is shifted, so that the better head-up direction A0 for observing the display device 212 is also deflected along with the display device 212 .
  • an included angle ⁇ 1 and an included angle ⁇ 2 are formed between the user's line-of-sight direction A1 and the preset head-up direction A0 . It can be understood that, in the schematic diagram of FIG.
  • the included angle between the user's line-of-sight direction A1 and the preset head-up direction A0 may be regarded as 0.
  • the observation effect of the user using the head-mounted display device 200 of the present application is the best.
  • the height of the bridge of the nose is different due to the different face shapes of the users mentioned above.
  • the relative position between the user's eyes and the display device 212 may be formed. difference.
  • the phenomenon shown in Fig. 4b or Fig. 4c may also occur. It can be understood that when the included angle ⁇ 1 or the included angle ⁇ 2 in FIG. 4b and FIG. 4c is too large, the phenomenon that the user observes the physical examination may be poor.
  • FIG. 5 illustrates a flowchart of a control method of the present application involving the head-mounted display device 200 .
  • the head-mounted display device control method of the present application specifically includes the following steps:
  • the eye tracking device 214 is disposed on the casing 211 and is disposed toward the user's eye, so as to track the user's eye.
  • FIG. 6 for the control logic diagram of the deformable nose pad 100 by the head-mounted display device 200 of the present application.
  • the control device 213 is electrically connected to the eye tracking device 214 , and the control device 213 is connected to the signal detected by the eye tracking device 214 , and can calculate the current gaze direction A1 of the user in real time.
  • the angle ⁇ between the user's gaze direction A1 and the head-mounted display device 200's head-up direction A0 can also be calculated (ie obtained). It can be understood that the calculation of the user's current gaze direction A1 and/or the calculation of the included angle ⁇ can also be completed on the eye tracking device 214 , or completed by the eye tracking device 214 and the control device 213 in cooperation.
  • Eye tracking technology is a technology that measures the gaze point of the subject's eyes by locating the pupil position and obtaining the coordinates. This technology belongs to a "non-invasive" detection technology.
  • the eye tracking device 214 includes a photosensitive unit 2141 and an infrared unit 2142 .
  • the infrared unit 2142 can emit infrared light (usually near-infrared light) toward the user's eyes, and the photosensitive unit 2141 records the interaction process, and based on the collected infrared light reflected by the eye's position in the eye, infers the user through analysis. line of sight direction A1.
  • the photosensitive unit 2141 can be implemented by a device such as a camera.
  • the included angle ⁇ can be compared with the angle range preset in the head-mounted display device 200 to determine whether the current user's line of sight direction A1 deviates from the head-up direction A0 by a predetermined amount. set range. It can be understood that the angle range preset in the present application is set based on the head-mounted display device 200 preset head-up direction A0. That is, taking the head-up direction A0 as a reference, within a certain angular range that is offset upward or downward relative to the head-up direction A0, the user can be guaranteed to receive a better observation experience.
  • the preset angle range can be adjusted appropriately, for example, the preset angle range is defined as ⁇ 5°, or the preset angle range is defined as ⁇ 10°, etc. It is set based on the characteristics of the display device 212 .
  • the preset angle range can also be set in an asymmetric manner.
  • the upper limit of the preset angle range can be defined to be about +10°; and when the head-mounted display device 200 is relatively low relative to the user's eyes, it can be defined
  • the lower limit of the preset angle range is about -5°. Because, when the head-mounted display device 200 is low relative to the user's eyes, the weight of the head-mounted display device 200 will be relatively concentrated on the position of the user's nose bridge, causing greater pressure and affecting the user's wearing comfort. Therefore, different setting of the upper limit value and the lower limit value of the angle range can not only improve the user's observation effect, but also ensure the user's wearing comfort.
  • the control device 213 can control the deformation of the deformable nose pad 100 relative to the housing 211 based on the value and direction of the angle ⁇ obtained by monitoring, that is, the control device 213 adjusts the size of the nose pad 100 protruding from the housing 211, and then adjusts to the head.
  • the head-mounted display device 200 can also be controlled to be within a preset angle range after adjustment, that is, the included angle ⁇ is within the angle range.
  • the user's line of sight direction A1 may also be adjusted to be flush with the preset head-up direction A0, so as to ensure that the user obtains a better observation effect.
  • the control device 213 can correspondingly adjust the deformation direction of the nose pad 100 based on the direction. For example, when it is determined that the head-mounted display device 200 is too high, the control device 213 can control the nose pad 100 to retract toward the housing 211 , and reduce the amount of expansion and contraction of the nose pad 100 relative to the housing 211 , thereby reducing the height of the head-mounted display device 200 .
  • the control device 213 can control the nose
  • the support 100 protrudes away from the housing 211, and the expansion and contraction amount of the nose pad 100 relative to the housing 211 is increased, thereby raising the height of the head-mounted display device 200, so that the head-mounted display device 200 is raised relative to the bridge of the user's nose, so as to make the included angle.
  • ⁇ is adjusted back to the preset angle range.
  • the control device 213 is also connected in communication with the nose pad 100 .
  • the control device 213 includes a processing circuit 2131 and a driving circuit 2132 .
  • the processing circuit 2131 can realize the above-mentioned work of calculating the user's sight direction A1, calculating the included angle ⁇ , and determining whether the included angle ⁇ exceeds the preset angle range. Meanwhile, the processing circuit 2131 can also be used to calculate the deformation amount of the nose pad 100 that needs to be adjusted when it is determined that the included angle ⁇ exceeds the preset angle range.
  • the processing circuit 2131 can control the driving circuit 2132 to control the nose pad 100 based on the deformation amount, so that the nose pad 100 is deformed according to the calculated deformation amount, and finally adjusts the included angle ⁇ back to the preset angle range .
  • the head-mounted display device 200 is further configured to detect a start instruction. That is, the application scenario of the control method of the present application may be when the user starts to activate the head-mounted display device 200 or during the process of using the head-mounted display device 200 by the user. Therefore, the present control method also needs to be implemented and carried out after the start instruction is detected.
  • the control method of the present application can be implemented at any time during the whole process of using the head-mounted display device 200 through the continuous monitoring of the user's eyes by the eye-tracking device 214 , thereby ensuring that the user can continue to obtain information in the process of using the head-mounted display device 200 better observation effect.
  • the control method of the head-mounted display device 200 of the present application has higher precision, can be used for a longer period of time, and does not cause too much damage to the user's observation during the adjustment process. big impact.
  • the head-mounted display device 200 of the present application can also ensure that the user can continuously obtain a better observation effect during use due to the above-mentioned solution settings.
  • the nose pad 100 includes a motor 110 and an adjustment member 120 .
  • the motor 110 is drivingly connected with the adjusting member 120 , and the motor 110 is fixed in the housing 211 .
  • the housing 211 is provided with a notch 2111 corresponding to the adjusting member 120 , and the motor 110 can drive the adjusting member 120 to expand and contract relative to the housing 211 and protrude from the housing 211 from the gap 2111 .
  • the adjustment member 120 may directly or indirectly contact and form support with the bridge of the user's nose.
  • the motor 110 can realize the deformation of the nose pad 100 relative to the housing 211 by driving the protruding amount of the adjusting member 120 relative to the housing 211 .
  • step S30 of the control method of the present application if the included angle ⁇ exceeds the preset angle range, adjust the shape of the nose pad 100 of the head-mounted display device 200 to drive the head-mounted display device 200 to move relative to the user's nose bridge, and the head The head-up direction A0 of the wearable display device 200 is close to the line-of-sight direction A1.”
  • the included angle ⁇ exceeds the preset angle range, adjust the shape of the nose pad 100 of the head-mounted display device 200 to drive the head-mounted display device 200 to move relative to the user's nose bridge, and the head The head-up direction A0 of the wearable display device 200 is close to the line-of-sight direction A1.”
  • the adjusting member 120 needs to be movably connected relative to the housing 211 , so that when the motor 110 drives the adjusting member 120 to move, the telescopic amount of the adjusting member 120 relative to the housing 211 can be controlled.
  • the movable connection of the adjusting member 120 relative to the housing 211 may be a sliding connection and/or a rotational connection.
  • the head-mounted display device 200 of the present application does not limit the specific connection manner of the adjustment member 120 relative to the housing 211.
  • the adjusting member 120 and the housing 211 are fixed in a rotational connection manner.
  • the housing 211 is further provided with a positioning hole 2112
  • the nose pad 100 is further provided with a rotating shaft 130 .
  • the inner diameter of the positioning hole 2112 matches the outer diameter of the rotating shaft 130 to fix the rotating shaft 130 in the housing 211 .
  • the adjusting member 120 includes opposite first ends 121 and second ends 122 along its length direction. The first end 121 is in driving connection with the motor 110 , and the second end 122 is provided with a through hole 124 .
  • the inner diameter of the through hole 123 is substantially equal to the inner diameter of the positioning hole 2112 , that is, the inner diameter of the through hole 123 and the outer diameter of the rotating shaft 130 also match each other.
  • the rotating shaft 130 also passes through the through hole 123 to realize the rotational connection between the adjusting member 120 and the housing 211 .
  • the output shaft 111 of the motor 110 is provided with a bevel gear 112 , and the transmission portion 123 of the adjusting member 120 is configured as a tooth arc structure matching the shape of the bevel gear 112 .
  • the bevel gear 112 rotates synchronously with the output shaft 111 .
  • the adjusting member 120 can be driven to rotate around the rotating shaft 130 .
  • the adjusting member 120 is further provided with an arc surface 125 , the arc surface 125 is connected between the first end 121 and the second end 122 , and is disposed toward the side away from the housing 211 .
  • the curved surface 125 can be used for fitting contact with the bridge of the user's nose, that is, the nose pad 100 is in fitting contact with the bridge of the user's nose through the curved surface 125 of the adjusting member 120 , so as to support the head-mounted display device 200 .
  • the motor 110 receives an instruction from the control device 213 , drives the bevel gear 112 to rotate through the output shaft 111 , and drives the adjusting member 120 to rotate relative to the housing 211 .
  • the adjusting member 120 extends into or retracts into the housing 211 from the notch 2111 , and at this time, the distance of the arc surface 125 of the adjusting member 120 relative to the housing 211 also changes accordingly.
  • the housing 211 can be displaced relative to the bridge of the nose that fits with the arc surface 125 , so as to adjust to the height of the head-mounted display device 200 relative to the user's eyes.
  • adjusting the shape of the nose pad 100 of the head-mounted display device 200 further includes:
  • the nose pad 100 is deformed by the rotation of the adjusting member 120 relative to the housing 211 .
  • part of the displacement ie the component of the direction of the head mounted display device 200 relative to the nose bridge
  • the adjustment distance for the displacement of the head-mounted display device 200 is compared with that of the adjusting member 120 using a sliding connection.
  • the adjustment distance that can be achieved when connected to the housing 211 is smaller.
  • the slidingly connected adjusting member 120 can realize a larger displacement of the housing 211, and also The displacement adjustment range of the nose pad 100 to the head-mounted display device 200 can be expanded. Both connection methods can achieve better adjustment effect.
  • the transmission mode between the motor 110 and the adjusting member 120 is not limited to the matching mode between the bevel gear 112 and the tooth arc, and other transmission modes such as worm gear transmission, cam transmission, link mechanism, etc., may be applied to the present invention.
  • the nose pad 100 of the head-mounted display device 200 of the application is used to realize the power transmission between the motor 110 and the adjusting member 120, and does not affect the function realization of the head-mounted display device 200 or the control method of the present application.
  • the number of the adjusting members 120 is two, and the two adjusting members 120 are symmetrically arranged to provide two opposite arc surfaces 125 . It can be understood that the two adjusting members 120 in the embodiment of Fig. 8 can be arranged on both sides of the bridge of the user's nose, and achieve a better fit and support effect with the bridge of the user's nose through the respective arc surfaces 125.
  • the motor 110 is located between the two adjusting members 120 .
  • the motor 110 extends an output shaft 111 toward opposite sides, and each output shaft 111 is provided with a bevel gear 112 .
  • the bevel gears 112 on both sides of the motor 110 in the row are respectively matched with the transmission part 123 of a regulating member 120 to realize the power output of the motor 110 .
  • controlling the motor 110 to rotate around the first rotation direction may include controlling the two output shafts 111 of the motor 110 to rotate around the first rotation direction synchronously; and, controlling the motor 110 to rotate around the second rotation direction may include controlling The two output shafts 111 of the motor 110 rotate around the second rotational direction synchronously.
  • the motor 110 synchronously drives the two output shafts 111 to rotate, and makes the two bevel gears 112 drive the two adjusting members 120 to rotate relative to the housing 211, respectively, so that the two oppositely disposed adjusting members 120 can be synchronized relative to each other.
  • the housing 211 is extended or retracted.
  • the head-mounted display device 200 is simultaneously supported by the two adjusting members 120, so that the displacement of the head-mounted display device 200 relative to the bridge of the user's nose is more stable, and the displacement process will not affect the user. Observation experience has too much influence.
  • the position between the adjusting member 120 and the motor 110 may be set as the initial position of the adjusting member 120 . That is, the bevel gear 112 of the motor 110 is located at the middle of the transmission part 123 of the adjusting member 120 . Therefore, the motor 110 can drive the bevel gear 112 to rotate in two opposite directions, and the rotational strokes L1 and L2 of the bevel gear 112 can tend to be the same (as shown in FIG. 11 ).
  • the deformation amount of the nose pad 100 in the two directions tends to be the same, which can make the head-mounted display device 200 move upward relative to the user's nose bridge or The distance of the downward displacement is also the same.
  • the bevel gear 112 of the motor 110 may also be located at a lower position of the transmission portion 123 of the adjusting member 120 , so that the motor 110 drives the bevel gear 112 to rotate downward, and the displacement distance L2 ′ of the adjusting member 120 moving downward is greater than that driven by the motor 110
  • the bevel gear 112 rotates upward, and causes the adjustment member 120 to move upward by the displacement distance L1' (see FIG. 13).
  • the displacement amount that the motor 110 can drive the adjustment member 120 to move downward can make the adjustment member 120 raise the displacement amount of the head-mounted display device 200 It is larger, which meets the usage requirements of the user when wearing the head-mounted display device 200 for a long time.
  • FIG. 14 illustrates the structure of another embodiment of the nose pad 100 in the head-mounted display device 200 of the present application.
  • the number of the motors 110 is also two (shown as the first motor 110a and the second motor 110b in FIG. 14 ), and each of the two motors 110 is associated with an adjusting member 120 (shown as the first motor 110a in FIG. 14 )
  • the adjusting member 120a and the second adjusting member 120b) are drive-connected to individually control the telescopic state of the adjusting member 120 on one side relative to the housing 211 .
  • the two motors 110 are arranged side by side, and the output shafts 111 protrude in the same direction opposite to each other.
  • Each output shaft 111 is provided with a bevel gear 112, and each bevel gear 112 is used for connecting with an adjusting member 120.
  • the transmission part 123 is matched.
  • the driving circuits 2132 of the control device 213 are electrically connected to the two motors 110 respectively, and are used to drive the motors 110 to work respectively. That is, the driving circuit 2132 can drive one motor 110 to work alone, so that the adjusting member 120 on one side extends or retracts relative to the housing 211 (as shown in FIG. 15 ); the driving circuit 2132 can also drive two motors 110 at the same time Work synchronously, so that the adjusting members 120 on both sides extend or retract relative to the housing 211 at the same time (as shown in FIG.
  • the driving circuit 2132 can also drive the two motors 110 to work respectively, so that the The two adjusting members 120 are respectively extended or retracted relative to the housing 211 , and the expansion and contraction amounts of the two adjusting members 120 are different (as shown in FIG. 17 ). Therefore, in step S30 of the control method of the present application, if the included angle ⁇ exceeds the preset angle range, adjust the shape of the nose pad 100 of the head-mounted display device 200 to drive the head-mounted display device 200 to move relative to the user's nose bridge, and the head The head-up direction A0 of the wearing display device is close to the line-of-sight direction A1.", it can also be:
  • the adjustment members 120 on both sides are controlled to move independently, which can correspond to a scene where the user wears the head-mounted display device 200 of the present application at different heights. That is, when the user uses the head-mounted display device 200 of the present application, he cannot guarantee that the posture of wearing the head-mounted display device 200 is correct every time, and it is inevitable that the head-mounted display device 200 is inconsistent with respect to the user's nose bridge, and the wearing posture is inclined. The phenomenon. At this time, through the monitoring of the eye tracking device 214 and the coordinates of the eye tracking device 214 itself, it can be determined that the head mounted display device 200 is tilted.
  • one side of the head-mounted display device 200 can be raised or lowered to ensure that the head-mounted display device 200 is in a relatively flush state from left to right. It can also improve the user's observation effect.
  • the two motors 110 also drive the adjusting member 120 on one side to extend relative to the housing 211 , and the adjusting member 120 on the other side retract relative to the housing 211 .
  • the deformable amount of the nose pad 100 is larger, and the displacement of the head-mounted display device 200 that can be realized by the nose pad 100 is also increased accordingly, that is, the two adjustment
  • the displacement stroke of the head-mounted display device 200 relative to the bridge of the user's nose also increases accordingly, and a wider range of attitude adjustment of the head-mounted display device 200 can be realized.
  • the first line of sight direction B1 and the second line of sight direction B2 may correspond to the line of sight direction A1 in the above embodiment
  • the first line of sight direction B1 corresponds to the line of sight direction of the left eye in the user's eyes
  • the second line of sight direction B2 It corresponds to the line of sight direction of the right eyeball in the user's eyes.
  • the head-up direction B0 for the two eyeballs is the same, and the head-up direction B0 preset here may also correspond to the above-mentioned head-up direction A0.
  • the first included angle ⁇ 1 of the first line of sight direction B1 relative to the head-up direction B0 and the second included angle ⁇ 2 of the second line of sight direction B2 relative to the head-up direction B0 can be obtained respectively. It can be understood that the first included angle ⁇ 1 and the second included angle ⁇ 2 here can also correspond to the aforementioned included angle ⁇ .
  • the eye-tracking device 214 may alternately perform eye-tracking on both eyes of the user, and then respectively determine the first included angle ⁇ 1 and the second included angle ⁇ 2.
  • the eye tracking device 214 may further include two sets of photosensitive units 2141 and infrared units 2142, each of which is used to monitor the direction of sight of one eyeball, that is, an eye tracking system 214 can perform eye-tracking identification on the eyeballs on both sides at the same time, and then determine the first included angle ⁇ 1 and the second included angle ⁇ 2.
  • the respective recognition of the gaze directions of the user's eyes may correspond to the above-mentioned scenario in which the head-mounted display device 200 is wearing offset.
  • the display device 212 also has a left-right inconsistency phenomenon with the head-mounted display device 200, and the user's eyes actually have a difference in the direction of sight, that is, the values of the first angle ⁇ 1 and the second angle ⁇ 2 are different.
  • the control method of the present application can control the adjustment member 120 on the side beyond the preset angle range to extend
  • the shape of the nose pad 100 on the side can be adjusted according to the size of the head mounted display device 200, and then the housing 211 on the side can be raised or lowered so that the included angle of the side is within a preset angle range.
  • the control device 213 may include a first driving circuit 2132a and a second driving circuit 2132b, wherein the first driving circuit 2132a is electrically connected to the first motor 110a (ie, the motor 110 on the side of the first included angle ⁇ 1), and is used to control the first motor 110a.
  • the motor 110a controls the motion of the first adjusting member 120a (ie, the adjusting member 120 on the side of the first included angle ⁇ 1).
  • the second driving circuit 2132b is electrically connected to the second motor 110b (ie the motor 110 on the side of the second included angle ⁇ 2), and is used to control the second motor 110b to the second adjusting member 120b (ie, the side of the second included angle ⁇ 2). Motion control of the adjusting member 120).
  • adjusting the shape of the nose pad 100 of the head-mounted display device 200 further includes:
  • the expansion and contraction amount of the first adjusting member 120 a and the second adjusting member 120 b relative to the housing 211 is adjusted respectively to change the shape of the nose pad 100 .
  • the present control method can determine that the head-mounted display device 200 is present relative to the user's eyes for the inclined posture.
  • the first motor 110a can be controlled to rotate, and the first adjusting member 120a can be extended out of the casing 211 more, thereby raising the casing 211 on the side of the first included angle ⁇ 1, so that the first included angle ⁇ 1 becomes smaller, and within the preset angle range.
  • the second included angle ⁇ 2 may still be within the preset angle range, and the included angles of the user's eyes may both be within the preset angle range, which ensures the user's observation effect.
  • the second included angle ⁇ 2 when the first included angle ⁇ 1 becomes smaller, the second included angle ⁇ 2 also changes accordingly, which may cause the second included angle ⁇ 2 to exceed the preset angle range.
  • the second included angle ⁇ 2 after the completion of controlling the rotation of the first motor 110a, the second included angle ⁇ 2 also needs to be detected (or referred to as a review).
  • the second motor 110b is activated to rotate, and the second adjusting member 120a is adjusted so that the second included angle ⁇ 2 is again within the preset angle range.
  • the embodiment of the present application monitors the user's eyes separately, and adjusts the two adjustment members 120 respectively, which can also solve the above-mentioned problem that the head-mounted display device 200 is in an inclined posture.
  • the eye sight directions (the first sight direction B1 and the second sight direction B2) of the eyes are inconsistent due to the inconsistency of the heights of the left and right nose bridges of the user.
  • the observation effect of the user's eyeball is not good.
  • the user's observation effect can also be improved.
  • step S30c if the first included angle ⁇ 1 and/or the second included angle ⁇ 2 exceeds a preset angle range, control the expansion and contraction amount of at least one adjusting member 120 relative to the housing 11 to change the nose
  • the shape of the support 100 drives the head-mounted display device 200 to move relative to the bridge of the user's nose, so that the head-mounted display device 200's head-up direction B0 approaches the first line of sight direction B1 and the second line of sight direction B2"
  • the amount of expansion and contraction of the first adjusting member 120a relative to the housing 211 is controlled to change the angle of the nose pad 100 shape;
  • the expansion and contraction amount of the second adjusting member 120 b relative to the housing 211 is controlled to change the shape of the nose pad 100 .
  • the first adjusting member 120a corresponds to a scene where both the first included angle ⁇ 1 and the second included angle ⁇ 2 exceed the preset angle range.
  • the first included angle ⁇ 1 on one side of the first adjusting member 120a is larger than the second included angle ⁇ 2, only the first adjusting member 120a can be adjusted individually to change the shape of the nose pad 100 and improve the user's observation effect.
  • the adjustment operation of the second adjusting member 120b may be omitted, which may make the second included angle ⁇ 2
  • the first adjusting member 120a is also located within the preset angle range with the movement of the first adjusting member 120a, which simplifies the control logic of the method.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

本申请涉及一种头戴显示设备控制方法，先利用眼动追踪技术识别用户的视线方向；然后获得该视线方向与头戴显示设备的平视方向之间的夹角；判断夹角是否超出预设的角度范围，并在夹角超出预设的角度范围时，调整头戴显示设备的鼻托形状，以带动头戴显示设备相对于用户的鼻梁移动，使得头戴显示设备的平视方向靠近用户的视线方向。本申请方法利用眼动追踪技术识别用户的视线方向，进而通过调整鼻托的形状，调整头戴显示设备相对于用户头部的姿态，使得头戴显示设备的平视方向朝向用户的视线方向靠近，从而提高了用户的观测效果。本申请还涉及一种头戴显示设备。

Description

头戴显示设备及其控制方法
本申请要求于2021年4月12日提交中国专利局、申请号为202110390772.0、申请名称为“头戴显示设备及其控制方法”的中国国家申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及智能穿戴领域，尤其涉及一种头戴显示设备，以及一种该头戴显示设备的控制方法。
背景技术
随着虚拟现实技术(Virtual Reality，VR)和增强现实技术(Augmented Reality，AR)的发展，头戴显示设备也逐渐得到普及。头戴显示设备通常固持于用户的头部，并通过架设于用户鼻梁处来实现与用户眼部的准确定位，进而保证用户的观测效果。
但不同用户的鼻梁高度、大小均存在差异，且随着用户使用时间的推移，难以保证头戴显示设备始终保持与用户眼部的相对位置，容易造成用户观测效果不佳的缺陷。
发明内容
本申请的目的在于提供一种头戴显示设备及其控制方法，用以保证不同用户使用时获得相对较佳的观测效果。本申请包括如下技术方案：
第一方面，本申请涉及一种头戴显示设备控制方法，包括如下步骤：
利用眼动追踪技术识别用户的视线方向；
获得所述视线方向与所述头戴显示设备的平视方向之间的夹角；
若所述夹角超出预设的角度范围，则调整所述头戴显示设备的鼻托形状，以使所述头戴显示设备相对于用户的鼻梁移动，所述头戴显示设备的平视方向靠近所述视线方向。
本申请头戴显示设备控制方法先通过眼动追踪技术识别用户的视线方向，然后可以基于视线方向计算出其与头戴显示设备的平视方向之间的夹角。当用户的视线方向与预设的平视方向趋于一致时，也即当用户的视线方向与头戴显示设备的平视方向之间的夹角位于预设的角度范围之内时，可以保证到用户的观测效果。而当判断到用户的视线方向与头戴显示设备的平视方向之间夹角超出预设角度范围时，可以判断到头戴显示设备的佩戴姿态偏高或偏低，可能影响到用户的观测体验。由此，本申请控制方法还通过调整头戴显示设备鼻托的形状，来带动头戴显示设备相对于用户的鼻梁移动，使得头戴显示设备的平视方向靠近用户的视线方向，进而保证用户的观测效果。
本申请头戴显示设备控制方法可以保证不同脸型的用户均获得相对一致的观测体验，并且通过在用户持续使用头戴显示设备的过程中周期性的识别用户视线方向，还可以持续对头戴显示设备进行调节，以保证用户的长期使用体验。
在一种可能的实现方式中，调整头戴显示设备的鼻托形状，以使头戴显示设备相对于用户的鼻梁移动后，用户视线方向与头戴显示设备的平视方向之间的夹角处于角度范围内。
在本实现方式中，使得用户的视线方向与头戴显示设备的平视方向之间的夹角位于角度范围之内，可以将用户的视线方向调整为与预设的平视方向趋于一致，达到更好的观测效果。
在一种可能的实现方式中，在利用眼动追踪技术识别用户的视线方向之前，头戴显示设备还用于检测到启动指令。
在本实现方式中，头戴显示设备控制方法应用于其启动使用或使用过程中，因此本控制方法也需要在检测到启动指令之后，才得以实施可开展。
在一种可能的实现方式中，头戴显示设备包括壳体，鼻托包括调节件，调节件能够相对于壳体向外伸缩，调整头戴显示设备的鼻托形状，包括：
控制调节件相对于壳体的伸缩量以改变鼻托的形状。
在本实现方式中，通过在鼻托中设置调节件，并使得该调节件可以相对于头戴显示设备的壳体向外伸缩，以改变鼻托的形状，进而改变鼻托与用户鼻梁的相对高度。由此头戴显示设备的壳体与用户眼部的相对高度也得以调整，可以使得头戴显示设备的显示装置相对于用户鼻梁上下移动，将头戴显示设备的平视方向朝向用户的视线方向调整。
在一种可能的实现方式中，调节件的数量为两个，两个调节件分别贴合于用户鼻梁的两侧，控制调节件相对于壳体的伸缩量以改变鼻托的形状，还包括：
控制至少一个调节件相对于壳体的伸缩量以改变鼻托的形状。
在本实现方式中，通过调节件对鼻托形状的调整，可以采用两个调节件同时伸缩的方式实现，也可以采用单个调节件伸缩的方式实现。对于头戴显示设备倾斜佩戴的场景，或用户鼻梁两侧不对称的场景，仅通过调整一侧调节件的伸缩量，也可以达到提升用户观测效果的功能。
在一种可能的实现方式中，利用眼动追踪技术识别用户的视线方向，还包括：
利用眼动追踪技术分别识别用户左眼球的视线方向和右眼球的视线方向；然后，获得所述视线方向与头戴显示设备的平视方向之间的夹角，还包括：
分别获得左眼球的视线方向和右眼球的视线方向与头戴显示设备的平视方向之间的夹角。
在本实现方式中，通过分别检测用户两个眼球各自的视线方向，可以感知到用户出现了上述头戴显示设备倾斜佩戴的场景，或用户鼻梁两侧不对称的场景，进而可以针对性的分别控制两个调节件的伸缩量，达到通过改变鼻托形状提升用户观测效果的功能。
在一种可能的实现方式中，调节件包括靠近用户左眼球的第一调节件，和靠近用户右眼球的第二调节件，若左眼球的视线方向与右眼球的视线方向不同，则调整头戴显示设备的鼻托形状，还包括：
分别调整第一调节件和第二调节件相对于壳体的伸缩量以改变鼻托的形状。
在本实现方式中，对应到用户两个眼球的视线方向不同，对两个调节件的调整量也区别设置，可以更好的将头戴显示设备调整至其相应的姿态，保证用户双眼的观测效果。
在一种可能的实现方式中，调整头戴显示设备的鼻托形状，还包括：
当左眼球的视线方向与头戴显示设备的平视方向之间的夹角，大于右眼球的视线方向与头戴显示设备的平视方向之间的夹角时，控制第一调节件相对于壳体的伸缩量以改变鼻托的形状；或
当左眼球的视线方向与头戴显示设备的平视方向之间的夹角，小于右眼球的视线方向与头戴显示设备的平视方向之间的夹角时，控制第二调节件相对于壳体的伸缩量以改变鼻托的形状。
在本实现方式中，当第一调节件一侧的夹角相对较大时，可以仅对第一调节件单独进行调整，以改变鼻托的形状并提升用户观测效果。因为第一调节件的调整过程中，第二调节件一侧的夹角也会相应被调整，因此可能省去对第二调节件的调整操作，简化本方法的控制逻辑。反之，当第二调节件一侧的夹角相对较大时，也可能仅调整第二调节件的伸缩量，即达到两个夹角均得到调整的效果。
在一种可能的实现方式中，鼻托还包括电机，调节件的一端与壳体转动连接，调节件的另一端与电机传动连接，调节件还包括连接于相对两端之间的弧面，弧面用于与用户的鼻梁贴合，调整头戴显示设备的鼻托形状，还包括：
控制电机绕第一旋向转动，以使得调节件相对于壳体伸出，弧面朝向远离壳体的方向转动以改变鼻托形状；或控制电机绕第二旋向转动，以使得调节件相对于壳体收回，弧面朝向壳体的方向转动以改变鼻托形状，其中第二旋向与第一旋向互为反向。
在本实现方式中，提供了一种鼻托的具体结构。通过电机的转动调整调节件的伸缩量，进而使得调节件与用户鼻梁配合的弧面能够相对于壳体伸缩，达到调整鼻托形状的效果。
在一种可能的实现方式中，电机位于两个调节件之间，电机分别朝向两个调节件设有输出轴，并分别与两个调节件传动连接，控制电机绕第一旋向转动，包括：
控制电机的两个输出轴同步绕第一旋向转动；以及控制电机绕第二旋向转动，包括：
控制电机的两个输出轴同步绕第二旋向转动。
在本实现方式中，将电机设置于两个调节件之间，并设置电机分别朝向两个调节件伸出有输出轴，可以通过一个电机的转动，同步控制两个调节件的伸缩量调整。
第二方面，本申请还涉及一种头戴显示设备，包括：
眼动追踪装置，用于利用眼动追踪技术识别用户的视线方向；
鼻托，用于与用户鼻梁接触并支撑头戴显示设备，鼻托能够自动变形；
控制装置，用于获得视线方向与头戴显示设备的平视方向之间的夹角，并在夹角超出预设的角度范围时，调整鼻托的形状，以使头戴显示设备相对于用户的鼻梁移动，头戴显示设备的平视方向靠近视线方向。
与本申请第一方面提供的控制方法类似，本申请头戴显示设备可以利用眼动追踪装置识别用户视线方向；然后利用控制装置计算视线方向与头戴显示设备的平视方向之间的夹角，并在夹角超出预设的角度范围时，调整鼻托的形状，并带动头戴显示设备相对于用户的鼻梁移动，使得头戴显示设备的平视方向靠近视线方向。本申请头戴显示设备也可以将用户的视线方向调整为与其平视方向趋于一致，进而保证用户的观测效果。
在一种可能的实现方式中，头戴显示设备包括壳体，鼻托包括调节件和电机，调节件与壳体可伸缩的连接，电机与调节件传动连接，电机用于调整调节件相对于壳体的伸缩量以改变鼻托的形状。
在本实现方式中，控制装置可以通过驱动鼻托中的电机来带动调节件运动，进而实现调节件相对于壳体向外伸缩，实现改变鼻托形状的效果。
在一种可能的实现方式中，调节件与壳体之间滑动连接和/或转动连接。
在本实现方式中，当调节件与壳体滑动连接时，调节件可以相对于壳体滑动伸缩以调整鼻托的形状；当调节件与壳体转动连接时，调节件可以相对与壳体转动伸缩以调整鼻托的形状。两种方式都可以实现调整鼻托形状的效果。可以理解的，调节件还可以同时与壳体滑动和转动连接，并同时采用两种方式调整鼻托形状。
在一种可能的实现方式中，调节件的数量为两个，两个调节件分别贴合于用户鼻梁的两 侧，电机位于两个调节件之间。
在本实现方式中，将电机设置于两个调节件之间，可以通过电机同时驱动两个调节件，以同时实现两个调节件相对于壳体的伸缩动作，简化了鼻托的结构，并降低头戴显示设备的制作成本。
在一种可能的实现方式中，调节件包括相对的第一端和第二端，第一端与电机传动连接，第二端与壳体转动连接，电机驱动调节件相对于壳体转动以改变鼻托的形状。
在本实现方式中，提供了一种调节件在头戴显示设备中的机构实现方式。当调节件相对于壳体转动时，可以控制到调节件的位移量相对较小，利于电机的精度控制，实现更准确的调整效果。
在一种可能的实现方式中，电机的数量为两个，每个电机分别与一个调节件传动连接。
在本实现方式中，利用两个电机分别调整两个调节件的伸缩动作，可以实现对单个调节件的伸缩量调整操作，进而在上述头戴显示设备倾斜佩戴的场景，或用户鼻梁两侧不对称的场景下，针对性的分别控制两个调节件的伸缩量，以提升用户的观测效果。
在一种可能的实现方式中，眼动追踪装置包括感光单元和红外单元，红外单元用于向用户眼部发出红外光，感光单元基于采集到的红外光在眼部的位置追踪用户视线方向。
在本实现方式中，利用红外单元和感光单元的配合，可以对用户眼部视线进行探测，然后通过眼动追踪技术识别到用户的视线方向。
附图说明
图1是本申请提供的头戴显示设备的应用场景示意图；
图2是本申请提供的头戴显示设备内部组件框架示意图；
图3是本申请提供的头戴显示设备中壳体与鼻托的结构示意图；
图4a、图4b和图4c分别为本申请提供的头戴显示设备不同应用场景中的示意图；
图5是本申请提供的头戴显示设备控制方法的流程图；
图6是本申请提供的头戴显示设备的控制逻辑示意图；
图7是本申请提供的头戴显示设备中鼻托的分解结构示意图；
图8是本申请提供的头戴显示设备一种实施例的局部结构示意图；
图9是本申请提供的头戴显示设备中鼻托的调节件结构示意图；
图10是本申请提供的头戴显示设备中鼻托的电机结构示意图；
图11是本申请提供的头戴显示设备中鼻托一种配合状态的示意图；
图12是本申请提供的头戴显示设备中鼻托另一种配合状态的示意图；
图13是本申请提供的头戴显示设备中鼻托一种工作状态的示意图；
图14是本申请提供的头戴显示设备中另一种鼻托实施例的结构示意图；
图15是本申请提供的头戴显示设备中另一种鼻托工作状态的示意图；
图16是本申请提供的头戴显示设备中另一种鼻托工作状态的示意图；
图17是本申请提供的头戴显示设备中另一种鼻托工作状态的示意图；
图18是本申请提供的头戴显示设备另一种应用场景中的示意图；
图19是本申请提供的头戴显示设备另一种控制逻辑的示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述，显然，所描述的实施例仅仅是本申请的一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其它实施例，都属于本申请保护的范围。
图1示意了本申请涉及的头戴显示设备200的应用场景。头戴显示设备200包括显示部210和固定部220。固定部220用于将显示部210固持于用户头部，并使得显示部210位于用户双眼位置，实现显示效果。在图1的示意中，固定部220采用了绑带的形式。而在另一些实施例中，固定部220还可以采用类似眼镜镜脚的形式，或采用头盔的形式将显示部210固持于用户头部。其中当固定部220采用头盔形式时，固定部220和显示部210还可以采用一体成型的结构。
图2示意了本申请涉及的头戴显示设备200中显示部210的内部组件。显示部210中可以包括壳体211、显示装置212、控制装置213、眼动追踪装置214以及鼻托100。壳体211用于提供显示部210的外形结构，其余组件均收容于壳体211的内部，并受壳体211的保护。显示装置212用于为用户提供显示画面。控制装置213与显示装置212电连接，用于控制显示装置212所显示的画面。眼动追踪系统214也与控制装置213电连接，用于利用眼动追踪技术识别用户的视线方向。在一些实施例中，控制装置213可以包括与显示装置212电连接的部分，以及包括与眼动追踪系统214电连接的部分，两部分相互独立布置于壳体211内部。在另一些实施例中，控制装置213也可以为一个整体，本申请对控制装置213的具体实现方式不做特别限定。
图3示意了壳体211的部分结构与鼻托100的配合示意。在图3的示意中，鼻托100位于壳体211的中部偏下位置，用于与用户的鼻梁配合，也即头戴显示设备200可以通过鼻托100架设于用户鼻梁上。因为鼻梁与双眼的位置相对较近，且鼻梁与双眼的位置相对固定，因此通过鼻托100与鼻梁的配合，便于控制到头戴显示设备200与用户眼部之间的相对位置。鼻托100至少部分与壳体211活动连接，并可以伸出壳体211之外，也即鼻托100在伸出壳体211之外的部分为可变形结构。可以理解的，因为鼻托100与用户鼻梁贴合，在鼻托100的形状改变时，其能够改变壳体211相对于用户鼻梁的姿态，进而可以调整到本申请头戴显示设备200与用户眼部的相对位置，实现调整用户观测角度的效果。
请分别参见图4a、图4b以及图4c所示的本申请头戴显示设备200的应用场景示意。头戴显示设备200中预设有平视方向A0，该平视方向A0对应头戴显示设备200的显示装置212设置。当用户的眼部与该平视方向A0齐平视，用户接收到的显示装置212的显示效果较好。在图4a的示意中，还标注了用户眼部的视线方向A1，且因为图4a中显示装置212与用户的眼部齐平，则用户的视线方向A1与头戴显示设备200中预设的平视方向A0相互重合。而在图4b和图4c的示意中，头戴显示设备200的显示装置212分别位于用户眼部的上方和下方，此时用户的视线方向A1依然朝向显示装置212发出，但因为显示装置212的位置偏移，使得观测显示装置212较好的平视方向A0也随显示装置212发生偏转。在图4b和图4c的示意中，用户视线方向A1与预设的平视方向A0之间形成了夹角α1和夹角α2。可以理解的，在图4a的示意中，用户视线方向A1与预设的平视方向A0之间可以视为夹角为0的情况。在图4a的场景下，用户使用本申请头戴显示设备200的观测效果最佳。
造成图4b和图4c的情况很多，譬如前述中提到的不同用户脸型不同造成的鼻梁高度不同，在统一的鼻托100的形状下，可能形成用户眼部与显示装置212之间的相对位置差异。或者，在出现用户佩戴不当，头戴显示设备200相对于用户头部偏移的场景下，也可能形成 图4b或图4c的现象。可以理解的，当图4b和图4c中的夹角α1或夹角α2过大时，可能造成用户观测体检较差的现象。
图5示意了本申请涉及头戴显示设备200的一种控制方法流程图。本申请头戴显示设备控制方法具体包括如下步骤：
S10、利用眼动追踪技术识别用户视线方向A1；
S20、获得视线方向A1与头戴显示设备200的平视方向A0之间的夹角α；
S30、若夹角α超出预设的角度范围，则调整头戴显示设备200的鼻托100的形状，带动头戴显示设备200相对于用户的鼻梁移动，头戴显示设备200的平视方向A0靠近视线方向A1。
具体的，眼动追踪装置214设置于壳体211上，并朝向用户眼部设置，用于对用户的眼部进行追踪。请同步参见图6所示本申请头戴显示设备200对可变形的鼻托100的控制逻辑示意。在图6的示意中，控制装置213与眼动追踪装置214电性连接，控制装置213接眼动追踪装置214检测到的信号，可以实时解算出用户当前的视线方向A1。然后，基于眼动追踪装置214相对于显示装置212的位置，还可以解算出(即获得)用户视线方向A1与头戴显示设备200的平视方向A0之间的夹角α。可以理解的，对于用户当前视线方向A1的解算，和/或夹角α的解算，也可以在眼动追踪装置214上完成，或由眼动追踪装置214与控制装置213协同完成。
眼动追踪技术是通过定位瞳孔位置，获取坐标以测量被试者眼睛注视点的技术。该技术属于一种“非入侵式”检测技术。在图6的示意中，眼动追踪装置214包括有感光单元2141和红外单元2142。红外单元2142可以朝向用户眼部发出红外光(通常为近红外光)，感光单元2141则记录交互过程，并基于采集到的经眼部反射的红外光在眼部的位置，通过分析推断出用户的视线方向A1。其中，感光单元2141可以采用摄像头等器件实现。
本控制方法在确定到夹角α的数值之后，可以将夹角α与头戴显示设备200中预设的角度范围进行比较，以判断当前用户的视线方向A1对于平视方向A0是否偏移出预设的范围。可以理解的，本申请预设的角度范围，是基于头戴显示设备200所预设的平视方向A0设置的。即以平视方向A0为基准，在相对于平视方向A0向上或向下偏移一定的角度范围之内，都可以保证用户接受到较好的观测体验。而当用户视线A1向上或向下超出该角度范围时，用户的视线方向A1与显示装置212之间的角度相对倾斜量较大，用户的观测体验也随之下降。对于本申请头戴显示设备200或本申请控制方法而言，预设的角度范围可以适当调整，例如预设角度范围定义在±5°，或预设角度范围定义在±10°等，具体可以基于显示装置212的特性来设定。
另一方面，预设角度范围也可以采用非对称的方式设定。例如当头戴显示设备200相对于用户的眼部偏高时，可以定义预设角度范围的上限在+10°左右；而当头戴显示设备200相对于用户的眼部偏低时，可以定义预设角度范围的下限在－5°左右。因为，当头戴显示设备200相对于用户的眼部偏低时，头戴显示设备200的重量会相对集中于用户的鼻梁位置，造成较大的压力，影响用户的佩戴舒适性。因此，对于角度范围的上限数值和下限数值区别设置，在提升用户观测效果的同时，还能保证用户的佩戴舒适性。
由此，本控制方法在确定到夹角α的数值超出预设的角度范围之后，可以判断到用户当前的观测效果不如预期。控制装置213可以基于监测得到的夹角α的数值和方向，控制可变形的鼻托100相对于壳体211变形，即控制装置213调整鼻托100伸出壳体211的尺寸，进而调整到头戴显示设备200相对于用户鼻梁的姿态，或描述为调整头戴显示设备200相对于 用户的鼻梁产生位移，使得夹角α变小，也即使得头戴显示设备200的平视方向A0靠近视线方向A1。在一些视线方式中，还可以控制头戴显示设备200的平视方向A0在调整后位于预设的角度范围之内，也即使得夹角α位于角度范围之内。在一些进一步的实施例中，还可以将用户的视线方向A1调整至与预设的平视方向A0齐平的状态，以保证用户获得较好的观测效果。
可以理解的，当确定到夹角α的方向时，控制装置213可以基于该方向对应调整鼻托100的变形方向。如，当确定到头戴显示设备200偏高时，控制装置213可以控制鼻托100朝向壳体211回缩，调小鼻托100相对于壳体211的伸缩量，进而降低头戴显示设备200的高度，使得头戴显示设备200相对于用户鼻梁下移，来将夹角α调回至预设的角度范围之内；而当确定到头戴显示被200偏低时，控制装置213可以控制鼻托100背离壳体211伸出，调大鼻托100相对于壳体211的伸缩量，进而升高头戴显示设备200的高度，使得头戴显示设备200相对于用户鼻梁上升，以将夹角α调回至预设的角度范围之内。
在图6的示意中，控制装置213还与鼻托100通信连接。控制装置213中包括处理电路2131和驱动电路2132。其中处理电路2131可以实现上述的解算用户视线方向A1、解算夹角α、以及判断夹角α是否超出预设角度范围等工作。同时，处理电路2131还可以用于在判断到夹角α超出预设角度范围时，计算鼻托100需要进行调整的变形量。然后，处理电路2131可以基于该变形量控制驱动电路2132对鼻托100进行控制，以使得鼻托100按照解算得到的变形量产生形变，并最终将夹角α调整回预设角度范围之内。
可以理解的，在一种实现方式中，在利用眼动追踪技术识别用户的视线方向A1之前，头戴显示设备200还用于检测到启动指令。也即，本申请控制方法的应用场景，可以为用户开始启用头戴显示设备200时，也可以为用户使用头戴显示设备200的过程中。因此本控制方法也需要在检测到启动指令之后，才得以实施可开展。本申请控制方法通过眼动追踪装置214对用户眼部的持续监测，可以在用户使用头戴显示设备200的全过程中任意时刻实施，进而保证用户在使用头戴显示设备200的过程中持续获得较佳的观测效果。相较于现有技术中多采用手动调节头戴显示设备的方案，本申请头戴显示设备200的控制方法精度更高，可作用的时段更长，调节过程中也不会对用户观测造成太大影响。本申请头戴显示设备200也因为上述的方案设置，可以保证用户在使用过程中持续获得较佳的观测效果。请参见图7所示的本申请头戴显示设备200中鼻托100的分解示意图。在一种实施例中，鼻托100包括电机110和调节件120。电机110与调节件120传动连接，且电机110固定于壳体211内。壳体211对应调节件120设有缺口2111，电机110可以驱动调节件120相对于壳体211伸缩，并从缺口2111处伸出壳体211。调节件120可以直接或间接与用户的鼻梁接触并形成支撑。电机110通过驱动调节件120相对于壳体211的伸出量，以实现鼻托100相对于壳体211的变形。
由此，本申请控制方法中步骤S30“若夹角α超出预设的角度范围，则调整头戴显示设备200的鼻托100的形状，带动头戴显示设备200相对于用户的鼻梁移动，头戴显示设备200的平视方向A0靠近视线方向A1。”可以为：
S30a、若夹角α超出预设的角度范围，则控制调节件120相对于壳体211的伸缩量以改变鼻托的形状，调整头戴显示设备200的鼻托100的形状，带动头戴显示设备200相对于用户的鼻梁移动，头戴显示设备200的平视方向A0靠近视线方向A1。
具体的，在本实施例中，调节件120需要相对于壳体211活动连接，以使得电机110在驱动调节件120运动时，调节件120相对于壳体211的伸缩量得以控制。调节件120相对于壳体211的活动连接可以为滑动连接和/或转动连接的方式。本申请头戴显示设备200并不限 制调节件120相对于壳体211的具体连接方式。
请结合图8，在图7和图8的示意中，调节件120与壳体211采用转动连接的方式固定。具体的，壳体211上还开设有定位孔2112，鼻托100还设有转轴130。定位孔2112的内径与转轴130的外径相匹配，以将转轴130固定于壳体211中。如图9所示，调节件120沿自身长度方向包括相对的第一端121和第二端122。其中第一端121与电机110传动连接，第二端122则开设有通孔124。通孔123的内径与定位孔2112的内径大致相等，也即通孔123的内径与转轴130的外径也相互匹配。转轴130还同时穿过通孔123中，实现调节件120与壳体211之间的转动连接。
而在第一端121一侧，则设有与电机110配合传动的传动部123。请同步参见图10。电机110的输出轴111上设有锥齿轮112，调节件120的传动部123则构造为与锥齿轮112形状匹配的齿弧结构。电机110的输出轴转动时，锥齿轮112随输出轴111同步转动。通过锥齿轮112与传动部123的齿弧结构啮合，可以带动调节件120绕转轴130转动。进一步的，调节件120还设有弧面125，该弧面125连接于第一端121与第二端122之间，并朝向背离壳体211的一侧设置。弧面125可用于与用户的鼻梁贴合接触，也即鼻托100通过调节件120的弧面125与用户鼻梁的贴合接触，以实现对头戴显示设备200的支撑。
由此，在本申请头戴显示设备200中鼻托100变形时，电机110接到控制装置213发出的指令，通过输出轴111带动锥齿轮112转动，并带动调节件120相对于壳体211转动。调节件120从缺口2111处伸入或收回壳体211，此时调节件120的弧面125相对于壳体211的距离也相应变化。壳体211得以相对于弧面125贴合的鼻梁实现位移，进而调整到头戴显示设备200相对于用户眼部的高度。
也即，对应到本申请控制方法，调整头戴显示设备200的鼻托100形状，还包括：
控制电机110绕第一旋向转动，以使得调节件120相对于壳体211伸出，弧面125朝向远离壳体211的方向转动以改变鼻托100形状；或控制电机110绕第二旋向转动，以使得调节件120相对于壳体211收回，弧面125朝向壳体211的方向转动以改变鼻托100的形状，其中第二旋向与第二旋向互为反向。
在本实施例中，鼻托100通过调节件120相对于壳体211的转动动作实现变形。电机110对调节件120的转动驱动，其部分位移量(即头戴显示设备200相对于鼻梁方向的分量)被转化为头戴显示设备200相对于鼻梁的位移动作。也即当调节件120采用转动连接的方式与壳体211连接时，在电机110行程相同的情况下，其对头戴显示设备200位移的调整距离，相较于调节件120采用滑动连接的方式与壳体211连接时可以实现的调整距离更小。这样的连接方式有助于控制电机110的位移调整精度，同时也降低了对驱动电路2132的控制精度需求，有利于降低本申请头戴显示设备200的成本。
可以理解的，在调节件120与壳体211之间采用滑动连接的实施例中，在电机110行程相同的情况下，滑动连接的调节件120可以实现的壳体211的位移量更大，也能扩展鼻托100对头戴显示设备200的位移调整范围。两种连接方式都可以实现较好的调整效果。另一方面，对于电机110与调节件120之间的传动方式，也不仅限于锥齿轮112与齿弧的配合方式，其它传动方式如蜗轮传动、凸轮传动、连杆机构等，都可能应用于本申请头戴显示设备200的鼻托100中，用于实现电机110与调节件120之间的动力传递，也不影响本申请头戴显示设备200或控制方法的功能实现。
请看回图8。在图8的示意中，调节件120的数量为两个，两个调节件120对称设置，可以提供两个相对的弧面125。可以理解的，图8实施例中两个调节件120可以分列用户鼻梁 的两侧，并通过各自的弧面125与用户鼻梁实现较好的贴合和支撑效果。电机110则位于两个调节件120之间，电机110朝向相对两侧分别伸出一输出轴111，且每个输出轴111上均设有一个锥齿轮112。分列电机110两侧的锥齿轮112各自与一个调节件120的传动部123配合，实现电机110的动力输出。
对应到上述控制方法，控制电机110绕第一旋向转动，可以包括控制电机110的两个输出轴111同步绕第一旋向转动；以及，控制电机110绕第二旋向转动，可以包括控制电机110的两个输出轴111同步绕第二旋向转动。
可以理解的，电机110同步带动两个输出轴111转动，并使得两个锥齿轮112不同带动两个调节件120分别相对于壳体211转动，可以使得相对设置的两个调节件120同步相对于壳体211伸出或收回。头戴显示设备200在鼻托100变形的过程中，同时受到两个调节件120的支撑作用，进而使得头戴显示设备200相对于用户鼻梁的位移更平稳，且位移过程中不会对用户的观测体验形成太大影响。
另一方面，在图8的示意中，调节件120与电机110之间的位置，可以设置为调节件120的初始位置。也即，电机110的锥齿轮112位于调节件120的传动部123的中部处。由此，电机110可以驱动锥齿轮112沿相反的两个方向转动，其可以转动的行程L1和L2可以趋于一致(如图11所示)。也即，当电机110的锥齿轮112位于调节件120的传动部123的中部位置时，鼻托100朝向两个方向的变形量趋于一致，可以使得头戴显示设备200相对于用户鼻梁向上或向下位移的距离也一致。
而在另一些实施例中，请参见图12。电机110的锥齿轮112还可以位于调节件120的传动部123靠下的位置，以使得电机110驱动锥齿轮112向下转动，并使得调节件120下移的位移距离L2’，大于电机110驱动锥齿轮112向上转动，并使得调节件120上移的位移距离L1’(参见图13)。因为头戴显示设备200在使用过程中通常会相对于用户的眼部下滑，因此放大电机110能够驱动调节件120下移的位移量，可以使得调节件120抬高头戴显示设备200的位移量更大，满足用户长时间佩戴头戴显示设备200时的使用需求。
图14示意了本申请头戴显示设备200中鼻托100另一种实施例的结构。在本实施例中，电机110的数量也为两个(图14中示意为第一电机110a和第二电机110b)，且两个电机110各自与一个调节件120(图14中示意为第一调节件120a和第二调节件120b)传动连接，以单独控制一侧调节件120相对于壳体211的伸缩状态。具体的，两个电机110并排设置，并且沿同一方向相背的伸出有输出轴111，每个输出轴111上设有一个锥齿轮112，且每个锥齿轮112用于与一个调节件120的传动部123配合。
控制装置213的驱动电路2132则分别与两个电机110电性连接，并用于分别驱动电机110的工作。也即，驱动电路2132可以单独驱动一个电机110工作，以使得单侧的调节件120相对于壳体211伸出或收回(如图15所示)；驱动电路2132还可以同时驱动两个电机110同步工作，以使得两侧的调节件120同时相对于壳体211伸出或收回(如图16所示)；在一些场景下，驱动电路2132还可以分别驱动两个电机110各自工作，以使得两个调节件120各自相对于壳体211伸出或收回，且两个调节件120的伸缩量不相同(如图17所示)。由此，本申请控制方法中步骤S30“若夹角α超出预设的角度范围，则调整头戴显示设备200的鼻托100的形状，带动头戴显示设备200相对于用户的鼻梁移动，头戴显示设备的平视方向A0靠近视线方向A1。”，还可以为：
S30b、若夹角α超出预设的角度范围，则控制至少一个调节件120相对于壳体211的伸缩量以改变鼻托100的形状，带动头戴显示设备200相对于用户的鼻梁移动，头戴显示设备 200的平视方向A0靠近视线方向A1。
对于本实施例而言，控制两侧的调节件120各自独立运动，可以对应到用户佩戴本申请头戴显示设备200左右高低不一致的场景。也即，用户在使用本申请头戴显示设备200时，其并不能保证每次佩戴头戴显示设备200的姿态均正确，难免出现头戴显示设备200相对于用户鼻梁左右高低不一致、佩戴姿态倾斜的现象。此时通过眼动追踪装置214的监测，结合眼动追踪装置214的自身坐标，可以判断到头戴显示设备200存在倾斜的现象。此时通过单独调整一侧的调节件120相对于壳体211的伸出量，可以将头戴显示设备200的单边升高或降低，保证头戴显示设备200处于左右相对平齐的状态，也能提升用户的观测效果。
其中在图17所示的场景中，两个电机110还分别驱动一侧的调节件120相对于壳体211伸出，另一侧的调节件120则相对于壳体211收回。这样的调整方式相对于两个调节件120同步伸缩的方式，鼻托100的可变形量更大，鼻托100能够实现的头戴显示设备200的位移量也相应增大，也即两个调节件120单独受控时，头戴显示设备200相对于用户鼻梁的位移行程也相应增大，可以实现头戴显示设备200更大范围的姿态调整。
请参见本申请头戴显示设备控制方法另一种实施例，具体包括如下步骤：
S10c、利用眼动追踪技术分别识别用户两个眼球的第一视线方向B1(左眼球的视线方向)和第二视线方向B2(右眼球的实现方向)；
S20c、分别获得两个视线方向与预设的平视方向B0之间的第一夹角β1和第二夹角β2；
S30c、若第一夹角β1和/或第二夹角β2超出预设的角度范围，则控制至少一个调节件120相对于壳体11的伸缩量以改变鼻托100的形状，带动头戴显示设备200相对于用户的鼻梁移动，使得头戴显示设备200的平视方向B0朝向第一视线方向B1和第二视线方向B2靠近。
具体的，请同步参见图18的示意。在本实施例中，第一视线方向B1和第二视线方向B2可以对应到上述实施例中的视线方向A1，第一视线方向B1对应到用户双眼中左眼球的视线方向，第二视线方向B2则对应到用户双眼中右眼球的视线方向。而对于显示装置212而言，其对于两个眼球的平视方向B0是一致的，此处预设的平视方向B0也可以对应到上述的平视方向A0。通过眼动追踪装置214的监测，可以分别获得第一视线方向B1相对于平视方向B0的第一夹角β1，以及第二视线方向B2相对于平视方向B0的第二夹角β2。可以理解的，此处的第一夹角β1和第二夹角β2也可以对应到上述的夹角α。
眼动追踪装置214可以交替的对用户双眼进行眼动追踪，进而分别确定到第一夹角β1和第二夹角β2。在一些实施例中，眼动追踪装置214还可以包括两组感光单元2141和红外单元2142，每一组感光单元2141和红外单元2142用于监测一侧眼球的视线方向，也即眼动追踪系统214可以同时分别对两侧眼球进行眼动追踪识别，进确定到第一夹角β1和第二夹角β2。对用户双眼视线方向的分别识别，可以对应到上述头戴显示设备200佩戴偏移的场景。此时，以为显示装置212也随头戴显示设备200出现左右高低不一致的现象，用户的双眼之间实际存在视线方向的差异，也即第一夹角β1和第二夹角β2的数值不同。
然后，当判断到第一夹角β1和第二夹角β2中任一夹角超出预设的角度范围时，本申请控制方法可以通过控制该超出预设角度范围一侧的调节件120伸出头戴显示设备200的尺寸，来对该侧的鼻托100的形状进行调节，进而可以将该侧的壳体211升高或降低，使得该侧的夹角位于预设角度范围之内。
示例性的，请参见图19的示意。控制装置213可以包括第一驱动电路2132a和第二驱动电路2132b，其中第一驱动电路2132a与第一电机110a(即第一夹角β1一侧的电机110)电性连接，并用于控制第一电机110a对第一调节件120a(即第一夹角β1一侧的调节件120) 的运动控制。第二驱动电路2132b则与第二电机110b(即第二夹角β2一侧的电机110)电性连接，并用于控制第二电机110b对第二调节件120b(即第二夹角β2一侧的调节件120)的运动控制。
也即，对应到本申请控制方法，若用户左眼球的第一视线方向B1与右眼球的第二视线方向B2不同，则调整头戴显示设备200的鼻托100的形状，还包括：
分别调整第一调节件120a和第二调节件120b相对于壳体211的伸缩量以改变鼻托100的形状。例如，当判断到第一夹角β1低于预设角度范围，而第二夹角β2位于预设角度范围之内时，通过本控制方法可以判断到头戴显示设备200相对于用户眼部呈现为倾斜的姿态。此时，可以控制第一电机110a转动，将第一调节件120a更多的伸出壳体211，进而抬高第一夹角β1一侧的壳体211，使得第一夹角β1变小，并位于预设的角度范围之内。此时，第二夹角β2依然可能位于预设角度范围之内，则用户双眼的夹角均可以位于预设角度范围之内，保证了用户的观测效果。
需要提出的是，当第一夹角β1变小时，第二夹角β2也会随之变化，此时可能造成第二夹角β2超出预设的角度范围。在此场景中，在控制第一电机110a转动完成之后，还需要对第二夹角β2进行检测(或称为复核)。并在第二夹角β2超出预设角度范围时，启动第二电机110b转动，调节第二调节件120a，使得第二夹角β2重新位于预设角度范围之内。如此反复，保证第一夹角β1和第二夹角β2均位于预设角度范围之内时，可以保证用户的观测效果。
本申请实施例对用户双眼的分别监测，并对两个调节件120分别进行调整，也可以解决上述头戴显示设备200呈倾斜姿态的问题。另一方面，对于用户而言，存在一定比例的用户鼻梁左右高度不一致的现象。也即当用户正确佩戴本申请头戴显示设备200时，也可能存在因用户左右鼻梁高度不一致，而造成的双眼视线方向(第一视线方向B1和第二视线方向B2)不一致的现象，进而可能导致用户一侧眼球的观测效果不佳。通过本控制方法的实施，同样可以提升用户的观测效果。
在一种实施例中，在步骤S30c“若第一夹角β1和/或第二夹角β2超出预设的角度范围，则控制至少一个调节件120相对于壳体11的伸缩量以改变鼻托100的形状，带动头戴显示设备200相对于用户的鼻梁移动，使得头戴显示设备200的平视方向B0朝向第一视线方向B1和第二视线方向B2靠近”，还可以包括：
S30d、若第一夹角β1和/或第二夹角β2超出预设的角度范围，当左眼球的第一视线方向B1与头戴显示设备200的平视方向B0之间的第一夹角β1，大于右眼球的第二视线方向B2与头戴显示设备200的平视方向B0之间的第二夹角β2时，控制第一调节件120a相对于壳体211的伸缩量以改变鼻托100的形状；或
当左眼球的第一视线方向B1与头戴显示设备200的平视方向B0之间的第一夹角β1，小于右眼球的第二视线方向B2与头戴显示设备200的平视方向B0之间的第二夹角β2时，控制第二调节件120b相对于壳体211的伸缩量以改变鼻托100的形状。
在本实施例中，对应到第一夹角β1和第二夹角β2均超出预设的角度范围的场景。当第一调节件120a一侧的第一夹角β1相对于第二夹角β2更大时，可以仅对第一调节件120a单独进行调整，以改变鼻托100的形状并提升用户观测效果。因为第一调节件120a的调整过程中，第二调节件120b一侧的第二夹角β2也会相应变化，因此可能省去对第二调节件120b的调整操作，可能使得第二夹角β2也随第一调节件120a的运动而位于预设角度范围之内，简化了本方法的控制逻辑。
反之，当第二夹角β2相对于第一夹角β1更大时，也可以仅对第二调节件120b单独进 行调整，可能使得第一夹角β1也随第二调节件120b的运动而位于预设角度范围之内，简化了本方法的控制逻辑。
可以理解的，本申请头戴显示设备控制方法中各实施例的展开，是基于本申请头戴显示设备200中各个实施例同步实现的。因此本申请头戴显示设备200可以实现的各种功能，均可以对应应用到本申请头戴显示设备200中得到实施。反之，本申请头戴显示设备控制方法可以实现的各种功能，也都可以应用于本申请头戴显示设备200中，二者互为补充。
以上描述，仅为本申请的具体实施例，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，例如减少或添加结构件，改变结构件的形状等，都应涵盖在本申请的保护范围之内；在不冲突的情况下，本申请的实施例及实施例中的特征可以相互组合。因此，本申请的保护范围应以权利要求的保护范围为准。

Claims (15)

  1. 一种头戴显示设备的控制方法，其特征在于，包括如下步骤：
    利用眼动追踪技术识别用户的视线方向；
    获得所述视线方向与所述头戴显示设备的平视方向之间的夹角；
    若所述夹角超出预设的角度范围，则调整所述头戴显示设备的鼻托形状，以使所述头戴显示设备相对于用户的鼻梁移动，所述头戴显示设备的平视方向靠近所述视线方向。
  2. 根据权利要求1所述的控制方法，其特征在于，所述调整所述头戴显示设备的鼻托形状，以使所述头戴显示设备相对于用户的鼻梁移动后，用户所述视线方向与所述头戴显示设备的平视方向之间的夹角处于所述角度范围内。
  3. 根据权利要求1或2所述的控制方法，其特征在于，所述头戴显示设备包括壳体，所述鼻托包括调节件，所述调节件能够相对于所述壳体向外伸缩，所述调整所述头戴显示设备的鼻托形状，包括：
    控制所述调节件相对于所述壳体的伸缩量以改变所述鼻托的形状。
  4. 根据权利要求3所述的控制方法，其特征在于，所述调节件的数量为两个，两个所述调节件用于分别贴合于用户鼻梁的两侧，所述控制所述调节件相对于所述壳体的伸缩量以改变所述鼻托的形状，包括：
    控制至少一个所述调节件相对于所述壳体的伸缩量以改变所述鼻托的形状。
  5. 根据权利要求4所述的控制方法，其特征在于，所述利用眼动追踪技术识别用户的视线方向，包括：
    利用眼动追踪技术分别识别用户左眼球的视线方向和右眼球的视线方向；然后，所述获得所述视线方向与所述头戴显示设备的平视方向之间的夹角，还包括：
    分别获得所述左眼球的视线方向和所述右眼球的视线方向与所述头戴显示设备的平视方向之间的夹角。
  6. 根据权利要求5所述的控制方法，其特征在于，所述调节件包括靠近用户左眼球的第一调节件，和靠近用户右眼球的第二调节件，若所述左眼球的视线方向与所述右眼球的视线方向不同，则所述调整所述头戴显示设备的鼻托形状，还包括：
    分别调整所述第一调节件和所述第二调节件相对于所述壳体的伸缩量以改变所述鼻托的形状。
  7. 根据权利要求5所述的控制方法，其特征在于，所述调整所述头戴显示设备的鼻托形状，还包括：
    当所述左眼球的视线方向与所述头戴显示设备的平视方向之间的夹角，大于所述右眼球的视线方向与所述头戴显示设备的平视方向之间的夹角时，控制所述第一调节件相对于所述壳体的伸缩量以改变所述鼻托的形状；或
    当所述左眼球的视线方向与所述头戴显示设备的平视方向之间的夹角，小于所述右眼球的视线方向与所述头戴显示设备的平视方向之间的夹角时，控制所述第二调节件相对于所述 壳体的伸缩量以改变所述鼻托的形状。
  8. 根据权利要求4-7任一项所述的控制方法，其特征在于，所述鼻托还包括电机，所述调节件的一端与所述壳体转动连接，所述调节件的另一端与所述电机传动连接，所述调节件还包括连接于相对两端之间的弧面，所述弧面用于与用户的鼻梁贴合，所述调整所述头戴显示设备的鼻托形状，还包括：
    控制所述电机绕第一旋向转动，以使得所述调节件相对于所述壳体伸出，所述弧面朝向远离所述壳体的方向转动以改变所述鼻托形状；或
    控制所述电机绕第二旋向转动，以使得所述调节件相对于所述壳体收回，所述弧面朝向所述壳体的方向转动以改变所述鼻托形状，其中所述第二旋向与所述第一旋向互为反向。
  9. 根据权利要求8所述的控制方法，其特征在于，所述电机位于两个所述调节件之间，所述电机分别朝向两个所述调节件设有输出轴，并分别与两个所述调节件传动连接，所述控制所述电机绕第一旋向转动，包括：
    所述控制所述电机的两个所述输出轴同步绕所述第一旋向转动；以及
    所述控制所述电机绕第二旋向转动，包括：
    所述控制所述电机的两个所述输出轴同步绕所述第二旋向转动。
  10. 一种头戴显示设备，其特征在于，包括：
    眼动追踪装置，用于利用眼动追踪技术识别用户的视线方向；
    鼻托，用于与用户鼻梁接触并支撑所述头戴显示设备，所述鼻托能够自动变形；
    控制装置，用于获得所述视线方向与所述头戴显示设备的平视方向之间的夹角，并在所述夹角超出预设的角度范围时，调整所述鼻托的形状，以使所述头戴显示设备相对于用户的鼻梁移动，所述头戴显示设备的平视方向靠近所述视线方向。
  11. 根据权利要求10所述的头戴显示设备，其特征在于，所述头戴显示设备包括壳体，所述鼻托包括调节件和电机，所述调节件与所述壳体可伸缩的连接，所述电机用于调整所述调节件相对于所述壳体的伸缩量以改变所述鼻托的形状。
  12. 根据权利要求11所述的头戴显示设备，其特征在于，所述调节件的数量为两个，两个所述调节件分别贴合于用户鼻梁的两侧，所述电机位于两个所述调节件之间。
  13. 根据权利要求12所述的头戴显示设备，其特征在于，所述调节件包括相对的第一端和第二端，所述第一端与所述电机传动连接，所述第二端与所述壳体转动连接，所述电机驱动所述调节件相对于所述壳体转动以改变所述鼻托的形状。
  14. 根据权利要求12或13所述的头戴显示设备，其特征在于，所述电机的数量为两个，每个所述电机分别与一个所述调节件传动连接。
  15. 根据权利要求10-14任一项所述的头戴显示设备，其特征在于，所述眼动追踪装置包括感光单元和红外单元，所述红外单元用于向用户眼部发出红外光，所述感光单元基于采集到的红外光在眼部的位置追踪用户视线方向。
PCT/CN2022/083829 2021-04-12 2022-03-29 头戴显示设备及其控制方法 WO2022218148A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110390772.0 2021-04-12
CN202110390772.0A CN115202043A (zh) 2021-04-12 2021-04-12 头戴显示设备及其控制方法

Publications (1)

Publication Number Publication Date
WO2022218148A1 true WO2022218148A1 (zh) 2022-10-20

Family

ID=83570335

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/083829 WO2022218148A1 (zh) 2021-04-12 2022-03-29 头戴显示设备及其控制方法

Country Status (2)

Country Link
CN (1) CN115202043A (zh)
WO (1) WO2022218148A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103439794A (zh) * 2013-09-11 2013-12-11 百度在线网络技术（北京）有限公司 头戴式设备的校准方法和头戴式设备
US9094677B1 (en) * 2013-07-25 2015-07-28 Google Inc. Head mounted display device with automated positioning
CN109271021A (zh) * 2018-08-28 2019-01-25 北京七鑫易维信息技术有限公司 头戴式设备的控制方法、装置、头戴式设备及存储介质
CN110082913A (zh) * 2018-01-26 2019-08-02 精工爱普生株式会社 虚像显示装置和虚像显示装置用的鼻托
CN112130328A (zh) * 2020-09-30 2020-12-25 萧县奥新农业科技有限公司 一种基于vr技术的实时双向调节装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106874895B (zh) * 2017-03-31 2019-02-05 北京七鑫易维信息技术有限公司 一种视线追踪装置及头戴式显示设备
CN207301523U (zh) * 2017-10-24 2018-05-01 深圳市型社眼镜有限公司 一种能够与鼻子自适应配合的眼镜
CN109491093B (zh) * 2019-01-11 2021-05-18 京东方科技集团股份有限公司 鼻托调节系统和虚拟现实设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9094677B1 (en) * 2013-07-25 2015-07-28 Google Inc. Head mounted display device with automated positioning
CN103439794A (zh) * 2013-09-11 2013-12-11 百度在线网络技术（北京）有限公司 头戴式设备的校准方法和头戴式设备
CN110082913A (zh) * 2018-01-26 2019-08-02 精工爱普生株式会社 虚像显示装置和虚像显示装置用的鼻托
CN109271021A (zh) * 2018-08-28 2019-01-25 北京七鑫易维信息技术有限公司 头戴式设备的控制方法、装置、头戴式设备及存储介质
CN112130328A (zh) * 2020-09-30 2020-12-25 萧县奥新农业科技有限公司 一种基于vr技术的实时双向调节装置

Also Published As

Publication number Publication date
CN115202043A (zh) 2022-10-18

Similar Documents

Publication Publication Date Title
US9025252B2 (en) Adjustment of a mixed reality display for inter-pupillary distance alignment
US9213163B2 (en) Aligning inter-pupillary distance in a near-eye display system
US9552060B2 (en) Radial selection by vestibulo-ocular reflex fixation
US8928558B2 (en) Gaze detection in a see-through, near-eye, mixed reality display
EP2095178B1 (en) Wearable high resolution audio visual interface
JP4742052B2 (ja) 眼鏡のセンタリングデータを検出するための装置および方法
CN206906702U (zh) 一种头戴显示器
CN103429139A (zh) 具有可调整视场的眼镜装置和方法
WO2015043274A1 (en) Imaging to facilitate object observation
CN106019589A (zh) 一种自动调整光学系统的近眼显示装置
CN111679436B (zh) 一种vr眼镜镜片角度调整结构
CN108828779B (zh) 一种头戴式显示设备
US11471049B2 (en) Ophthalmologic apparatus
CN109116565A (zh) 一种头戴式显示设备
TWI695997B (zh) 眼球追蹤架構設計
WO2022218148A1 (zh) 头戴显示设备及其控制方法
JP5907781B2 (ja) 頭部装着表示装置
JP4826988B1 (ja) 検眼メガネ
CN104615238A (zh) 一种信息处理方法及穿戴式电子设备
CN211669457U (zh) 一种可调瞳距的便携眼镜架
CN113093502A (zh) 一种穿戴跟踪型几何全息显示系统
CN112987312B (zh) 瞳距调节结构及电子设备
TWI693060B (zh) 自覺式瞳孔間距量測裝置
JP6638195B2 (ja) 表示装置、表示装置の制御方法、および、プログラム
CN209148959U (zh) 一种舒适性良好的vr眼镜结构

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22787377

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22787377

Country of ref document: EP

Kind code of ref document: A1