WO2019109318A1 - Head-mounted display device and adjustment control method therefor - Google Patents

Head-mounted display device and adjustment control method therefor Download PDF

Info

Publication number
WO2019109318A1
WO2019109318A1 PCT/CN2017/115093 CN2017115093W WO2019109318A1 WO 2019109318 A1 WO2019109318 A1 WO 2019109318A1 CN 2017115093 W CN2017115093 W CN 2017115093W WO 2019109318 A1 WO2019109318 A1 WO 2019109318A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
user
center
mounted display
head
Prior art date
Application number
PCT/CN2017/115093
Other languages
French (fr)
Chinese (zh)
Inventor
黄政
陈臻伟
赵越
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to CN201780097153.4A priority Critical patent/CN111417888B/en
Priority to PCT/CN2017/115093 priority patent/WO2019109318A1/en
Publication of WO2019109318A1 publication Critical patent/WO2019109318A1/en

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays

Definitions

  • the present invention relates to a display device, and more particularly to a head mounted display device and an adjustment control method of the head mounted display device.
  • Head-mounted display devices have gradually become popular because of their convenience and ability to achieve stereoscopic display and stereo sound.
  • VR virtual reality
  • head-mounted display devices have become more widely used as hardware support devices for VR technology.
  • the user wears the head-mounted display device if the user's eyeball rotates, it will inevitably cause the optical axis to deviate from the center of the eyeball pupil, that is, the user's line of sight is inconsistent with the optical axis of the optical lens, which may affect the imaging quality, thereby affecting the user experience.
  • an embodiment of the present invention discloses a head mounted display device and an adjustment control method thereof.
  • a head mounted display device includes a display device and a processor, the display device is configured to output a display screen and transmit the display screen to a user's eyes,
  • the head mounted display device further includes:
  • a driving device connected to the display device for driving the display device to move
  • a detecting device configured to collect eye image information of a user wearing the head mounted display device
  • the processor is connected to the display device, the driving device and the detecting device, and the processor is configured to control the movement of the driving device to adjust the display device according to at least the eye image information collected by the detecting device. position.
  • controlling the movement of the driving device to adjust the position of the display device according to the image information of the eye collected by the detecting device comprises: acquiring a feature position according to the image information of the eye collected by the detecting device, and determining When the feature position deviates from the preset position, the driving device is controlled to adjust the position of the display device, so that the optical axis of the display device passes through the pupil center of the eyeball.
  • the processor calculates an adjustment path of the display device according to the feature position, and the processor controls the driving device to drive the display device to move along the adjustment path.
  • the preset position is a central position of the eye, and when the user faces the front, the position of the pupil center is located at a center position of the eye, and when the user's eyeball rotates to other directions, the processor according to the eye image information Determining that the pupil center of the user's eye deviates from the predetermined position, the processor determines the distance and direction of the deviation, and then controls the drive to drive the display device to move the corresponding distance in the corresponding direction.
  • the preset position is that when the optical axis of the display device passes through the center of the pupil of the user, the center of the pupil in the eye image collected by the detecting device is located at the position of the eye image
  • the processor calculates a feature location according to the eye image information; the processor compares the feature location with the preset location, and if the feature location deviates from the preset location, the processor Determining that the optical axis of the display device is offset from the center of the pupil; if the feature position is the same as the preset position, the processor determines that the optical axis of the display device passes through the center of the pupil.
  • the head mounted display device further includes a housing and a guiding member fixedly mounted on the housing, and the display device is slidably disposed on the guiding member.
  • the guiding member has a circular arc structure, and when the user uses the head mounted display device, the center of the guiding member coincides with the center of the user's eyeball, and the optical axis of the detecting device is The optical axis of the display device is in a first plane, the guide is on a second plane, and the first plane and the second plane are perpendicular to each other.
  • the display device includes a display screen and an optical lens, and the display screen, the optical lens and the detecting device are all movably mounted on the guiding member, and the display screen is used for outputting a display screen.
  • the optical lens is located on an output path of a display screen of the display screen.
  • the display device further includes a base slidingly contacting the guiding member, and the display screen, the optical lens and the detecting device are fixed on the base.
  • a guiding groove is formed on the base, and the base is slidably contacted with the guiding member through the guiding groove.
  • the guide member forms a plurality of racks disposed along a circular arc profile thereof
  • the head mounted display device further includes a gear structure movably coupled to the base, the gear structure and the plurality of teeth Strip engagement.
  • An adjustment control method for a head mounted display device includes the following steps:
  • the drive device controlling the head mounted display device drives the display device to move to adjust the position of the display device when it is determined that the user's eyeball is rotated.
  • the step of determining, according to the at least the eye image information, whether the eyeball of the user is rotated comprises: acquiring a feature position according to at least the eye image information; and determining whether the feature position deviates from a preset position A determination is made as to whether the user's eyeball has rotated.
  • the step of controlling the driving device of the head mounted display device to drive the display device to adjust the position of the display device comprises:
  • the preset position is a central position of the eye, and when the user faces the front, the pupil center is located at a center position of the eye, that is, the preset position, and the characteristic position of the user's eye is determined according to the eye image information.
  • the preset position is deviated, it is determined that the optical axis of the display device is offset from the center of the pupil; if the feature position is the same as the preset position, determining that the optical axis of the display device passes through the center of the pupil.
  • the preset position is that when the optical axis of the display device passes through the center of the pupil of the user, the feature in the eye image collected by the detecting device is located at the position of the eye image. Calculating a feature position according to the eye image information, comparing the feature position and the preset position, and if the feature position deviates from the preset position, determining that an optical axis of the display device is offset from a center of the pupil And if the feature position is the same as the preset position, determining that the optical axis of the display device passes through the center of the pupil.
  • the step of controlling the driving device of the head mounted display device to drive the display device to adjust the position of the display device includes controlling the head a driving device of the wearable display device drives the display device on the head mounted display The guide of the device moves.
  • the head-mounted display device and the adjustment control method provided by the invention can automatically detect the user's eyeball steering, and can automatically adjust the position of the display device when the user's line of sight does not coincide with the optical axis of the display device, so that the display device
  • the optical axis passes through the center of the pupil such that the line of sight of the user coincides with the optical axis of the display device, thereby causing the portion of the eyeball to be re-imaged through the central portion of the optical lens, and the image quality is obtained. Guaranteed, improved user immersion, and improved user experience.
  • FIG. 1 is a perspective view of a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 2 is a block diagram showing the structure of a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 3 is a perspective view showing a partial structure of a head mounted display device according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a user using a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 5 is a flowchart of an adjustment control method of a head mounted display device according to an embodiment of the present invention.
  • an embodiment of the present invention provides a head mounted display device 100 .
  • the head mounted display device 100 can be a head mounted device such as a smart helmet or smart glasses.
  • the head mounted display device 100 includes a display device 20 , a detecting device 30 , a driving device 40 , and a processor 50 .
  • the display device 20 is configured to output a display screen and transmit the display screen to a user's eyes.
  • the detecting device 30 is configured to collect eye image information including a user's eyes.
  • the driving device 40 is configured to drive the display device 20 to move to adjust the position of the display device 20.
  • the processor 50 is connected to the detecting device 30, the display device 20, and the driving device 40.
  • the processor 50 is configured to control the movement of the driving device 40 according to at least the eye image information collected by the detecting device 30 to adjust the position of the display device 20.
  • the processor 50 can be a microcontroller, a microprocessor, a microcontroller, a digital signal processor, or the like.
  • the head mounted display device 100 includes a housing 10 on which the display device 20 is movably disposed.
  • the display device 20 includes a base 22, a display screen 24, and an optical lens 26.
  • the base 22 is movably coupled to the housing 10 for carrying the display screen 24 and the optical lens 26.
  • the driving device 40 is coupled to the base 22 for driving the base 22 to move.
  • the display screen 24 is fixed to the base 22 for outputting a display screen.
  • the display screen 24 is a flexible display screen, and the display screen 24 is arranged in a circular arc shape to maximize the display range.
  • the optical lens 26 is fixed on the base 22, and the optical lens 26 is located on an output path of the display screen of the display screen 24 for transmitting the display screen to the eyes of the user.
  • the optical lens 26 is located on the side of the display screen 24 close to the user's eyes, so that the display screen output by the display screen 24 passes through the optical lens 26 The eyes of the user.
  • the optical axis of the optical lens 26 coincides with the optical axis of the display screen 24, and the optical axis of the optical lens 26 is the optical axis of the display device 20.
  • the detecting device 30 is fixed on the base 22, as described above, for detecting eye information including the eyes of the user.
  • the detecting device 30 is an image capturing device for taking in image information of the user's eyes.
  • the camera device is an infrared camera device.
  • the processor 50 is configured to control the movement of the driving device 40 to adjust the position of the display device 20 according to at least the eye image information collected by the detecting device 30. Determining whether the eyeball of the user rotates according to the eye image information collected by the detecting device 30, and determining the eye of the user The movement of the drive unit 40 is controlled to adjust the position of the display unit 20 as the ball rotates.
  • the feature position information is acquired according to the eye image information collected by the detecting device 30, and when the feature position is determined to deviate from the preset position, the eyeball of the user is determined to rotate.
  • the center of the pupil is selected as the determined eye feature.
  • the feature position is a position in the eye image in the eye image collected by the detecting device 30, and the feature position is a pupil center position.
  • other features of the eyeball may be selected for judgment, such as a point on the red blood cell on the eyeball, and the like.
  • the processor 50 acquires a feature position according to the eye image information.
  • the processor 50 determines whether the optical axis of the display device 20 deviates from the user's pupil center based on at least the feature position. If the processor 50 determines that the user's eyeball is rotating, that is, the optical axis of the display device 20 is offset from the center of the pupil of the user.
  • the processor 50 controls the driving device 40 to drive the display device 20 to move according to at least the feature position.
  • the processor 50 performs the pupil image positioning, the morphological method processing, the edge information extraction, and the like on the eye image, and further calculates the feature position by using the image, and determines whether the feature position deviates from the Preset position.
  • the preset position is that when the optical axis of the display device 20 passes through the pupil center of the user, the feature in the eye image collected by the detecting device 30 is located at the position of the eye image. .
  • the feature position is that the feature in the eye image collected by the detecting device 30 is located at the position of the eye image.
  • the preset position is located at the center of the eye image. position.
  • the preset position is located at an intersection of a vertical line of the long side of the rectangle and a vertical line of the short side; when the eye image is a circle, the preset position Located on the center of the circle.
  • the head mounted display device 100 further includes a guide 60 .
  • the guiding member 60 is fixedly mounted on the housing 10 .
  • the base 22 is slidably coupled to the guide member 60.
  • the guide 60 is used to guide the movement of the display device 20.
  • a guiding groove 224 is formed on the base 22.
  • the base 22 is movably sleeved on the guiding member 60 through the guiding slot 224.
  • the driving device 40 is capable of driving the base 22 of the display device 20 to slide on the guide member 60 to adjust the position of the display device 20.
  • a guide rail is formed on the housing 10,
  • the base 22 is mounted on the rail.
  • the guide member 60 has an arc structure.
  • the optical axis of the detecting device 30 is located in a first plane with the optical axis of the display device 20, and the guiding member 60 is located on a second plane, the first plane and the second plane being perpendicular to each other.
  • the center of the guide member 60 coincides with the center of the eyeball of the user, and the second plane is at the same level as the center of the pupil of the user.
  • the user's eyeball rotates, The distance between the optical lens 26 of the display device 20 and the user's eyeball is kept constant, and the use of the optical axis of the display device 20 is maintained without being consistent with the user's line of sight.
  • the guide member 60 is formed with a plurality of racks 61 disposed along a circular arc profile thereof, and the head mounted display setting table 100 further includes a gear structure 80 movably coupled to the base 22, the gear structure 80 meshes with a plurality of the racks 61, so that the movement of the display device 20 on the guide member 60 is smooth and stable, and thus does not affect the viewing experience of the user.
  • the guiding member 60 may be provided with a guiding groove, and the base 22 may form a guide rail, and the guiding rail of the base 22 is slidably engaged with the guiding groove of the guiding member 60. It can be understood that the display device 20 can omit the pedestal 22, and the display screen 24, the optical lens 26 and the detecting device 30 are all movably mounted on the guiding member 60.
  • the detecting device 30 collects user eye image information and transmits the user eye image information to the processor 50, and the processor 50 according to the The user's eye image information is calculated and analyzed to obtain the feature position.
  • the processor 50 determines whether the optical axis of the display device 20 passes through the pupil center according to the feature position. If the processor 50 determines that the optical axis of the display device 20 deviates through the center of the pupil, the processor 50 controls the driving device 40 to drive the display device 20 to adjust the position to make the display The optical axis of device 20 re-enters the center of the pupil such that the user's line of sight coincides with the optical axis of display device 20.
  • the detecting device 30 continuously collects an image of the eye including the eye until the processor 50 determines that the feature position is the same as the preset position, the processor 50 controls the The display device 20 stops moving.
  • the portion of the eyeball that is gazing is again imaged through the central portion of the optical lens 26, the image quality is ensured, the immersion sensation of the user is improved, and the user experience is improved.
  • the display device 20 of the head mounted display device 100 is capable of being controlled by the processor 50 Automatically detecting the user's eyeball steering and automatically adjusting the position of the display device 20 such that the optical axis of the display device 20 re-passes through the center of the pupil, so that even in the case where the user's eyeball is rotated, the head
  • the wearable display device 100 can automatically adjust the position of the display device 20 to facilitate the use of the head mounted display device 100.
  • the optical axis of the detecting device 30 is in the same plane as the optical axis of the display device 20. If the optical axis of the display device 20 passes through the center of the pupil, in the eyeball image taken by the detecting device 30, the pupil center is located at the center of the eyeball image, in other words, if the processor According to the user's eye image information, it is calculated that the feature position is located at the center of the eyeball image, and the processor 50 determines that the optical axis of the display device passes through the pupil center; otherwise, the The processor 50 then determines that the optical axis of the display device 20 is offset from the center of the pupil.
  • the detecting device 30 collects image information of the user's eyes, and the processor 50 performs analysis according to the newly collected image information of the user's eyes until the processor 50 determines
  • the optical axis of the display device 20 passes through the center of the pupil, that is, the optical axis of the display device 20 is consistent with the line of sight of the user's eyeball, and the processor 50 controls the display device 20 to stop moving.
  • the detecting device 30 collects user's eye image information in real time, and the processor 50 acquires the feature position according to at least the user's eye image information. It can be understood that the detecting device 30 can collect user's eye image information from time to time or timing.
  • the processor 50 acquires a feature position according to at least the user's eye image information, and calculates an adjustment path of the display device 20, for example, if the feature position deviates in a first direction.
  • the first position of the central position of the eyeball image adjusts the display device 20 to move the first distance in the first direction;
  • the driving device 40 drives the display device 20 to move in response to the processor 50,
  • the display device 20 moves along the adjustment path to adjust the position, thereby passing the optical axis of the display device 20 through the center of the pupil.
  • the optical axis of the detecting device 30 and the optical axis of the display device 20 may not be in the same plane, and the plane of the optical axis of the detecting device 30 is not perpendicular to the first plane.
  • the processor 50 calculates a feature position according to the image information of the user's eye, and the feature position is a position of a feature in the eyeball image collected by the detecting device 30.
  • the processor 50 compares the feature location with the preset location, and if the feature location and the preset location are the same, the location The processor 50 determines that the optical axis of the display device 20 passes through the center of the pupil; if the feature position deviates from the preset position, the processor 50 determines that the optical axis of the display device 20 is offset from the pupil center, The processor 50 calculates a corresponding adjustment path according to the feature position and the preset position, and controls the display device 20 to move along the adjustment path.
  • the user's eyeball rotation may be determined according to other manners, such as the distance from the center of the pupil to one of the corners of the eye, and when the distance changes, it means that the user's eyeball rotates; Or the position of a feature on the eyeball changes, which also means that the user's eyeball rotates.
  • the preset position is a center position of the eye, and when the user faces the front, the center of the pupil is located at a center position of the eye, that is, the preset position, when the user's eyeball rotates to other directions.
  • the processor 50 acquires the feature position according to the eye image information, and when the feature position deviates from the preset position, Determining that the center of the pupil of the user's eye deviates from the preset position, the processor determines the distance and direction of the deviation, and then controls the driving device 40 to drive the display device 20 to move the corresponding distance in the corresponding direction while maintaining the display device
  • the optical axis of 20 passes through the center of the user's pupil such that the optical axis of the display device 20 coincides with the line of sight of the user's eye.
  • an adjustment control method in an embodiment of the present invention is applied to a head mounted display device, and the steps in the adjustment control method are not limited to the following execution sequence.
  • the adjustment control method includes the following steps:
  • Step 501 Collect, by the detecting device of the head mounted display device, eye image information of a user wearing the head mounted display device;
  • Step 502 determining, according to at least the eye image information, whether the eyeball of the user is rotated;
  • Step 503 when determining that the user's eyeball is rotated, controlling a driving device of the head mounted display device to drive the display device to adjust the position of the display device, thereby making the optical axis of the display device Pass through the center of the pupil of the user's eye.
  • the step 502 includes: acquiring a feature position according to at least the eye image information; and determining whether the eyeball of the user is rotated by determining whether the feature position deviates from a preset position.
  • the image of the user's eye is processed and analyzed by a processor of the head mounted display device And acquiring the feature position, comparing the feature position with the preset position, determining whether the feature position deviates from the preset position, and determining whether the eyeball of the user is rotated, and if yes, executing step 503 Otherwise, return to step 501.
  • the optical axis of the display device is offset from the center of the pupil of the user, in other words, the optical axis of the display device does not coincide with the line of sight of the user.
  • the preset position is that a feature in the eye image collected by the detecting device is located at a position of the eye image when the optical axis of the display device passes through the pupil center of the user.
  • the feature position is that a feature in the eye image collected by the detecting device is located at a position of the eye image.
  • the preset position is located at the center position of the eye image in the eye image collected by the detecting device.
  • the preset position is located at an intersection of a vertical line of the long side of the rectangle and a vertical line of the short side; when the eye image is a circle, the preset position Located on the center of the circle.
  • step 502 when it is determined by the processor that the feature position deviates from the preset position, it is determined that the user's eyeball is rotated, meaning that the optical axis of the display device is offset from the pupil center, and execution is performed. Step 503, otherwise, return to step 501.
  • the detecting device can collect image information of the user's eyes periodically or irregularly.
  • the driving device driving the display device on the headset
  • the guide of the display device moves in the corresponding direction.
  • the guide member has an arc structure.
  • the optical axis of the detecting device is located in a first plane with an optical axis of the display device, the guiding member is located on a second plane, and the first plane and the second plane are perpendicular to each other.
  • the center of the guide member coincides with the center of the eyeball of the user, and the first plane is at the same level as the center of the pupil of the user.
  • the driving device drives the display device to move the guide member of the head mounted display device, and the detecting device continuously collects an eye image including the eye until the processor Determining that the feature location is opposite the preset location At the same time, the processor controls the display device to stop moving.
  • the step 503 includes: calculating an adjustment path of the display device according to at least the feature position; and controlling the driving device to drive the display device to move along the adjustment path.
  • the preset position is a center position of the eye
  • the position of the pupil center is located at a center position of the eye, that is, the preset position, when the user's eyeball rotates to other
  • the processor determines, according to the eye image information, that the pupil center of the user's eye deviates from the preset position, and determines The distance and direction of the deviation are then controlled to drive the display device to move the corresponding distance in the respective direction while maintaining the optical axis of the display device through the center of the user's pupil.
  • the user's eyeball rotation may be determined according to other manners, such as the distance from the center of the pupil to one of the corners of the eye. When the distance changes, it means that the user's eyeball rotates; Or the position of a feature on the eyeball changes, which also means that the user's eyeball rotates.
  • the head-mounted display device and the adjustment control method provided by the invention can automatically detect whether the user's eyeball is rotated, and can automatically adjust the position of the display device when the user's line of sight does not coincide with the optical axis of the display device, so that the The optical axis of the display device passes through the center of the pupil such that the line of sight of the user coincides with the optical axis of the display device, thereby causing the portion of the eyeball to be re-imaged through the central portion of the optical lens for imaging
  • the quality is guaranteed, which enhances the user's immersion and improves the user experience.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

A head-mounted display device (100) and an adjustment control method therefor. The head-mounted display device (100) comprises a display apparatus (20), a processor (50), a driving apparatus (40) and a detection apparatus (30). The driving apparatus (40) is connected to the display apparatus (20). The detection apparatus (30) is used for collecting eye image information of a user who wears the head-mounted display device (100). The processor (50) is connected to the display apparatus (20), the driving apparatus (40) and the detection apparatus (30), and the processor (50) is used for controlling, at least according to the eye image information collected by the detection apparatus (30), the driving apparatus (40) so same moves to adjust the position of the display apparatus (20), so that an optical axis of the display apparatus (20) passes through a pupil center of an eyeball, thus making the line of sight of the user consistent with the optical axis of the display apparatus (20).

Description

头戴式显示设备及其调节控制方法Head mounted display device and adjustment control method thereof 技术领域Technical field
本发明涉及一种显示设备,尤其涉及一种头戴式显示设备及所述头戴式显示设备的调节控制方法。The present invention relates to a display device, and more particularly to a head mounted display device and an adjustment control method of the head mounted display device.
背景技术Background technique
头戴式显示设备由于便捷性,且能实现立体显示及立体声等效果,已经逐渐被人们所喜爱。近年来,随着虚拟现实(virtual reality,VR)技术的出现,头戴式显示设备作为VR技术的硬件支持设备,更加应用广泛。用户穿戴头戴式显示设备时,若用户眼球转动,则势必会引起光轴偏离眼球瞳孔中心,即用户视线与光学镜头的光轴不一致,如此会影响成像质量,进而影响用户的使用体验。Head-mounted display devices have gradually become popular because of their convenience and ability to achieve stereoscopic display and stereo sound. In recent years, with the advent of virtual reality (VR) technology, head-mounted display devices have become more widely used as hardware support devices for VR technology. When the user wears the head-mounted display device, if the user's eyeball rotates, it will inevitably cause the optical axis to deviate from the center of the eyeball pupil, that is, the user's line of sight is inconsistent with the optical axis of the optical lens, which may affect the imaging quality, thereby affecting the user experience.
发明内容Summary of the invention
为解决上述问题,本发明实施例公开一种头戴式显示设备及其调节控制方法。In order to solve the above problems, an embodiment of the present invention discloses a head mounted display device and an adjustment control method thereof.
一种头戴式显示设备,包括显示装置及处理器,所述显示装置用于输出显示画面及将所述显示画面传送至用户眼睛,A head mounted display device includes a display device and a processor, the display device is configured to output a display screen and transmit the display screen to a user's eyes,
所述头戴式显示设备还包括:The head mounted display device further includes:
驱动装置,与所述显示装置连接,用于驱动所述显示装置运动;a driving device connected to the display device for driving the display device to move;
侦测装置,用于采集穿戴所述头戴式显示设备的用户的眼部图像信息;a detecting device, configured to collect eye image information of a user wearing the head mounted display device;
其中,所述处理器与显示装置、驱动装置及侦测装置连接,所述处理器用于至少根据所述侦测装置采集到的眼部图像信息控制所述驱动装置运动以调节所述显示装置的位置。The processor is connected to the display device, the driving device and the detecting device, and the processor is configured to control the movement of the driving device to adjust the display device according to at least the eye image information collected by the detecting device. position.
进一步地,根据所述侦测装置采集到的眼部图像信息控制所述驱动装置运动以调节所述显示装置的位置包括:根据所述侦测装置采集到的眼部图像信息获取特征位置,确定所述特征位置偏离预设位置时,控制所述驱动装置运动以调节所述显示装置的位置,进而使所述显示装置的光轴穿过所述眼球的瞳孔中心。 Further, controlling the movement of the driving device to adjust the position of the display device according to the image information of the eye collected by the detecting device comprises: acquiring a feature position according to the image information of the eye collected by the detecting device, and determining When the feature position deviates from the preset position, the driving device is controlled to adjust the position of the display device, so that the optical axis of the display device passes through the pupil center of the eyeball.
进一步地,所述处理器至少依据所述特征位置,计算出所述显示装置的调节路径,所述处理器控制所述驱动装置驱动所述显示装置沿所述调节路径运动。Further, the processor calculates an adjustment path of the display device according to the feature position, and the processor controls the driving device to drive the display device to move along the adjustment path.
进一步地,所述预设位置为眼睛的中心位置,在用户正视前方时,瞳孔中心的位置位于所述眼睛的中心位置,当用户眼球转动到其他方向时,所述处理器根据眼部图像信息确定用户眼睛的瞳孔中心偏离了所述预设位置,所述处理器确定偏离的距离和方向,然后控制驱动装置驱动显示装置朝相应的方向运动相应的距离。Further, the preset position is a central position of the eye, and when the user faces the front, the position of the pupil center is located at a center position of the eye, and when the user's eyeball rotates to other directions, the processor according to the eye image information Determining that the pupil center of the user's eye deviates from the predetermined position, the processor determines the distance and direction of the deviation, and then controls the drive to drive the display device to move the corresponding distance in the corresponding direction.
进一步地,所述预设位置为,所述显示装置的光轴穿过所述用户的瞳孔中心时,所述侦测装置采集到的眼部图像中的瞳孔中心位于所述眼部图像的位置,所述处理器根据所述眼部图像信息计算得到特征位置;所述处理器比较所述特征位置及所述预设位置,若所述特征位置偏离所述预设位置,则所述处理器判断所述显示装置的光轴偏离所述瞳孔中心;若所述特征位置与所述预设位置相同,则所述处理器判断所述显示装置的光轴穿过瞳孔中心。Further, the preset position is that when the optical axis of the display device passes through the center of the pupil of the user, the center of the pupil in the eye image collected by the detecting device is located at the position of the eye image The processor calculates a feature location according to the eye image information; the processor compares the feature location with the preset location, and if the feature location deviates from the preset location, the processor Determining that the optical axis of the display device is offset from the center of the pupil; if the feature position is the same as the preset position, the processor determines that the optical axis of the display device passes through the center of the pupil.
进一步地,所述头戴式显示设备还包括壳体及固定装设于所述壳体上的导向件,所述显示装置能够滑动地设于所述导向件上。Further, the head mounted display device further includes a housing and a guiding member fixedly mounted on the housing, and the display device is slidably disposed on the guiding member.
进一步地,所述导向件为圆弧结构,用户使用所述头戴式显示设备时,所述导向件的球心与所述用户眼球的中心重合,所述侦测装置的光轴与所述显示装置的光轴位于第一平面,所述导向件位于第二平面上,所述第一平面与所述第二平面相互垂直。Further, the guiding member has a circular arc structure, and when the user uses the head mounted display device, the center of the guiding member coincides with the center of the user's eyeball, and the optical axis of the detecting device is The optical axis of the display device is in a first plane, the guide is on a second plane, and the first plane and the second plane are perpendicular to each other.
进一步地,所述显示装置包括显示屏及光学镜头,所述显示屏、所述光学镜头及所述侦测装置均活动装设于所述导向件上,所述显示屏用于输出显示画面,所述光学镜头位于所述显示屏的显示画面的输出路径上。Further, the display device includes a display screen and an optical lens, and the display screen, the optical lens and the detecting device are all movably mounted on the guiding member, and the display screen is used for outputting a display screen. The optical lens is located on an output path of a display screen of the display screen.
进一步地,所述显示装置还包括与所述导向件滑动相接的基座,所述显示屏、所述光学镜头及所述侦测装置固定于所述基座上。Further, the display device further includes a base slidingly contacting the guiding member, and the display screen, the optical lens and the detecting device are fixed on the base.
进一步地,所述基座上形成导向槽,所述基座通过所述导向槽与所述导向件滑动相接。Further, a guiding groove is formed on the base, and the base is slidably contacted with the guiding member through the guiding groove.
进一步地,所述导向件上形成沿其圆弧轮廓设置的若干齿条,所述头戴式显示设备还包括与所述基座活动连接的齿轮结构,所述齿轮结构与若干所述齿 条啮合。Further, the guide member forms a plurality of racks disposed along a circular arc profile thereof, and the head mounted display device further includes a gear structure movably coupled to the base, the gear structure and the plurality of teeth Strip engagement.
一种头戴式显示设备的调节控制方法,其包括以下步骤:An adjustment control method for a head mounted display device includes the following steps:
通过所述头戴式显示设备的侦测装置采集穿戴所述头戴式显示设备的用户的眼部图像信息;Collecting, by the detecting device of the head mounted display device, eye image information of a user wearing the head mounted display device;
至少根据所述眼部图像信息判断用户的眼球是否发生转动;Determining, according to at least the eye image information, whether the user's eyeball is rotated;
在确定所述用户的眼球发生转动时,控制所述头戴式显示设备的驱动装置驱动所述显示装置运动,以调节所述显示装置的位置。The drive device controlling the head mounted display device drives the display device to move to adjust the position of the display device when it is determined that the user's eyeball is rotated.
进一步地,所述至少根据所述眼部图像信息判断用户的眼球是否发生转动的步骤中包括:至少根据所述眼部图像信息获取特征位置;以及通过判断所述特征位置是否偏离预设位置来判断所述用户的眼球是否发生转动。Further, the step of determining, according to the at least the eye image information, whether the eyeball of the user is rotated comprises: acquiring a feature position according to at least the eye image information; and determining whether the feature position deviates from a preset position A determination is made as to whether the user's eyeball has rotated.
进一步地,所述在确定所述用户的眼球发生转动时,控制所述头戴式显示设备的驱动装置驱动所述显示装置运动,以调节所述显示装置的位置的步骤包括:Further, when determining that the user's eyeball is rotated, the step of controlling the driving device of the head mounted display device to drive the display device to adjust the position of the display device comprises:
至少根据所述特征位置计算出所述显示装置的调节路径;Calculating an adjustment path of the display device according to at least the feature position;
控制所述驱动装置驱动所述显示装置沿调节路径运动。Controlling the drive device to drive the display device to move along an adjustment path.
进一步地,所述预设位置为眼睛的中心位置,在用户正视前方时,瞳孔中心位于所述眼睛的中心位置,即所述预设位置,根据所述眼部图像信息确定用户眼睛的特征位置偏离所述预设位置时,则判断所述显示装置的光轴偏离所述瞳孔中心;若所述特征位置与所述预设位置相同,则判断所述显示装置的光轴穿过瞳孔中心。Further, the preset position is a central position of the eye, and when the user faces the front, the pupil center is located at a center position of the eye, that is, the preset position, and the characteristic position of the user's eye is determined according to the eye image information. When the preset position is deviated, it is determined that the optical axis of the display device is offset from the center of the pupil; if the feature position is the same as the preset position, determining that the optical axis of the display device passes through the center of the pupil.
进一步地,所述预设位置为,所述显示装置的光轴穿过所述用户的瞳孔中心时,所述侦测装置采集到的眼部图像中的特征位于所述眼部图像的位置,根据所述眼部图像信息计算得到特征位置,比较所述特征位置及所述预设位置,若所述特征位置偏离所述预设位置,则判断所述显示装置的光轴偏离所述瞳孔中心;若所述特征位置与所述预设位置相同,则判断所述显示装置的光轴穿过瞳孔中心。Further, the preset position is that when the optical axis of the display device passes through the center of the pupil of the user, the feature in the eye image collected by the detecting device is located at the position of the eye image. Calculating a feature position according to the eye image information, comparing the feature position and the preset position, and if the feature position deviates from the preset position, determining that an optical axis of the display device is offset from a center of the pupil And if the feature position is the same as the preset position, determining that the optical axis of the display device passes through the center of the pupil.
进一步地,所述在确定所述用户的眼球发生转动时,控制所述头戴式显示设备的驱动装置驱动所述显示装置运动,以调节所述显示装置的位置的步骤包括,控制所述头戴式显示设备的驱动装置驱动所述显示装置于所述头戴式显示 设备的导向件运动。Further, when determining that the user's eyeball is rotated, the step of controlling the driving device of the head mounted display device to drive the display device to adjust the position of the display device includes controlling the head a driving device of the wearable display device drives the display device on the head mounted display The guide of the device moves.
本发明提供的头戴式显示设备及调节控制方法,能够自动检测用户眼球转向,在用户视线与所述显示装置的光轴不一致时,能够自动调节所述显示装置的位置,使得所述显示装置的光轴穿过所述瞳孔中心,从而使所述用户视线与所述显示装置的光轴达到一致,进而使所述眼球注视的部分重新穿过所述光学镜头的中心部分成像,成像质量得到保证,提升了用户的浸入感,亦提高了用户的使用体验。The head-mounted display device and the adjustment control method provided by the invention can automatically detect the user's eyeball steering, and can automatically adjust the position of the display device when the user's line of sight does not coincide with the optical axis of the display device, so that the display device The optical axis passes through the center of the pupil such that the line of sight of the user coincides with the optical axis of the display device, thereby causing the portion of the eyeball to be re-imaged through the central portion of the optical lens, and the image quality is obtained. Guaranteed, improved user immersion, and improved user experience.
附图说明DRAWINGS
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings to be used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.
图1为本发明一实施例中的头戴式显示设备的立体示意图。1 is a perspective view of a head mounted display device in accordance with an embodiment of the present invention.
图2为本发明一实施例中的头戴式显示设备的结构框图。2 is a block diagram showing the structure of a head mounted display device in accordance with an embodiment of the present invention.
图3为本发明一实施例中的头戴式显示设备的部分结构立体示意图。FIG. 3 is a perspective view showing a partial structure of a head mounted display device according to an embodiment of the present invention.
图4为本发明一实施例中的用户使用头戴式显示设备的示意图。4 is a schematic diagram of a user using a head mounted display device in accordance with an embodiment of the present invention.
图5为本发明一实施例中的头戴式显示设备的调节控制方法的流程图。FIG. 5 is a flowchart of an adjustment control method of a head mounted display device according to an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
请参阅图1,本发明一实施例提供一种头戴式显示设备100。所述头戴式显示设备100可为智能头盔,智能眼镜等头戴式设备。Referring to FIG. 1 , an embodiment of the present invention provides a head mounted display device 100 . The head mounted display device 100 can be a head mounted device such as a smart helmet or smart glasses.
请一并参阅图2,所述头戴式显示设备100包括显示装置20、侦测装置30、驱动装置40及处理器50。 Referring to FIG. 2 , the head mounted display device 100 includes a display device 20 , a detecting device 30 , a driving device 40 , and a processor 50 .
所述显示装置20,用于输出显示画面及将所述显示画面传送至用户眼睛。The display device 20 is configured to output a display screen and transmit the display screen to a user's eyes.
所述侦测装置30,用于采集包括用户眼睛在内的眼部图像信息。The detecting device 30 is configured to collect eye image information including a user's eyes.
所述驱动装置40,用于驱动所述显示装置20运动以调节所述显示装置20的位置。The driving device 40 is configured to drive the display device 20 to move to adjust the position of the display device 20.
所述处理器50与所述侦测装置30、所述显示装置20以及所述驱动装置40均连接。The processor 50 is connected to the detecting device 30, the display device 20, and the driving device 40.
所述处理器50用于至少根据所述侦测装置30采集到的眼部图像信息控制所述驱动装置40运动,以以调节所述显示装置20的位置。The processor 50 is configured to control the movement of the driving device 40 according to at least the eye image information collected by the detecting device 30 to adjust the position of the display device 20.
所述处理器50可为微控制器、微处理器、单片机、数字信号处理器等。The processor 50 can be a microcontroller, a microprocessor, a microcontroller, a digital signal processor, or the like.
具体地,头戴式显示设备100包括壳体10,所述显示装置20活动设于所述壳体10上。Specifically, the head mounted display device 100 includes a housing 10 on which the display device 20 is movably disposed.
请结合参阅图3,所述显示装置20包括基座22、显示屏24及光学镜头26。Referring to FIG. 3 together, the display device 20 includes a base 22, a display screen 24, and an optical lens 26.
所述基座22与所述壳体10活动相接,用于承载所述显示屏24及光学镜头26。所述驱动装置40与所述基座22连接,用以驱动所述基座22运动。The base 22 is movably coupled to the housing 10 for carrying the display screen 24 and the optical lens 26. The driving device 40 is coupled to the base 22 for driving the base 22 to move.
所述显示屏24固定于所述基座22上,用于输出显示画面。所述显示屏24为柔性显示屏,所述显示屏24设置成圆弧形,以最大程度的扩大显示范围。The display screen 24 is fixed to the base 22 for outputting a display screen. The display screen 24 is a flexible display screen, and the display screen 24 is arranged in a circular arc shape to maximize the display range.
所述光学镜头26固定于所述基座22上,所述光学镜头26位于所述显示屏24显示画面的输出路径上,用于传送所述显示画面至所述用户眼睛。当用户穿戴头戴式显示设备100时,所述光学镜头26为位于所述显示屏24靠近用户眼睛的一侧,从而使所述显示屏24输出的显示画面经过所述光学镜头26后才到用户的眼睛。所述光学镜头26的光轴与所述显示屏24的光轴重合,所述光学镜头26的光轴为所述显示装置20的光轴。The optical lens 26 is fixed on the base 22, and the optical lens 26 is located on an output path of the display screen of the display screen 24 for transmitting the display screen to the eyes of the user. When the user wears the head mounted display device 100, the optical lens 26 is located on the side of the display screen 24 close to the user's eyes, so that the display screen output by the display screen 24 passes through the optical lens 26 The eyes of the user. The optical axis of the optical lens 26 coincides with the optical axis of the display screen 24, and the optical axis of the optical lens 26 is the optical axis of the display device 20.
所述侦测装置30固定于所述基座22上,如前所述,用于侦测包括用户眼睛在内的眼部信息。所述侦测装置30为一摄像装置,用于摄取用户眼部图像信息。优选地,所述摄像装置为一红外摄像装置。The detecting device 30 is fixed on the base 22, as described above, for detecting eye information including the eyes of the user. The detecting device 30 is an image capturing device for taking in image information of the user's eyes. Preferably, the camera device is an infrared camera device.
所述处理器50用于至少根据所述侦测装置30采集到的眼部图像信息控制所述驱动装置40运动以调节所述显示装置20的位置。根据所述侦测装置30采集到的眼部图像信息判断所述用户的眼球是否发生转动,确定所述用户的眼 球发生转动时控制所述驱动装置40运动以调节所述显示装置20的位置。The processor 50 is configured to control the movement of the driving device 40 to adjust the position of the display device 20 according to at least the eye image information collected by the detecting device 30. Determining whether the eyeball of the user rotates according to the eye image information collected by the detecting device 30, and determining the eye of the user The movement of the drive unit 40 is controlled to adjust the position of the display unit 20 as the ball rotates.
进一步地,根据所述侦测装置30采集到的眼部图像信息获取特征位置信息,确定所述特征位置偏离预设位置时,确定所述用户的眼球发生转动。本实施方式中,选取瞳孔的中心作为判断的眼部特征。所述特征位置为所述侦测装置30采集到的眼部图像中的所述特征位于所述眼部图像中的位置,所述特征位置为瞳孔中心位置。在一些实施例中,可以选取眼球的其他特征进行判断,例如眼球上的红血丝上的某一点,等等。Further, the feature position information is acquired according to the eye image information collected by the detecting device 30, and when the feature position is determined to deviate from the preset position, the eyeball of the user is determined to rotate. In the present embodiment, the center of the pupil is selected as the determined eye feature. The feature position is a position in the eye image in the eye image collected by the detecting device 30, and the feature position is a pupil center position. In some embodiments, other features of the eyeball may be selected for judgment, such as a point on the red blood cell on the eyeball, and the like.
具体地,所述处理器50根据所述眼部图像信息获取特征位置。所述处理器50至少根据所述特征位置判断所述显示装置20的光轴是否偏离用户瞳孔中心。若所述处理器50判断所述用户眼球发生转动,即所述显示装置20的光轴偏离穿过所述用户的瞳孔中心。所述处理器50至少根据所述特征位置控制所述驱动装置40驱动所述显示装置20运动。在本实施方式中,所述处理器50将所述眼部图像进行瞳孔粗定位、形态学方法处理和边缘信息提取等,再通过进一步计算得到所述特征位置,确定所述特征位置是否偏离所述预设位置。Specifically, the processor 50 acquires a feature position according to the eye image information. The processor 50 determines whether the optical axis of the display device 20 deviates from the user's pupil center based on at least the feature position. If the processor 50 determines that the user's eyeball is rotating, that is, the optical axis of the display device 20 is offset from the center of the pupil of the user. The processor 50 controls the driving device 40 to drive the display device 20 to move according to at least the feature position. In this embodiment, the processor 50 performs the pupil image positioning, the morphological method processing, the edge information extraction, and the like on the eye image, and further calculates the feature position by using the image, and determines whether the feature position deviates from the Preset position.
其中,所述预设位置为,所述显示装置20的光轴穿过所述用户的瞳孔中心时,所述侦测装置30采集到的眼部图像中的特征位于所述眼部图像的位置。所述特征位置为,所述侦测装置30采集到的眼部图像中的特征位于所述眼部图像的位置。本实施方式中,所述显示装置20的光轴穿过所述用户的瞳孔中心时,所述侦测装置30采集到的眼部图像中,所述预设位置位于所述眼部图像的中心位置。所述眼部图像为矩形时,所述预设位置位于所述矩形的长边中垂线及短边中垂线的交叉点上;所述眼部图像为圆形时,所述预设位置位于所述圆形的圆心上。当用户眼球向左转动或向右发生转动时,在所述侦测装置30采集到的眼部图像中,所述特征位置偏离所述预设位置。The preset position is that when the optical axis of the display device 20 passes through the pupil center of the user, the feature in the eye image collected by the detecting device 30 is located at the position of the eye image. . The feature position is that the feature in the eye image collected by the detecting device 30 is located at the position of the eye image. In the embodiment, when the optical axis of the display device 20 passes through the pupil center of the user, in the eye image collected by the detecting device 30, the preset position is located at the center of the eye image. position. When the eye image is a rectangle, the preset position is located at an intersection of a vertical line of the long side of the rectangle and a vertical line of the short side; when the eye image is a circle, the preset position Located on the center of the circle. When the user's eyeball rotates to the left or rotates to the right, the feature position is deviated from the preset position in the eye image collected by the detecting device 30.
请参阅图3及图4,所述头戴式显示设备100还包括导向件60。所述导向件60固定装设于所述壳体10上。所述基座22与所述导向件60滑动相接。所述导向件60用于对所述显示装置20的运动进行导向。所述基座22上形成导向槽224。所述基座22通过所述导向槽224活动套设于所述导向件60上。所述驱动装置40能够驱动所述显示装置20的基座22于所述导向件60上滑动,以调节所述显示装置20的位置。于一些实施例中,所述壳体10上形成导轨, 所述基座22装设于所述导轨上。Referring to FIGS. 3 and 4 , the head mounted display device 100 further includes a guide 60 . The guiding member 60 is fixedly mounted on the housing 10 . The base 22 is slidably coupled to the guide member 60. The guide 60 is used to guide the movement of the display device 20. A guiding groove 224 is formed on the base 22. The base 22 is movably sleeved on the guiding member 60 through the guiding slot 224. The driving device 40 is capable of driving the base 22 of the display device 20 to slide on the guide member 60 to adjust the position of the display device 20. In some embodiments, a guide rail is formed on the housing 10, The base 22 is mounted on the rail.
所述导向件60为弧形结构。所述侦测装置30的光轴与所述显示装置20的光轴位于第一平面,所述导向件60位于第二平面上,所述第一平面与所述第二平面相互垂直。用户使用所述头戴式显示设备100时,所述导向件60的球心与所述用户的眼球中心重合,所述第二平面与用户的瞳孔中心位于同一水平面,在用户眼球发生转动时,使所述显示装置20的光学镜头26与用户眼球之间的距离保持不变,进而在保持所述显示装置20的光轴与用户视线保持一致的情况下,不影响使用。The guide member 60 has an arc structure. The optical axis of the detecting device 30 is located in a first plane with the optical axis of the display device 20, and the guiding member 60 is located on a second plane, the first plane and the second plane being perpendicular to each other. When the user uses the head mounted display device 100, the center of the guide member 60 coincides with the center of the eyeball of the user, and the second plane is at the same level as the center of the pupil of the user. When the user's eyeball rotates, The distance between the optical lens 26 of the display device 20 and the user's eyeball is kept constant, and the use of the optical axis of the display device 20 is maintained without being consistent with the user's line of sight.
进一步地,所述导向件60上形成沿其圆弧轮廓设置的若干齿条61,所述头戴式显示设置表100还包括与所述基座22活动连接的齿轮结构80,所述齿轮结构80与若干所述齿条61啮合,使得所述显示装置20于所述导向件60上的运动顺畅、稳定,进而不会影响用户的观看体验。Further, the guide member 60 is formed with a plurality of racks 61 disposed along a circular arc profile thereof, and the head mounted display setting table 100 further includes a gear structure 80 movably coupled to the base 22, the gear structure 80 meshes with a plurality of the racks 61, so that the movement of the display device 20 on the guide member 60 is smooth and stable, and thus does not affect the viewing experience of the user.
在一实施例中,所述导向件60可以设导槽,所述基座22可以形成导轨,所述基座22的导轨与所述导向件60的导槽滑动相接。可以理解,所述显示装置20可以省略基座22,所述显示屏24、所述光学镜头26及所述侦测装置30均活动装设于所述导向件60上。In an embodiment, the guiding member 60 may be provided with a guiding groove, and the base 22 may form a guide rail, and the guiding rail of the base 22 is slidably engaged with the guiding groove of the guiding member 60. It can be understood that the display device 20 can omit the pedestal 22, and the display screen 24, the optical lens 26 and the detecting device 30 are all movably mounted on the guiding member 60.
用户佩戴所述头戴式显示设备100使用时,所述侦测装置30采集用户眼部图像信息并将所述用户眼部图像信息传送至所述处理器50,所述处理器50根据所述用户眼部图像信息,计算分析得到特征位置。所述处理器50根据所述特征位置判断所述显示装置20的光轴是否穿过所述瞳孔中心。若所述处理器50判断所述显示装置20的光轴偏离穿过所述瞳孔中心,则所述处理器50控制所述驱动装置40驱动所述显示装置20运动调节位置,以使所述显示装置20的光轴重新穿过所述瞳孔中心,从而使所述用户视线与所述显示装置20的光轴达到一致。在此过程中,所述侦测装置30不断采集包括眼睛在内的眼部图像,直至所述处理器50确定所述特征位置与所述预设位置相同时,所述处理器50控制所述显示装置20停止运动。所述眼球注视的部分重新穿过所述光学镜头26的中心部分成像,成像质量得到保证,提升了用户的浸入感,亦提高了用户的使用体验。When the user wears the head mounted display device 100, the detecting device 30 collects user eye image information and transmits the user eye image information to the processor 50, and the processor 50 according to the The user's eye image information is calculated and analyzed to obtain the feature position. The processor 50 determines whether the optical axis of the display device 20 passes through the pupil center according to the feature position. If the processor 50 determines that the optical axis of the display device 20 deviates through the center of the pupil, the processor 50 controls the driving device 40 to drive the display device 20 to adjust the position to make the display The optical axis of device 20 re-enters the center of the pupil such that the user's line of sight coincides with the optical axis of display device 20. During this process, the detecting device 30 continuously collects an image of the eye including the eye until the processor 50 determines that the feature position is the same as the preset position, the processor 50 controls the The display device 20 stops moving. The portion of the eyeball that is gazing is again imaged through the central portion of the optical lens 26, the image quality is ensured, the immersion sensation of the user is improved, and the user experience is improved.
所述头戴式显示设备100的显示装置20在所述处理器50的控制下,能够 自动检测用户眼球转向,并自动调节所述显示装置20的位置,以使所述显示装置20的光轴重新穿过所述瞳孔中心,故而,即使在用户眼球发生转动的情况下,所述头戴式显示设备100能自动调节所述显示装置20的位置,方便了所述头戴式显示设备100的使用。The display device 20 of the head mounted display device 100 is capable of being controlled by the processor 50 Automatically detecting the user's eyeball steering and automatically adjusting the position of the display device 20 such that the optical axis of the display device 20 re-passes through the center of the pupil, so that even in the case where the user's eyeball is rotated, the head The wearable display device 100 can automatically adjust the position of the display device 20 to facilitate the use of the head mounted display device 100.
在本实施例中,所述侦测装置30的光轴与所述显示装置20的光轴位于同一平面。若所述显示装置20的光轴穿过所述瞳孔中心,则所述侦测装置30摄取的眼球图像中,所述瞳孔中心位于所述眼球图像的中心,换句话说,若所述处理器50根据所述用户眼部图像信息,计算得出所述特征位置位于所述眼球图像的中心,则所述处理器50判断所述显示装置的光轴穿过所述瞳孔中心;否则,所述处理器50则判断所述显示装置20的光轴偏离所述瞳孔中心。In this embodiment, the optical axis of the detecting device 30 is in the same plane as the optical axis of the display device 20. If the optical axis of the display device 20 passes through the center of the pupil, in the eyeball image taken by the detecting device 30, the pupil center is located at the center of the eyeball image, in other words, if the processor According to the user's eye image information, it is calculated that the feature position is located at the center of the eyeball image, and the processor 50 determines that the optical axis of the display device passes through the pupil center; otherwise, the The processor 50 then determines that the optical axis of the display device 20 is offset from the center of the pupil.
在所述显示装置20调节位置的过程中,所述侦测装置30采集用户眼部图像信息,所述处理器50根据新采集的用户眼部图像信息进行分析,直至所述处理器50判断得出所述显示装置20的光轴穿过所述瞳孔中心,即所述显示装置20的光轴与用户眼球的视线保持一致,所述处理器50控制所述显示装置20停止运动。In the process of adjusting the position of the display device 20, the detecting device 30 collects image information of the user's eyes, and the processor 50 performs analysis according to the newly collected image information of the user's eyes until the processor 50 determines The optical axis of the display device 20 passes through the center of the pupil, that is, the optical axis of the display device 20 is consistent with the line of sight of the user's eyeball, and the processor 50 controls the display device 20 to stop moving.
在本实施方式中,所述侦测装置30实时采集用户眼部图像信息,所述处理器50至少根据所述用户眼部图像信息获取所述特征位置。可以理解,所述侦测装置30可不定时或定时采集用户眼部图像信息。In this embodiment, the detecting device 30 collects user's eye image information in real time, and the processor 50 acquires the feature position according to at least the user's eye image information. It can be understood that the detecting device 30 can collect user's eye image information from time to time or timing.
在一实施例中,所述处理器50至少根据所述用户眼部图像信息,获取特征位置,并计算得出所述显示装置20的调节路径,例如,若所述特征位置于第一方向偏离所述眼球图像的中心位置第一距离,则调节所述显示装置20沿所述第一方向移动所述第一距离;所述驱动装置40响应所述处理器50驱动所述显示装置20运动,所述显示装置20沿所述调节路径运动来调节位置,进而使所述显示装置20的光轴穿过所述瞳孔中心。In an embodiment, the processor 50 acquires a feature position according to at least the user's eye image information, and calculates an adjustment path of the display device 20, for example, if the feature position deviates in a first direction. The first position of the central position of the eyeball image adjusts the display device 20 to move the first distance in the first direction; the driving device 40 drives the display device 20 to move in response to the processor 50, The display device 20 moves along the adjustment path to adjust the position, thereby passing the optical axis of the display device 20 through the center of the pupil.
在一实施例中,所述侦测装置30的光轴与所述显示装置20的光轴可以不位于同一平面,所述侦测装置30的光轴所在平面不与所述第一平面垂直。所述处理器50根据所述用户眼部图像信息计算得到特征位置,所述特征位置为所述侦测装置30所采集到的眼球图像中的特征的位置。所述处理器50比较所述特征位置及所述预设位置,若所述特征位置及所述预设位置相同,则所述处 理器50判断所述显示装置20的光轴穿过瞳孔中心;若所述特征位置偏离所述预设位置,则所述处理器50判断所述显示装置20的光轴偏离瞳孔中心,所述处理器50依据所述特征位置与所述预设位置计算得到相应的调节路径,并控制所述显示装置20沿所述调节路径运动。In an embodiment, the optical axis of the detecting device 30 and the optical axis of the display device 20 may not be in the same plane, and the plane of the optical axis of the detecting device 30 is not perpendicular to the first plane. The processor 50 calculates a feature position according to the image information of the user's eye, and the feature position is a position of a feature in the eyeball image collected by the detecting device 30. The processor 50 compares the feature location with the preset location, and if the feature location and the preset location are the same, the location The processor 50 determines that the optical axis of the display device 20 passes through the center of the pupil; if the feature position deviates from the preset position, the processor 50 determines that the optical axis of the display device 20 is offset from the pupil center, The processor 50 calculates a corresponding adjustment path according to the feature position and the preset position, and controls the display device 20 to move along the adjustment path.
在一些实施例中,可以依据其它方式来判断使用时所述用户的眼球发生转动,例如瞳孔中心至其中一个眼角的距离,当所述距离发生改变时,则意味着所述用户眼球发生转动;或者眼球上的某个特征的位置发生变化,亦意味着所述用户眼球发生转动。In some embodiments, the user's eyeball rotation may be determined according to other manners, such as the distance from the center of the pupil to one of the corners of the eye, and when the distance changes, it means that the user's eyeball rotates; Or the position of a feature on the eyeball changes, which also means that the user's eyeball rotates.
在一实施例中,其中,所述预设位置为眼睛的中心位置,在用户正视前方时,瞳孔中心位于所述眼睛的中心位置,即所述预设位置,当用户眼球转动到其他方向时,例如向左看或向右看时,瞳孔中心将偏离所述预设位置,所述处理器50根据眼部图像信息获取所述特征位置,所述特征位置偏离所述预设位置时,则确定用户眼睛的瞳孔中心偏离了所述预设位置时,所述处理器确定偏离的距离和方向,然后控制驱动装置40驱动显示装置20朝相应的方向运动相应的距离,而维持所述显示装置20的光轴穿过用户瞳孔中心,使得所述显示装置20的光轴与用户眼球的视线达到一致。In an embodiment, wherein the preset position is a center position of the eye, and when the user faces the front, the center of the pupil is located at a center position of the eye, that is, the preset position, when the user's eyeball rotates to other directions. For example, when looking to the left or to the right, the pupil center will deviate from the preset position, and the processor 50 acquires the feature position according to the eye image information, and when the feature position deviates from the preset position, Determining that the center of the pupil of the user's eye deviates from the preset position, the processor determines the distance and direction of the deviation, and then controls the driving device 40 to drive the display device 20 to move the corresponding distance in the corresponding direction while maintaining the display device The optical axis of 20 passes through the center of the user's pupil such that the optical axis of the display device 20 coincides with the line of sight of the user's eye.
请参阅图5,本发明一实施例中的调节控制方法,应用于头戴式显示设备,所述调节控制方法中的步骤并不限于以下的执行顺序。所述调节控制方法包括以下步骤:Referring to FIG. 5, an adjustment control method in an embodiment of the present invention is applied to a head mounted display device, and the steps in the adjustment control method are not limited to the following execution sequence. The adjustment control method includes the following steps:
步骤501,通过所述头戴式显示设备的侦测装置采集穿戴所述头戴式显示设备的用户的眼部图像信息;Step 501: Collect, by the detecting device of the head mounted display device, eye image information of a user wearing the head mounted display device;
步骤502,至少根据所述眼部图像信息判断所述用户的眼球是否发生转动;以及Step 502: determining, according to at least the eye image information, whether the eyeball of the user is rotated;
步骤503,在确定所述用户的眼球发生转动时,控制所述头戴式显示设备的驱动装置驱动所述显示装置运动,以调节所述显示装置的位置,进而使所述显示装置的光轴穿过所述用户眼睛的瞳孔中心。 Step 503, when determining that the user's eyeball is rotated, controlling a driving device of the head mounted display device to drive the display device to adjust the position of the display device, thereby making the optical axis of the display device Pass through the center of the pupil of the user's eye.
所述步骤502包括:至少根据所述眼部图像信息获取特征位置;以及通过判断所述特征位置是否偏离预设位置来判断所述用户的眼球是否发生转动。The step 502 includes: acquiring a feature position according to at least the eye image information; and determining whether the eyeball of the user is rotated by determining whether the feature position deviates from a preset position.
具体地,通过所述头戴式显示设备的处理器,处理分析所述用户眼部图像 信息,获取所述特征位置,将所述特征位置与所述预设位置进行比较,确定所述特征位置是否偏离预设位置,进而判断所述用户的眼球是否发生转动,若是,则执行步骤503,否则,返回步骤501。Specifically, the image of the user's eye is processed and analyzed by a processor of the head mounted display device And acquiring the feature position, comparing the feature position with the preset position, determining whether the feature position deviates from the preset position, and determining whether the eyeball of the user is rotated, and if yes, executing step 503 Otherwise, return to step 501.
当判断所述用户的眼球发生转动时,所述显示装置的光轴偏离所述用户的瞳孔中心,换句话说,所述显示装置的光轴与所述用户的视线不一致。When it is judged that the eyeball of the user is rotated, the optical axis of the display device is offset from the center of the pupil of the user, in other words, the optical axis of the display device does not coincide with the line of sight of the user.
其中,所述预设位置为,所述显示装置的光轴穿过所述用户的瞳孔中心时所述侦测装置采集到的眼部图像中的特征位于所述眼部图像的位置。所述特征位置为,所述侦测装置采集到的眼部图像中的特征位于所述眼部图像的位置。本实施方式中,所述显示装置的光轴穿过所述用户的瞳孔中心时,所述侦测装置采集到的眼部图像中,所述预设位置位于所述眼部图像的中心位置。所述眼部图像为矩形时,所述预设位置位于所述矩形的长边中垂线及短边中垂线的交叉点上;所述眼部图像为圆形时,所述预设位置位于所述圆形的圆心上。当用户眼球向左转动或向右发生转动时,在所述侦测装置采集到的眼部图像中,所述特征位置偏离所述预设位置。The preset position is that a feature in the eye image collected by the detecting device is located at a position of the eye image when the optical axis of the display device passes through the pupil center of the user. The feature position is that a feature in the eye image collected by the detecting device is located at a position of the eye image. In this embodiment, when the optical axis of the display device passes through the pupil center of the user, the preset position is located at the center position of the eye image in the eye image collected by the detecting device. When the eye image is a rectangle, the preset position is located at an intersection of a vertical line of the long side of the rectangle and a vertical line of the short side; when the eye image is a circle, the preset position Located on the center of the circle. When the user's eyeball rotates to the left or rotates to the right, the feature position is deviated from the preset position in the eye image collected by the detecting device.
所述步骤502中,当通过所述处理器确定所述特征位置偏离所述预设位置时,则判断所述用户眼球发生转动,意味着所述显示装置的光轴偏离所述瞳孔中心,执行步骤503,否则,返回步骤501。In the step 502, when it is determined by the processor that the feature position deviates from the preset position, it is determined that the user's eyeball is rotated, meaning that the optical axis of the display device is offset from the pupil center, and execution is performed. Step 503, otherwise, return to step 501.
可以理解,当所述处理器判断所述用户眼球未发生转动时,即所述显示装置的光轴穿过所述瞳孔中心,可以不返回步骤501。所述侦测装置可以定时或不定时采集用户眼部图像信息。It can be understood that when the processor determines that the user's eyeball has not rotated, that is, the optical axis of the display device passes through the center of the pupil, it may not return to step 501. The detecting device can collect image information of the user's eyes periodically or irregularly.
进一步地,在所述步骤503中,至少根据所述特征位置,确定所述用户眼球运动的方向,即所述用户瞳孔中心偏离的方向,所述驱动装置驱动所述显示装置于所述头戴式显示设备的导向件上于相应方向运动。所述导向件为弧形结构。所述侦测装置的光轴与所述显示装置的光轴位于第一平面,所述导向件位于第二平面上,所述第一平面与所述第二平面相互垂直。用户使用所述头戴式显示设备时,所述导向件的球心与所述用户的眼球中心重合,所述第一平面与用户的瞳孔中心位于同一水平面。在用户眼球发生转动后,所述驱动装置驱动所述显示装置于所述头戴式显示设备的导向件运动,所述侦测装置不断采集包括眼睛在内的眼部图像,直至所述处理器确定所述特征位置与所述预设位置相 同时,所述处理器控制所述显示装置停止运动。Further, in the step 503, determining, according to the feature position, the direction of the eye movement of the user, that is, the direction in which the center of the user's pupil is deviated, the driving device driving the display device on the headset The guide of the display device moves in the corresponding direction. The guide member has an arc structure. The optical axis of the detecting device is located in a first plane with an optical axis of the display device, the guiding member is located on a second plane, and the first plane and the second plane are perpendicular to each other. When the user uses the head mounted display device, the center of the guide member coincides with the center of the eyeball of the user, and the first plane is at the same level as the center of the pupil of the user. After the user's eyeball rotates, the driving device drives the display device to move the guide member of the head mounted display device, and the detecting device continuously collects an eye image including the eye until the processor Determining that the feature location is opposite the preset location At the same time, the processor controls the display device to stop moving.
在一实施例中,在所述步骤503中包括:至少根据所述特征位置计算出所述显示装置的调节路径;控制所述驱动装置驱动所述显示装置沿调节路径运动。In an embodiment, the step 503 includes: calculating an adjustment path of the display device according to at least the feature position; and controlling the driving device to drive the display device to move along the adjustment path.
在一实施例中,其中,所述预设位置为眼睛的中心位置,在用户正视前方时,瞳孔中心的位置位于所述眼睛的中心位置,即所述预设位置,当用户眼球转动到其他方向时,例如向左看或向右看时,瞳孔中心的位置将偏离所述预设位置,所述处理器根据眼部图像信息确定用户眼睛的瞳孔中心偏离了所述预设位置时,确定偏离的距离和方向,然后控制驱动装置驱动显示装置朝相应的方向运动相应的距离,而维持所述显示装置的光轴穿过用户瞳孔中心。In an embodiment, wherein the preset position is a center position of the eye, and when the user faces the front side, the position of the pupil center is located at a center position of the eye, that is, the preset position, when the user's eyeball rotates to other When the direction is, for example, looking left or right, the position of the pupil center will deviate from the preset position, and the processor determines, according to the eye image information, that the pupil center of the user's eye deviates from the preset position, and determines The distance and direction of the deviation are then controlled to drive the display device to move the corresponding distance in the respective direction while maintaining the optical axis of the display device through the center of the user's pupil.
在一实施例中,可以依据其它方式来判断使用时所述用户的眼球发生转动,例如瞳孔中心至其中一个眼角的距离,当所述距离发生改变时,则意味着所述用户眼球发生转动;或者眼球上的某个特征的位置发生变化,亦意味着所述用户眼球发生转动。In an embodiment, the user's eyeball rotation may be determined according to other manners, such as the distance from the center of the pupil to one of the corners of the eye. When the distance changes, it means that the user's eyeball rotates; Or the position of a feature on the eyeball changes, which also means that the user's eyeball rotates.
本发明提供的头戴式显示设备及调节控制方法,能够自动检测用户眼球是否发生转动,在用户视线与所述显示装置的光轴不一致时,能够自动调节所述显示装置的位置,使得所述显示装置的光轴穿过所述瞳孔中心,从而使所述用户视线与所述显示装置的光轴达到一致,进而使所述眼球注视的部分重新穿过所述光学镜头的中心部分成像,成像质量得到保证,提升了用户的浸入感,亦提高了用户的使用体验。The head-mounted display device and the adjustment control method provided by the invention can automatically detect whether the user's eyeball is rotated, and can automatically adjust the position of the display device when the user's line of sight does not coincide with the optical axis of the display device, so that the The optical axis of the display device passes through the center of the pupil such that the line of sight of the user coincides with the optical axis of the display device, thereby causing the portion of the eyeball to be re-imaged through the central portion of the optical lens for imaging The quality is guaranteed, which enhances the user's immersion and improves the user experience.
以上所述是本发明的优选实施例,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也视为本发明的保护范围。 The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It is the scope of protection of the present invention.

Claims (17)

  1. 一种头戴式显示设备,包括显示装置及处理器,所述显示装置用于输出显示画面及将所述显示画面传送至用户眼睛,A head mounted display device includes a display device and a processor, the display device is configured to output a display screen and transmit the display screen to a user's eyes,
    其特征在于,It is characterized in that
    所述头戴式显示设备还包括:The head mounted display device further includes:
    驱动装置,与所述显示装置连接,用于驱动所述显示装置运动;a driving device connected to the display device for driving the display device to move;
    侦测装置,用于采集穿戴所述头戴式显示设备的用户的眼部图像信息;a detecting device, configured to collect eye image information of a user wearing the head mounted display device;
    其中,所述处理器与显示装置、驱动装置及侦测装置连接,所述处理器用于至少根据所述侦测装置采集到的眼部图像信息控制所述驱动装置运动以调节所述显示装置的位置。The processor is connected to the display device, the driving device and the detecting device, and the processor is configured to control the movement of the driving device to adjust the display device according to at least the eye image information collected by the detecting device. position.
  2. 如权利要求1所述的头戴式显示设备,其特征在于,根据所述侦测装置采集到的眼部图像信息控制所述驱动装置运动以调节所述显示装置的位置包括:根据所述侦测装置采集到的眼部图像信息获取特征位置,确定所述特征位置偏离预设位置时,控制所述驱动装置运动以调节所述显示装置的位置,进而使所述显示装置的光轴穿过所述眼球的瞳孔中心。The head-mounted display device according to claim 1, wherein controlling the movement of the driving device to adjust the position of the display device according to the image information of the eye collected by the detecting device comprises: according to the detecting The eye image information collected by the measuring device acquires a feature position, and when the feature position is determined to deviate from the preset position, the driving device is controlled to move to adjust the position of the display device, thereby allowing the optical axis of the display device to pass through The pupil center of the eyeball.
  3. 如权利要求2所述的头戴式显示设备,其特征在于,所述处理器至少依据所述特征位置,计算出所述显示装置的调节路径,所述处理器控制所述驱动装置驱动所述显示装置沿所述调节路径运动。The head-mounted display device according to claim 2, wherein said processor calculates an adjustment path of said display device based at least on said feature position, said processor controlling said drive device to drive said The display device moves along the adjustment path.
  4. 如权利要求2所述的头戴式显示设备,其特征在于,所述预设位置为眼睛的中心位置,在用户正视前方时,瞳孔中心的位置位于所述眼睛的中心位置,当用户眼球转动到其他方向时,所述处理器根据眼部图像信息确定用户眼睛的瞳孔中心偏离了所述预设位置,所述处理器确定偏离的距离和方向,然后控制驱动装置驱动显示装置朝相应的方向运动相应的距离。The head-mounted display device according to claim 2, wherein the preset position is a center position of the eye, and when the user faces the front, the position of the pupil center is located at a center position of the eye, when the user's eye rotates When in other directions, the processor determines, according to the eye image information, that the pupil center of the user's eye deviates from the preset position, the processor determines the distance and direction of the deviation, and then controls the driving device to drive the display device toward the corresponding direction. The corresponding distance of movement.
  5. 如权利要求2所述的头戴式显示设备,其特征在于,所述预设位置为,所述显示装置的光轴穿过所述用户的瞳孔中心时,所述侦测装置采集到的眼部图像中的瞳孔中心位于所述眼部图像的位置,所述处理器根据所述眼部图像信息计算得到特征位置;所述处理器比较所述特征位置及所述预设位置,若所述特征位置偏离所述预设位置,则所述处理器判断所述显示装置的光轴偏离所述 瞳孔中心;若所述特征位置与所述预设位置相同,则所述处理器判断所述显示装置的光轴穿过瞳孔中心。The head-mounted display device according to claim 2, wherein the preset position is an eye collected by the detecting device when an optical axis of the display device passes through a center of the pupil of the user The center of the pupil in the image is located at the position of the eye image, and the processor calculates the feature position according to the image information of the eye; the processor compares the feature position with the preset position, if Deviating from the preset position, the processor determines that an optical axis of the display device deviates from the a pupil center; if the feature position is the same as the preset position, the processor determines that the optical axis of the display device passes through the center of the pupil.
  6. 如权利要求2所述的头戴式显示设备,其特征在于,所述头戴式显示设备还包括壳体及固定装设于所述壳体上的导向件,所述显示装置能够滑动地设于所述导向件上。The head-mounted display device according to claim 2, wherein the head-mounted display device further comprises a housing and a guiding member fixedly mounted on the housing, wherein the display device is slidably disposed On the guide member.
  7. 如权利要求6所述的头戴式显示设备,其特征在于,所述导向件为圆弧结构,用户使用所述头戴式显示设备时,所述导向件的球心与所述用户眼球的中心重合,所述侦测装置的光轴与所述显示装置的光轴位于第一平面,所述导向件位于第二平面上,所述第一平面与所述第二平面相互垂直。The head-mounted display device according to claim 6, wherein the guide member has a circular arc structure, and when the user uses the head-mounted display device, the center of the guide member and the eyeball of the user Centers coincide, an optical axis of the detecting device is located in a first plane with an optical axis of the display device, and the guiding member is located on a second plane, the first plane and the second plane being perpendicular to each other.
  8. 如权利要求6所述的头戴式显示设备,其特征在于,所述显示装置包括显示屏及光学镜头,所述显示屏、所述光学镜头及所述侦测装置均活动装设于所述导向件上,所述显示屏用于输出显示画面,所述光学镜头位于所述显示屏的显示画面的输出路径上。The head-mounted display device according to claim 6, wherein the display device comprises a display screen and an optical lens, and the display screen, the optical lens and the detecting device are all movably mounted on the On the guide, the display screen is for outputting a display screen, and the optical lens is located on an output path of the display screen of the display screen.
  9. 如权利要求8所述的头戴式显示设备,其特征在于,所述显示装置还包括与所述导向件滑动相接的基座,所述显示屏、所述光学镜头及所述侦测装置固定于所述基座上。The head-mounted display device according to claim 8, wherein the display device further comprises a base slidably coupled to the guide member, the display screen, the optical lens and the detecting device Fixed to the base.
  10. 如权利要求9所述的头戴式显示设备,其特征在于,所述基座上形成导向槽,所述基座通过所述导向槽与所述导向件滑动相接。A head-mounted display device according to claim 9, wherein a guide groove is formed in the base, and the base is slidably coupled to the guide member through the guide groove.
  11. 如权利要求9所述的头戴式显示设备,其特征在于,所述导向件上形成沿其圆弧轮廓设置的若干齿条,所述头戴式显示设备还包括与所述基座活动连接的齿轮结构,所述齿轮结构与若干所述齿条啮合。A head mounted display device according to claim 9, wherein said guide member has a plurality of racks disposed along a circular arc profile thereof, and said head mounted display device further comprises an active connection with said base Gear structure that meshes with a plurality of said racks.
  12. 一种头戴式显示设备的调节控制方法,其特征在于包括以下步骤:An adjustment control method for a head mounted display device, comprising the steps of:
    通过所述头戴式显示设备的侦测装置采集穿戴所述头戴式显示设备的用户的眼部图像信息;Collecting, by the detecting device of the head mounted display device, eye image information of a user wearing the head mounted display device;
    至少根据所述眼部图像信息判断用户的眼球是否发生转动;Determining, according to at least the eye image information, whether the user's eyeball is rotated;
    在确定所述用户的眼球发生转动时,控制所述头戴式显示设备的驱动装置驱动所述显示装置运动,以调节所述显示装置的位置。The drive device controlling the head mounted display device drives the display device to move to adjust the position of the display device when it is determined that the user's eyeball is rotated.
  13. 如权利要求12所述的调节控制方法,其特征在于,所述至少根据所述眼部图像信息判断用户的眼球是否发生转动的步骤中包括:至少根据所述眼 部图像信息获取特征位置;以及通过判断所述特征位置是否偏离预设位置来判断所述用户的眼球是否发生转动。The adjustment control method according to claim 12, wherein the step of determining whether the user's eyeball has rotated based at least on the eye image information comprises: at least according to the eye The part image information acquires the feature position; and determines whether the user's eyeball is rotated by determining whether the feature position deviates from the preset position.
  14. 如权利要求13所述的调节控制方法,其特征在于,所述在确定所述用户的眼球发生转动时,控制所述头戴式显示设备的驱动装置驱动所述显示装置运动,以调节所述显示装置的位置的步骤包括:The adjustment control method according to claim 13, wherein said controlling a driving device of said head mounted display device drives said display device to move when said determining that said user's eyeball is rotated The steps of displaying the location of the device include:
    至少根据所述特征位置计算出所述显示装置的调节路径;Calculating an adjustment path of the display device according to at least the feature position;
    控制所述驱动装置驱动所述显示装置沿调节路径运动。Controlling the drive device to drive the display device to move along an adjustment path.
  15. 如权利要求13所述的调节控制方法,其特征在于,所述预设位置为眼睛的中心位置,在用户正视前方时,瞳孔中心位于所述眼睛的中心位置,即所述预设位置,根据所述眼部图像信息确定用户眼睛的特征位置偏离所述预设位置时,则判断所述显示装置的光轴偏离所述瞳孔中心;若所述特征位置与所述预设位置相同,则判断所述显示装置的光轴穿过瞳孔中心。The adjustment control method according to claim 13, wherein the preset position is a center position of the eye, and when the user faces the front, the center of the pupil is located at a center position of the eye, that is, the preset position, according to When the eye image information determines that the feature position of the user's eyes deviates from the preset position, it is determined that the optical axis of the display device is offset from the center of the pupil; if the feature position is the same as the preset position, then determining The optical axis of the display device passes through the center of the pupil.
  16. 如权利要求13所述的调节控制方法,其特征在于,所述预设位置为,所述显示装置的光轴穿过所述用户的瞳孔中心时,所述侦测装置采集到的眼部图像中的特征位于所述眼部图像的位置,根据所述眼部图像信息计算得到特征位置,比较所述特征位置及所述预设位置,若所述特征位置偏离所述预设位置,则判断所述显示装置的光轴偏离所述瞳孔中心;若所述特征位置与所述预设位置相同,则判断所述显示装置的光轴穿过瞳孔中心。The adjustment control method according to claim 13, wherein the preset position is an eye image collected by the detecting device when an optical axis of the display device passes through a center of the pupil of the user The feature is located at a position of the eye image, and the feature position is calculated according to the eye image information, and the feature position and the preset position are compared, and if the feature position deviates from the preset position, determining The optical axis of the display device is offset from the center of the pupil; if the feature position is the same as the preset position, it is determined that the optical axis of the display device passes through the center of the pupil.
  17. 如权利要求12所述的调节控制方法,其特征在于,所述在确定所述用户的眼球发生转动时,控制所述头戴式显示设备的驱动装置驱动所述显示装置运动,以调节所述显示装置的位置的步骤包括,控制所述头戴式显示设备的驱动装置驱动所述显示装置于所述头戴式显示设备的导向件运动。 The adjustment control method according to claim 12, wherein said controlling a driving device of said head mounted display device drives said display device to move when said determining that said user's eyeball is rotated The step of displaying the position of the device includes controlling a drive of the head mounted display device to drive movement of the display device to the guide of the head mounted display device.
PCT/CN2017/115093 2017-12-07 2017-12-07 Head-mounted display device and adjustment control method therefor WO2019109318A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780097153.4A CN111417888B (en) 2017-12-07 2017-12-07 Head-mounted display device and adjustment control method thereof
PCT/CN2017/115093 WO2019109318A1 (en) 2017-12-07 2017-12-07 Head-mounted display device and adjustment control method therefor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/115093 WO2019109318A1 (en) 2017-12-07 2017-12-07 Head-mounted display device and adjustment control method therefor

Publications (1)

Publication Number Publication Date
WO2019109318A1 true WO2019109318A1 (en) 2019-06-13

Family

ID=66750008

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/115093 WO2019109318A1 (en) 2017-12-07 2017-12-07 Head-mounted display device and adjustment control method therefor

Country Status (2)

Country Link
CN (1) CN111417888B (en)
WO (1) WO2019109318A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111367405A (en) * 2020-02-17 2020-07-03 深圳岱仕科技有限公司 Method and device for adjusting head-mounted display equipment, computer equipment and storage medium
CN113786322A (en) * 2021-09-27 2021-12-14 深圳市倍轻松科技股份有限公司 Head massaging device
CN113925716A (en) * 2021-10-22 2022-01-14 河南省中医院(河南中医药大学第二附属医院) Multifunctional nursing frame for traditional Chinese medicine neurology and control method
CN114099984A (en) * 2021-11-29 2022-03-01 苏州宣嘉光电科技有限公司 Vision training device and vision training instrument

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004007315A (en) * 2002-06-03 2004-01-08 Victor Co Of Japan Ltd Head mounted display
CN104570347A (en) * 2013-10-25 2015-04-29 广达电脑股份有限公司 Head-mounted display device and imaging method thereof
CN106019589A (en) * 2016-06-25 2016-10-12 深圳市虚拟现实科技有限公司 Near-to-eye display device capable of automatically adjusting optical system
CN106445167A (en) * 2016-10-20 2017-02-22 网易(杭州)网络有限公司 Monocular vision field self-adaptive adjustment method and device and wearable visual device
CN106646903A (en) * 2017-02-27 2017-05-10 赵山山 Follow-up head display device and method
CN106686365A (en) * 2016-12-16 2017-05-17 歌尔科技有限公司 Lens adjusting method and lens adjusting device for head-mounted display equipment, and head-mounted display equipment

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5714967A (en) * 1994-05-16 1998-02-03 Olympus Optical Co., Ltd. Head-mounted or face-mounted image display apparatus with an increased exit pupil
CA2885874A1 (en) * 2014-04-04 2015-10-04 Bradford A. Folkens Image processing system including image priority
CN104581126A (en) * 2014-12-16 2015-04-29 青岛歌尔声学科技有限公司 Image display processing method and processing device for head-mounted display device
JP6378781B2 (en) * 2014-12-19 2018-08-22 株式会社ソニー・インタラクティブエンタテインメント Head-mounted display device and video display system
KR101638095B1 (en) * 2015-01-16 2016-07-20 한국과학기술원 Method for providing user interface through head mount display by using gaze recognition and bio-signal, and device, and computer-readable recording media using the same
CN205246972U (en) * 2015-12-18 2016-05-18 北京蚁视科技有限公司 Nearly eye display device of wear -type with eyeball synchronization display function

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004007315A (en) * 2002-06-03 2004-01-08 Victor Co Of Japan Ltd Head mounted display
CN104570347A (en) * 2013-10-25 2015-04-29 广达电脑股份有限公司 Head-mounted display device and imaging method thereof
CN106019589A (en) * 2016-06-25 2016-10-12 深圳市虚拟现实科技有限公司 Near-to-eye display device capable of automatically adjusting optical system
CN106445167A (en) * 2016-10-20 2017-02-22 网易(杭州)网络有限公司 Monocular vision field self-adaptive adjustment method and device and wearable visual device
CN106686365A (en) * 2016-12-16 2017-05-17 歌尔科技有限公司 Lens adjusting method and lens adjusting device for head-mounted display equipment, and head-mounted display equipment
CN106646903A (en) * 2017-02-27 2017-05-10 赵山山 Follow-up head display device and method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111367405A (en) * 2020-02-17 2020-07-03 深圳岱仕科技有限公司 Method and device for adjusting head-mounted display equipment, computer equipment and storage medium
CN113786322A (en) * 2021-09-27 2021-12-14 深圳市倍轻松科技股份有限公司 Head massaging device
CN113925716A (en) * 2021-10-22 2022-01-14 河南省中医院(河南中医药大学第二附属医院) Multifunctional nursing frame for traditional Chinese medicine neurology and control method
CN113925716B (en) * 2021-10-22 2023-08-04 河南省中医院(河南中医药大学第二附属医院) Multifunctional nursing frame for traditional Chinese medicine neurology department and control method
CN114099984A (en) * 2021-11-29 2022-03-01 苏州宣嘉光电科技有限公司 Vision training device and vision training instrument
CN114099984B (en) * 2021-11-29 2022-12-02 苏州宣嘉光电科技有限公司 Vision training device and vision training instrument

Also Published As

Publication number Publication date
CN111417888A (en) 2020-07-14
CN111417888B (en) 2022-09-20

Similar Documents

Publication Publication Date Title
WO2019109318A1 (en) Head-mounted display device and adjustment control method therefor
EP3129849B1 (en) Systems and methods of eye tracking calibration
US10452137B2 (en) Information processing apparatus and information processing method
JP6656921B2 (en) Apparatus for gaze detection
CN105554384B (en) Wearable device and image pickup method
WO2015172514A1 (en) Image acquisition device and method
EP3753246B1 (en) Imaging system and method for producing stereoscopic images using more than two cameras and gaze direction
JP6556133B2 (en) Apparatus and method for measuring subjective refractive power
KR102093953B1 (en) Method for helping determine the vision parameters of a subject
TW201814356A (en) Head-mounted display apparatus and lens position adjusting method thereof
EP4083682A1 (en) Head-mountable display apparatus and methods
KR102548807B1 (en) Method and Apparatus for Determining Subject's Reference Head Pose
US11927831B2 (en) Method for determining at least one geometrico-morphological parameters of a subject in a natural posture for determining a vision correction equipment
CN113729609A (en) Synoptophore
EP3721289B1 (en) Method and assembly for verifying the mounting of an ophthalmic lens in a frame
JPH024313A (en) Steady gazing position detector
JP6488546B2 (en) Spectacle wearing image analysis apparatus, spectacle wearing image analysis method, and spectacle wearing image analysis program
CA2963584C (en) Method for precisely measuring optico-physiognomic parameters of a subject for the adjustment of eyeglass lenses to the subject in a near viewing situation
TWI700456B (en) Mobile phone holder with function of eye angle recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17934044

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17934044

Country of ref document: EP

Kind code of ref document: A1