CN111417888B - Head-mounted display device and adjustment control method thereof - Google Patents
Head-mounted display device and adjustment control method thereof Download PDFInfo
- Publication number
- CN111417888B CN111417888B CN201780097153.4A CN201780097153A CN111417888B CN 111417888 B CN111417888 B CN 111417888B CN 201780097153 A CN201780097153 A CN 201780097153A CN 111417888 B CN111417888 B CN 111417888B
- Authority
- CN
- China
- Prior art keywords
- display device
- user
- head
- eye image
- center
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Abstract
A head-mounted display device (100) and a regulation control method thereof are provided, the head-mounted display device (100) comprises a display device (20), a processor (50), a driving device (40) and a detecting device (30). The drive device (40) is connected to the display device (20). The detection device (30) is used for collecting eye image information of a user wearing the head-mounted display equipment (100). The processor (50) is connected with the display device (20), the driving device (40) and the detecting device (30), and the processor (50) is used for controlling the driving device (40) to move according to at least eye image information collected by the detecting device (30) so as to adjust the position of the display device (20), so that the optical axis of the display device (20) penetrates through the center of the pupil of an eyeball, and the sight of a user is consistent with the optical axis of the display device (20).
Description
Technical Field
The present disclosure relates to display devices, and particularly to a head-mounted display device and an adjustment control method for the head-mounted display device.
Background
Head-mounted display devices have been gradually favored by people due to their convenience and ability to achieve stereoscopic display and stereo effects. In recent years, with the advent of Virtual Reality (VR) technology, head-mounted display devices have become more widely used as hardware support devices for VR technology. When the user dresses head-mounted display device, if user's eyeball rotated, then will arouse the skew eyeball pupil center of optical axis, namely user's sight is inconsistent with optical lens's optical axis, so can influence the imaging quality, and then influence user's use and experience.
Disclosure of Invention
In order to solve the above problem, an embodiment of the present invention discloses a head-mounted display device and an adjustment control method thereof.
A head-mounted display device comprises a display device and a processor, wherein the display device is used for outputting a display picture and transmitting the display picture to eyes of a user,
the head-mounted display device further includes:
the driving device is connected with the display device and used for driving the display device to move;
the detection device is used for collecting eye image information of a user wearing the head-mounted display equipment;
the processor is connected with the display device, the driving device and the detecting device, and the processor is used for controlling the driving device to move at least according to the eye image information collected by the detecting device so as to adjust the position of the display device.
Further, controlling the driving device to move according to the eye image information collected by the detecting device to adjust the position of the display device includes: and acquiring a characteristic position according to the eye image information acquired by the detection device, and controlling the driving device to move to adjust the position of the display device when the characteristic position deviates from a preset position, so that the optical axis of the display device passes through the pupil center of the eyeball.
Further, the processor calculates an adjustment path of the display device at least according to the characteristic position, and the processor controls the driving device to drive the display device to move along the adjustment path.
Further, the preset position is the center position of the eyes, when the front of the eyes of the user is seen, the center position of the pupils is located at the center position of the eyes, when the eyeballs of the user rotate to other directions, the processor determines that the centers of the pupils of the eyes of the user deviate from the preset position according to the eye image information, the processor determines the deviating distance and direction, and then the driving device is controlled to drive the display device to move towards the corresponding direction by the corresponding distance.
Further, the preset position is that when the optical axis of the display device passes through the pupil center of the user, the pupil center in the eye image collected by the detection device is located at the position of the eye image, and the processor calculates to obtain a characteristic position according to the eye image information; the processor compares the characteristic position with the preset position, and if the characteristic position deviates from the preset position, the processor judges that the optical axis of the display device deviates from the pupil center; and if the characteristic position is the same as the preset position, the processor judges that the optical axis of the display device passes through the center of the pupil.
Furthermore, the head-mounted display device further comprises a shell and a guide piece fixedly arranged on the shell, and the display device can be arranged on the guide piece in a sliding mode.
Furthermore, the guide part is of an arc structure, when the user uses the head-mounted display device, the spherical center of the guide part coincides with the center of the eyeball of the user, the optical axis of the detection device and the optical axis of the display device are located on a first plane, the guide part is located on a second plane, and the first plane and the second plane are perpendicular to each other.
Furthermore, the display device comprises a display screen and an optical lens, the display screen, the optical lens and the detecting device are movably arranged on the guide piece, the display screen is used for outputting a display picture, and the optical lens is positioned on an output path of the display picture of the display screen.
Furthermore, the display device further comprises a base connected with the guide piece in a sliding mode, and the display screen, the optical lens and the detection device are fixed on the base.
Further, a guide groove is formed in the base, and the base is in sliding connection with the guide piece through the guide groove.
Furthermore, a plurality of racks arranged along the arc contour of the guide piece are formed on the guide piece, the head-mounted display device further comprises a gear structure movably connected with the base, and the gear structure is meshed with the racks.
An adjustment control method of a head-mounted display apparatus, comprising the steps of:
acquiring eye image information of a user wearing the head-mounted display equipment through a detection device of the head-mounted display equipment;
judging whether the eyeballs of the user rotate or not at least according to the eye image information;
and when the eyeball of the user is determined to rotate, controlling a driving device of the head-mounted display equipment to drive the display device to move so as to adjust the position of the display device.
Further, the step of determining whether the eyeball of the user rotates according to at least the eye image information comprises: acquiring a characteristic position at least according to the eye image information; and judging whether the eyeballs of the user rotate or not by judging whether the characteristic position deviates from a preset position or not.
Further, when it is determined that the eyeball of the user rotates, the step of controlling the driving device of the head-mounted display apparatus to drive the display device to move so as to adjust the position of the display device comprises:
calculating an adjusting path of the display device according to the characteristic position;
and controlling the driving device to drive the display device to move along the adjusting path.
Further, the preset position is the center position of the eyes, when the user is looking ahead, the center of the pupils is located at the center position of the eyes, namely the preset position, and when the characteristic position of the eyes of the user deviates from the preset position according to the eye image information, it is determined that the optical axis of the display device deviates from the center of the pupils; and if the characteristic position is the same as the preset position, judging that the optical axis of the display device passes through the center of the pupil.
Further, the preset position is that when the optical axis of the display device passes through the pupil center of the user, the feature in the eye image collected by the detection device is located at the position of the eye image, the feature position is obtained by calculation according to the eye image information, the feature position and the preset position are compared, and if the feature position deviates from the preset position, it is determined that the optical axis of the display device deviates from the pupil center; and if the characteristic position is the same as the preset position, judging that the optical axis of the display device passes through the center of the pupil.
Further, when it is determined that the eyeball of the user rotates, the step of controlling the driving device of the head-mounted display device to drive the display device to move so as to adjust the position of the display device includes controlling the driving device of the head-mounted display device to drive the display device to move on a guide of the head-mounted display device.
The head-mounted display equipment and the adjusting control method provided by the invention can automatically detect the eyeball turning direction of a user, and can automatically adjust the position of the display device when the sight line of the user is inconsistent with the optical axis of the display device, so that the optical axis of the display device passes through the center of the pupil, the sight line of the user is consistent with the optical axis of the display device, the part watched by the eyeball passes through the center part of the optical lens again for imaging, the imaging quality is ensured, the immersion feeling of the user is improved, and the use experience of the user is also improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic perspective view of a head-mounted display device according to an embodiment of the invention.
Fig. 2 is a block diagram of a head-mounted display device according to an embodiment of the invention.
Fig. 3 is a perspective view illustrating a partial structure of a head-mounted display device according to an embodiment of the invention.
FIG. 4 is a diagram illustrating a user using a head mounted display device according to an embodiment of the invention.
Fig. 5 is a flowchart of an adjustment control method for a head-mounted display device according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a head-mounted display apparatus 100 according to an embodiment of the invention is provided. The head-mounted display device 100 may be a head-mounted device such as an intelligent helmet or intelligent glasses.
Referring to fig. 2, the head-mounted display apparatus 100 includes a display device 20, a detection device 30, a driving device 40, and a processor 50.
The display device 20 is configured to output a display image and transmit the display image to the eyes of the user.
The detecting device 30 is used for acquiring eye image information including eyes of a user.
The driving device 40 is used for driving the display device 20 to move so as to adjust the position of the display device 20.
The processor 50 is connected to the detecting device 30, the display device 20 and the driving device 40.
The processor 50 is configured to control the driving device 40 to move according to at least the eye image information collected by the detecting device 30, so as to adjust the position of the display device 20.
The processor 50 may be a microcontroller, a microprocessor, a single chip, a digital signal processor, or the like.
Specifically, the head-mounted display apparatus 100 includes a housing 10, and the display device 20 is movably disposed on the housing 10.
Referring to fig. 3, the display device 20 includes a base 22, a display screen 24 and an optical lens 26.
The base 22 is movably connected to the housing 10 for carrying the display screen 24 and the optical lens 26. The driving device 40 is connected to the base 22 for driving the base 22 to move.
The display screen 24 is fixed on the base 22 and used for outputting a display picture. The display screen 24 is a flexible display screen, and the display screen 24 is arranged in a circular arc shape so as to expand the display range to the maximum extent.
The optical lens 26 is fixed on the base 22, and the optical lens 26 is located on an output path of the display screen 24 for transmitting the display to the eyes of the user. When the user wears the head-mounted display device 100, the optical lens 26 is located on a side of the display screen 24 close to the user's eyes, so that the display image output by the display screen 24 reaches the user's eyes after passing through the optical lens 26. The optical axis of the optical lens 26 coincides with the optical axis of the display screen 24, and the optical axis of the optical lens 26 is the optical axis of the display device 20.
The detecting device 30 is fixed on the base 22, and is used for detecting the eye information including the eyes of the user as mentioned above. The detecting device 30 is a camera device for capturing the eye image information of the user. Preferably, the camera device is an infrared camera device.
The processor 50 is configured to control the driving device 40 to move to adjust the position of the display device 20 according to at least the eye image information collected by the detecting device 30. And judging whether the eyeball of the user rotates according to the eye image information acquired by the detection device 30, and controlling the driving device 40 to move when the eyeball of the user rotates so as to adjust the position of the display device 20.
Further, feature position information is obtained according to the eye image information acquired by the detection device 30, and when it is determined that the feature position deviates from a preset position, it is determined that the eyeball of the user rotates. In the present embodiment, the center of the pupil is selected as the eye feature to be determined. The feature position is a position where the feature in the eye image acquired by the detection device 30 is located in the eye image, and the feature position is a pupil center position. In some embodiments, other features of the eyeball may be selected for determination, such as a certain point on the red blood streak on the eyeball, and so on.
Specifically, the processor 50 obtains a feature position according to the eye image information. The processor 50 determines whether the optical axis of the display device 20 deviates from the center of the pupil of the user at least according to the characteristic position. If the processor 50 determines that the user's eyeball rotates, the optical axis of the display device 20 deviates from passing through the center of the user's pupil. The processor 50 controls the driving device 40 to drive the display device 20 to move according to at least the characteristic position. In this embodiment, the processor 50 performs pupil rough positioning, morphological processing, edge information extraction, and the like on the eye image, obtains the feature position through further calculation, and determines whether the feature position deviates from the preset position.
The preset position is a position where the feature in the eye image acquired by the detection device 30 is located in the eye image when the optical axis of the display device 20 passes through the center of the pupil of the user. The feature position is a position where a feature in the eye image acquired by the detection device 30 is located in the eye image. In this embodiment, when the optical axis of the display device 20 passes through the center of the pupil of the user, the preset position is located at the center of the eye image in the eye image collected by the detection device 30. When the eye image is a rectangle, the preset position is located at the intersection point of the long-side perpendicular bisector and the short-side perpendicular bisector of the rectangle; when the eye image is circular, the preset position is located on the center of the circle. When the eyeball of the user rotates left or right, the characteristic position deviates from the preset position in the eye image collected by the detection device 30.
Referring to fig. 3 and 4, the head-mounted display apparatus 100 further includes a guide 60. The guide 60 is fixedly installed on the housing 10. The base 22 is slidably engaged with the guide 60. The guide 60 serves to guide the movement of the display device 20. The base 22 has a guide groove 224 formed therein. The base 22 is movably sleeved on the guiding element 60 through the guiding groove 224. The driving device 40 can drive the base 22 of the display device 20 to slide on the guide 60, so as to adjust the position of the display device 20. In some embodiments, the housing 10 is formed with rails on which the base 22 is mounted.
The guide 60 has an arc-shaped configuration. The optical axis of the detecting device 30 and the optical axis of the display device 20 are located on a first plane, and the guiding element 60 is located on a second plane, where the first plane and the second plane are perpendicular to each other. When the user uses the head-mounted display device 100, the center of the sphere of the guide 60 coincides with the center of the user's eyeball, and the second plane is located on the same horizontal plane as the center of the user's pupil, so that when the user's eyeball rotates, the distance between the optical lens 26 of the display device 20 and the user's eyeball is kept unchanged, and further, the use is not affected under the condition that the optical axis of the display device 20 is kept consistent with the user's sight line.
Further, a plurality of racks 61 arranged along the arc contour of the guide 60 are formed on the guide 60, the head-mounted display device 100 further includes a gear structure 80 movably connected to the base 22, and the gear structure 80 is engaged with the plurality of racks 61, so that the movement of the display device 20 on the guide 60 is smooth and stable, and the viewing experience of the user is not affected.
In one embodiment, the guide member 60 may be provided with a guide slot, and the base 22 may form a guide rail, wherein the guide rail of the base 22 is slidably connected with the guide slot of the guide member 60. It is understood that the base 22 of the display device 20 can be omitted, and the display screen 24, the optical lens 26 and the detecting device 30 are movably mounted on the guiding element 60.
When the user wears the head-mounted display device 100 for use, the detecting device 30 collects the eye image information of the user and transmits the eye image information of the user to the processor 50, and the processor 50 calculates and analyzes the eye image information of the user to obtain the feature position. The processor 50 determines whether the optical axis of the display device 20 passes through the pupil center according to the characteristic position. If the processor 50 determines that the optical axis of the display device 20 deviates from passing through the pupil center, the processor 50 controls the driving device 40 to drive the display device 20 to move and adjust the position, so that the optical axis of the display device 20 passes through the pupil center again, and the line of sight of the user is consistent with the optical axis of the display device 20. In the process, the detecting device 30 continuously acquires the eye images including the eyes until the processor 50 determines that the characteristic position is the same as the preset position, and the processor 50 controls the display device 20 to stop moving. The part watched by the eyeballs passes through the central part of the optical lens 26 again for imaging, the imaging quality is guaranteed, the immersion feeling of a user is improved, and the use experience of the user is also improved.
The display device 20 of the head-mounted display apparatus 100 can automatically detect the direction of the eyeball of the user and automatically adjust the position of the display device 20 under the control of the processor 50, so that the optical axis of the display device 20 passes through the center of the pupil again, therefore, even if the eyeball of the user rotates, the head-mounted display apparatus 100 can automatically adjust the position of the display device 20, and the use of the head-mounted display apparatus 100 is facilitated.
In this embodiment, the optical axis of the detecting device 30 and the optical axis of the display device 20 are located on the same plane. If the optical axis of the display device 20 passes through the pupil center, the pupil center is located at the center of the eyeball image in the eyeball image captured by the detection device 30, in other words, if the processor 50 calculates that the characteristic position is located at the center of the eyeball image according to the eye image information of the user, the processor 50 determines that the optical axis of the display device passes through the pupil center; otherwise, the processor 50 determines that the optical axis of the display device 20 deviates from the pupil center.
In the process of adjusting the position of the display device 20, the detecting device 30 collects the eye image information of the user, the processor 50 analyzes the eye image information according to the newly collected eye image information of the user until the processor 50 judges that the optical axis of the display device 20 passes through the center of the pupil, that is, the optical axis of the display device 20 is consistent with the sight line of the eyeball of the user, and the processor 50 controls the display device 20 to stop moving.
In this embodiment, the detecting device 30 collects the image information of the user's eyes in real time, and the processor 50 obtains the characteristic position at least according to the image information of the user's eyes. It is understood that the detecting device 30 can collect the image information of the eyes of the user at random or regular time.
In one embodiment, the processor 50 obtains a feature position at least according to the user eye image information, and calculates an adjustment path of the display device 20, for example, if the feature position is located at a first distance from the center position of the eyeball image in a first direction, the display device 20 is adjusted to move the first distance in the first direction; the driving device 40 responds to the processor 50 to drive the display device 20 to move, and the display device 20 moves along the adjusting path to adjust the position, so that the optical axis of the display device 20 passes through the pupil center.
In an embodiment, the optical axis of the detecting device 30 and the optical axis of the display device 20 may not be located on the same plane, and the plane on which the optical axis of the detecting device 30 is located is not perpendicular to the first plane. The processor 50 calculates a feature position according to the eye image information of the user, where the feature position is a position of a feature in the eyeball image collected by the detection device 30. The processor 50 compares the characteristic position with the preset position, and if the characteristic position is the same as the preset position, the processor 50 determines that the optical axis of the display device 20 passes through the center of the pupil; if the characteristic position deviates from the preset position, the processor 50 determines that the optical axis of the display device 20 deviates from the pupil center, and the processor 50 calculates a corresponding adjustment path according to the characteristic position and the preset position and controls the display device 20 to move along the adjustment path.
In some embodiments, it may be determined that the user's eyeball rotates during use in other ways, such as a distance from a pupil center to one of the corners of the eye, and when the distance changes, it means that the user's eyeball rotates; or the position of a feature on the eye changes, it also means that the user's eye rotates.
In an embodiment, the preset position is a center position of an eye, when a user looks ahead, a pupil center is located at the center position of the eye, that is, the preset position, when a user's eyeball rotates to another direction, for example, looks left or right, the pupil center deviates from the preset position, the processor 50 acquires the characteristic position according to the eye image information, and when the characteristic position deviates from the preset position, it is determined that the pupil center of the user's eye deviates from the preset position, the processor determines the distance and the direction of the deviation, and then controls the driving device 40 to drive the display device 20 to move to the corresponding direction by the corresponding distance, so as to maintain the optical axis of the display device 20 to pass through the pupil center of the user, so that the optical axis of the display device 20 is consistent with the line of sight of the user's eyeball.
Referring to fig. 5, an adjustment control method in an embodiment of the invention is applied to a head-mounted display device, and steps in the adjustment control method are not limited to the following execution sequence. The regulation control method comprises the following steps:
The step 502 comprises: acquiring a characteristic position at least according to the eye image information; and judging whether the eyeball of the user rotates or not by judging whether the characteristic position deviates from a preset position or not.
Specifically, the processor of the head-mounted display device processes and analyzes the image information of the eyes of the user, obtains the characteristic position, compares the characteristic position with the preset position, determines whether the characteristic position deviates from the preset position, and further determines whether the eyeball of the user rotates, if so, step 503 is executed, otherwise, step 501 is returned.
When the eyeball of the user is judged to rotate, the optical axis of the display device deviates from the center of the pupil of the user, in other words, the optical axis of the display device is inconsistent with the sight line of the user.
The preset position is a position where the feature in the eye image acquired by the detection device is located in the eye image when the optical axis of the display device passes through the pupil center of the user. The feature position is a position where a feature in the eye image acquired by the detection device is located in the eye image. In this embodiment, when the optical axis of the display device passes through the center of the pupil of the user, the preset position is located at the center of the eye image in the eye image collected by the detection device. When the eye image is rectangular, the preset position is located at the intersection point of the long-side perpendicular bisector and the short-side perpendicular bisector of the rectangle; and when the eye image is circular, the preset position is positioned on the center of the circle. When the eyeballs of the user rotate leftwards or rightwards, the characteristic positions deviate from the preset positions in the eye images collected by the detection device.
In step 502, when the processor determines that the characteristic position deviates from the preset position, it is determined that the user's eyeball rotates, meaning that the optical axis of the display device deviates from the pupil center, and step 503 is executed, otherwise, the process returns to step 501.
It is understood that when the processor determines that the user's eyeball is not rotated, i.e. the optical axis of the display device passes through the center of the pupil, the process may not return to step 501. The detection device can collect the eye image information of the user at regular time or irregular time.
Further, in the step 503, a direction of the eye movement of the user, that is, a direction of the pupil center deviation of the user, is determined according to at least the characteristic position, and the driving device drives the display device to move on the guide of the head-mounted display device in the corresponding direction. The guide piece is of an arc-shaped structure. The optical axis of the detection device and the optical axis of the display device are positioned on a first plane, the guide piece is positioned on a second plane, and the first plane and the second plane are perpendicular to each other. When the user uses the head-mounted display equipment, the sphere center of the guide piece is superposed with the eyeball center of the user, and the first plane and the pupil center of the user are located on the same horizontal plane. After the eyeballs of the user rotate, the driving device drives the display device to move on the guide piece of the head-mounted display device, the detection device continuously collects eye images including the eyes, and the processor controls the display device to stop moving until the processor determines that the characteristic position is the same as the preset position.
In one embodiment, step 503 includes: calculating an adjusting path of the display device according to the characteristic position; and controlling the driving device to drive the display device to move along the adjusting path.
In an embodiment, the preset position is a center position of an eye, when a user looks ahead, a position of a pupil center is located at the center position of the eye, that is, the preset position, when an eyeball of the user rotates to another direction, for example, to look left or to look right, the position of the pupil center deviates from the preset position, the processor determines the deviating distance and direction when determining that the pupil center of the eye of the user deviates from the preset position according to the eye image information, and then controls the driving device to drive the display device to move a corresponding distance in a corresponding direction, so as to maintain that an optical axis of the display device passes through the pupil center of the user.
In one embodiment, it may be determined that the user's eyeball rotates during use according to other manners, such as a distance from a pupil center to one of the corners of the eye, and when the distance changes, it means that the user's eyeball rotates; or the position of a feature on the eye changes, it also means that the user's eye rotates.
The head-mounted display equipment and the adjustment control method provided by the invention can automatically detect whether the eyeball of the user rotates, and can automatically adjust the position of the display device when the sight line of the user is inconsistent with the optical axis of the display device, so that the optical axis of the display device passes through the center of the pupil, the sight line of the user is consistent with the optical axis of the display device, and the part watched by the eyeball passes through the center part of the optical lens again for imaging, thereby ensuring the imaging quality, improving the immersion feeling of the user and improving the use experience of the user.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (13)
1. A head-mounted display device comprises a display device and a processor, wherein the display device is used for outputting a display picture and transmitting the display picture to eyes of a user,
it is characterized in that the preparation method is characterized in that,
the head mounted display device further includes:
the driving device is connected with the display device and used for driving the display device to move;
the detection device is used for collecting eye image information of a user wearing the head-mounted display equipment;
the processor is connected with the display device, the driving device and the detecting device, and is used for controlling the driving device to move at least according to the eye image information acquired by the detecting device so as to adjust the position of the display device;
controlling the driving device to move according to the eye image information acquired by the detecting device so as to adjust the position of the display device comprises: acquiring a characteristic position according to the eye image information acquired by the detection device, and controlling the driving device to move to adjust the position of the display device when the characteristic position deviates from a preset position, so that the optical axis of the display device passes through the pupil center of the eyeball;
the preset position is that when the optical axis of the display device passes through the pupil center of the user, the pupil center in the eye image collected by the detection device is located at the position of the eye image, and the processor calculates to obtain a characteristic position according to the eye image information; the processor compares the characteristic position with the preset position, and if the characteristic position deviates from the preset position, the processor judges that the optical axis of the display device deviates from the pupil center; and if the characteristic position is the same as the preset position, the processor judges that the optical axis of the display device passes through the center of the pupil.
2. The head-mounted display device of claim 1, wherein the processor calculates an adjustment path of the display device based at least on the characteristic position, and the processor controls the driving device to drive the display device to move along the adjustment path.
3. The head-mounted display device of claim 1, wherein the preset position is a center position of an eye, the center position of a pupil is located at the center position of the eye when the user is looking forward, the processor determines that the center of the pupil of the eye of the user deviates from the preset position according to the eye image information when the user rotates to other directions, the processor determines the deviated distance and direction, and then controls the driving device to drive the display device to move by the corresponding distance in the corresponding direction.
4. The head-mounted display device of claim 1, further comprising a housing and a guide fixedly mounted on the housing, wherein the display device is slidably mounted on the guide.
5. The head-mounted display apparatus of claim 4, wherein the guiding element is a circular arc structure, when the head-mounted display apparatus is used by a user, a spherical center of the guiding element coincides with a center of an eyeball of the user, an optical axis of the detecting device and an optical axis of the display device are located on a first plane, the guiding element is located on a second plane, and the first plane and the second plane are perpendicular to each other.
6. The head-mounted display apparatus according to claim 4, wherein the display device comprises a display screen and an optical lens, the display screen, the optical lens and the detecting device are movably mounted on the guiding member, the display screen is used for outputting a display image, and the optical lens is located on an output path of the display image of the display screen.
7. The head-mounted display apparatus of claim 6, wherein the display device further comprises a base slidably connected to the guide, and the display screen, the optical lens and the detecting device are fixed on the base.
8. The head-mounted display device of claim 7, wherein the base has a guide groove formed thereon, and the base is slidably engaged with the guide member through the guide groove.
9. The head-mounted display device of claim 7, wherein the guide member has a plurality of racks formed thereon along a circular contour thereof, the head-mounted display device further comprising a gear structure movably coupled to the base, the gear structure engaging the plurality of racks.
10. An adjustment control method of a head-mounted display apparatus, characterized by comprising the steps of:
acquiring eye image information of a user wearing the head-mounted display equipment through a detection device of the head-mounted display equipment;
judging whether the eyeballs of the user rotate or not at least according to the eye image information;
when the eyeball of the user is determined to rotate, controlling a driving device of the head-mounted display equipment to drive a display device of the head-mounted display equipment to move so as to adjust the position of the display device;
the step of judging whether the eyeballs of the user rotate or not at least according to the eye image information comprises the following steps: acquiring a characteristic position at least according to the eye image information; judging whether the eyeballs of the user rotate or not by judging whether the characteristic positions deviate from preset positions or not;
the preset position is that when the optical axis of the display device passes through the pupil center of the user, the feature in the eye image collected by the detection device is located at the position of the eye image, the feature position is obtained by calculation according to the eye image information, the feature position and the preset position are compared, and if the feature position deviates from the preset position, the optical axis of the display device is judged to deviate from the pupil center; and if the characteristic position is the same as the preset position, judging that the optical axis of the display device passes through the center of the pupil.
11. The adjustment control method according to claim 10, wherein the step of controlling the driving means of the head-mounted display apparatus to drive the display means to move to adjust the position of the display means when it is determined that the user's eyes are rotated comprises:
calculating an adjusting path of the display device according to the characteristic position;
and controlling the driving device to drive the display device to move along the adjusting path.
12. The accommodation control method according to claim 10, wherein the preset position is a center position of an eye, and when the user is looking forward, a pupil center is located at the center position of the eye, that is, the preset position, and when it is determined that the characteristic position of the user's eye deviates from the preset position according to the eye image information, it is determined that the optical axis of the display device deviates from the pupil center; and if the characteristic position is the same as the preset position, judging that the optical axis of the display device passes through the center of the pupil.
13. The adjustment control method according to claim 10, wherein the step of controlling the driving device of the head-mounted display apparatus to drive the display device to move to adjust the position of the display device when it is determined that the eyeball of the user rotates comprises controlling the driving device of the head-mounted display apparatus to drive the display device to move on a guide of the head-mounted display apparatus.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/115093 WO2019109318A1 (en) | 2017-12-07 | 2017-12-07 | Head-mounted display device and adjustment control method therefor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111417888A CN111417888A (en) | 2020-07-14 |
| CN111417888B true CN111417888B (en) | 2022-09-20 |
Family
ID=66750008
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780097153.4A Active CN111417888B (en) | 2017-12-07 | 2017-12-07 | Head-mounted display device and adjustment control method thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111417888B (en) |
| WO (1) | WO2019109318A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111367405A (en) * | 2020-02-17 | 2020-07-03 | 深圳岱仕科技有限公司 | Method and device for adjusting head-mounted display equipment, computer equipment and storage medium |
| CN113925716B (en) * | 2021-10-22 | 2023-08-04 | 河南省中医院（河南中医药大学第二附属医院） | Multifunctional nursing frame for traditional Chinese medicine neurology department and control method |
| CN114099984B (en) * | 2021-11-29 | 2022-12-02 | 苏州宣嘉光电科技有限公司 | Vision training device and vision training instrument |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5714967A (en) * | 1994-05-16 | 1998-02-03 | Olympus Optical Co., Ltd. | Head-mounted or face-mounted image display apparatus with an increased exit pupil |
| CN104581126A (en) * | 2014-12-16 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Image display processing method and processing device for head-mounted display device |
| CA2885874A1 (en) * | 2014-04-04 | 2015-10-04 | Bradford A. Folkens | Image processing system including image priority |
| CN106019589A (en) * | 2016-06-25 | 2016-10-12 | 深圳市虚拟现实科技有限公司 | Near-to-eye display device capable of automatically adjusting optical system |
| CN106686365A (en) * | 2016-12-16 | 2017-05-17 | 歌尔科技有限公司 | Lens adjusting method and lens adjusting device for head-mounted display equipment, and head-mounted display equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004007315A (en) * | 2002-06-03 | 2004-01-08 | Victor Co Of Japan Ltd | Head mounted display |
| TW201516467A (en) * | 2013-10-25 | 2015-05-01 | Quanta Comp Inc | Head mounted display and imaging method thereof |
| US10353207B2 (en) * | 2014-12-19 | 2019-07-16 | Sony Interactive Entertainment Inc. | Head-mounted display device and video display system |
| KR101638095B1 (en) * | 2015-01-16 | 2016-07-20 | 한국과학기술원 | Method for providing user interface through head mount display by using gaze recognition and bio-signal, and device, and computer-readable recording media using the same |
| CN205246972U (en) * | 2015-12-18 | 2016-05-18 | 北京蚁视科技有限公司 | Nearly eye display device of wear -type with eyeball synchronization display function |
| CN106445167B (en) * | 2016-10-20 | 2019-09-20 | 网易（杭州）网络有限公司 | Simple eye visual field is adaptive to match method of adjustment and device, wear-type visual device |
| CN106646903A (en) * | 2017-02-27 | 2017-05-10 | 赵山山 | Follow-up head display device and method |
-
2017
- 2017-12-07 WO PCT/CN2017/115093 patent/WO2019109318A1/en active Application Filing
- 2017-12-07 CN CN201780097153.4A patent/CN111417888B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5714967A (en) * | 1994-05-16 | 1998-02-03 | Olympus Optical Co., Ltd. | Head-mounted or face-mounted image display apparatus with an increased exit pupil |
| CA2885874A1 (en) * | 2014-04-04 | 2015-10-04 | Bradford A. Folkens | Image processing system including image priority |
| CN104581126A (en) * | 2014-12-16 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Image display processing method and processing device for head-mounted display device |
| CN106019589A (en) * | 2016-06-25 | 2016-10-12 | 深圳市虚拟现实科技有限公司 | Near-to-eye display device capable of automatically adjusting optical system |
| CN106686365A (en) * | 2016-12-16 | 2017-05-17 | 歌尔科技有限公司 | Lens adjusting method and lens adjusting device for head-mounted display equipment, and head-mounted display equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019109318A1 (en) | 2019-06-13 |
| CN111417888A (en) | 2020-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11669160B2 (en) | Predictive eye tracking systems and methods for foveated rendering for electronic displays | |
| US11635806B2 (en) | Information processing apparatus and information processing method | |
| US10871825B1 (en) | Predictive eye tracking systems and methods for variable focus electronic displays | |
| US5726704A (en) | Stereoscopic image pickup and display apparatus | |
| US20060098087A1 (en) | Housing device for head-worn image recording and method for control of the housing device | |
| US10061384B2 (en) | Information processing apparatus, information processing method, and program | |
| CN111417888B (en) | Head-mounted display device and adjustment control method thereof | |
| CN107092346B (en) | Information processing method and electronic equipment | |
| US8692870B2 (en) | Adaptive adjustment of depth cues in a stereo telepresence system | |
| EP3753246B1 (en) | Imaging system and method for producing stereoscopic images using more than two cameras and gaze direction | |
| CN112666705A (en) | Eye movement tracking device and eye movement tracking method | |
| KR20150102941A (en) | Method for helping determine the vision parameters of a subject | |
| EP3929650A1 (en) | Gaze tracking apparatus and systems | |
| JP6097919B2 (en) | Image display system and three-dimensional display device for stereoscopic video | |
| US20200213467A1 (en) | Image display system, image display method, and image display program | |
| US11925412B2 (en) | Gaze tracking apparatus and systems | |
| GB2595461A (en) | Gaze tracking apparatus and systems | |
| CN109756663B (en) | AR device control method and device and AR device | |
| CN111580646A (en) | Method, device and system for adjusting position of visual equipment according to face | |
| US20220350141A1 (en) | Head-mountable display apparatus and methods | |
| JPH024313A (en) | Steady gazing position detector | |
| US20230393655A1 (en) | Electronic apparatus | |
| CN117412020A (en) | Parallax adjustment method, parallax adjustment device, storage medium and computing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Building 43, Dayun software Town, No. 8288 Longgang Avenue, Henggang street, Longgang District, Shenzhen City, Guangdong Province Applicant after: Shenzhen Ruoyu Technology Co.,Ltd. Address before: Building 43, Dayun software Town, No. 8288 Longgang Avenue, Henggang street, Longgang District, Shenzhen City, Guangdong Province Applicant before: SHENZHEN ROYOLE TECHNOLOGIES Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |