CN114355615A

CN114355615A - Head-mounted display device and control method thereof

Info

Publication number: CN114355615A
Application number: CN202210252422.2A
Authority: CN
Inventors: 武斌; 翟羽佳
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-03-15
Filing date: 2022-03-15
Publication date: 2022-04-15
Anticipated expiration: 2042-03-15
Also published as: CN114355615B

Abstract

The application provides a head-mounted display device and a control method thereof, which can improve user experience. A first light transmission unit is arranged in the first supporting structure, and a second light transmission unit is arranged in the second supporting structure; the light reflected by the left eye is imaged on the image surface of the first detection unit through the first light transmission unit, and the light reflected by the right eye is imaged on the second detection unit through the second light transmission unit; when the image formed by the image surface of the first detection unit is different from the first preset position and the image formed by the image surface of the second detection unit is different from the second preset position, the adjusting unit adjusts the positions of the first support structure and the second support structure on the bearing structure; the measuring unit records the displacement of the first and second support structures; the control module determines the actual interpupillary distance of the human eyes according to the displacement; based on the actual human eye pupil distance, the light emitted by the first display is collected by the left eye through the first light propagation unit; the light emitted from the second display is collected by the right eye through the second light propagation unit.

Description

Head-mounted display device and control method thereof

Technical Field

The present disclosure relates to display technologies, and particularly to a head-mounted display device and a control method thereof.

Background

The electronic equipment presents image information such as characters and images to a user through the display, and can display pictures for the user, play videos, play game interaction with the user and the like. For example, Augmented Reality (AR) head mounted display devices may present images to a user through a display, giving the user an immersive experience. Specifically, because the two eyes of a person have a certain distance, the visual scenes seen by the left and right eyes are different. Based on this, in the stereoscopic projection imaging system, it is possible to provide a 3D (three-dimensional) image that can be viewed three-dimensionally to an observer by displaying images having parallax to the right and left eyes of the observer.

However, when the interpupillary distances of the left and right displays of the AR head-mounted display device do not match the interpupillary distances of the right and left eyes of the observer, the observer may observe distorted images, which not only spoils the experience of the observer, but also causes problems such as eye fatigue or headache of the observer.

Disclosure of Invention

In order to solve the above technical problem, the present application provides a head-mounted display device and a control method thereof. The pupil distance of an observer can be accurately determined, the three-dimensional image is displayed according to the pupil distance, the display effect is good, and the user experience is improved. In addition, the head-mounted display device is small in size and light in weight.

In a first aspect, an embodiment of the present application provides a head-mounted display device, including: a load bearing structure, a first support structure and a second support structure; the first supporting structure and the second supporting structure are movably arranged on the bearing structure; the head-mounted display device further includes: the device comprises a control module, an optical display module and a measurement adjusting module; the optical display module comprises a first display, a first light transmission unit, a second display and a second light transmission unit; the measurement adjusting module comprises a first detecting unit, a second detecting unit, a measuring unit and an adjusting unit; a first light transmission unit is arranged in the first supporting structure, and a second light transmission unit is arranged in the second supporting structure; the light reflected by the left eye of the observer is imaged on the image surface of the first detection unit through the first light transmission unit, and the light reflected by the right eye of the observer is imaged on the second detection unit through the second light transmission unit; when the image formed by the image surface of the first detection unit is different from the first preset position and the image formed by the image surface of the second detection unit is different from the second preset position, the adjusting unit is used for adjusting the positions of the first supporting structure and the second supporting structure on the bearing structure so as to enable the image formed by the image surface of the first detection unit to be the same as the first preset position and the image formed by the image surface of the second detection unit to be the same as the second preset position; the measuring unit is used for recording the displacement of the first supporting structure and the second supporting structure; the first preset position is the position of the optical axes of the first display and the first light transmission unit on the image surface of the first detection unit when the interpupillary distance of the head-mounted display device is the preset interpupillary distance of the human eyes; the second preset position is the position of the optical axes of the second display and the second light transmission unit on the image surface of the second detection unit when the interpupillary distance of the head-mounted display device is the preset interpupillary distance of the human eyes; when the image formed by the image surface of the first detection unit is the same as the first preset position and the image formed by the image surface of the second detection unit is the same as the second preset position, the control module is used for determining the actual human eye pupil distance according to the displacement and the preset human eye pupil distance; based on the actual human eye pupil distance, the light emitted by the first display is collected by the left eye through the first light propagation unit; and the light emitted by the second display is collected by the right eye through the second light propagation unit.

Through regulating unit and measuring element combination, the pupil interval of definite observer that can be accurate to according to observer's pupil interval, adjust the content of three-dimensional display, with the pupil interval of matching the observer, the display effect is good, and the observer is difficult to produce tired or headache scheduling problem, promotes user experience. In addition, the volume and the weight of the head-mounted display device are greatly reduced by the design of a common light path (the light transmission unit transmits light reflected by eyes and also transmits light emitted by the display) of the measuring unit and the optical display module.

In some possible implementations, the head-mounted display device further includes: the early warning module is electrically connected with the control module; when the image formed by the image plane of the first detection unit is different from the first preset position and the image formed by the image plane of the second detection unit is different from the second preset position, the early warning module is used for reminding an observer to readjust the posture of wearing the head-mounted display device, for example, the distance between the first support structure and the second support structure is adjusted, and the user experience is further improved.

In some possible implementation manners, the head-mounted display device further includes a plurality of light supplement lamps, and a plurality of light supplement lamps are respectively disposed on the first support structure and the second support structure on the sides facing the observer; the plurality of light supplement lamps are uniformly arranged on the first supporting structure and the second supporting structure for example; the left eye and the right eye are illuminated by light rays emitted by the light supplementing lamps, so that the images collected by the interpupillary distance detection unit have enough brightness.

In some possible implementations, the first light propagating unit and the second light propagating unit each include a waveguide. Since the optical path is folded by the waveguide, the volume of the head-mounted display device is further reduced.

In some possible implementation manners, on the basis that the first light propagation unit and the second light propagation unit both include waveguides, the head-mounted display device further includes a plurality of light supplement lamps, and a plurality of light supplement lamps are respectively disposed on sides of the first support structure and the second support structure facing the observer; the left eye and the right eye are illuminated by light rays emitted by the plurality of light supplementing lamps; the first light propagation unit comprises a first coupling-in unit and a first coupling-out unit; the second light propagation unit comprises a second coupling-in unit and a second coupling-out unit; when the first coupling-out unit corresponding to the first detection unit and the first coupling-in unit corresponding to the first display are shared, the head-mounted display device further comprises a beam splitter prism; a light splitting prism is arranged on a path for transmitting the light reflected by the left eye and a path for transmitting the light emitted by the first display; when the second coupling-out unit corresponding to the second detection unit and the second coupling-in unit corresponding to the second display are shared, the head-mounted display device further comprises a beam splitter prism; and a light splitting prism is arranged on a path for transmitting the light reflected by the right eye and a path for transmitting the light emitted by the second display. The light is split by a splitting prism.

In some possible implementations, the first light propagation unit and the second light propagation unit each include a free-form surface prism; or, the first light propagation unit and the second light propagation unit both comprise free-form surface reflectors. Of course, the types of the first and second light propagation units include, but are not limited to, a waveguide, a free-form prism, or a free-form mirror.

In some possible implementations, the measurement unit includes a grating scale. The displacement accuracy of the first supporting structure and the second supporting structure determined by the grating ruler is high.

In some possible implementations, the head-mounted display device further includes a visibility adjustment module for performing visibility compensation to meet the needs of different observers, so as to provide a more comfortable use experience for the observers with visual defects (myopia, hyperopia, astigmatism, etc.).

In some possible implementations, on the basis that the head-mounted display device includes the visibility adjustment module, the visibility adjustment module includes two detachable lenses; the two detachable lenses are detachably arranged on one sides of the first supporting structure and the second supporting structure facing the observer.

In some possible implementation manners, on the basis that the head-mounted display device comprises a visibility adjusting module, the visibility adjusting module comprises two groups of tunable lens groups; each group of tunable lens groups comprises a first tunable lens and a second tunable lens, wherein the first tunable lens and the second tunable lens in one group of tunable lens groups are fixed on two opposite sides of the first supporting structure; and the first tunable lens and the second tunable lens in the other group of tunable lens groups are fixed on two opposite sides of the second support structure. The second tunable lens is used for adjusting the virtual image distance. The combination of the first tunable lens and the second tunable lens ensures that the focal power of the external light passing through the first tunable lens and the second tunable lens is zero. Because the tunable lens can directly change the corresponding power according to the voltage, different lenses do not need to be replaced aiming at different users with eyesight defects.

In a second aspect, an embodiment of the present application provides a method for controlling a head-mounted display device, which is applied to the head-mounted display device according to the first aspect; the control method of the head-mounted display device comprises the following steps: collecting pictures of a left eye and a right eye; the interpupillary distance of the head-mounted display device is a preset interpupillary distance of human eyes; judging whether the picture of the left eye is the same as the first preset position or not and whether the picture of the right eye is the same as the second preset position or not; if the left-eye picture is different from the first preset position and the right-eye picture is different from the second preset position, controlling the adjusting unit to adjust the positions of the first supporting structure and the second supporting structure on the bearing structure so as to enable the left-eye picture to be the same as the first preset position and enable the right-eye picture to be the same as the second preset position; and recording the displacement amounts of the first and second support structures; determining the actual human eye pupil distance according to the displacement and the preset human eye pupil distance, and completing primary pupil distance adjustment; controlling the first display to emit light based on the actual human eye pupil distance, so that the light emitted by the first display is collected by a left eye through the first light transmission unit; and controlling the second display to emit light so that the light emitted by the second display is collected by the right eye through the second light transmission unit. Because the three-dimensional image that shows is based on the interpupillary distance of new observer and confirms, the display effect is good, and the observer is difficult to produce tired or headache scheduling problem, promotes user experience.

In some possible implementation manners, if the left-eye picture is the same as the first preset position and the right-eye picture is the same as the second preset position, controlling the first display to emit light rays based on a preset eye pupil distance, so that the light rays emitted by the first display are collected by the left eye through the first light propagation unit; and controlling the second display to emit light so that the light emitted by the second display is collected by the right eye through the second light transmission unit. I.e. no adjustment is necessary.

In some possible implementation manners, before determining the actual human eye interpupillary distance according to the displacement amount and the preset human eye interpupillary distance, the method further includes: judging whether the picture of the left eye is the same as the first preset position or not and whether the picture of the right eye is the same as the second preset position or not; if the picture of the left eye is different from the first preset position and the picture of the right eye is different from the second preset position, the steps of controlling the adjusting unit to adjust the positions of the first supporting structure and the second supporting structure on the bearing structure and recording the displacement of the first supporting structure and the second supporting structure are repeatedly executed until the picture of the left eye is the same as the first preset position and the picture of the right eye is the same as the second preset position. Like this, can improve the regulation precision, when preventing that the regulating unit from adjusting the interval between first bearing structure and the second bearing structure, error scheduling problem appears for the unsatisfied distance that needs the regulation of the displacement volume of first bearing structure and second bearing structure.

In some possible implementations, the method for controlling a head-mounted display device further includes: judging whether the interpupillary distance adjustment times exceed preset times or not; if the pupil interval adjustment times exceed the preset times, adjusting the interval between the first support structure and the second support structure through an adjusting unit so as to enable the interval between the first support structure and the second support structure to be the preset human eye pupil interval; or, prompting an observer to manually adjust the unit so that the distance between the first support structure and the second support structure is the preset human eye pupil distance to avoid the influence of system errors on the adjustment precision.

Drawings

FIG. 1 is a model diagram of three-dimensional imaging provided by an embodiment of the present application;

fig. 2 is a schematic structural diagram of a head-mounted display device according to an embodiment of the present disclosure;

fig. 3 is a schematic view of an application scenario of a head-mounted display device according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of another head-mounted display device provided in the embodiment of the present application;

FIG. 5 is a schematic diagram of an optical axis of a human eye and an optical axis of an optical display module according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of another head-mounted display device according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of another head-mounted display device according to an embodiment of the present disclosure;

fig. 8 is a schematic structural diagram of another head-mounted display device according to an embodiment of the present disclosure;

fig. 9 is a schematic view illustrating a light propagation unit for performing light propagation according to an embodiment of the present disclosure;

fig. 10 is a schematic view illustrating light propagation performed by another light propagation unit according to an embodiment of the present disclosure;

fig. 11 is a schematic structural diagram of a measurement unit according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of another head-mounted display device according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of another head-mounted display device according to an embodiment of the present disclosure;

fig. 14 is a flowchart of a method for controlling a head-mounted display device according to an embodiment of the present disclosure.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone.

The terms "first" and "second," and the like, in the description and in the claims of the embodiments of the present application are used for distinguishing between different objects and not for describing a particular order of the objects. For example, the first target object and the second target object, etc. are specific sequences for distinguishing different target objects, rather than describing target objects.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

In the description of the embodiments of the present application, the meaning of "a plurality" means two or more unless otherwise specified. For example, a plurality of processing units refers to two or more processing units; the plurality of systems refers to two or more systems.

For convenience of description, the following first introduces the relationship among parallax, interpupillary distance, and depth of the three-dimensional reconstruction according to the embodiment of the present application:

fig. 1 is a model diagram of three-dimensional imaging, and it should be noted that all coordinates in fig. 1 are defined in the same coordinate system, and a coordinate origin and a frame are already identified in the lower left corner of fig. 1. In FIG. 1, C_LAnd C_RIs the optical center of the first camera and the second camera; b is the distance between the optical centers of the two cameras; l represents the length of the image surface of the first camera and the second camera, and is symmetrical about the optical axis; f is the focal length (the shortest distance from the optical center to the image plane is the focal length f). P is a point in space with coordinates (x, z), P_LAnd P_RIs an imaging point of the point P on the first and second image planes. P_LHas the coordinate of (X)_L，f），P_RHas the coordinate of (X)_R，f），X_R ^*And X_L ^*Is P_LAnd P_RDistance from the first edge of the respective image plane. z is the object depth. d is the parallax. The relationship between parallax and object depth is as follows:

then push out:

it follows that the depth z is related to the focal length f, the distance b between the optical centers of the two cameras, and the parallax d. If the interpupillary distance (the distance b between the optical centers of the two cameras) of the head-mounted display device does not match the interpupillary distance of the human eyes, the distance of the displayed virtual object is different from the distance perceived by the human eyes, which causes problems of image distortion, visual fatigue, dizziness and the like.

The embodiment of the application provides a head-mounted display device, and fig. 2 shows a schematic structural diagram of the head-mounted display device. As shown in fig. 2, the head-mounted display apparatus 100 may include: a control module 10, an input-output module 20, an optical display module 30, and a measurement and adjustment module 40. The control module 10 includes a processor 11 and a memory 12. The input-output module 20 includes a speaker 21, a microphone 22, at least one sensor 23, a camera 24, and the like. When the number of the sensors 23 is plural, for example, the plural sensors 23 include, for example, a gyro sensor, a luminance sensor, a distance sensor, a touch sensor, a displacement sensor, a temperature sensor, an image sensor, and the like. The optical display module 30 includes a display 31, a lens group 32, and a light propagation unit 33. The measurement adjustment module 40 includes a detection unit 41, an adjustment unit 42, and a measurement unit 43.

It is to be understood that the illustrated structure of the embodiment of the invention does not constitute a specific limitation to the head-mounted display apparatus 100. In other embodiments of the present application, the head mounted display device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The head-mounted display device 100 may be an AR head-mounted display device, a Virtual Reality (VR) head-mounted display device, a Mixed Reality (MR) head-mounted display device, or the like, and the embodiment of the present application does not particularly limit the specific form of the head-mounted display device 100. When the head-mounted display device 100 is an AR head-mounted display device, it may be an AR helmet, AR glasses, or an AR cinema. When the head-mounted display device 100 is a VR head-mounted display device, it may be a VR helmet, VR glasses, or a VR movie theatre. When the head-mounted display device 100 is an MR head-mounted display device, it may be an MR helmet, MR glasses, or an MR movie theater, etc.

For convenience of description, a specific configuration of the head-mounted display device 100 and functions of the respective configurations will be described below by taking the head-mounted display device 100 as AR glasses as an example.

As shown in fig. 3, the AR glasses include a main body 110, a first wearing seat 120a, and a second wearing seat 120 b. When the AR glasses are worn on the head of the observer through the first wearing seat 120a and the second wearing seat 120b, the observer can see not only the image presented by the display of the AR glasses but also the external physical object through the eyes (the left eye 70a and the right eye 70 b), that is, the virtual-real combination is realized.

Referring to fig. 4, the main body 110 includes a bearing structure 50, a first support structure 60a, and a second support structure 60 b. The first support structure 60a and the second support structure 60b are movably disposed on the load-bearing structure 50. The load bearing structure 50 is used to support the first support structure 60a and the second support structure 60 b. The adjustment unit 42 and the measurement unit 43 are for example arranged between the first support structure 60a and the second support structure 60b, i.e. when the observer wears the AR glasses, the adjustment unit 42 and the measurement unit 43 are located in a position intermediate the left eye 70a and the right eye 70b near the bridge of the nose. The adjustment unit 42 may be used to adjust the position of the first and

second support structures

60a, 60b on the load bearing structure 50 such that the distance between the first and

second support structures

60a, 60b changes. The measuring unit 43 is used to record the distance change between the first support structure 60a and the second support structure 60 b.

The light propagation unit 33 is disposed in each of the first and

second support structures

60a and 60 b. For the sake of distinction, the light propagation unit 33 in the first supporting structure 60a is a first light propagation unit 33a, and the light propagation unit 33 in the second supporting structure 60b is a second light propagation unit 33 b. The first wearing seat 120a and the second wearing seat 120b are both disposed inside the display 31 and the lens group 32, wherein the lens group 32 includes at least one lens for magnifying or reducing an image displayed on the display 31. For differentiation, the display 31 in the first mount 120a is a first display 31a, and the lens group 32 is a first lens group 32 a. The display 31 in the second wearing seat 120b is a second display 31b, and the lens group 32 is a second lens group 32 b. When the observer wears the AR glasses through the first wearing seat 120a and the second wearing seat 120b, the first display 31a and the second display 31b provide display contents for both eyes of the observer, respectively. For example, the first display 31a provides display content for the left eye 70a of the viewer, and the second display 31b provides display content for the right eye 70b of the viewer; alternatively, the first display 31a provides display content for the right eye 70b of the observer, and the second display 31b provides display content for the left eye 70a of the observer, wherein in the embodiments of the present application, the first display 31a provides display content for the left eye 70a of the observer, and the second display 31b provides display content for the right eye 70b of the observer.

The first wearing seat 120a and the second wearing seat 120b are each provided therein with a detection unit 41. For the sake of distinction, the detection unit 41 in the first wearing seat 120a is the first detection unit 41 a. The detection unit 41 in the second wearing seat 120b is a second detection unit 41 b. The embodiment of the present application does not limit the positions of other structures in fig. 2.

Illustratively, when the AR glasses are worn on the head of the observer by the first wearing seat 120a and the second wearing seat 120b, light reflected by the left eye 70a of the observer (indicated by a left broken line arrow in fig. 4) is collected by the first detecting unit 41a through the first light propagation unit 33a, i.e., a picture of the left eye 70a of the observer is displayed on an image plane of the first detecting unit 41 a. The light reflected by the right eye 70b of the observer (indicated by the dashed arrow on the right side in fig. 4) is collected by the second detection unit 41b through the second light propagation unit 33b, i.e., a picture of the right eye 70b of the observer is displayed on the image plane of the second detection unit 41 b.

Then, it is determined whether the optical axis of the left eye 70a coincides with the optical axis of the first display 31a, the optical axes of the lenses in the first lens group 32a, and the optical axis of the first light transmitting unit 33a, and whether the optical axis of the right eye 70b coincides with the optical axis of the second display 31b, the optical axes of the lenses in the second lens group 32b, and the optical axis of the second light transmitting unit 33 b.

The specific judging steps are as follows: referring to fig. 5, before shipping, the AR glasses need to be calibrated, and the calibration is performed to make the optical axis of the left eye of the observer coincide with the optical axis of the first display 31a, the optical axis of each lens in the first lens group 32a, and the optical axis of the first light transmission unit 33a, and to make the optical axis of the right eye of the observer coincide with the optical axis of the second display 31b, the optical axis of each lens in the second lens group 32b, and the optical axis of the second light transmission unit 33 b. The AR glasses are calibrated before shipment by calibrating the interpupillary distance of a normal adult (for example, the interpupillary distance is 63 mm), that is, the interpupillary distance of the observer is 63mm as a default, and when the interpupillary distance is 63mm, the optical axis of the left eye of the observer coincides with the optical axis of the first display 31a, the optical axis of each lens in the first lens group 32a, and the optical axis of the first light propagation unit 33a, and the optical axis of the right eye of the observer coincides with the optical axis of the second display 31b, the optical axis of each lens in the second lens group 32b, and the optical axis of the second light propagation unit 33 b. In other words, the AR glasses are calibrated before shipment so that the optical axes of the human eyes (with a interpupillary distance of 63 mm) coincide with the optical axes of the units in the optical display module 30. That is, in fig. 5, before an observer having a pupil distance of 63mm wears AR glasses, the optical axes of the eyes of the observer coincide with the optical axes of the respective cells in the optical display module (position (r)). However, the interpupillary distances of people of different ages, sexes, and races vary. For example, the minimum interpupillary distance is only 49mm, the maximum interpupillary distance is 74mm, and the variation range is 25 mm. That is, when a new observer is wearing the AR glasses, the interpupillary distance of the new observer may not be 63mm, so further calibration is required to determine whether the optical axis of the new observer's eye coincides with the optical axis of each unit of the optical display module 30 before shipment.

If the interpupillary distance of the new observer is 70 mm, the new observer's eye will change from the position (r) to the position (r), and the new observer's eye will be horizontally displaced from the optical axis by a first distance H1, as represented on the image plane of the detecting unit 41, by H1 pixels. That is, at this time, the optical axis of the left eye 70a does not coincide with the optical axis of the first display 31a, the optical axes of the lenses in the first lens group 32a, and the optical axis of the first light transmitting unit 33a, and the optical axis of the right eye 70b does not coincide with the optical axis of the second display 31b, the optical axes of the lenses in the second lens group 32b, and the optical axis of the second light transmitting unit 33 b.

The detecting unit 41 feeds back the pupil interval deviation value to the control module 10, the control module 10 sends a control signal to the adjusting unit 42, and the adjusting unit 42 adjusts the intervals of the first supporting structure 60a and the second supporting structure 60b according to the control signal so that the optical axis of each structure in the optical display module 30 matches the optical axis of the eye of the new observer even though the optical axis of the eye of the new observer coincides with the optical axis of each structure in the optical display module 30. Alternatively, the control module 10 displays the deviation value on the display 31, and the observer manually controls the adjusting unit 42 by observing the indication information given by the display 31 to change the distance between the first supporting structure 60a and the second supporting structure 60b so that the optical axis of the new observer's eye coincides with the optical axis of each structure in the optical display module 30.

At this time, the measurement unit 43 may record the displacement amounts of the first support structure 60a and the second support structure 60b, calculate the interpupillary distance of the AR glasses after adjustment according to the displacement amounts and the interpupillary distance of the AR glasses before shipment, and then fix the first support structure 60a and the second support structure 60 b.

Then, the AR glasses output the three-dimensional content according to the new interpupillary data. That is, at this time, the light (indicated by the left solid arrow in fig. 4) emitted from the first display 31a is transmitted to the first light propagation unit 33a and then imaged in the left eye 70a of the observer, and the light (indicated by the right solid arrow in fig. 4) emitted from the second display 31b is transmitted to the second light propagation unit 33b and then imaged in the right eye 70b of the observer, completing the 3D (three-dimensional) image display. Since the optical axes of the structures in the optical display module 30 coincide with the optical axis of the observer's eye, the 3D image is a correct 3D image.

Of course, if the interpupillary distance of the new observer is exactly 63mm, the interpupillary distance does not need to be adjusted, and the three-dimensional content may be displayed by operating according to the interpupillary distance before shipping.

The horizontal deviation of the image plane of the detecting unit 41 reflects the horizontal deviation between the optical axis of the observer and the optical axis of each structure in the optical display module 30, so that the adjustment of the AR glasses pupil distance to match the user pupil distance can be guided. The vertical flat deviation of the image plane of the detection unit 41 reflects the vertical deviation of the optical axis of the observer from the optical axes of the respective structures in the optical display module 30, and represents whether the posture of the observer wearing the AR glasses is correct or not. Fig. 5 illustrates only the case where the eye of the observer is horizontally deviated from the optical axis by the first distance H1 and the image plane of the detection unit 41 is horizontally deviated from H1 pixels.

It is understood that when the resolution of the detection unit 41 is sufficiently large, the shift of the pixels may more accurately reflect the deviation of the optical axis of the human eye from the optical axes of the units of the optical display module.

In sum, through the combination of the adjusting unit 42 and the measuring unit 43, the pupil distance of the observer can be accurately determined, and the three-dimensional display content can be adjusted according to the pupil distance of the observer, so as to match the pupil distance of the observer, the display effect is good, the observer is not easy to have fatigue or headache and other problems, and the user experience is improved. In addition, the size and weight of the AR glasses are greatly reduced by the design of the common optical path between the measurement unit 42 and the optical display module 30 (the light transmission unit 33 transmits the light reflected by the eyes and also transmits the light emitted by the display 31).

In addition, referring to fig. 6, the AR glasses further include an early warning module 80. When there is a horizontal deviation between the optical axis of the new observer's eye and the optical axis of each structure in the optical display module 30, the early warning module 80 is used to remind the observer to adjust the distance between the first supporting structure 60a and the second supporting structure 60b through the adjusting unit 42. When the optical axis of the eye of the new observer and the optical axis of each structure in the optical display module 30 have vertical deviation, the early warning module 80 is used for reminding the observer to readjust the wearing posture, so that the user experience is further improved.

In addition, in order to ensure that the images collected by the interpupillary distance detection unit 41 have sufficient brightness, referring to fig. 7, the first support structure 60a and the second support structure 60b are respectively provided with a plurality of light supplement lamps 61, wherein the light supplement lamps 61 include, for example, light emitting diodes that can emit infrared light (700 nm-1200 nm) harmless to human eyes and do not affect the display. The light emitted from the plurality of fill-in lamps 61 illuminates the left eye 70a and the right eye 70b of the observer.

As for the type of the display 31, the embodiment of the present application does not specifically limit the type of the display 31. Exemplary displays 31 include, for example, a Liquid Crystal Display (LCD) panel, an Organic Light Emitting Diode (OLED) Display panel, an LED Display panel including, for example, a Micro-LED Display panel, a Mini-LED Display panel, and the like.

The lens in the lens group 32 may be a plastic lens or a glass lens. When the lens assembly 32 includes a plurality of lenses, the plurality of lenses may be the same or different, that is, they may all be plastic lenses, glass lenses, or a combination of plastic lenses and glass lenses.

As for the type of the light propagation unit 33, the embodiment of the present application does not particularly limit the type of the light propagation unit 33. So long as it can transmit light emitted from the display 31 and light reflected from human eyes and transmit external light.

In one possible implementation, with continued reference to fig. 4, the light propagation unit 33 comprises a waveguide. When the light propagation unit 33 includes a waveguide, the light propagation unit 33 further includes a coupling-in unit 331 and a coupling-out unit 332. The in-coupling unit 331 and the out-coupling unit 332 are both couplers, for example. For the sake of distinction, the coupling-in unit 331 of the first light propagation unit 33a is a first coupling-in unit 331a, and the coupling-out unit 332 is a first coupling-out unit 332 a. The incoupling coupler 331 of the second light propagation unit 33b is a second incoupling coupler 331b, and the outcoupling unit 332 is a second outcoupling unit 332 b. Since one waveguide is shared when the light reflected by the eye is propagated and when the light emitted from the display 31 is propagated, the coupling-out unit 332 for coupling out the light emitted from the display 31 to the human eye and the coupling-in unit 331 for coupling in the light reflected by the eye to the waveguide are also used.

Specifically, the light reflected by the left eye 70a is coupled into the waveguide by the first in-coupling unit 331a, propagates forward in the waveguide in a form of total reflection, is coupled out of the waveguide when reaching the first out-coupling unit 332a, and is imaged at the first detection unit 41a, and the light emitted by the first display 31a is coupled into the waveguide by the first in-coupling unit 331a, propagates forward in the waveguide in a form of total reflection, is coupled out of the waveguide when reaching the first out-coupling unit 332a, and then enters the left eye 70a for imaging. The light reflected by the right eye 70b is coupled into the waveguide by the second in-coupling unit 331b, propagates forward in the waveguide in the form of total reflection, is coupled out of the waveguide when reaching the second out-coupling unit 332b and is imaged at the second detection unit 41b, and the light emitted by the second display 31b is coupled into the waveguide by the second in-coupling unit 331b, propagates forward in the waveguide in the form of total reflection, is coupled out of the waveguide when reaching the second out-coupling unit 332b and enters the right eye 70b for imaging. The AR glasses are relatively small in size because the optical path is folded with the waveguide.

When the light propagation unit 33 includes a waveguide, both the out-coupling unit 332 corresponding to the detection unit 41 and the in-coupling unit 331 corresponding to the optical display module 30 may have separate out-coupling unit 332 and in-coupling unit 331, respectively, as shown in fig. 4. Alternatively, the out-coupling unit 332 corresponding to the detection unit 41 and the in-coupling unit 331 corresponding to the optical display module 30 may be shared, as shown in fig. 8.

With continued reference to fig. 8, when the out-coupling unit 332 corresponding to the detecting unit 41 and the in-coupling unit 331 corresponding to the optical display module 30 are shared, signal separation between the two units needs to be performed in a light splitting manner. I.e. the AR glasses also comprise a beam splitter prism 44. That is, the splitting prism 44 is disposed on a path along which light reflected by the human eye travels and a path along which light emitted from the display 31 travels. Since the light reflected by the human eye (near infrared 780-1100 nm) and the light emitted by the display 31 (visible light 380-780 nm) adopt different wave bands, the light can be split by the splitting prism 44.

Fig. 8 illustrates an example in which the spectral prism 44 is provided only on one side (left side in fig. 8) of the AR glasses.

When the light propagation unit 33 includes a waveguide, the waveguide may be a geometric waveguide and a diffractive waveguide (a volume holographic waveguide, a surface relief grating), and the waveguide may have an expanding pupil in a one-dimensional expanding pupil or a two-dimensional expanding pupil, which is not limited in the embodiment of the present application.

In yet another possible implementation, referring to fig. 9, the light propagation unit 33 includes a free-form surface prism. The light reflected by the human eye and the light emitted from the display 31 are propagated through the free-form surface prism.

In yet another possible implementation, referring to fig. 10, the light propagation unit 33 includes a free-form surface mirror. The light reflected by the human eye and the light emitted by the display 31 are propagated by the free-form surface mirror.

As for the type of the detection unit 41, the embodiment of the present application does not limit the type of the detection unit 41.

In one possible implementation, with continued reference to fig. 4, the detection unit 41 comprises a camera including a lens group 411 and an image sensor 412. The image of human eyes is collected through a camera, and whether the human eyes deviate or not is judged.

As for the specific structure of the adjusting unit 42, the specific structure of the adjusting unit 42 is not limited in the embodiment of the present application. For example, the adjusting unit 42 is a gear by which the first support structure 60a and the second support structure 60b are moved away from or close to each other, that is, the interval between the first support structure 60a and the second support structure 60b is changed so that the optical axis of the eye of the observer coincides with the optical axis of each structure in the optical display module 30 of the optical display module 30.

The embodiment of the present application does not limit how to determine the interpupillary distance of the adjusted AR glasses.

In one possible implementation, referring to fig. 11, the measurement unit 43 comprises a grating scale. The grating scale is composed of a scale grating 431 and a grating reading head. The grating readhead includes a light source 432, a condenser lens 433, an indicator grating 434, a light sensitive element 435, and a drive circuit 436.

When the adjustment unit 42 moves the first support structure 60a and the second support structure 60b, the scale grating 431 is pulled to move, and the scale grating 431 moves. Bright and dark stripes are generated on the photosensitive elements 435 to determine the amount of displacement by which the first and

second support structures

60a and 60b are moved. For the principle of determining the displacement amounts of the first supporting structure 60a and the second supporting structure 60b by using the grating ruler, reference may be made to the technical solutions in the embodiments of the prior art, and details of the embodiments of the present application are not repeated.

The accuracy of determining the displacement amounts of the first support structure 60a and the second support structure 60b by the grating ruler is high.

Furthermore, in order to provide a more comfortable use experience for the observer with visual defects (myopia, hyperopia, astigmatism, etc.). Referring to fig. 12, the AR glasses further include a diopter adjustment module 90. The visibility compensation is performed by the visibility adjustment module 90 to meet the needs of different observers.

Regarding the type and the setting position of the visibility adjustment module 90, the embodiment of the present application does not limit the type and the setting position of the visibility adjustment module 90.

In one possible implementation, with continued reference to fig. 12, the diopter adjustment module 90 includes two detachable lenses 91, the two detachable lenses 91 being detachably disposed on the sides of the first support structure 60a and the second support structure 60b facing the human eye. That is, the respective lenses are customized for different users. Illustratively, when the observer is a myopic observer, the left and right eyes are both at 200 °. It is sufficient to arrange the 200 deg. lenses on the side of the first and

second support structures

60a and 60b facing the human eye. When the observer is a myopia, the degrees of the left and right eyes are 300 degrees. It is sufficient to arrange the 300 deg. lenses on the side of the first and

second support structures

60a, 60b facing the human eye.

In yet another possible implementation, referring to fig. 13, the diopter adjustment module 90 includes two tunable lens groups 92, each tunable lens group 92 includes a first tunable lens 921 and a second tunable lens 921, wherein the first tunable lens 921 and the second tunable lens 922 in one tunable lens group 92 are fixed on two opposite sides of the first support structure 60 a. The first tunable lens 921 and the second tunable lens 922 of the other set of tunable lens groups 92 are fixed to opposite sides of the second support structure 60 b. The second tunable lens 922 is used to adjust the virtual image distance. The combination of the first tunable lens 921 and the second tunable lens 922 ensures that the focal power of the external light passing through the first tunable lens 921 and the second tunable lens 922 is zero.

Because the tunable lens can directly change the corresponding power according to the voltage, different lenses do not need to be replaced aiming at different users with eyesight defects.

The embodiments of the present application also provide a method for controlling a head-mounted display device, which can be applied to the head-mounted display device in the embodiments, for example, and have the same beneficial effects, and details not described in detail in the embodiments may refer to the embodiments of the head-mounted display device described above. The following describes a method for controlling the head-mounted display device with reference to the head-mounted display device shown in fig. 4 and 7.

As shown in fig. 14, the method for controlling the head-mounted display device may be implemented by:

s1401, the control module controls the light supplement lamp to be turned on, wherein the pupil interval of the AR glasses is the preset eye pupil interval.

When a new observer wears the AR glasses, the control module 10 controls the light supplement lamps 61 to be turned on, and the left eye 70a and the right eye 70b of the observer are illuminated by light emitted by the light supplement lamps 61.

Prior to step S1401, the method further includes: and calibrating the AR glasses before leaving the factory. That is, the optical axis of the left eye of the observer coincides with the optical axis of the first display 31a, the optical axis of each lens in the first lens group 32a, and the optical axis of the first light transmitting unit 33a, and the optical axis of the right eye of the observer coincides with the optical axis of the second display 31b, the optical axis of each lens in the second lens group 32b, and the optical axis of the second light transmitting unit 33b, at a preset human eye interpupillary distance (e.g., 63mm, the pupil distance of a normal adult). And when it is determined that the optical axis of the left eye coincides with the optical axis of the first display 31a, the optical axis of each lens in the first lens group 32a, and the optical axis of the first light transmitting unit 33a, and the optical axis of the right eye coincides with the optical axis of the second display 31b, the optical axis of each lens in the second lens group 32b, and the optical axis of the second light transmitting unit 33b, the position of the left eye (the pupil interval of the observer is 63 mm) of the observer at the image plane of the first detecting unit 41a, that is, the first preset position, and the position of the right eye at the image plane of the second detecting unit 41b, that is, the second preset position, are determined. When a new observer wears AR glasses, further calibration is required to determine if the optical axes of the new observer's eyes coincide before shipment, since the actual human interpupillary distance of the observer at this time may not be 63 mm. The method comprises the following steps.

S1402, the first detecting unit and the second detecting unit capture images of left and right eyes of an observer, respectively.

The light reflected by the left eye 70a of the observer (indicated by a left broken-line arrow in fig. 4) is collected by the first detection unit 41a through the first light propagation unit 33a, i.e., a picture of the left eye 70a of the observer is displayed on the image plane of the first detection unit 41 a. The light reflected by the right eye 70b of the observer (indicated by the dashed arrow on the right side in fig. 4) is collected by the second detection unit 41b through the second light propagation unit 33b, i.e., a picture of the right eye 70b of the observer is displayed on the image plane of the second detection unit 41 b.

S1403, the first detecting unit determines whether the optical axis of the left eye coincides with the optical axis of the first display, the optical axes of the lenses in the first lens group, and the optical axis of the first light transmitting unit, and the second detecting unit determines whether the right eye 70b coincides with the optical axis of the second display, the optical axes of the lenses in the second lens group, and the optical axis of the second light transmitting unit; if yes, go to step S1407; if not, go to step S1404.

The first detecting unit 41a compares the actually captured image of the left eye 70a with a first preset position, and the second detecting unit 41b compares the actually captured image of the right eye 70b with a second preset position.

If the image of the left eye 70a deviates from the first preset position and the image of the right eye 70b deviates from the second preset position, for example, by h1 pixels, it means that the optical axis of the left eye 70a does not coincide with the optical axis of the first display 31a, the optical axis of each lens in the first lens group 32a, and the optical axis of the first light propagation unit 33a, and that the optical axis of the right eye 70b does not coincide with the optical axis of the second display 31b, the optical axis of each lens in the second lens group 32b, and the optical axis of the second light propagation unit 33 b. The distance between the first support structure 60a and the second support structure 60b needs to be adjusted by the adjustment unit 42 at this time.

If the image of the left eye 70a coincides with the first preset position and the image of the right eye 70b coincides with the second preset position, it is described whether the optical axis of the left eye 70a coincides with the optical axis of the first display 31a, the optical axes of the lenses in the first lens group 32a, and the optical axis of the first light transmitting unit 33a, and the right eye 70b coincides with the optical axis of the second display 31b, the optical axes of the lenses in the second lens group 32b, and the optical axis of the second light transmitting unit 33 b. There is no need to adjust the spacing between the first support structure 60a and the second support structure 60 b.

S1404, the control module automatically adjusts the distance between the first support structure and the second support structure through the adjusting unit or instructs an observer to manually adjust the adjusting unit through the display and/or the early warning module so as to change the distance between the first support structure and the second support structure; while the measuring unit records the displacement of the first and second support structures.

When the distance between the first support structure 60a and the second support structure 60b needs to be adjusted by the adjustment unit 42, the first detection unit 41a and the second detection unit 41 determine the offset amount and send the offset amount to the control module 10. The control module 10 determines the distance that the adjustment unit 42 needs to adjust based on the offset, i.e. the distance between the first support structure 60a and the second support structure 60b is adjusted by the adjustment unit 42. The control module 10 may be adjusted by providing some driving module or the like, or directly controlling the adjusting unit 42, so as to change the distance between the first supporting structure 60a and the second supporting structure 60 b. Alternatively, the control module 10 displays the distance to be adjusted through the display 31, and the observer manually adjusts the adjusting unit 42 according to the displayed content, so that the distance between the first support structure 60a and the second support structure 60b is changed.

While the spacing between the first support structure 60a and the second support structure 60b is changed, the measurement unit 43 monitors the amount of displacement of the first support structure 60a and the second support structure 60 b.

S1405, after the adjustment, the first detecting unit continues to determine whether the optical axis of the left eye coincides with the optical axis of the first display, the optical axes of the lenses in the first lens group, and the optical axis of the first light transmitting unit, and the second detecting unit determines whether the optical axis of the right eye coincides with the optical axis of the second display, the optical axes of the lenses in the second lens group, and the optical axis of the second light transmitting unit, if yes, step S1406 is executed; if not, go to step S1404.

In order to improve the adjustment accuracy, the adjustment unit 42 is prevented from adjusting the distance between the first support structure 60a and the second support structure 60b, which causes an error or the like, so that the displacement amounts of the first support structure 60a and the second support structure 60b do not satisfy the distance to be adjusted. Therefore, after further adjustment, it is necessary to determine whether the optical axis of the left eye 70a coincides with the optical axis of the first display 31a, the optical axes of the lenses in the first lens group 32a, and the optical axis of the first light transmitting unit 33a, and whether the optical axis of the right eye 70b coincides with the optical axis of the second display 31b, the optical axes of the lenses in the second lens group 32b, and the optical axis of the second light transmitting unit 33 b.

If not, the adjustment is continued according to the above steps so that the optical axis of the left eye 70a coincides with the optical axis of the first display 31a, the optical axes of the lenses in the first lens group 32a, and the optical axis of the first light propagation unit 33a, and the optical axis of the right eye 70b coincides with the optical axis of the second display 31b, the optical axes of the lenses in the second lens group 32b, and the optical axis of the second light propagation unit 33 b.

If so, no adjustment is required.

And S1406, the control module determines the adjusted interpupillary distance, and fixes the first support structure and the second support structure to complete primary interpupillary distance adjustment.

As can be seen from the description of fig. 1, only when the actual human eye pupil distance is determined and the virtual object is displayed based on the actual human eye pupil distance, the distance of the virtual object displayed on the display 31 is the same as the distance perceived by the human eye. Therefore, the interpupillary distance of the AR glasses after adjustment needs to be determined (the optical path is overlapped, and therefore the interpupillary distance is the same as the actual interpupillary distance of the human eye). By adjusting the previous interpupillary distance and the displacement amount of the first and

second support structures

60a and 60b, the accurate interpupillary distance (the actual interpupillary distance of the observer) can be calculated. At this point, the adjustment is complete. The first and

second support structures

60a and 60b may be fixed.

S1407, the control module controls the light supplement lamp and the first detection unit and the second detection unit to be closed, light emitted by the first display is transmitted to the first light transmission unit and then imaged at the left eye of an observer, light emitted by the second display is transmitted to the second light transmission unit and then imaged at the right eye of the observer, and 3D image display is completed.

In order not to affect the display and save energy, after the interpupillary distance adjustment is completed, the control module 10 controls the fill-in light 61 and the first and second detecting

units

41a and 41b to turn off. Then, the light emitted from the first display 31a is transmitted to the first light propagation unit 33a and then imaged at the left eye 70a of the observer, and the light emitted from the second display 31b is transmitted to the second light propagation unit 33b and then imaged at the right eye 70b of the observer, completing the 3D image display.

Because the 3D image that shows is based on the interpupillary distance of new observer and confirms, the display effect is good, and the observer is difficult to produce tired or headache scheduling problem, promotes user experience.

Further, it is considered that an uncontrollable error occurs in adjusting the interpupillary distance of the AR glasses. Each time the interpupillary distance is adjusted, the last measurement result is required to be relied on, and the accumulated error is larger and larger. Therefore, to avoid systematic errors affecting the adjustment accuracy. The method for controlling the head-mounted display device further comprises the following steps:

the control module judges whether the interpupillary distance adjustment times exceed preset times;

if the pupil interval adjustment times exceed the preset times, the control module automatically adjusts the pupil interval of the first support structure and the second support structure through the adjusting unit so that the interval between the first support structure and the second support structure is the preset human eye pupil interval; or the control module prompts an observer to manually adjust the unit so that the distance between the first support structure and the second support structure is the preset human eye pupil distance.

When the times of pupil interval adjustment exceed the preset times, the pupil interval of the AR glasses can be restored to the pupil interval when leaving the factory, so that the influence of system errors on the adjustment precision is avoided. In which, a person skilled in the art may set the preset times according to the actual situation, and the embodiment of the present application is not limited thereto.

When the pupil interval adjustment times exceed the preset times, the control module 10 automatically adjusts the interval between the first support structure 60a and the second support structure 60b through the adjustment unit 42, so that the pupil interval of the AR glasses is restored to the factory-ready pupil interval, i.e., the preset eye pupil interval. Alternatively, the control module 10 instructs the observer to manually adjust the adjusting unit 42 through the display 31 and/or the early warning module 80, so as to restore the interpupillary distance of the AR glasses to the factory interpupillary distance, that is, the preset eye interpupillary distance. Alternatively, when the observer feels obviously that the current device interpupillary distance (dizziness, eye fatigue, or the like) does not match the self interpupillary distance, the observer manually adjusts the adjustment unit 42 to restore the interpupillary distance of the AR glasses to the interpupillary distance at the time of factory shipment, that is, the preset human eye interpupillary distance.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A head-mounted display device, comprising: a load bearing structure, a first support structure and a second support structure; the first supporting structure and the second supporting structure are movably arranged on the bearing structure;

further comprising: the device comprises a control module, an optical display module and a measurement adjusting module; the optical display module comprises a first display, a first light transmission unit, a second display and a second light transmission unit; the measurement adjusting module comprises a first detecting unit, a second detecting unit, a measuring unit and an adjusting unit;

the first light transmission unit is arranged in the first supporting structure, and the second light transmission unit is arranged in the second supporting structure;

light reflected by the left eye of an observer is imaged on the image plane of the first detection unit through the first light transmission unit, and light reflected by the right eye of the observer is imaged on the second detection unit through the second light transmission unit;

when the image formed by the image plane of the first detection unit is different from a first preset position, and the image formed by the image plane of the second detection unit is different from a second preset position, the adjusting unit is used for adjusting the positions of the first supporting structure and the second supporting structure on the bearing structure, so that the image formed by the image plane of the first detection unit is the same as the first preset position, and the image formed by the image plane of the second detection unit is the same as the second preset position; the measuring unit is used for recording the displacement of the first supporting structure and the second supporting structure; the first preset position is the position of the optical axes of the first display and the first light transmission unit on the image surface of the first detection unit when the interpupillary distance of the head-mounted display device is the preset interpupillary distance of the human eyes; the second preset position is a position of the optical axes of the second display and the second light transmission unit on the image plane of the second detection unit when the interpupillary distance of the head-mounted display device is the preset interpupillary distance of the human eyes;

when the image formed by the image surface of the first detection unit is the same as a first preset position and the image formed by the image surface of the second detection unit is the same as a second preset position, the control module is used for determining an actual human eye pupil distance according to the displacement and the preset human eye pupil distance;

based on the actual human eye interpupillary distance, the light emitted by the first display is collected by the left eye of the observer through the first light propagation unit; and the light emitted by the second display is collected by the right eye of the observer through the second light propagation unit.

2. The head-mounted display device according to claim 1, further comprising: an early warning module;

when the image formed by the image plane of the first detection unit is different from the first preset position, and the image formed by the image plane of the second detection unit is different from the second preset position, the early warning module is used for reminding the observer to readjust the posture of wearing the head-mounted display device.

3. The head-mounted display device according to claim 1, further comprising a plurality of fill-in lamps, wherein the first support structure and the second support structure are respectively provided with a plurality of fill-in lamps at a side facing the observer;

the left eye and the right eye are illuminated by light rays emitted by the light supplementing lamps.

4. The head-mounted display device of claim 1, wherein the first light propagating unit and the second light propagating unit each comprise a waveguide.

5. The head-mounted display device according to claim 4, further comprising a plurality of fill-in lamps, wherein the first support structure and the second support structure are respectively provided with a plurality of fill-in lamps at a side facing the observer; the left eye and the right eye are illuminated by light rays emitted by the light supplementing lamps;

the first light propagation unit comprises a first coupling-in unit and a first coupling-out unit;

the second light propagation unit comprises a second coupling-in unit and a second coupling-out unit;

when the first coupling-out unit corresponding to the first detection unit and the first coupling-in unit corresponding to the first display are shared, the head-mounted display device further comprises a beam splitter prism; the beam splitting prism is arranged on a path for transmitting the light reflected by the left eye and a path for transmitting the light emitted by the first display;

when the second coupling-out unit corresponding to the second detection unit and the second coupling-in unit corresponding to the second display are shared, the head-mounted display device further comprises a beam splitter prism; the beam splitting prism is arranged on a path where the light reflected by the right eye propagates and on a path where the light emitted by the second display propagates.

6. The head-mounted display device of claim 1, wherein the first and second light propagating units each comprise a freeform prism; or,

the first light propagation unit and the second light propagation unit both include a free-form surface reflector.

7. The head-mounted display device of claim 1, wherein the measurement unit comprises a grating scale.

8. The head-mounted display device of claim 1, further comprising a visibility adjustment module for performing visibility compensation.

9. The head-mounted display device of claim 8, wherein the visibility adjustment module comprises two detachable lenses; the two detachable lenses are detachably arranged on one sides of the first supporting structure and the second supporting structure facing the observer.

10. The head-mounted display device of claim 8, wherein the diopter adjustment module comprises two sets of tunable lenses; each group of tunable lens groups comprises a first tunable lens and a second tunable lens, wherein the first tunable lens and the second tunable lens in one group of tunable lens groups are fixed on two opposite sides of the first supporting structure; the first tunable lens and the second tunable lens in the other group of tunable lens groups are fixed on two opposite sides of the second support structure.

11. A method for controlling a head-mounted display device, which is applied to the head-mounted display device according to any one of claims 1 to 10;

the control method of the head-mounted display device comprises the following steps:

collecting pictures of the left eye and the right eye; the interpupillary distance of the head-mounted display device is a preset interpupillary distance of human eyes;

judging whether the left-eye picture is the same as the first preset position or not and whether the right-eye picture is the same as the second preset position or not;

if the left-eye picture is different from the first preset position and the right-eye picture is different from the second preset position, controlling an adjusting unit to adjust the positions of the first supporting structure and the second supporting structure on the bearing structure so as to enable the left-eye picture to be the same as the first preset position and the right-eye picture to be the same as the second preset position; and recording the displacement of the first and second support structures;

determining the actual human eye pupil distance according to the displacement and the preset human eye pupil distance;

controlling the first display to emit light based on the actual human eye interpupillary distance, so that the light emitted by the first display is collected by the left eye through the first light propagation unit; and controlling the second display to emit light so that the light emitted by the second display is collected by the right eye through the second light transmission unit.

12. The control method according to claim 11, wherein if the left eye picture is the same as the first preset position and the right eye picture is the same as the second preset position, controlling the first display to emit light based on the preset eye pupil distance, so that the light emitted by the first display is collected by the left eye through the first light propagation unit; and controlling the second display to emit light so that the light emitted by the second display is collected by the right eye through the second light transmission unit.

13. The control method according to claim 11, before determining an actual human eye pupillary distance based on the displacement amount and the preset human eye pupillary distance, further comprising:

if the picture of the left eye is different from the first preset position, and the picture of the right eye is different from the second preset position, the step of repeatedly executing the control and adjustment unit to adjust the first supporting structure and the second supporting structure to be located at the position of the bearing structure and record the displacement of the first supporting structure and the second supporting structure is repeated until the picture of the left eye is the same as the first preset position, and the picture of the right eye is the same as the second preset position.

14. The control method according to claim 11, characterized by further comprising: judging whether the interpupillary distance adjustment times exceed preset times or not;

if the pupil interval adjustment times exceed the preset times, adjusting the interval between the first support structure and the second support structure through the adjusting unit so as to enable the interval between the first support structure and the second support structure to be the preset human eye pupil interval; or prompting the observer to manually adjust the unit so that the distance between the first support structure and the second support structure is the preset human eye pupil distance.