MR glasses with high accuracy motion tracking locate function
Technical Field
The invention mainly relates to the technical field of MR (magnetic resonance) glasses, in particular to an MR glasses with a high-precision motion tracking and positioning function.
Background
The mixed virtual reality, namely MR, is a combination of virtual reality VR and augmented reality AR, and MR glasses comprehensively utilize a plurality of image sensors to enable people to be immersed in a three-dimensional visual environment after superposition of real world and virtual matters.
According to an anti-dizziness MR glasses provided in patent document No. CN201921619690.3, the product comprises a glasses body and an anti-dizziness device, wherein the anti-dizziness device is detachable on the glasses body; the anti-dizziness device comprises a front-view anti-dizziness structure and a side-view anti-dizziness structure, wherein the front-view anti-dizziness structure comprises lenses and a lens frame, the lens frame is coated on the peripheries of the lenses, the lens frame is a hollow transparent structure, the side-view anti-dizziness structure is a hollow transparent box, and balance liquid is filled in the lens frame and the transparent box. The MR glasses provide the anti-dizziness MR glasses which can greatly reduce the dizziness feeling of a human body after wearing the MR glasses.
However, the above MR glasses still have drawbacks, for example, although the above MR glasses provide an anti-dizziness MR glasses that can greatly reduce the dizziness feeling of a human body after wearing the MR glasses, the conventional MR glasses lack a motion tracking function for a wearer, resulting in insufficient sensitivity when the glasses are used. The play feeling is reduced.
Disclosure of Invention
The invention mainly provides MR glasses with high-precision motion tracking and positioning functions, which are used for solving the technical problems in the background technology.
The technical scheme adopted for solving the technical problems is as follows:
an MR (magnetic resonance) glasses with high-precision motion tracking and positioning functions comprises a glasses frame and glasses legs fixed on two sides of the glasses frame, wherein a head motion tracking device and an analysis device are sequentially arranged on a shell of each glasses leg in a penetrating manner, an eyeball tracking device fixed on the shell of the glasses frame and two OLED (organic light emitting diode) display screens embedded in the shell of the glasses frame are arranged between the two analysis devices;
the eyeball tracking device is used for capturing eyeball images of a wearer and outputting the eyeball images to the analysis device;
the head motion tracking device is used for capturing dynamic change information of the sight of a wearer and transmitting the dynamic change information to the analysis device, wherein the dynamic change information comprises the deflection distance of the sight direction and the rotation angular speed of the head;
the analysis device is used for receiving the eyeball image output by the eyeball tracking device, judging whether the eyeball continuously gazes at the OLED display screen for a preset time according to the eyeball image, and controlling the OLED display screen to be closed if the preset time is reached, and also used for receiving the dynamic change information sent by the head movement tracking device and generating the operation for controlling the OLED display screen according to the dynamic change information.
Further, the eyeball tracking device comprises a camera and a sending module;
the camera is used for shooting eyeball images of a wearer;
and the first sending module is used for transmitting the eyeball image to an analysis device.
Further, the head motion tracking device comprises a gyroscope and a second sending module;
a gyroscope for capturing dynamic change information of the wearer's gaze;
and the second sending module is used for transmitting the dynamic change information to the analysis device.
Further, the analysis device comprises a first judgment module and a first switch module;
the first judging module is used for receiving the eyeball image, judging human eye position data and eyeball position data according to the eyeball image, and judging whether the eyeball continuously looks at the OLED display screen for a preset time or not according to the human eye position data and the eyeball position data;
and the switch module is used for controlling the OLED display screen to be turned off when the preset time is reached.
Further, the analysis device also comprises a closing alarm module;
the closing alarm module is used for sending closing prompt information to the OLED display screen within the preset time when the eyeball continuously looks at the OLED display screen, and the preset value of the closing prompt information sent by the eyeball within the preset time when the eyeball continuously looks at the OLED display screen is 120-250 seconds.
Further, the analysis device further comprises a second judging module
The second judging module is used for receiving the dynamic change information sent by the head motion tracking device;
the switching module judges head movements according to the dynamic change information and generates operation instructions for controlling the OLED display screen according to the head movements, wherein the head movements comprise head tilting movements and head lowering movements, the head tilting movements serve as confirmation movements, and the head lowering movements serve as cancellation movements.
Further, the analysis device also comprises a GPS chip, wherein the GPS chip is used for determining the position information of the wearer.
Further, the analysis device further comprises a summarizing module, wherein the summarizing module is used for summarizing the position information, the dynamic change information and the eyeball image of the wearer so as to obtain the distance between the current position of the wearer and the position of the corresponding article.
Further, the GPS chip rotates the moving speed of the wearer to reach the preset speed, and the gyroscope judges that the angular displacement speed of the head of the wearer reaches the preset speed, so that the operation command of the analysis device to the OLED display screen is stopped.
Further, the position information includes posture data, triaxial speed and triaxial position data of the wearer.
Compared with the prior art, the invention has the beneficial effects that:
according to the invention, the eye position data and the eyeball position data can be obtained according to the eyeball image, so that the operation command of the OLED display screen can be obtained by positioning the fast-moving eyeballs.
Secondly, the invention can position with high precision according to the movement of the head of the wearer to obtain the dynamic change information of the sight line, and obtain the operation command to the OLED display screen according to the dynamic change information.
Thirdly, the invention gathers the motion tracking information of the eyeballs, the body and the head to obtain the position information, the dynamic change information and the eyeball image of the wearer so as to obtain the distance between the current position of the wearer and the position of the corresponding article, so that the distance between the current position of the wearer and the position of the corresponding article is fused into the virtual display environment displayed by the OLED display screen to correct the deviation, and the positioning accuracy of the position information, the dynamic change information and the eyeball image is further improved.
The invention will be explained in detail below with reference to the drawings and specific embodiments.
Drawings
FIG. 1 is a schematic diagram of the structure of the present invention;
FIG. 2 is a flow chart of the present invention;
FIG. 3 is a schematic diagram of an eye tracking device according to the present invention;
FIG. 4 is a schematic view of a head motion tracking apparatus of the present invention;
FIG. 5 is a schematic diagram of an analysis device according to the present invention.
In the figure: 10. a frame; 20. a temple; 30. an analysis device; 31. a first judgment module; 32. a first switch module; 33. closing the alarm module; 34. a second judging module; 35. a switching module; 36. a GPS chip; 37. a summarizing module; 40. an eyeball tracking device; 41. a camera; 42. a transmitting module; 50. an OLED display screen; 60. a head motion tracking device; 61. a gyroscope; 62. and a second transmitting module.
Detailed Description
In order that the invention may be more fully understood, a more particular description of the invention will be rendered by reference to the appended drawings, in which several embodiments of the invention are illustrated, but which may be embodied in different forms and are not limited to the embodiments described herein, which are, on the contrary, provided to provide a more thorough and complete disclosure of the invention.
It will be understood that when an element is referred to as being "mounted" on another element, it can be directly on the other element or intervening elements may be present, and when an element is referred to as being "connected" to the other element, it may be directly connected to the other element or intervening elements may also be present, the terms "vertical", "horizontal", "left", "right" and the like are used herein for the purpose of illustration only.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly connected to one of ordinary skill in the art to which this invention belongs, and the knowledge of terms used in the description of this invention herein for the purpose of describing particular embodiments is not intended to limit the invention, and the term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
Referring to fig. 1-5, in a preferred embodiment of the present invention, an MR glasses with high precision motion tracking and positioning function includes a glasses frame 10, and glasses legs 20 fixed on two sides of the glasses frame 10, wherein a head motion tracking device 60 and an analysis device 30 are sequentially arranged on a housing of the glasses legs 20, an eyeball tracking device 40 fixed on the housing of the glasses frame 10 and two OLED display screens 50 embedded on the housing of the glasses frame 10 are arranged between the two analysis devices 30;
an eye tracking device 40 for capturing an eye image of a wearer and outputting the eye image worn to the analysis device 30;
head movement tracking means 60 for capturing dynamic change information of the wearer's gaze including gaze direction deflection distance and head rotational angular velocity, and transmitting the dynamic change information to analysis means 30;
the analysis device 30 is configured to receive the eyeball image output by the eyeball tracking device 40, determine whether the eyeball continuously looks at the OLED display screen 50 for a predetermined time according to the eyeball image, and control the OLED display screen 50 to be turned off if the predetermined time is reached, and the analysis device 30 is further configured to receive the dynamic change information sent by the head movement tracking device 60, and generate an operation for controlling the OLED display screen 50 according to the dynamic change information;
further, the eye tracking device 40 includes a camera 41 and a transmitting module 42;
a camera 41 for taking an eyeball image of a wearer;
a first transmitting module 42 for transmitting the eyeball image to the analysis device 30.
Further, the head motion tracking device 60 includes a gyroscope 61 and a second transmitting module 62;
a gyroscope 61 for capturing dynamic information of the line of sight of the wearer;
a second sending module 62, configured to transmit the dynamic change information to the analysis device 30.
Further, the analysis device 30 includes a first judgment module 31 and a first switch module 32;
a first judging module 31, configured to receive the eyeball image, and judge, according to the eyeball image, human eye position data and eyeball position data, and judge whether the eyeball continuously gazes at the OLED display 50 for a predetermined time through the human eye position data and the eyeball position data;
the switch module 32 is used for controlling the OLED display screen 50 to be turned off when a preset time is reached.
Further, the analysis device 30 further comprises a closing alarm module 33;
the closing alarm module 33 is configured to send a closing prompt message to the OLED display screen 50 within a predetermined time period when the eyeball continuously gazes at the OLED display screen 50, where the eyeball sends the closing prompt message within the predetermined time period when the eyeball continuously gazes at the OLED display screen 50, where the preset value of the closing prompt message is 120 seconds to 250 seconds, so as to remind the wearer of timely performing a physical action through the closing prompt message, so as to prevent the wearer from automatically closing the glasses when the wearer uses the glasses.
Further, the analysis device 30 further includes a second determination module 34
A second judging module 34, configured to receive the dynamic change information sent by the head motion tracking device 60;
the switching module 35 determines a head motion according to the dynamic change information, and generates an operation instruction for controlling the OLED display 50 according to the head motion, wherein the head motion includes a head-up motion and a head-down motion, the head-up motion is used as a confirmation motion, and the head-down motion is used as a cancel motion, so as to confirm the operation instruction of the OLED display 50 through the confirmation motion and the cancel motion.
Further, the analyzing device 30 further comprises a GPS chip 36, and the GPS chip 36 is used for determining the position information of the wearer.
Further, the analyzing device 30 further includes a summarizing module 37, where the summarizing module 37 is configured to summarize the position information, dynamic change information, and eyeball images of the wearer to obtain the distance between the current position of the wearer and the corresponding object position, and summarize the high-precision positioning performed on the eyeballs, the body, and the head by the wearer to obtain the position information, the dynamic change information, and the eyeball images of the wearer to obtain the distance between the current position of the wearer and the corresponding object position, so as to fuse the distance between the current position of the wearer and the corresponding object position to the virtual display environment displayed by the OLED display screen to perform correction, thereby further improving the positioning precision of the position information, the dynamic change information, and the eyeball images.
Further, the GPS chip 36 rotates to reach a preset speed, and the gyroscope 61 determines that the angular displacement speed of the head of the wearer reaches the preset speed, so as to stop the operation command of the analysis device 30 on the OLED display 50.
Further, the position information includes posture data, triaxial speed and triaxial position data of the wearer.
The specific operation mode of the invention is as follows:
when using the MR glasses, firstly, the glasses legs 20 are put on the ears of a wearer, the glasses frame 10 is mounted on the face, the eyeball image of the wearer is captured by the eyeball tracking device 40, and the eyeball image which is worn is output to the analysis device 30;
capturing dynamic change information of the wearer's gaze by the head movement tracking device 60 and transmitting the dynamic change information to the analysis device 30;
the analysis device 30 receives the eyeball image output by the eyeball tracking device 40, judges whether the eyeball continuously looks at the OLED display screen 50 for a preset time according to the eyeball image, controls the OLED display screen 50 to be turned off if the preset time is reached, and the analysis device 30 receives the dynamic change information sent by the head movement tracking device 60 and generates and controls the operation of the OLED display screen 50 according to the dynamic change information.
While the invention has been described above with reference to the accompanying drawings, it will be apparent that the invention is not limited to the embodiments described above, but is intended to be within the scope of the invention, as long as such insubstantial modifications are made by the method concepts and technical solutions of the invention, or the concepts and technical solutions of the invention are applied directly to other occasions without any modifications.