CN111221418B - Method and device for entering VR helmet to hide menu and VR helmet - Google Patents

Method and device for entering VR helmet to hide menu and VR helmet Download PDF

Info

Publication number
CN111221418B
CN111221418B CN202010027439.9A CN202010027439A CN111221418B CN 111221418 B CN111221418 B CN 111221418B CN 202010027439 A CN202010027439 A CN 202010027439A CN 111221418 B CN111221418 B CN 111221418B
Authority
CN
China
Prior art keywords
data
helmet
motion
motion gesture
gyroscope
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010027439.9A
Other languages
Chinese (zh)
Other versions
CN111221418A (en
Inventor
廖镇南
侯实
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Jiqu Information Technology Co ltd
Original Assignee
Guangzhou Jiqu Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Jiqu Information Technology Co ltd filed Critical Guangzhou Jiqu Information Technology Co ltd
Priority to CN202010027439.9A priority Critical patent/CN111221418B/en
Publication of CN111221418A publication Critical patent/CN111221418A/en
Application granted granted Critical
Publication of CN111221418B publication Critical patent/CN111221418B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention discloses a method and a device for entering a VR helmet hidden menu based on motion perception detection and a VR helmet, wherein the method comprises the following steps: resetting states of a gyroscope, an acceleration sensor and the infrared sensor which are arranged on the VR helmet; triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not; and if so, checking the movement posture data, and entering a hidden interface of the VR helmet after the checking is correct. In the embodiment of the invention, a novel mode of entering a hidden menu is provided for the VR helmet by providing a safe and convenient motion gesture sensing mode, so that the defects that the original scheme is easy to operate by mistake, easy to be deciphered and the like are overcome.

Description

Method and device for entering VR helmet to hide menu and VR helmet
Technical Field
The invention relates to the technical field of VR helmets, in particular to a method and a device for entering a VR helmet to hide a menu based on motion perception detection and a VR helmet.
Background
Virtual Reality, VR for short, is a technology for providing immersion feeling in an interactive three-dimensional environment generated on a computer by comprehensively utilizing a computer graphics system and various interface devices such as Reality and control; the virtual reality technology is an important direction of simulation technology, is a set of multiple technologies such as simulation technology, computer graphics man-machine interface technology, multimedia technology, sensing technology network technology and the like, and is a challenging crossover technology leading-edge subject and research field; virtual reality technology (VR) mainly includes aspects of simulating environments, perception, natural skills, sensing devices, and the like. The simulated environment is a computer-generated, real-time, dynamic three-dimensional realistic image. In addition to the visual perception generated by computer graphics technology, there are also auditory, tactile, force, motion, etc. sensations, even including olfactory and gustatory sensations, etc., also known as multi-sensations. Natural skills refer to human head rotation, eye, hand gestures, or other human behavioral actions, and data corresponding to the actions of the participants are processed by a computer, and are responded to user inputs in real time and fed back to the user's five sense organs, respectively. The sensing device refers to a three-dimensional interaction device.
VR devices can be divided into three categories: external head-mounted equipment, integrated head-mounted equipment and mobile end display equipment. The mobile terminal display device is popular in the market due to simple structure and low price, and can be watched only by accessing a mobile phone, so that the mobile terminal display device is convenient to use. The VR mobile end display device mainly refers to VR glasses, the VR glasses are used for sealing the outside vision and hearing of a person by using the head-mounted display device, a user is guided to generate a feeling of a body in a virtual environment, the display principle is that left and right eye screens respectively display left and right eye images, and human eyes generate a stereoscopic impression in the brain after acquiring the information with difference.
Commercial VR equipment is currently widely used in public places such as malls, exhibitions, libraries, etc. The administrator needs to manage the VR device, i.e. add VR video content, put in advertisements, manage the number of uses, supplement VR data, etc., and needs to enter the administrator hidden interface. In an unattended application scene in a public place, the equipment experienter needs to be ensured not to operate by mistake to hide an interface by an administrator, so that the operation of the equipment is influenced. In addition, the motion gesture entering the hidden interface needs to have diversity to prevent the motion gesture from being interpreted.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, provides a method and a device for entering a VR helmet to hide a menu based on motion perception detection, and the VR helmet, provides a new mode for entering the hidden menu for the VR helmet by a safe and convenient motion gesture perception mode, and solves the defects that the original scheme is easy to operate by mistake, easy to be deciphered and the like.
In order to solve the above technical problems, an embodiment of the present invention provides a method for entering a VR helmet to hide a menu based on motion perception detection, the method comprising:
resetting states of a gyroscope, an acceleration sensor and the infrared sensor which are arranged on the VR helmet;
triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; the method comprises the steps of,
judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not;
and if so, checking the movement posture data, and entering a hidden interface of the VR helmet after the checking is correct.
Optionally, the method further comprises:
after entering a hidden interface of the VR helmet, receiving a motion gesture modification instruction generated by clicking a motion gesture modification button by a user;
recording first motion gesture data by using the gyroscope and the acceleration sensor based on the modification instruction and storing the first motion gesture data into a cache region;
continuing to record second motion gesture data after the first motion gesture data is recorded;
checking the recorded second motion gesture data with the first motion gesture stored in the buffer area; the method comprises the steps of,
after the first motion gesture data and the second motion gesture data are matched, the matched motion gesture is stored as a new motion gesture.
Optionally, when the gyroscope and the acceleration sensor record motion gesture data, and when the recording time exceeds a preset time, the built-in detection system of the VR helmet exits to detect the gyroscope and the acceleration sensor to record motion gesture data.
Optionally, the triggering of the infrared sensor by the built-in detection system of the VR helmet to detect the gyroscope and the acceleration sensor to record motion gesture data includes:
monitoring in real time whether a user is approaching the VR headset based on the infrared sensor;
triggering a built-in detection system of the VR helmet to correct states of the gyroscope and the acceleration sensor when a user is monitored to approach the VR helmet;
the built-in detection system of the VR helmet detects the corrected gyroscope and the acceleration sensor to record movement gesture data.
Optionally, the record of the gyroscope and the acceleration sensor after correcting of the built-in detecting system of the VR helmet records motion gesture data, including:
the corrected gyroscope records the motion gesture data of the VR helmet, and the corrected acceleration sensor records the triaxial motion acceleration component data taking the VR helmet as an origin;
the corrected gyroscope converts the recorded motion gesture data into motion state voltage signal data, and the corrected acceleration sensor converts the recorded triaxial motion acceleration component data into motion acceleration voltage signal data;
the built-in detection system of the VR helmet records the movement state voltage signal data and the movement acceleration voltage signal data.
Optionally, the motion gesture data includes angle data, rotation data, flip data, and inversion data of the VR headset;
the triaxial motion acceleration component data includes rising or falling acceleration component data, left or right movement acceleration component data, front or rear movement acceleration component data of the VR headset.
Optionally, the checking the motion gesture data includes:
and the built-in detection system of the VR helmet takes out the pre-stored correct movement posture data from the Flash storage and checks the movement posture data.
Optionally, the built-in detection system of the VR helmet takes out pre-stored correct motion gesture data from the Flash storage and checks the motion gesture data, including:
and the internal detection system of the VR helmet checks the movement posture data with the correct movement posture data step by step according to time sequence and within a preset time length.
In addition, the embodiment of the invention also provides a device for hiding a menu into a VR helmet based on motion perception detection, which comprises the following steps:
and (3) a setting module: the state resetting device is used for resetting states of a gyroscope, an acceleration sensor and the infrared sensor which are arranged on the VR helmet;
and a detection module: the built-in detection system is used for triggering the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; the method comprises the steps of,
and a judging module: the method is used for judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface;
and (3) a checking module: and if the motion gesture data is reached, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct.
In addition, the embodiment of the invention also provides a VR helmet, which comprises:
one or more processors, flash memory, infrared sensors, gyroscopes, acceleration sensors, and one or more applications; wherein the VR headset is configured to perform the method of entering VR headset hidden menu of any of the above.
In the embodiment of the invention, states of a gyroscope, an acceleration sensor and an infrared sensor which are arranged on a VR helmet are cleared; triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not; if the motion gesture data is achieved, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct; the novel mode of entering the hidden menu is provided for the VR helmet by the safe and convenient motion gesture sensing mode, and the defects that the original scheme is easy to operate by mistake, easy to be deciphered and the like are overcome.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings which are required in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart of a method for entering a VR headset hidden menu based on motion awareness detection in an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a device for entering a VR helmet hidden menu based on motion perception detection in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a VR headset in accordance with an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Examples
Referring to fig. 1, fig. 1 is a flow chart of a method for entering a VR helmet hidden menu based on motion sensing detection in an embodiment of the present invention.
As shown in fig. 1, a method for entering a VR helmet hidden menu based on motion perception detection, the method comprising:
s11: resetting states of a gyroscope, an acceleration sensor and the infrared sensor which are arranged on the VR helmet;
in the implementation process of the invention, after the VR helmet is powered on, the state of the gyroscope, the acceleration sensor and the infrared sensor arranged on the VR helmet is cleared when the VR helmet is in an idle state, so that the gyroscope, the acceleration sensor and the infrared sensor enter an initial state, the VR helmet is positioned at an initial motion origin on a built-in detection system of the VR helmet, and a position comparison point for the subsequent motion sensing detection is based on the origin.
By resetting the state of the sensor arranged in the VR helmet, the detection result can be obtained with higher precision when the motion perception detection is carried out later, and detection errors are prevented from occurring, so that non-management personnel can enter the hidden menu interface by using the detection errors.
S12: triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data;
in the implementation process of the invention, the triggering of the built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data comprises the following steps: monitoring in real time whether a user is approaching the VR headset based on the infrared sensor; triggering a built-in detection system of the VR helmet to correct states of the gyroscope and the acceleration sensor when a user is monitored to approach the VR helmet; the built-in detection system of the VR helmet detects the corrected gyroscope and the acceleration sensor to record movement gesture data.
Further, the built-in detecting system of the VR helmet records the corrected gyroscope and the corrected acceleration sensor records the motion gesture data, and the method comprises the following steps: the corrected gyroscope records the motion gesture data of the VR helmet, and the corrected acceleration sensor records the triaxial motion acceleration component data taking the VR helmet as an origin; the corrected gyroscope converts the recorded motion gesture data into motion state voltage signal data, and the corrected acceleration sensor converts the recorded triaxial motion acceleration component data into motion acceleration voltage signal data; the built-in detection system of the VR helmet records the movement state voltage signal data and the movement acceleration voltage signal data.
Further the motion profile data includes angle data, rotation data, flip data, and inversion data for the VR headset; the triaxial motion acceleration component data includes rising or falling acceleration component data, left or right movement acceleration component data, front or rear movement acceleration component data of the VR headset.
Furthermore, when the gyroscope and the acceleration sensor record motion gesture data, and when the recording time exceeds the preset time, the built-in detection system of the VR helmet exits to detect the gyroscope and the acceleration sensor to record motion gesture data.
Specifically, whether the user (manager) approaches the VR helmet is monitored in real time through the infrared sensor arranged on the VR helmet, after the user approaches the VR helmet is monitored, the built-in detection system arranged in the VR helmet is triggered to correct the states of the gyroscope and the acceleration sensor through the preset instruction of the VR helmet, and then the built-in detection system of the VR helmet detects the corrected gyroscope and the acceleration sensor to record the motion gesture data.
The corrected gyroscope is used for recording motion gesture data of the VR helmet, and the corrected acceleration sensor is used for recording triaxial motion acceleration component data taking the VR helmet as an origin; then the corrected gyroscope converts the recorded motion gesture data into motion state voltage signal data, and the corrected acceleration sensor converts the recorded triaxial motion acceleration component data into motion acceleration voltage signal data; the built-in detection system of the VR helmet records movement state voltage signal data and movement acceleration voltage signal data.
The motion gesture data comprises angle data, rotation data, overturning data and inversion data of the VR helmet; the triaxial motion acceleration component data includes rising or falling acceleration component data, left or right movement acceleration component data, front or rear movement acceleration component data of the VR headset.
When the recording time exceeds the preset time, the built-in detection system of the VR helmet exits to detect the gyroscope and the acceleration sensor to record the motion gesture data, and specifically, the preset time can be set according to the user requirement and is generally set to be 10s; by the arrangement, the program that the non-management user triggers the VR helmet to enter the hidden interface through similar operation can be effectively guaranteed.
S13: judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not;
in the implementation process of the invention, the built-in detection system of the VR helmet can determine whether the condition for triggering the display of the hidden interface is reached or not by comparing whether the motion gesture data recorded by the gyroscope and the acceleration sensor in the preset time with the action for displaying the hidden interface and further according to the time length of the gyroscope and the acceleration sensor for recording the motion gesture data.
The condition that whether the condition for triggering the display of the hidden interface is reached or not is triggered by the two condition setting modes, so that the condition that a general user cannot randomly trigger the display of the hidden interface can be effectively ensured, and the safety of setting and management of a manager on the VR helmet is ensured.
S14: and if so, checking the movement posture data, and entering a hidden interface of the VR helmet after the checking is correct.
In the implementation process of the invention, the checking the motion gesture data comprises the following steps: and the built-in detection system of the VR helmet takes out the pre-stored correct movement posture data from the Flash storage and checks the movement posture data.
Further, the built-in detection system of the VR helmet takes out the pre-stored correct motion gesture data from the Flash storage and checks the motion gesture data, including: and the internal detection system of the VR helmet checks the movement posture data with the correct movement posture data step by step according to time sequence and within a preset time length.
Specifically, the built-in detection system of the VR helmet detects the state change of the gyroscope and the acceleration sensor, when a user swings the VR helmet or drags the VR helmet to move, after the sensor data change is triggered, the built-in detection system reads and checks the correct motion gesture data from the device Flash, the sensor data and the correct data are compared step by step according to the time sequence and within the preset time length, when all the motion gestures of the user are checked correctly within the preset time, the built-in detection system finally checks and passes, a hidden menu interface is started, and an administrator can manage the device.
In the implementation process of the invention, the method further comprises the following steps: after entering a hidden interface of the VR helmet, receiving a motion gesture modification instruction generated by clicking a motion gesture modification button by a user; recording first motion gesture data by using the gyroscope and the acceleration sensor based on the modification instruction and storing the first motion gesture data into a cache region; continuing to record second motion gesture data after the first motion gesture data is recorded; checking the recorded second motion gesture data with the first motion gesture stored in the buffer area; and after the first motion gesture data and the second motion gesture data are matched, storing the matched motion gesture as a new motion gesture.
Specifically, when a manager needs to correspondingly modify the original motion gesture data entering the hidden interface, clicking a motion gesture modifying button on the hidden interface or clicking a physical modifying button on the VR helmet after entering the hidden interface of the VR helmet to generate a motion gesture modifying instruction; then the VR helmet records first motion gesture data by utilizing the gyroscope and the acceleration sensor according to a motion gesture modification instruction, and stores the first motion gesture data into a buffer area, wherein the buffer area is a buffer area opened up in a flash memory in the VR helmet, and after the first motion gesture data recording is completed, second motion gesture data is continuously recorded; checking the recorded second motion gesture data with the first motion gesture stored in the buffer area; after the first motion gesture data and the second motion gesture data are matched, the matched motion gesture is stored as a new motion gesture.
Through the mode, the manager can modify the movement gesture of the VR helmet entering the hidden interface, so that the movement gesture can be conveniently modified.
In the embodiment of the invention, states of a gyroscope, an acceleration sensor and an infrared sensor which are arranged on a VR helmet are cleared; triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not; if the motion gesture data is achieved, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct; the novel mode of entering the hidden menu is provided for the VR helmet by the safe and convenient motion gesture sensing mode, and the defects that the original scheme is easy to operate by mistake, easy to be deciphered and the like are overcome.
Examples
Referring to fig. 2, fig. 2 is a schematic structural diagram of a hidden menu device for entering a VR helmet based on motion sensing detection according to an embodiment of the present invention.
As shown in fig. 2, a device for hiding a menu into a VR headset based on motion-aware detection, the device comprising:
the setting module 21: the state resetting device is used for resetting states of a gyroscope, an acceleration sensor and the infrared sensor which are arranged on the VR helmet;
in the implementation process of the invention, after the VR helmet is powered on, the state of the gyroscope, the acceleration sensor and the infrared sensor arranged on the VR helmet is cleared when the VR helmet is in an idle state, so that the gyroscope, the acceleration sensor and the infrared sensor enter an initial state, the VR helmet is positioned at an initial motion origin on a built-in detection system of the VR helmet, and a position comparison point for the subsequent motion sensing detection is based on the origin.
By resetting the state of the sensor arranged in the VR helmet, the detection result can be obtained with higher precision when the motion perception detection is carried out later, and detection errors are prevented from occurring, so that non-management personnel can enter the hidden menu interface by using the detection errors.
The detection module 22: the built-in detection system is used for triggering the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data;
in the implementation process of the invention, the triggering of the built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data comprises the following steps: monitoring in real time whether a user is approaching the VR headset based on the infrared sensor; triggering a built-in detection system of the VR helmet to correct states of the gyroscope and the acceleration sensor when a user is monitored to approach the VR helmet; the built-in detection system of the VR helmet detects the corrected gyroscope and the acceleration sensor to record movement gesture data.
Further, the built-in detecting system of the VR helmet records the corrected gyroscope and the corrected acceleration sensor records the motion gesture data, and the method comprises the following steps: the corrected gyroscope records the motion gesture data of the VR helmet, and the corrected acceleration sensor records the triaxial motion acceleration component data taking the VR helmet as an origin; the corrected gyroscope converts the recorded motion gesture data into motion state voltage signal data, and the corrected acceleration sensor converts the recorded triaxial motion acceleration component data into motion acceleration voltage signal data; the built-in detection system of the VR helmet records the movement state voltage signal data and the movement acceleration voltage signal data.
Further the motion profile data includes angle data, rotation data, flip data, and inversion data for the VR headset; the triaxial motion acceleration component data includes rising or falling acceleration component data, left or right movement acceleration component data, front or rear movement acceleration component data of the VR headset.
Furthermore, when the gyroscope and the acceleration sensor record motion gesture data, and when the recording time exceeds the preset time, the built-in detection system of the VR helmet exits to detect the gyroscope and the acceleration sensor to record motion gesture data.
Specifically, whether the user (manager) approaches the VR helmet is monitored in real time through the infrared sensor arranged on the VR helmet, after the user approaches the VR helmet is monitored, the built-in detection system arranged in the VR helmet is triggered to correct the states of the gyroscope and the acceleration sensor through the preset instruction of the VR helmet, and then the built-in detection system of the VR helmet detects the corrected gyroscope and the acceleration sensor to record the motion gesture data.
The corrected gyroscope is used for recording motion gesture data of the VR helmet, and the corrected acceleration sensor is used for recording triaxial motion acceleration component data taking the VR helmet as an origin; then the corrected gyroscope converts the recorded motion gesture data into motion state voltage signal data, and the corrected acceleration sensor converts the recorded triaxial motion acceleration component data into motion acceleration voltage signal data; the built-in detection system of the VR helmet records movement state voltage signal data and movement acceleration voltage signal data.
The motion gesture data comprises angle data, rotation data, overturning data and inversion data of the VR helmet; the triaxial motion acceleration component data includes rising or falling acceleration component data, left or right movement acceleration component data, front or rear movement acceleration component data of the VR headset.
When the recording time exceeds the preset time, the built-in detection system of the VR helmet exits to detect the gyroscope and the acceleration sensor to record the motion gesture data, and specifically, the preset time can be set according to the user requirement and is generally set to be 10s; by the arrangement, the program that the non-management user triggers the VR helmet to enter the hidden interface through similar operation can be effectively guaranteed.
The judgment module 23: the method is used for judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface;
in the implementation process of the invention, the built-in detection system of the VR helmet can determine whether the condition for triggering the display of the hidden interface is reached or not by comparing whether the motion gesture data recorded by the gyroscope and the acceleration sensor in the preset time with the action for displaying the hidden interface and further according to the time length of the gyroscope and the acceleration sensor for recording the motion gesture data.
The condition that whether the condition for triggering the display of the hidden interface is reached or not is triggered by the two condition setting modes, so that the condition that a general user cannot randomly trigger the display of the hidden interface can be effectively ensured, and the safety of setting and management of a manager on the VR helmet is ensured.
Collation module 24: and if the motion gesture data is reached, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct.
In the implementation process of the invention, the checking the motion gesture data comprises the following steps: and the built-in detection system of the VR helmet takes out the pre-stored correct movement posture data from the Flash storage and checks the movement posture data.
Further, the built-in detection system of the VR helmet takes out the pre-stored correct motion gesture data from the Flash storage and checks the motion gesture data, including: and the internal detection system of the VR helmet checks the movement posture data with the correct movement posture data step by step according to time sequence and within a preset time length.
Specifically, the built-in detection system of the VR helmet detects the state change of the gyroscope and the acceleration sensor, when a user swings the VR helmet or drags the VR helmet to move, after the sensor data change is triggered, the built-in detection system reads and checks the correct motion gesture data from the device Flash, the sensor data and the correct data are compared step by step according to the time sequence and within the preset time length, when all the motion gestures of the user are checked correctly within the preset time, the built-in detection system finally checks and passes, a hidden menu interface is started, and an administrator can manage the device.
In the implementation process of the invention, the method further comprises the following steps: after entering a hidden interface of the VR helmet, receiving a motion gesture modification instruction generated by clicking a motion gesture modification button by a user; recording first motion gesture data by using the gyroscope and the acceleration sensor based on the modification instruction and storing the first motion gesture data into a cache region; continuing to record second motion gesture data after the first motion gesture data is recorded; checking the recorded second motion gesture data with the first motion gesture stored in the buffer area; and after the first motion gesture data and the second motion gesture data are matched, storing the matched motion gesture as a new motion gesture.
Specifically, when a manager needs to correspondingly modify the original motion gesture data entering the hidden interface, clicking a motion gesture modifying button on the hidden interface or clicking a physical modifying button on the VR helmet after entering the hidden interface of the VR helmet to generate a motion gesture modifying instruction; then the VR helmet records first motion gesture data by utilizing the gyroscope and the acceleration sensor according to a motion gesture modification instruction, and stores the first motion gesture data into a buffer area, wherein the buffer area is a buffer area opened up in a flash memory in the VR helmet, and after the first motion gesture data recording is completed, second motion gesture data is continuously recorded; checking the recorded second motion gesture data with the first motion gesture stored in the buffer area; after the first motion gesture data and the second motion gesture data are matched, the matched motion gesture is stored as a new motion gesture.
Through the mode, the manager can modify the movement gesture of the VR helmet entering the hidden interface, so that the movement gesture can be conveniently modified.
In the embodiment of the invention, states of a gyroscope, an acceleration sensor and an infrared sensor which are arranged on a VR helmet are cleared; triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not; if the motion gesture data is achieved, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct; the novel mode of entering the hidden menu is provided for the VR helmet by the safe and convenient motion gesture sensing mode, and the defects that the original scheme is easy to operate by mistake, easy to be deciphered and the like are overcome.
Examples
The embodiment of the invention provides a computer readable storage medium, and a computer program is stored on the computer readable storage medium, and when the program is executed by a processor, the method for entering into the VR helmet hiding menu in any one of the above embodiments is realized. The computer readable storage medium includes, but is not limited to, any type of disk including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks, ROMs (Read-Only memories), RAMs (Random AcceSS Memory, random access memories), EPROMs (EraSable Programmable Read-Only memories), EEPROMs (Electrically EraSable ProgrammableRead-Only memories), flash memories, magnetic cards, or optical cards. That is, a storage device includes any medium that stores or transmits information in a form readable by a device (e.g., computer, cell phone), and may be read-only memory, magnetic or optical disk, etc.
The embodiment of the invention also provides a computer application program which runs on a computer and is used for executing the method for entering the VR helmet hidden menu in any one of the embodiments.
In addition, fig. 3 is a schematic structural diagram of a VR headset according to an embodiment of the present invention.
The embodiment of the invention also provides a VR helmet, as shown in fig. 3, which comprises:
one or more processors 302, a memory 303, an infrared sensor 304, a gyroscope 305, an acceleration sensor 306, and one or more applications 301.
It will be appreciated by those skilled in the art that the device architecture shown in fig. 3 does not constitute a limitation of all devices, and may include more or fewer components than shown, or may combine certain components. The processor 302 runs the application 301 stored in the memory 303, thereby executing various functional applications of the device and data processing. The memory may be internal memory or external memory, or include both internal memory and external memory. The internal memory may include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), flash memory, or random access memory. The external memory may include a hard disk, floppy disk, ZIP disk, U-disk, tape, etc. The disclosed memory includes, but is not limited to, these types of memory. The memory disclosed herein is by way of example only and not by way of limitation.
The input unit is used for receiving input of signals and receiving keywords input by users. The input unit may include a touch panel and other input devices. The touch panel may collect touch operations on or near the user (e.g., the user's operation on or near the touch panel using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a preset program; other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., play control keys, switch keys, etc.), a trackball, mouse, joystick, etc. The display unit may be used to display information input by a user or information provided to the user and various menus of the terminal device. The display unit may take the form of a liquid crystal display, an organic light emitting diode, or the like. The processor 302 is a control center of the terminal device, connects various parts of the entire device using various interfaces and lines, performs various functions and processes data by running or executing software programs and/or modules stored in the memory 302, and invoking data stored in the memory.
As one embodiment, the VR headset includes:
one or more processors 302, memory 303, infrared sensors 304, gyroscopes 305, acceleration sensors 306, and one or more applications 301; wherein the VR headset is configured to perform the method of entering VR headset hidden menu of any of the above.
In the embodiment of the invention, states of a gyroscope, an acceleration sensor and an infrared sensor which are arranged on a VR helmet are cleared; triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not; if the motion gesture data is achieved, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct; the novel mode of entering the hidden menu is provided for the VR helmet by the safe and convenient motion gesture sensing mode, and the defects that the original scheme is easy to operate by mistake, easy to be deciphered and the like are overcome.
In addition, the method and the device for entering the VR helmet hidden menu and the VR helmet provided by the embodiments of the present invention are described in detail, and specific examples should be adopted to illustrate the principles and the embodiments of the present invention, where the descriptions of the above examples are only used to help understand the method and the core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (9)

1. A method for entering a VR headset hidden menu based on motion awareness detection, the method comprising:
resetting states of a gyroscope, an acceleration sensor and an infrared sensor which are arranged on the VR helmet;
triggering a built-in detection system of the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; the method comprises the steps of,
judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface or not;
if the motion gesture data is achieved, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct;
after entering a hidden interface of the VR helmet, receiving a motion gesture modification instruction generated by clicking a motion gesture modification button by a user;
recording first motion gesture data by using the gyroscope and the acceleration sensor based on the modification instruction and storing the first motion gesture data into a cache region;
continuing to record second motion gesture data after the first motion gesture data is recorded;
checking the recorded second motion gesture data with the first motion gesture stored in the buffer area; the method comprises the steps of,
after the first motion posture data and the second motion posture data are collated to be identical, the identical motion posture is stored as a new motion posture.
2. The method for accessing a VR headset hidden menu of claim 1, wherein when the gyroscope and the acceleration sensor record motion gesture data, and when the recording time exceeds a preset time, the built-in detection system of the VR headset exits from detecting the gyroscope and the acceleration sensor to record motion gesture data.
3. The method of accessing a VR headset hidden menu of claim 1, wherein the triggering of the built-in detection system of the VR headset based on the infrared sensor to detect the gyroscope and the acceleration sensor to record motion gesture data comprises:
monitoring in real time whether a user is approaching the VR headset based on the infrared sensor;
triggering a built-in detection system of the VR helmet to correct states of the gyroscope and the acceleration sensor when a user is monitored to approach the VR helmet;
the built-in detection system of the VR helmet detects the corrected gyroscope and the acceleration sensor to record movement gesture data.
4. The method of accessing a VR headset hidden menu of claim 3, wherein the VR headset built-in detection system records corrected gyroscopes and acceleration sensors to record motion gesture data, comprising:
the corrected gyroscope records the motion gesture data of the VR helmet, and the corrected acceleration sensor records the triaxial motion acceleration component data taking the VR helmet as an origin;
the corrected gyroscope converts the recorded motion gesture data into motion state voltage signal data, and the corrected acceleration sensor converts the recorded triaxial motion acceleration component data into motion acceleration voltage signal data;
the built-in detection system of the VR helmet records the movement state voltage signal data and the movement acceleration voltage signal data.
5. The method of accessing a VR headset hidden menu of claim 4, wherein the motion gesture data comprises angle data, rotation data, flip data, and flip data of the VR headset;
the triaxial motion acceleration component data includes rising or falling acceleration component data, left or right movement acceleration component data, front or rear movement acceleration component data of the VR headset.
6. The method of accessing a VR headset hidden menu of claim 1, wherein said checking said motion gesture data comprises:
and the built-in detection system of the VR helmet takes out the pre-stored correct movement posture data from the Flash storage and checks the movement posture data.
7. The method for accessing a VR headset hidden menu of claim 6, wherein the VR headset built-in detection system retrieves pre-stored correct motion gesture data from Flash storage for verification with the motion gesture data, comprising:
and the internal detection system of the VR helmet checks the movement posture data with the correct movement posture data step by step according to time sequence and within a preset time length.
8. An in-VR headset hidden menu device based on motion-aware detection, the device comprising:
and (3) a setting module: the state resetting device is used for resetting states of a gyroscope, an acceleration sensor and an infrared sensor which are arranged on the VR helmet;
and a detection module: the built-in detection system is used for triggering the VR helmet based on the infrared sensor to detect the gyroscope and the acceleration sensor to record movement gesture data; the method comprises the steps of,
and a judging module: the method is used for judging whether the motion gesture data recorded by the gyroscope and the acceleration sensor reach the condition of triggering the display of the hidden interface;
and (3) a checking module: if the motion gesture data is reached, checking the motion gesture data, and entering a hidden interface of the VR helmet after the checking is correct;
a motion gesture modification module: the VR helmet is used for receiving a motion gesture modification instruction generated by clicking a motion gesture modification button by a user after entering a hidden interface of the VR helmet;
recording first motion gesture data by using the gyroscope and the acceleration sensor based on the modification instruction and storing the first motion gesture data into a cache region;
continuing to record second motion gesture data after the first motion gesture data is recorded;
checking the recorded second motion gesture data with the first motion gesture stored in the buffer area; the method comprises the steps of,
after the first motion posture data and the second motion posture data are collated to be identical, the identical motion posture is stored as a new motion posture.
9. A VR headset, the VR headset comprising:
one or more processors, flash memory, infrared sensors, gyroscopes, acceleration sensors, and one or more applications; wherein the VR headset is configured to perform the method of entering VR headset hidden menu of any one of claims 1-7.
CN202010027439.9A 2020-01-10 2020-01-10 Method and device for entering VR helmet to hide menu and VR helmet Active CN111221418B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010027439.9A CN111221418B (en) 2020-01-10 2020-01-10 Method and device for entering VR helmet to hide menu and VR helmet

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010027439.9A CN111221418B (en) 2020-01-10 2020-01-10 Method and device for entering VR helmet to hide menu and VR helmet

Publications (2)

Publication Number Publication Date
CN111221418A CN111221418A (en) 2020-06-02
CN111221418B true CN111221418B (en) 2023-05-23

Family

ID=70808005

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010027439.9A Active CN111221418B (en) 2020-01-10 2020-01-10 Method and device for entering VR helmet to hide menu and VR helmet

Country Status (1)

Country Link
CN (1) CN111221418B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112596830A (en) * 2020-12-16 2021-04-02 广东湾区智能终端工业设计研究院有限公司 Interface display method and device
CN113687717A (en) * 2021-08-10 2021-11-23 青岛小鸟看看科技有限公司 VR (virtual reality) interaction method and system based on position change

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105867607A (en) * 2015-12-15 2016-08-17 乐视致新电子科技(天津)有限公司 Menu selection method and device of virtual reality helmet and virtual reality helmet
CN106249886A (en) * 2016-07-27 2016-12-21 广东欧珀移动通信有限公司 The display packing of menu and device
CN108307074A (en) * 2018-02-05 2018-07-20 广东欧珀移动通信有限公司 Display control method and device, terminal, computer readable storage medium
CN108369447A (en) * 2016-04-13 2018-08-03 华为技术有限公司 The method and apparatus for controlling wearable electronic operating status

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10890600B2 (en) * 2016-05-18 2021-01-12 Google Llc Real-time visual-inertial motion tracking fault detection

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105867607A (en) * 2015-12-15 2016-08-17 乐视致新电子科技(天津)有限公司 Menu selection method and device of virtual reality helmet and virtual reality helmet
CN108369447A (en) * 2016-04-13 2018-08-03 华为技术有限公司 The method and apparatus for controlling wearable electronic operating status
CN106249886A (en) * 2016-07-27 2016-12-21 广东欧珀移动通信有限公司 The display packing of menu and device
CN108307074A (en) * 2018-02-05 2018-07-20 广东欧珀移动通信有限公司 Display control method and device, terminal, computer readable storage medium

Also Published As

Publication number Publication date
CN111221418A (en) 2020-06-02

Similar Documents

Publication Publication Date Title
CN105518575B (en) With the two handed input of natural user interface
EP3527121B1 (en) Gesture detection in a 3d mapping environment
WO2014028504A1 (en) Augmented reality overlay for control devices
CN111221418B (en) Method and device for entering VR helmet to hide menu and VR helmet
CN106861184B (en) Method and system for realizing human-computer interaction in immersive VR game
US11373373B2 (en) Method and system for translating air writing to an augmented reality device
CN110968190B (en) IMU for touch detection
CN103595984A (en) 3D glasses, a 3D display system, and a 3D display method
US20210041942A1 (en) Sensing and control method based on virtual reality, smart terminal, and device having storage function
US20220270302A1 (en) Content distribution system, content distribution method, and content distribution program
US11367416B1 (en) Presenting computer-generated content associated with reading content based on user interactions
EP3582068A1 (en) Information processing device, information processing method, and program
US9958946B2 (en) Switching input rails without a release command in a natural user interface
WO2018000606A1 (en) Virtual-reality interaction interface switching method and electronic device
US11947731B2 (en) Intention-based user interface control for electronic devices
CN112286411A (en) Display mode control method and device, storage medium and electronic equipment
US20230102820A1 (en) Parallel renderers for electronic devices
JP7291106B2 (en) Content delivery system, content delivery method, and content delivery program
Spanogianopoulos et al. Human computer interaction using gestures for mobile devices and serious games: A review
US20230034773A1 (en) Electronic headset for test or exam administration
Deepateep et al. Facial movement interface for mobile devices using depth-sensing camera
CN106708256B (en) virtual key triggering method based on opencv and easyar
US11899840B2 (en) Haptic emulation of input device
CN117687507A (en) Simulation man-machine interaction verification method and device, electronic equipment and storage medium
CN111016784A (en) Image presentation method and device, electronic terminal and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant