CN116755554A - Interactive mode switching method, head-mounted display device and computer-readable storage medium - Google Patents

Interactive mode switching method, head-mounted display device and computer-readable storage medium Download PDF

Info

Publication number
CN116755554A
CN116755554A CN202310639783.7A CN202310639783A CN116755554A CN 116755554 A CN116755554 A CN 116755554A CN 202310639783 A CN202310639783 A CN 202310639783A CN 116755554 A CN116755554 A CN 116755554A
Authority
CN
China
Prior art keywords
handle
change information
interaction mode
sound
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310639783.7A
Other languages
Chinese (zh)
Inventor
李海龙
张军国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Inc
Original Assignee
Goertek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Inc filed Critical Goertek Inc
Priority to CN202310639783.7A priority Critical patent/CN116755554A/en
Publication of CN116755554A publication Critical patent/CN116755554A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
    • A63F13/92—Video game devices specially adapted to be hand-held while playing
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/105—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals using inertial sensors, e.g. accelerometers, gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8076—Shooting
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082—Virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses an interaction mode switching method, a head-mounted display device and a computer readable storage medium, wherein the interaction mode switching method comprises the following steps: acquiring sound change information of a handle; determining whether the use state of the handle is changed according to the sound change information; if yes, acquiring a holding position signal and a holding part optical signal of the handle; and switching the current interaction mode of the head-mounted display device according to the holding position and pose signal and the holding part optical signal. The application realizes automatic switching of the hand interaction mode and avoids the phenomenon of complicated operation when the user switches the interaction mode of the head-mounted display device.

Description

Interactive mode switching method, head-mounted display device and computer-readable storage medium
Technical Field
The present application relates to the field of head-mounted display devices, and in particular, to an interactive mode switching method, a head-mounted display device, and a computer readable storage medium.
Background
The hand interaction mode of VR (Virtual Reality) is mainly divided into a handle interaction mode and a bare hand interaction mode, that is, detecting hand actions by a handle device and resolving hand actions by bare hand gesture interaction, an independent tactile handle, a tactile glove, an myoelectric bracelet and other technologies, because the difficulty of implementing the bare hand interaction mode is large by adopting the bare hand interaction mode alone, the VR hand interaction mode is usually used by combining the bare hand interaction mode with the handle interaction mode, so that a user needs to switch the interaction mode according to actual situations, for example, when the user performs shooting game and pulls a trigger, the handle interaction mode needs to be switched.
The current interactive mode switching method is that a User selects a required mode by clicking a User Interface (UI), however, from the perspective of User data, the use frequency of a handle interactive mode is greater than that of a bare hand interactive mode, and the User needs to manually switch modes frequently, so that the operation is complicated, and the User experience is affected.
Disclosure of Invention
The application mainly aims to provide a hand interaction mode switching method, an intelligent handle and a computer storage medium, and aims to solve the technical problem of complex operation when a user switches hand interaction modes.
To achieve the above object, the present application provides an interaction mode switching method applied to a head-mounted display device, the interaction mode of the head-mounted display device including a non-handle interaction mode and a handle interaction mode that are switchable to each other, the method comprising:
acquiring sound change information of a handle, wherein the sound change information is acquired by a sound sensor arranged at a holding part of the handle;
determining whether the use state of the handle is changed according to the sound change information;
if yes, acquiring a holding position and posture signal of the handle and an optical signal of a holding part, wherein the holding position and posture signal is acquired through an inertial sensor arranged at the holding part of the handle, and the optical signal of the holding part is acquired through an optical sensor arranged at the holding part of the handle;
And switching the current interaction mode of the head-mounted display device according to the holding pose signal and the holding part optical signal.
Optionally, the step of determining whether the use state of the handle is changed according to the sound change information includes:
according to the sound change information, determining the sound fluctuation amplitude and the sound fluctuation phase characteristics of the handle in a first preset duration;
and determining whether the use state of the handle is changed according to the sound fluctuation amplitude and the sound fluctuation phase characteristic.
Optionally, the step of determining whether the use state of the handle is changed according to the sound fluctuation amplitude and the sound fluctuation phase characteristic comprises the following steps:
acquiring a sound phase characteristic template for calibrating the vibration state of the holding part in advance;
if the sound fluctuation amplitude value is larger than or equal to a first preset amplitude value, and the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is larger than or equal to a preset ratio threshold value, determining that the use state of the handle is changed;
and if the sound fluctuation amplitude value is smaller than a first preset amplitude value and/or the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is smaller than a preset ratio threshold value, determining that the use state of the handle is not changed.
Optionally, the step of switching the current interaction mode of the head-mounted display device according to the holding pose signal and the holding part optical signal includes:
determining pose change information of the handle within a second preset duration according to the holding pose signal, wherein the pose change information comprises an angle rotation value and a displacement value;
determining light intensity fluctuation information of the handle within a third preset duration according to the optical signals of the holding part, wherein the light intensity fluctuation information comprises a light intensity fluctuation direction and a light intensity fluctuation amplitude value;
determining handle state change information according to the angle rotation value, the displacement value, the light intensity fluctuation direction and the light intensity fluctuation amplitude value;
and switching the current interaction mode of the head-mounted display device according to the handle state change information.
Optionally, the step of determining the handle state change information according to the angle rotation value, the displacement value, the light intensity fluctuation direction and the light intensity fluctuation amplitude value includes:
if the angle rotation value is greater than or equal to a preset angle threshold value, the displacement value is greater than or equal to a preset displacement threshold value, the light intensity fluctuation direction is downward fluctuation, and the light intensity fluctuation amplitude value is greater than a first preset amplitude value, determining that the handle state change information is first change information, wherein the first change information is change information that the handle state is changed from a placing state to a taking state;
If the angle rotation value is smaller than a preset angle threshold value, the displacement value is smaller than a preset displacement threshold value, the light intensity fluctuation direction is upward fluctuation, the light intensity fluctuation amplitude value is larger than a second preset amplitude value, and the handle state change information is determined to be second change information, wherein the second change information is change information that the handle state is changed from a taking state to a placing state.
Optionally, the step of switching the current interaction mode of the head-mounted display device according to the handle state change information includes:
if the handle state change information is first change information, switching the current interaction mode of the head-mounted display device from the handle interaction mode to the non-handle interaction mode;
and if the handle state change information is second change information, switching the current interaction mode of the head-mounted display device from the non-handle interaction mode to the handle interaction mode.
Optionally, before the step of switching the current interaction mode of the head mounted display device from the handle interaction mode to the non-handle interaction mode, the method further comprises:
disconnecting a communication link established between the handle and the head mounted display device;
Before the step of switching the current interaction mode of the head mounted display device from the non-handle interaction mode to the handle interaction mode, the method further comprises:
a communication link is established between the handle and the head mounted display device.
Optionally, the non-handle interaction mode is a bare hand tracking interaction mode, an eye tracking interaction mode, or a head tracking interaction mode.
The present application also provides a head-mounted display device, which is an entity device, comprising: the interactive mode switching device comprises a memory, a processor and a program of the interactive mode switching method stored in the memory and capable of running on the processor, wherein the program of the interactive mode switching method can realize the steps of the interactive mode switching method when being executed by the processor.
The present application also provides a computer-readable storage medium having stored thereon a program for implementing an interactive mode switching method, the program for implementing the interactive mode switching method being executed by a processor to implement the steps of the interactive mode switching method as described above.
The application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the interactive mode switching method as described above.
The application provides an interactive mode switching method, a head-mounted display device and a computer readable storage medium, which are characterized in that sound change information of a handle is acquired by acquiring a sound sensor arranged at a holding part of the handle, whether the use state of the handle is changed is determined according to the sound change information, if yes, a holding position and posture signal of the handle and an optical signal of the holding part are acquired, wherein the holding position and posture signal is acquired by an inertial sensor arranged at the holding part of the handle, the optical signal of the holding part is acquired by an optical sensor arranged at the holding part of the handle, and the optical signal of the holding part is acquired
According to the holding position and pose signal and the optical signal of the holding part, the current interaction mode of the head-mounted display device is rapidly switched, so that the automatic switching of the hand interaction mode is realized, and the phenomenon of complex operation when a user switches the interaction mode of the head-mounted display device is avoided.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the technical solutions of the present embodiment or the prior art, the drawings used in the description of the embodiment or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a flowchart of a first embodiment of an interactive mode switching method according to the present application;
FIG. 2 is an overall schematic of the smart handle of the present application;
FIG. 3 is a schematic diagram of a control module of the intelligent handle of the present application;
FIG. 4 is a schematic block diagram of an interactive mode switching device according to an embodiment of the present application;
fig. 5 is a schematic device structure diagram of a hardware running environment related to the head-mounted display device in this embodiment.
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
In order to make the above objects, features and advantages of the present application more comprehensible, the following description of the embodiments accompanied with the accompanying drawings will be given in detail. It will be apparent that the described embodiments are only some, but not all, embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Example 1
Referring to fig. 1, the present embodiment provides an interaction mode switching method, which is applied to a head-mounted display device, where the interaction mode of the head-mounted display device includes a non-handle interaction mode and a handle interaction mode that can be switched to each other, and the method includes:
Step S10, acquiring sound change information of a handle, wherein the sound change information is acquired by a sound sensor arranged at a holding part of the handle;
the execution subject of the interaction mode switching method of the embodiments of the present application is a head-mounted display device including, but not limited to, a Mixed Reality (Mixed Reality) -MR device (e.g., MR glasses or MR helmets), an augmented Reality (Augmented Reality) -AR device (e.g., AR glasses or AR helmets), a Virtual Reality (Virtual Reality) -VR device (e.g., VR glasses or VR helmets), an augmented Reality (Extended Reality) -XR device or some combination thereof, and the like.
In this embodiment, when the interaction mode is a handle interaction mode, the handle is connected to the head-mounted display device, and the user manipulates the handle to detect the hand motion, and when the interaction mode is a non-handle interaction mode, the handle is disconnected from the head-mounted device and is converted into a non-handle interaction mode other than the handle interaction mode, and the non-handle interaction mode is, for example, a bare hand tracking interaction mode, an eye tracking interaction mode or a head tracking interaction mode. The bare hand tracking interaction mode can be that the head-mounted device analyzes hand actions or gestures through shooting or photographing, and input of user operation instructions corresponding to the hand actions or gestures is achieved. The eye movement tracking interaction mode can be to track the gazing direction or eyeball action of the eyeball of the user through a camera, and input a user operation instruction according to the gazing direction or eyeball action. The head movement tracking interaction mode may be to detect the posture and the motion of the head by an IMU (Inertial Measurement Unit ) sensor, and input a user operation instruction according to the posture and the motion of the head. In this embodiment, the bare hand tracking interaction mode, the eye tracking interaction mode or the head tracking interaction mode have been studied by those skilled in the art, and the sensor is not described herein.
Step S20, determining whether the use state of the handle is changed according to the sound change information;
step S30, if yes, acquiring a holding position and posture signal and a holding part optical signal of the handle, wherein the holding position and posture signal is acquired through an inertial sensor arranged at a holding part of the handle, and the holding part optical signal is acquired through an optical sensor arranged at the holding part of the handle;
among them, it is known to those skilled in the art that the inertial sensor of the present embodiment may include a six-axis acceleration and gyro sensor.
And S40, switching the current interaction mode of the head-mounted display device according to the holding position and pose signal and the holding part optical signal.
When the handle is held or released, the sound sensor detects that the volume of the handle holding part shell is increased, so that the use state of the handle is changed, the next step is to detect the holding position and the light intensity of the handle at the same time, when the handle is held for use, the environment light brightness is weakened, the handle generates a certain position change after a preset time period, so that when the light intensity is detected by the optical sensor to be reduced, the position information (including the rotation angle and/or the position) of the handle generates a certain change in the preset time period, the use state change information of the handle is judged to be changed from the holding state to the taking state of the handle, and conversely, when the handle is released, the environment light brightness is enhanced, the handle does not generate position change in the preset time period, so that when the optical sensor detects that the light intensity is increased, and the position information (including the rotation angle and/or the position) of the handle does not generate change in the preset time period (or the position change is smaller than the preset position change value), the use state information of the handle is judged to be changed from the holding state to the taking state of the handle.
Referring to fig. 2, an acoustic microphone (i.e., the above-mentioned sound sensor), an inertial sensor and an optical sensor are fixed on a grip portion of a handle, where the optical sensor collects light intensity data of the grip portion housing (i.e., the grip portion optical signal) in real time, the inertial sensor collects pose data of the grip portion housing (including the current position and angle in real space) in real time, the sound sensor collects volume data of the grip portion housing in real time, and the handle collects light intensity data, pose data and volume data once every predetermined time interval, in this way, pose change information, light intensity fluctuation information and sound change information of the grip portion housing in the predetermined time are obtained, so that it is convenient for a subsequent head-mounted display device to accurately determine whether the hand-state change information is a change from a take state to a put state or a change from a put state to a take state, and further to accurately switch the current interaction mode of the head-mounted display device to an interaction mode of the user intended for use, thereby improving the user experience, and avoiding the frequent interaction mode switching of the head-mounted display device.
As shown in fig. 3, in this embodiment, a main control chip, an optical sensor, an inertial sensor and an acoustic microphone (i.e., the above-mentioned sound sensor) are fixed on the handle grip portion by a hot melting method, and the environment data (including specific sound change information, a grip position signal and a grip optical signal) of the handle grip portion detected by the optical sensor, the inertial sensor and the acoustic microphone are processed by the main control chip in the handle, so as to determine the handle state change information (i.e., the handle use state change information), which may be understood as that the user may cause the change of the environment data, such as the volume, the light intensity, the pose, etc. of the handle grip portion when picking or placing the handle.
In this embodiment, the interactive mode of the head-mounted display device is switched by actively sending the sound change information, the holding pose signal and the holding part optical signal to the head-mounted display device by the handle, and after the head-mounted display device receives the sound change information, the holding pose signal and the holding part optical signal, determining whether the use state of the handle is changed according to the received sound change information, if so, switching the current interactive mode of the head-mounted display device according to the received holding pose signal and the holding part optical signal. For example, if it is determined that the handle state change information is that the handle is changed from the placement state to the taking state according to the holding position and posture signal and the holding portion optical signal, the current interaction mode of the head-mounted display device is triggered to be switched from the non-handle interaction mode to the handle interaction mode. And if the handle state change information is determined to be that the handle is changed from the taking state to the placing state according to the holding position and posture signal and the holding part optical signal, triggering to switch the current interaction mode of the head-mounted display device from the handle interaction mode to the non-handle interaction mode.
The embodiment of the application provides an interaction mode switching method, a head-mounted display device and a computer readable storage medium, which are characterized in that sound change information of a handle is acquired through acquiring a sound sensor arranged at a holding part of the handle, whether the using state of the handle is changed is determined according to the sound change information, if yes, a holding position and posture signal of the handle and a holding part optical signal are acquired, wherein the holding position and posture signal is acquired through an inertial sensor arranged at the holding part of the handle, the holding part optical signal is acquired through an optical sensor arranged at the holding part of the handle, and then the current interaction mode of the head-mounted display device is rapidly switched according to the holding position and the holding part optical signal, so that the phenomenon of complex operation when a user switches the interaction mode of the head-mounted display device is avoided.
In one embodiment, the step of determining whether the usage state of the handle is changed according to the sound change information includes:
step A10, according to the sound change information, determining the sound fluctuation amplitude and sound fluctuation phase characteristics of the handle in a first preset duration;
And step A20, determining whether the use state of the handle is changed according to the sound fluctuation amplitude and the sound fluctuation phase characteristic.
In this embodiment, since the phase characteristics of the acoustic wave generated by the vibration of the grip housing when the handle is placed or lifted (i.e., when the use state of the handle is changed) are consistent with a certain rule, the phase characteristics of the acoustic wave generated by the vibration of the grip housing can be calibrated in advance to obtain the acoustic phase characteristic template, and whether the use state of the handle is changed can be basically determined by comparing the acoustic phase characteristics detected in real time with the acoustic phase characteristic template. In addition, when the use state of the handle is changed, the handle holding part shell can vibrate with a certain amplitude, so that the judgment of whether the use state of the handle is changed can be further assisted based on the amplitude of the sound fluctuation.
Specifically, the step of determining whether the use state of the handle is changed according to the sound fluctuation amplitude and the sound fluctuation phase characteristic comprises the following steps:
step B10, acquiring a sound phase characteristic template for calibrating the vibration state of the holding part in advance;
It can be understood that the voice phase feature template can be calibrated in advance according to a plurality of voice phase feature samples corresponding to the holding part when the use state of the handle is changed by detecting the voice wave phase feature of the handle when the holding part is in the vibration state when the handle is placed or lifted (namely, the use state of the handle is changed) for a plurality of times.
Step B20, if the sound fluctuation amplitude is greater than or equal to a first preset amplitude value, and the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is greater than or equal to a preset ratio threshold value, determining that the use state of the handle is changed;
and step B30, if the sound fluctuation amplitude value is smaller than a first preset amplitude value and/or the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is smaller than a preset ratio threshold value, determining that the use state of the handle is not changed.
In this embodiment, the first preset amplitude value is not specifically limited, and it is preferable that the first preset amplitude value reflects the amplitude of the sound fluctuation generated by the vibration of the grip portion caused by the change of the use state of the handle more truly and accurately.
The sound phase characteristic template is not particularly limited in this embodiment, and is based on the sound phase characteristic that reflects the vibration of the grip portion caused by the change of the use state of the handle more truly and accurately.
In this embodiment, when the use state of the handle is changed, the principle that the sound fluctuation phase characteristic that causes the housing of the grip portion to vibrate accords with a certain rule is utilized to calibrate in advance the vibration phase characteristic rule (i.e., the sound phase characteristic template) that causes the grip portion to vibrate when the use state of the handle is changed, and if it is determined that the sound fluctuation amplitude is greater than or equal to a first preset amplitude value and the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is greater than or equal to a preset ratio threshold, it is determined that the use state of the handle is changed. And if the sound fluctuation amplitude is smaller than the first preset amplitude value and/or the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is smaller than the preset ratio threshold, determining that the use state of the handle is unchanged, so that compared with the method for judging whether the use state of the hand is changed or not according to the sound fluctuation phase characteristic or the sound fluctuation amplitude alone, the method and the device can improve the accuracy of judging whether the use state of the handle is changed or not.
Example two
In another embodiment of the present application, the same or similar content as that of the first embodiment may be referred to the description above, and will not be repeated. On the basis, the step of switching the current interaction mode of the head-mounted display device according to the holding pose signal and the holding part optical signal comprises the following steps of:
step C10, determining pose change information of the handle in a second preset duration according to the holding pose signal, wherein the pose change information comprises an angle rotation value and a displacement value;
step C20, determining light intensity fluctuation information of the handle in a third preset duration according to the optical signals of the holding part, wherein the light intensity fluctuation information comprises a light intensity fluctuation direction and a light intensity fluctuation amplitude value;
step C30, determining handle state change information according to the angle rotation value, the displacement value, the light intensity fluctuation direction and the light intensity fluctuation amplitude value;
and step C40, switching the current interaction mode of the head-mounted display device according to the handle state change information.
The change of the volume of the shell of the handle holding part is determined through the sound change information, at the moment, a user possibly takes or places the handle, but the use state of the handle cannot be determined through the sound change information, so that the change of the light intensity and the pose of the shell of the handle holding part is respectively determined through the light intensity fluctuation information and the pose change information, and the handle state change information is determined through the light intensity fluctuation information and the pose change information.
In this embodiment, the holding gesture signal may be gesture data acquired at two time points separated by a preset time period, and is used to characterize a gesture change (including an angle rotation value and a displacement value) within the preset time period. Similarly, the optical fluctuation information may be light intensity data acquired at two time points spaced apart by a preset time period, and the light intensity data is used for characterizing light intensity fluctuation within the preset time period, where the preset time period may be 1 ms, 2 ms, 3 ms, or the like.
It will be appreciated that the determination of the change in the status of the handle is based on the detection of environmental data about the grip of the handle by sensors (including optical sensors, acoustic sensors and inertial sensors), and that the user may take or place the handle, such as sound, light intensity, and position.
In this embodiment, the light intensity fluctuation direction is used to represent the light intensity fluctuation trend in the third preset duration, the light intensity fluctuation amplitude value is used to represent the light intensity data variation in the third preset duration, and the light intensity fluctuation information includes, for example, light intensity data of two time points spaced by the preset duration, where the difference between the larger light intensity data and the smaller light intensity data is the light intensity fluctuation amplitude value, if the light intensity data of the later time point is greater than the light intensity data of the previous time point, the light intensity fluctuation direction is upward fluctuation, and conversely, if the light intensity data of the later time point is less than the light intensity data of the previous time point, the light intensity fluctuation direction is downward fluctuation.
For example, when the previous time point p and the next time point q are separated by a preset time period, the light intensity data collected by the main control chip at the time point p is 1000 candelas, the light intensity data collected at the time point q is 900 candelas, the light intensity fluctuation amplitude value is 100 candelas, and the light intensity fluctuation direction is downward fluctuation.
For example, when the previous time point p and the next time point q are separated by a preset time period, the light intensity data collected by the main control chip at the time point p is 900 candela, the light intensity data collected at the time point q is 1000 candela, the light intensity fluctuation amplitude value is 100 candela, and the light intensity fluctuation direction is upward fluctuation.
When the handle is held for use, the ambient light intensity is weakened, the handle generates certain pose change after the preset time period, so when the optical sensor detects that the light intensity is reduced and the pose information (including the rotation angle and/or the position) of the handle generates certain change within the preset time period, the use state change information of the handle is judged to be changed from the holding state to the taking state of the handle, conversely, when the handle is loosened, the ambient light intensity is enhanced, the handle cannot generate pose change within the preset time period, and therefore when the optical sensor detects that the light intensity is increased and the pose information (including the rotation angle and/or the position) of the handle cannot generate change within the preset time period (or the pose change is smaller than the preset pose change value), the use state change information of the handle is judged to be changed from the taking state to the holding state of the handle.
In one possible embodiment, the step of determining the handle state change information according to the angle rotation value, the displacement value, the light intensity fluctuation direction, and the light intensity fluctuation amplitude value includes:
step D10, if the angle rotation value is greater than or equal to a preset angle threshold value, the displacement value is greater than or equal to a preset displacement threshold value, the light intensity fluctuation direction is downward fluctuation, and the light intensity fluctuation amplitude value is greater than a first preset amplitude value, determining that the handle state change information is first change information, wherein the first change information is change information that the handle state is changed from a placing state to a taking state;
and D20, determining the handle state change information as second change information if the angle rotation value is smaller than a preset angle threshold value, the displacement value is smaller than a preset displacement threshold value, the light intensity fluctuation direction is upward fluctuation, and the light intensity fluctuation amplitude value is larger than a second preset amplitude value, wherein the second change information is change information that the handle state is changed from a taking state to a placing state.
In this embodiment, the first preset amplitude value is a threshold value for judging that the light intensity data has a significant downward fluctuation, which can be set by a person skilled in the art, and this embodiment is not limited specifically, so as to detect that the light intensity data of the handle grip portion has a significant downward fluctuation, and if the light intensity fluctuation amplitude value is greater than the first preset amplitude value, it is determined that the light intensity of the handle grip portion is significantly reduced, and conversely, it is determined that the light intensity data has a weak reduction.
When the hand is attached to the handle holding part, the illumination received by the handle holding part is reduced, and the light intensity is obviously reduced, so that if the light intensity fluctuation direction is downward and the light intensity fluctuation amplitude value is larger than the first preset amplitude value, the handle state change information can be basically determined to be the first change information.
In this embodiment, the second preset amplitude value is a threshold value for judging that the light intensity data has a significant upward fluctuation, which can be set by a person skilled in the art, and this embodiment is not limited specifically, so as to detect that the light intensity data of the handle grip portion has a significant upward fluctuation, and if the light intensity fluctuation amplitude value is greater than the second preset amplitude value, it is determined that the light intensity of the handle grip portion has a significant increase, and conversely, it is determined that the light intensity data has a weak increase.
When the hand loosens the handle holding part, the handle holding part is subjected to more illumination, and the light intensity can be obviously increased, so that if the light intensity fluctuation direction is upward and the light intensity fluctuation amplitude value is larger than a second preset amplitude value, the handle state change information can be basically determined to be second change information.
In this embodiment, the values of the first preset amplitude value and the second preset amplitude value may be the same or different, which is not limited in this embodiment.
In this embodiment, the preset angle threshold is a threshold for judging that the current angle of the handle generates an obvious rotation, and a person skilled in the art can set the preset angle threshold by himself.
In this embodiment, the preset displacement threshold is a threshold for judging that the position of the handle has significantly moved, and can be set by a person skilled in the art.
When a user takes the handle to use, the handle can generate certain pose change within a certain period of time, so that the state change information of the handle can be determined according to the pose change information (including angle rotation and displacement) of the handle. If the angle rotation value is greater than or equal to the preset angle threshold value and the displacement value is greater than or equal to the preset displacement threshold value, the handle state change information can be basically determined to be first change information. If the angle rotation value is smaller than the preset angle threshold value and the displacement value is smaller than the preset displacement threshold value, the handle state change information can be basically determined to be second change information.
In this embodiment, if the angle rotation value is greater than or equal to the preset angle threshold, the displacement value is greater than or equal to the preset displacement threshold, the light intensity fluctuation direction is downward fluctuation, and the light intensity fluctuation amplitude value is greater than the first preset amplitude value, it may be accurately determined that the handle state change information is first change information, where the first change information is change information that the handle state is changed from the placement state to the picking state. And if the angle rotation value is smaller than the preset angle threshold value, the displacement value is smaller than the preset displacement threshold value, the light intensity fluctuation direction is upward fluctuation, and the light intensity fluctuation amplitude value is larger than a second preset amplitude value, the handle state change information can be accurately determined to be second change information, wherein the second change information is change information that the handle state is changed from the taking state to the placing state.
According to the embodiment, the change information of the handle state is determined by integrating the change information of the light intensity and the pose at the handle holding part shell, so that a more multidimensional judgment basis is provided for the switching of the handle interaction mode, the judgment error generated by only independently detecting the light intensity change information or the pose change information is reduced, and the accuracy of identifying the handle state change information is improved.
In one implementation manner, the step of switching the current interaction mode of the head-mounted display device according to the handle state change information includes:
e10, if the handle state change information is first change information, switching the current interaction mode of the head-mounted display device from the handle interaction mode to the non-handle interaction mode;
and E20, switching the current interaction mode of the head-mounted display device from the non-handle interaction mode to the handle interaction mode if the handle state change information is the second change information.
Illustratively, prior to the step of switching the current interaction mode of the head mounted display device from the handle interaction mode to the non-handle interaction mode, the method further comprises:
step E30, disconnecting a communication link established between the handle and the head-mounted display device;
before the step of switching the current interaction mode of the head mounted display device from the non-handle interaction mode to the handle interaction mode, the method further comprises:
and E40, establishing a communication link between the handle and the head-mounted display device.
In this embodiment, when determining that the handle state change information is the first change information, the head-mounted display device switches the current interaction mode of the head-mounted display device from the handle interaction mode to the non-handle interaction mode, and disconnects from the handle. It is easy to understand that if the current interaction mode of the head-mounted display device is the non-handle interaction mode, the switching from the handle interaction mode to the non-handle interaction mode does not need to be performed.
The method includes the steps of determining that the handle state change information is the second change information, and switching a current interaction mode of the head-mounted display device from a non-handle interaction mode to a handle interaction mode to establish connection with the handle. It is easy to understand that if the current interaction mode of the head-mounted display device is the handle interaction mode, the switching from the non-handle interaction mode to the handle interaction mode does not need to be performed.
In a scene, the optical sensor is shielded by other objects (hands are not), so that the change of the light intensity of the handle holding part cannot be accurately determined, and misjudgment can occur. In another scenario, there is shake on an object (e.g., a table) placed on the handle, so that the change of the state change information of the handle cannot be accurately determined through the change of the holding pose of the handle, and misjudgment can also occur. Therefore, the embodiment determines the handle state change information by integrating the change information of the light intensity and the pose at the handle holding part shell, thereby providing more multidimensional judgment basis for the switching of the handle interaction mode, reducing judgment errors generated by independently detecting the light intensity change information (or called light intensity fluctuation information) or the pose change information, and further improving the accuracy of identifying the handle state change information.
It should be noted that, in this embodiment, the optical sensor, the sound sensor and the inertial sensor are used to collect the light intensity fluctuation information, the sound variation information and the pose variation information respectively, and the comprehensive judgment is performed according to the light intensity, the sound and the pose, so that the situation that the light intensity fluctuation information or the pose variation information is misjudged is avoided, and the accuracy of judging the state variation information of the hand is improved.
Example III
The embodiment of the invention also provides an interaction mode switching device, please refer to fig. 4, the interaction mode switching device is applied to a head-mounted display device, the interaction mode of the head-mounted display device includes a non-handle interaction mode and a handle interaction mode which can be switched with each other, and the interaction mode switching device includes:
the acquisition module 10 is used for acquiring sound change information of the handle, wherein the sound change information is acquired by a sound sensor arranged at a holding part of the handle;
a determining module 20, configured to determine whether the usage state of the handle is changed according to the sound change information;
the detection module 30 is configured to obtain a holding position and posture signal of the handle and a holding portion optical signal if the holding position and posture signal is obtained by acquiring an inertial sensor arranged at a holding portion of the handle, and the holding portion optical signal is obtained by acquiring an optical sensor arranged at the holding portion of the handle;
And the switching module 40 is configured to switch the current interaction mode of the head-mounted display device according to the holding pose signal and the holding portion optical signal.
Optionally, the determining module 20 is further configured to:
according to the sound change information, determining the sound fluctuation amplitude and the sound fluctuation phase characteristics of the handle in a first preset duration;
and determining whether the use state of the handle is changed according to the sound fluctuation amplitude and the sound fluctuation phase characteristic.
Optionally, the determining module 20 is further configured to:
acquiring a sound phase characteristic template for calibrating the vibration state of the holding part in advance;
if the sound fluctuation amplitude value is larger than or equal to a first preset amplitude value, and the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is larger than or equal to a preset ratio threshold value, determining that the use state of the handle is changed;
and if the sound fluctuation amplitude value is smaller than a first preset amplitude value and/or the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is smaller than a preset ratio threshold value, determining that the use state of the handle is not changed.
Optionally, the switching module 40 is further configured to:
Determining pose change information of the handle within a second preset duration according to the holding pose signal, wherein the pose change information comprises an angle rotation value and a displacement value;
determining light intensity fluctuation information of the handle within a third preset duration according to the optical signals of the holding part, wherein the light intensity fluctuation information comprises a light intensity fluctuation direction and a light intensity fluctuation amplitude value;
determining handle state change information according to the angle rotation value, the displacement value, the light intensity fluctuation direction and the light intensity fluctuation amplitude value;
and switching the current interaction mode of the head-mounted display device according to the handle state change information.
Optionally, the switching module 40 is further configured to:
if the angle rotation value is greater than or equal to a preset angle threshold value, the displacement value is greater than or equal to a preset displacement threshold value, the light intensity fluctuation direction is downward fluctuation, and the light intensity fluctuation amplitude value is greater than a first preset amplitude value, determining that the handle state change information is first change information, wherein the first change information is change information that the handle state is changed from a placing state to a taking state;
if the angle rotation value is smaller than a preset angle threshold value, the displacement value is smaller than a preset displacement threshold value, the light intensity fluctuation direction is upward fluctuation, the light intensity fluctuation amplitude value is larger than a second preset amplitude value, and the handle state change information is determined to be second change information, wherein the second change information is change information that the handle state is changed from a taking state to a placing state.
Optionally, the switching module 40 is further configured to:
if the handle state change information is first change information, switching the current interaction mode of the head-mounted display device from the handle interaction mode to the non-handle interaction mode;
and if the handle state change information is second change information, switching the current interaction mode of the head-mounted display device from the non-handle interaction mode to the handle interaction mode.
Optionally, the switching module 40 is further configured to:
disconnecting a communication link established between the handle and the head mounted display device prior to the step of switching a current interaction mode of the head mounted display device from the handle interaction mode to the non-handle interaction mode;
a communication link is established between the handle and the head mounted display device prior to the step of switching the current interaction mode of the head mounted display device from the non-handle interaction mode to the handle interaction mode.
Optionally, the non-handle interaction mode is a bare hand tracking interaction mode, an eye tracking interaction mode, or a head tracking interaction mode.
The interactive mode switching device provided by the embodiment of the invention can solve the technical problem of complicated operation when a user switches the hand interactive mode by adopting the interactive mode switching method in the first embodiment or the second embodiment. Compared with the prior art, the interactive mode switching device provided by the embodiment of the invention has the same beneficial effects as the interactive mode switching method provided by the embodiment, and other technical features in the interactive mode switching device are the same as the features disclosed by the method of the embodiment, and are not repeated herein.
Example IV
An embodiment of the present invention provides a head-mounted display device, including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the interactive mode switching method in the first embodiment.
Referring now to fig. 5, a schematic diagram of a head mounted display device suitable for use in implementing embodiments of the present disclosure is shown. The head mounted display device in embodiments of the present disclosure includes, but is not limited to, a Mixed Reality (Mixed Reality) -MR device (e.g., MR glasses or MR helmets), an augmented Reality (Augmented Reality) -AR device (e.g., AR glasses or AR helmets), a Virtual Reality (Virtual Reality) -VR device (e.g., VR glasses or VR helmets), an augmented Reality (Extended Reality) -XR device, or some combination thereof, and the like head mounted display device. The head mounted display device shown in fig. 5 is only one example and should not impose any limitations on the functionality and scope of use of the disclosed embodiments.
As shown in fig. 5, the head mounted display device may include a processing means 1001 (e.g., a central processor, a graphics processor, etc.) which may perform various appropriate actions and processes according to a program stored in a read only memory (ROM 1002) or a program loaded from a storage means into a random access memory (RAM 1004). In the RAM1004, various programs and data required for the operation of the head mounted display device are also stored. The processing device 1001, the ROM1002, and the RAM1004 are connected to each other by a bus 1005. An input/output (I/O) interface is also connected to bus 1005.
In general, the following systems may be connected to the I/O interface 1006: input devices 1007 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, and the like; an output device 1008 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage device 1003 including, for example, a magnetic tape, a hard disk, and the like; and communication means 1009. The communication means 1009 may allow the head mounted display device to communicate wirelessly or by wire with other devices to exchange data. While a head mounted display device having various systems is shown in the figures, it should be understood that not all of the illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network through a communication device, or installed from the storage device 1003, or installed from the ROM 1002. The above-described functions defined in the method of the embodiment of the present disclosure are performed when the computer program is executed by the processing device 1001.
The head-mounted display device provided by the invention adopts the interactive mode switching method in the embodiment, so that the technical problem of complicated operation when a user switches the hand interactive mode can be solved. Compared with the prior art, the beneficial effects of the head-mounted display device provided by the embodiment of the invention are the same as those of the interactive mode switching method provided by the embodiment, and other technical features of the head-mounted display device are the same as those disclosed by the method of the previous embodiment, so that details are not repeated.
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the description of the above embodiments, particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Example five
An embodiment of the present invention provides a computer-readable storage medium having computer-readable program instructions stored thereon for performing the interactive mode switching method in the above embodiment.
The computer readable storage medium according to the embodiments of the present invention may be, for example, a usb disk, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this embodiment, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
The above-described computer-readable storage medium may be embodied in a head-mounted display device; or may be present alone without being fitted into the head mounted display device.
The computer-readable storage medium carries one or more programs that, when executed by the head-mounted display device, cause the head-mounted display device to: acquiring sound change information of a handle, wherein the sound change information is acquired by a sound sensor arranged at a holding part of the handle; determining whether the use state of the handle is changed according to the sound change information; if yes, acquiring a holding position and posture signal of the handle and an optical signal of a holding part, wherein the holding position and posture signal is acquired through an inertial sensor arranged at the holding part of the handle, and the optical signal of the holding part is acquired through an optical sensor arranged at the holding part of the handle; and switching the current interaction mode of the head-mounted display device according to the holding pose signal and the holding part optical signal.
Computer program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, small talk, C++ and the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present disclosure may be implemented in software or hardware. Wherein the name of the module does not constitute a limitation of the unit itself in some cases.
The computer readable storage medium provided by the application stores the computer readable program instructions for executing the interactive mode switching method, and can solve the technical problem of complicated operation when a user switches the hand interactive mode. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the embodiment of the present application are the same as those of the interactive mode switching method provided by the first embodiment or the second embodiment, and are not described herein.
Example six
The embodiment of the application also provides a computer program product, which comprises a computer program, wherein the computer program realizes the steps of the interactive mode switching method when being executed by a processor.
The computer program product provided by the application can solve the technical problem of complex operation when a user switches the hand interaction mode. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present application are the same as those of the interactive mode switching method provided by the first embodiment or the second embodiment, and are not described herein.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the application, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein, or any application, directly or indirectly, within the scope of the application.

Claims (10)

1. An interaction mode switching method, wherein the interaction mode switching method is applied to a head-mounted display device, and the interaction mode of the head-mounted display device comprises a non-handle interaction mode and a handle interaction mode which can be switched mutually, and the method comprises the following steps:
acquiring sound change information of a handle, wherein the sound change information is acquired by a sound sensor arranged at a holding part of the handle;
determining whether the use state of the handle is changed according to the sound change information;
if yes, acquiring a holding position and posture signal of the handle and an optical signal of a holding part, wherein the holding position and posture signal is acquired through an inertial sensor arranged at the holding part of the handle, and the optical signal of the holding part is acquired through an optical sensor arranged at the holding part of the handle;
and switching the current interaction mode of the head-mounted display device according to the holding pose signal and the holding part optical signal.
2. The interactive mode switching method according to claim 1, wherein the step of determining whether the use state of the handle is changed according to the sound change information comprises:
According to the sound change information, determining the sound fluctuation amplitude and the sound fluctuation phase characteristics of the handle in a first preset duration;
and determining whether the use state of the handle is changed according to the sound fluctuation amplitude and the sound fluctuation phase characteristic.
3. The interactive mode switching method according to claim 2, wherein the step of determining whether the use state of the handle is changed according to the sound fluctuation amplitude and the sound fluctuation phase characteristic comprises:
acquiring a sound phase characteristic template for calibrating the vibration state of the holding part in advance;
if the sound fluctuation amplitude value is larger than or equal to a first preset amplitude value, and the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is larger than or equal to a preset ratio threshold value, determining that the use state of the handle is changed;
and if the sound fluctuation amplitude value is smaller than a first preset amplitude value and/or the matching degree of the sound fluctuation phase characteristic and the sound phase characteristic template is smaller than a preset ratio threshold value, determining that the use state of the handle is not changed.
4. The interactive mode switching method according to claim 1, wherein the step of switching the current interactive mode of the head-mounted display device according to the grip pose signal and the grip optical signal comprises:
Determining pose change information of the handle within a second preset duration according to the holding pose signal, wherein the pose change information comprises an angle rotation value and a displacement value;
determining light intensity fluctuation information of the handle within a third preset duration according to the optical signals of the holding part, wherein the light intensity fluctuation information comprises a light intensity fluctuation direction and a light intensity fluctuation amplitude value;
determining handle state change information according to the angle rotation value, the displacement value, the light intensity fluctuation direction and the light intensity fluctuation amplitude value;
and switching the current interaction mode of the head-mounted display device according to the handle state change information.
5. The interactive mode switching method according to claim 4, wherein the step of determining the handle state change information according to the angle rotation value, the displacement value, the light intensity fluctuation direction, and the light intensity fluctuation amplitude value comprises:
if the angle rotation value is greater than or equal to a preset angle threshold value, the displacement value is greater than or equal to a preset displacement threshold value, the light intensity fluctuation direction is downward fluctuation, and the light intensity fluctuation amplitude value is greater than a first preset amplitude value, determining that the handle state change information is first change information, wherein the first change information is change information that the handle state is changed from a placing state to a taking state;
If the angle rotation value is smaller than a preset angle threshold value, the displacement value is smaller than a preset displacement threshold value, the light intensity fluctuation direction is upward fluctuation, the light intensity fluctuation amplitude value is larger than a second preset amplitude value, and the handle state change information is determined to be second change information, wherein the second change information is change information that the handle state is changed from a taking state to a placing state.
6. The interactive mode switching method according to claim 5, wherein the step of switching the current interactive mode of the head-mounted display device according to the handle state change information comprises:
if the handle state change information is first change information, switching the current interaction mode of the head-mounted display device from the handle interaction mode to the non-handle interaction mode;
and if the handle state change information is second change information, switching the current interaction mode of the head-mounted display device from the non-handle interaction mode to the handle interaction mode.
7. The interaction mode switching method of claim 6, wherein prior to the step of switching the current interaction mode of the head-mounted display device from the handle interaction mode to the non-handle interaction mode, the method further comprises:
Disconnecting a communication link established between the handle and the head mounted display device;
before the step of switching the current interaction mode of the head mounted display device from the non-handle interaction mode to the handle interaction mode, the method further comprises:
a communication link is established between the handle and the head mounted display device.
8. The interaction mode switching method of any of claims 1 to 7, wherein the non-handle interaction mode is a nude-hand tracking interaction mode, an eye-tracking interaction mode or a head-tracking interaction mode.
9. A head-mounted display device, the head-mounted display device comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the interaction-mode switching method of any of claims 1-8.
10. A computer-readable storage medium, wherein a program for implementing an interactive mode switching method is stored on the computer-readable storage medium, the program for implementing the interactive mode switching method being executed by a processor to implement the steps of the interactive mode switching method according to any one of claims 1 to 8.
CN202310639783.7A 2023-05-30 2023-05-30 Interactive mode switching method, head-mounted display device and computer-readable storage medium Pending CN116755554A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310639783.7A CN116755554A (en) 2023-05-30 2023-05-30 Interactive mode switching method, head-mounted display device and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310639783.7A CN116755554A (en) 2023-05-30 2023-05-30 Interactive mode switching method, head-mounted display device and computer-readable storage medium

Publications (1)

Publication Number Publication Date
CN116755554A true CN116755554A (en) 2023-09-15

Family

ID=87948775

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310639783.7A Pending CN116755554A (en) 2023-05-30 2023-05-30 Interactive mode switching method, head-mounted display device and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN116755554A (en)

Similar Documents

Publication Publication Date Title
US9367136B2 (en) Holographic object feedback
US10488918B2 (en) Analysis of user interface interactions within a virtual reality environment
WO2021154437A1 (en) Gaze timer based augmentation of functionality of a user input device
US11803233B2 (en) IMU for touch detection
US20170017303A1 (en) Operation recognition device and operation recognition method
CN108369451B (en) Information processing apparatus, information processing method, and computer-readable storage medium
WO2018179661A1 (en) Information processing apparatus, information processing method, and program
CN109302563B (en) Anti-shake processing method and device, storage medium and mobile terminal
CN108509127B (en) Method and device for starting screen recording task and computer equipment
JP6575518B2 (en) Display control apparatus, display control method, and program
WO2020233170A1 (en) Information display method, apparatus and device, and medium
CN116755554A (en) Interactive mode switching method, head-mounted display device and computer-readable storage medium
CN107463257B (en) Human-computer interaction method and device of virtual reality VR system
CN108292167B (en) Information processing apparatus, information processing method, and program
US9898183B1 (en) Motions for object rendering and selection
CN116700483A (en) Interactive mode switching method, head-mounted display device and computer-readable storage medium
WO2020233167A1 (en) Method, apparatus and device for image capture, and medium
CN116700485A (en) Interactive mode switching method, head-mounted display device and computer-readable storage medium
CN116700484A (en) Hand interaction mode switching method, intelligent handle and computer readable storage medium
US11989344B2 (en) Information display device
US20230409121A1 (en) Display control method, apparatus, electronic device, medium, and program product
EP4283972A1 (en) Imaging device, imaging control method, and program
CN118092629A (en) Multi-mode interaction method, device, electronic equipment and storage medium
CN115981481A (en) Interface display method, device, equipment, medium and program product
CN114786091A (en) Display picture optimization method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination