WO2018196107A1

WO2018196107A1 - Gaming input method and device for virtual reality device, and virtual reality system

Info

Publication number: WO2018196107A1
Application number: PCT/CN2017/087552
Authority: WO
Inventors: 董坤; 张颖; 刘小建
Original assignee: 歌尔科技有限公司
Priority date: 2017-04-26
Filing date: 2017-06-08
Publication date: 2018-11-01
Also published as: CN107185229A

Abstract

A gaming input method and device for a virtual reality device, and a virtual reality system. The method comprises: a camera on a virtual reality device photographs an LED module of an on-foot device to produce images of the LED module during a foot movement (S102); movement posture information of the on-foot device collected by an inertia measurement unit of the on-foot device is acquired (S104); a movement state of the on-foot device is determined on the basis of the images and of the movement posture information (S106); a gaming input in the virtual reality device by a user is determined on the basis of the movement state, and the gaming input is displayed in the virtual reality device (S108), thus implementing immersive experience for the user.

Description

Game input method and device of virtual reality device, virtual reality system

Technical field

The present application relates to the field of smart wearable devices, and more particularly, to a game input method and apparatus for a virtual reality device, and a virtual reality system.

Background technique

Virtual Reality (VR) is a virtual world that uses computer simulation to generate a three-dimensional space. It provides users with simulations of visual, auditory, tactile and other senses, so that users can be as timely as they are. Observe things in the third dimension without restriction.

Developers are now increasingly looking at simulations of user immersive experiences in virtual reality environments. At present, VR head-display technology can complete immersive mobile games by cooperating with peripherals, but for foot games such as live football and shuttlecock, there is currently no VR system that can realize the immersive experience of foot games.

Application content

According to an aspect of the present application, a game input method for a virtual reality device is provided, including:

The camera on the virtual reality device captures an LED module of the foot device to obtain an image of the LED module during the movement of the foot;

Obtaining motion posture information of the foot device collected by the inertial measurement unit of the foot device;

Determining a motion state of the foot device according to the image and the motion posture information;

A game input of the user in the virtual reality device is determined according to the motion state, and the game input is displayed in the virtual reality device.

Optionally, the motion state of the foot device includes at least a moving direction and a moving distance of the foot device.

Optionally, the method further includes:

The virtual reality device monitors whether a particular game input occurs;

If so, a haptic feedback signal is generated that wirelessly transmits the haptic feedback signal to the foot device to cause the foot device to haptic feedback to the user's foot.

Optionally, the specific game input is a function of a force of a foot of a game member in a scene presented by the virtual reality device.

Optionally, wirelessly transmitting the haptic feedback signal to the foot device to cause the foot device to perform tactile feedback on the user's foot, including:

The haptic feedback signal is wirelessly transmitted to the vibration motor of the foot device such that the force of the foot is fed back by the vibration motor.

Optionally, the camera on the virtual reality device photographs the LED module of the foot device, obtains an image of the LED module during the movement of the foot, and acquires the foot collected by the inertial measurement unit of the foot device. Before the motion posture information of the device, the method further includes:

Selecting one game member from a plurality of game members in the scene presented by the virtual reality device, and establishing a corresponding relationship between the selected game member and the user.

Optionally, displaying the game input in the virtual reality device comprises:

The determined game input of the user in the virtual reality device is embodied on a game member selected from the virtual reality scene.

According to a second aspect of the present application, a game input device for a virtual reality device is provided, including:

a first acquiring module, configured to acquire an image of the LED module during a movement of the foot obtained by the camera on the virtual reality device and the LED module of the foot device;

a second acquiring module, configured to acquire motion posture information of the foot device collected by the inertial measurement unit of the foot device;

a determining module, configured to determine a motion state of the foot device according to the image and the motion posture information;

And a display module, configured to determine a game input of the user in the virtual reality device according to the motion state, and display the game input in the virtual reality device.

Optionally, the motion state of the foot device includes at least a movement direction of the foot device And the distance of the movement.

Optionally, the device further includes:

a monitoring module, configured to monitor, by the virtual reality device, whether a specific game input occurs;

And a transmitting module, if yes, generating a haptic feedback signal, wirelessly transmitting the haptic feedback signal to the foot device to cause the foot device to perform tactile feedback on the user's foot.

Optionally, the sending module is further configured to:

Optionally, the device further includes:

And establishing a correspondence module, configured to select a game member from a plurality of game members in the scene presented by the virtual reality device, and establish a correspondence between the selected game member and the user.

Optionally, the display module is further configured to:

According to a third aspect of the present application, there is provided a game input device for a virtual reality device, comprising a memory and a processor, the memory for storing an instruction for controlling the processor to operate to perform the above The game input method of the virtual reality device described in the item.

According to a fourth aspect of the present application, a virtual reality system is provided, including a first foot device, a second foot device, and a virtual reality wearing device, wherein the first foot device is provided with a first LED module and a first inertial measurement unit, the second foot device is provided with a second LED module and a second inertial measurement unit; the virtual reality headset includes a game input device of the virtual reality device as described above.

Optionally, the first LED module and the second LED module are infrared LED modules, the first LED module emits a first wavelength infrared ray, and the second LED module emits a second wavelength infrared ray.

Game input method and device of virtual reality device provided by embodiment of the present application, virtual reality The system determines the movement state of the foot device by capturing an image obtained by capturing the LED module during the movement of the foot, and acquiring the motion posture information of the collected foot device, and virtualizing the motion state of the foot device The corresponding display in the real device realizes the user's immersive experience.

Other features and advantages of the present application will become apparent from the following detailed description of the exemplary embodiments.

DRAWINGS

The accompanying drawings, which are incorporated in FIG

FIG. 1 illustrates a process flow diagram of a game input method of a virtual reality device in accordance with some embodiments of the present application.

2 is a block diagram showing the structure of a game input device of a virtual reality device according to some embodiments of the present application.

FIG. 3 illustrates another structural diagram of a game input device of a virtual reality device according to some embodiments of the present application.

FIG. 4 is a block diagram showing the hardware structure of a game input device of a virtual reality device according to some embodiments of the present application.

FIG. 5 shows a schematic structural diagram of a virtual reality system according to some embodiments of the present application.

6 shows a physical schematic of a virtual reality headset, in accordance with some embodiments of the present invention.

detailed description

Some exemplary embodiments of the present application will now be described in detail with reference to the drawings. It should be noted that the relative arrangement of the components and steps, numerical expressions and numerical values set forth in the embodiments are not intended to limit the scope of the application.

The following description of the at least one exemplary embodiment is merely illustrative and is in no way

Techniques, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail. The techniques, methods, and devices should be considered as part of the specification, where appropriate.

In all of the examples shown and discussed herein, any specific values are to be construed as illustrative only and not as a limitation. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that similar reference numerals and letters indicate similar items in the following figures, and therefore, once an item is defined in one figure, it is not required to be further discussed in the subsequent figures.

Some embodiments of the present application provide a game input method of a virtual reality device. FIG. 1 illustrates a process flow diagram of a game input method of a virtual reality device in accordance with some embodiments of the present application. Referring to FIG. 1, the method includes at least steps S102 to S108.

Step S102, the camera on the virtual reality device photographs the LED module of the foot device, and obtains an image of the LED module during the movement of the foot;

Step S104, acquiring motion posture information of the foot device collected by the inertial measurement unit of the foot device;

Step S106, determining a motion state of the foot device according to the image and the motion posture information;

Step S108, determining a game input of the user in the virtual reality device according to the motion state, and displaying the game input in the virtual reality device.

The game input method of the virtual reality device provided by some embodiments of the present application determines the image of the foot device by capturing an image obtained by capturing the LED module during the movement of the foot and acquiring the motion posture information of the collected foot device. The motion state and the motion state of the foot device are displayed correspondingly in the virtual reality device, thereby realizing the user's immersive experience.

In some embodiments of the present application, the motion state of the foot device may be determined according to the image corresponding to the captured LED module and the motion posture information of the foot device acquired by the acquired inertial measurement unit. The motion state of the foot device includes at least the direction of motion and the distance of movement of the foot device.

In some embodiments of the present application, when the user wears the foot device for exercise, the LED module disposed on the foot device moves accordingly. By real-time shooting of the LED module of the foot device, an image corresponding to the movement of the LED module can be obtained. The moving distance of the foot device can be determined according to the corresponding image when the LED module is moved. The direction of movement of the foot device can be determined based on the inertial measurement unit of the foot device. The inertial measurement unit of the foot device includes at least an acceleration sensor And gyro sensor.

In some embodiments of the present application, before the LED module of the foot device is photographed, the image of the LED module during the movement of the foot is obtained, and the motion posture information of the foot device collected by the inertial measurement unit of the foot device is acquired. A game member is selected from a plurality of game members in the scene presented by the virtual reality device, and the corresponding relationship between the selected game member and the user is established. Then, based on the image of the captured LED module and the acquired motion posture information of the foot device, the motion state of the foot device is determined, and then the user's game input in the virtual reality device is determined according to the motion state of the foot device. Finally, the determined game input of the user in the virtual reality device is embodied on the selected game member.

In some embodiments of the present application, the virtual reality device also needs to monitor whether a particular game input occurs. If a particular game input is detected, the virtual reality device generates a tactile feedback signal and wirelessly transmits the tactile feedback signal to the foot device. After receiving the haptic feedback signal, the foot device performs tactile feedback on the user's foot. The tactile feedback of the foot device to the user's foot can be achieved by a vibration motor. The VR device can transmit the haptic feedback signal to the foot device through the Bluetooth communication method or the WIFI communication method. This application does not limit the application.

In some embodiments of the present application, the particular game input is the force of the foot of the game member in the scene presented by the virtual reality device. For example, in a soccer game scene, a soccer game member receives an instant of another soccer game member's pass, and the soccer game member's foot is hit by the soccer ball. For another example, in the kicking game scene, when the game member kicks the scorpion, the foot of the game member is subjected to the force of the scorpion.

It should be noted that the above steps S102 and S104 are two simultaneous operation steps. In addition, the game input method of the virtual reality device provided by some embodiments of the present application is a real-time process. The image corresponding to the LED module of the obtained foot device is information that changes in real time, and the obtained motion posture information measured by the inertial measurement unit of the foot device is also information that changes in real time. Correspondingly, the determined motion state of the foot device is also a real-time changing state, and the game input of the user in the virtual reality device determined according to the motion state of the foot device that changes in real time also changes in real time. The virtual reality device needs to present the user's game input in real time.

Some embodiments of the present application provide a game input device for a virtual reality device. Figure 2 shows A schematic structural diagram of a game input device of a virtual reality device according to some embodiments of the present application. Referring to FIG. 2, the game input device of the virtual reality device includes at least: a first acquiring module 210, configured to acquire an image of the LED module during the movement of the foot obtained by the camera on the virtual reality device and the LED module of the foot device; The second obtaining module 220 is configured to acquire the motion posture information of the foot device collected by the inertial measurement unit of the foot device; the determining module 230 is configured to determine the motion state of the foot device according to the image and the motion posture information; the display module 240, A method for determining a user's game input in the virtual reality device according to the motion state, and displaying the game input in the virtual reality device.

In some embodiments of the present application, the motion state of the foot device includes at least the direction of motion and the distance of movement of the foot device.

In some embodiments of the present application, referring to FIG. 3, the game input device of the virtual reality device further includes: a correspondence establishing module 250, configured to select one game member from a plurality of game members in the scene presented by the virtual reality device, and establish a selection. The correspondence between the game members and the users. The display module 240 is further configured to display the determined game input of the user in the virtual reality device on the game member selected from the virtual reality scene.

In some embodiments of the present application, referring to FIG. 3, the game input device of the virtual reality device further includes: a monitoring module 260, configured for the virtual reality device to monitor whether a specific game input occurs; and a sending module 270, configured to: if the monitoring module 260 detects A specific game input occurs, a haptic feedback signal is generated, and the haptic feedback signal is wirelessly transmitted to the foot device to cause the foot device to tactilely feedback the user's foot.

FIG. 4 is a block diagram showing the hardware structure of a game input device of a virtual reality device according to some embodiments of the present application. Referring to FIG. 4, the game input device of the virtual reality device includes at least a memory 420 and a processor 410. The memory 420 is for storing instructions for controlling the processor 410 to operate to perform a game input method of a virtual reality device in accordance with some embodiments of the present application.

The memory 420 can include high speed random access memory and can also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.

Some of the applications of the present application provide a virtual reality system. FIG. 5 shows a schematic structural diagram of a virtual reality system according to an embodiment of the present application. Referring to FIG. 5, the virtual reality system includes the first foot. The device 510, the second foot device 520, and the virtual reality headset 530. The first foot device 510 is provided with a first LED module and a first inertial measurement unit. The second foot device 520 is provided with a second LED module and a second inertial measurement unit. The virtual reality headset 530 includes a game input device 5310 of the virtual reality device according to any of the above embodiments.

In the embodiment of the present application, the first foot device 510 is worn on the left foot of the user, and the second foot device 520 is worn on the right foot of the user. The first foot device 510 and the second foot device 520 each include at least a circuit board and a first processor, an LED module, an inertial measurement unit, a foot device communication module, and a vibration motor disposed on the circuit board. The game input device 5310 of the virtual reality device includes at least a second processor, a camera module, a storage module, a display module, and a virtual reality headset communication module. The LED module can be an array of LEDs disposed on the circuit board. Specifically, a plurality of LED lights are evenly arranged on the circuit board along the peripheral contour of the user's foot.

The camera module of the virtual reality headset includes a first camera module and a second camera module, and the virtual reality headset communication module includes a first communication module and a second communication module. FIG. 6 shows a physical schematic diagram of a virtual reality headset in accordance with an embodiment of the present invention. The virtual reality headset 600 shown in FIG. 6 is provided with two camera modules, namely a first camera module 610 and a second camera module 620. The first camera module 610 is used to capture an LED module of the first foot device that is worn on the left foot of the user. The first communication module is used as a communication component between the virtual reality headset and the first foot device. The second camera module 620 is used to capture an LED module of a second foot device that is worn on the user's right foot. The second communication module is used as a communication component between the virtual reality headset and the second foot device.

The LED module is coupled to the first processor, the inertial measurement unit is coupled to the first processor, the foot device communication module is coupled to the first processor, and the vibration motor is coupled to the first processor.

The first camera module can take a real-time shot of the LED module of the first foot device and send the captured image to the second processor. The second camera module can take a real-time shot of the LED module of the second foot device and send the captured image to the second processor.

The inertial measurement unit is configured to measure a motion posture of the foot device, and transmit the measured motion posture information to the first processor. The first processor is configured to transmit the received motion pose information to the virtual reality headset 530 via the foot device communication component. The second processor is configured to acquire motion posture information sent by the first foot device by using the first communication module, and according to the received image And the motion posture information determines the motion state of the first foot device. At the same time, the second processor is configured to acquire the motion posture information sent by the second foot device through the second communication module, and determine the motion state of the second foot device according to the received image and the motion posture information. The second processor determines a game input of the user in the virtual reality device according to the motion state of the first foot device and the motion state of the second foot device, and inputs the determined game to the display module of the virtual reality headset Displayed on.

When the right foot of the user in the virtual reality scene displayed by the display module of the virtual reality headset 530 is subjected to a force, the second processor acquires the right foot of the user in the virtual reality scene from the display module. After the information, a haptic feedback signal is generated, and the haptic feedback signal is sent to the first processor of the second foot device 520 through the second communication module. After receiving the haptic feedback signal, the first processor sends a control signal to the vibration motor. When the vibration motor receives the control signal, it starts to vibrate to feedback the right foot force.

In some embodiments of the present application, the LED module of the first foot device and the LED module of the second foot device are preferably infrared LED modules that emit infrared light. The first camera module and the second camera module of the virtual reality headset are preferably infrared camera modules. The infrared light emitted by the infrared LED module provided by the first foot device is different from the wavelength of the infrared light emitted by the infrared LED module provided by the second foot device. For example, the infrared light emitted by the infrared LED module of the first foot device has a wavelength of 850 nm, and the infrared light emitted by the infrared LED module of the second foot device has a wavelength of 900 nm. The first camera module of the virtual reality headset is used to capture the infrared LED module of the first foot device, and the second camera module is used to capture the infrared LED module of the second foot device. It should be noted that the LED module may also be a module that emits visible light, and the present application does not limit it.

In some embodiments of the present application, the inertial measurement unit of the foot device is further configured to record the number of motion steps of the user wearing the foot device, and send the number of motion steps to the virtual reality headset 530 through the foot device communication module. After receiving the motion step number by the virtual reality headset communication module, the second processor of the virtual reality headset 530 sends the motion step to the display module and displays it on the display module.

Taking the football game scene as an example, before the game starts, the virtual reality scene in the virtual reality device shows 22 football players. The user can access the device through the virtual reality headset Among the 22 football players, one football player is selected. For example, the No. 4 football player will select the No. 4 football player as the user in the virtual reality scene, and associate the No. 4 football player with the user. The user's left foot is wearing the first foot device, and the user's right foot is wearing the second foot device. After the football game begins, users wearing two foot devices can exercise. The virtual reality headset can determine the distance of movement of the first foot device based on the image captured by the LED module of the first foot device. The virtual reality headset can determine the distance of movement of the second foot device based on the image captured by the LED module of the second foot device. The virtual reality wearing device determines the moving direction of the first foot device according to the acquired motion posture information collected by the inertial measurement unit of the first foot device. The virtual reality wearing device determines the moving direction of the second foot device according to the acquired motion posture information collected by the inertial measurement unit of the second foot device. Then, the virtual reality wearing device determines the motion state of the first foot device and the second leg according to the determined moving distance and moving direction of the first foot device, and the moving distance and the moving direction of the second foot device. The motion state of the device. Finally, the virtual reality wearing device determines the user's game input in the virtual reality wearing device according to the determined motion state of the first foot device and the motion state of the second foot device, and presents in the virtual reality scene. . For example, the user wearing the foot device is moving, and the virtual reality wearing device determines that the movement distance of the first foot device is 10 m according to the image taken by the LED module of the first foot device, according to the second foot device The LED module captures the obtained image and determines that the second foot device has a moving distance of 10 m. The virtual reality wearing device determines, according to the motion posture information of the first foot device collected by the inertial measurement unit of the first foot device, that the motion direction of the first foot device is forward motion, according to the inertia of the second foot device The motion posture information of the second foot device collected by the measuring unit determines that the moving direction of the second foot device is forward motion. According to the motion state of the first foot device and the second foot device, it is determined that the user's game input in the virtual reality device is forward motion 10m, and the game input is displayed in the virtual reality device. The above state of motion is then embodied in the No. 4 football player selected from the virtual reality scene.

When the selected No. 4 football player displayed in the virtual reality scene receives the soccer ball from other football players, the selected No. 4 football player performs the right ankle kicking action. At this time, after the virtual reality wearing device monitors the right ankle kicking motion of the No. 4 football player, a tactile feedback signal is generated, and the tactile feedback signal is wirelessly transmitted to the second foot device. Second foot device connection After receiving the haptic feedback signal, the vibration motor disposed on the second foot device is controlled to vibrate, so that the user's right foot receives the feedback of the force condition, thereby realizing the user's immersive experience.

The application can be a system, method and/or computer program product. The computer program product can comprise a computer readable storage medium having computer readable program instructions embodied thereon for causing a processor to implement various aspects of the present application.

The computer readable storage medium can be a tangible device that can hold and store the instructions used by the instruction execution device. The computer readable storage medium can be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) Or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, for example, with instructions stored thereon A raised structure in the hole card or groove, and any suitable combination of the above. A computer readable storage medium as used herein is not to be interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (eg, a light pulse through a fiber optic cable), or through a wire The electrical signal transmitted.

The computer readable program instructions described herein can be downloaded from a computer readable storage medium to various computing/processing devices or downloaded to an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in each computing/processing device .

Computer program instructions for performing the operations of the present application can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine related instructions, microcode, firmware instructions, state setting data, or in one or more programming languages. Source code or object code written in any combination, including object oriented programming languages such as Smalltalk, C++, etc., as well as conventional procedural programming languages such as the "C" language or similar programming languages. Computer readable program instructions It may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer, partly on the remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computer (eg, using an Internet service provider to access the Internet) connection). In some embodiments, the customized electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by utilizing state information of computer readable program instructions. Computer readable program instructions are executed to implement various aspects of the present application.

Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus, and computer program products according to some embodiments of the present application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams can be implemented by computer readable program instructions.

The computer readable program instructions can be provided to a general purpose computer, a special purpose computer, or a processor of other programmable data processing apparatus to produce a machine such that when executed by a processor of a computer or other programmable data processing apparatus Means for implementing the functions/acts specified in one or more of the blocks of the flowcharts and/or block diagrams. The computer readable program instructions can also be stored in a computer readable storage medium that causes the computer, programmable data processing device, and/or other device to operate in a particular manner, such that the computer readable medium storing the instructions includes An article of manufacture that includes instructions for implementing various aspects of the functions/acts recited in one or more of the flowcharts.

The computer readable program instructions can also be loaded onto a computer, other programmable data processing device, or other device to perform a series of operational steps on a computer, other programmable data processing device or other device to produce a computer-implemented process. Thus, instructions executed on a computer, other programmable data processing apparatus, or other device implement the functions/acts recited in one or more of the flowcharts and/or block diagrams.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a portion of an instruction. A module, program segment, or portion of an instruction contains one or more executable instructions for implementing the specified logical functions. In some alternative implementations, the functions noted in the blocks may also occur in a different order than those illustrated in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or function. Or it can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are equivalent.

The various embodiments of the present application have been described above, and the foregoing description is illustrative, not limiting, and not limited to the disclosed embodiments. Numerous modifications and changes will be apparent to those skilled in the art without departing from the scope of the invention. The choice of terms used herein is intended to best explain the principles, practical applications, or improvements of the techniques in the various embodiments of the embodiments, or to enable those of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the application is defined by the appended claims.

Claims

A game input method for a virtual reality device, comprising:

The camera on the virtual reality device captures an LED module of the foot device to obtain an image of the LED module during the movement of the foot;

Obtaining motion posture information of the foot device collected by the inertial measurement unit of the foot device;

Determining a motion state of the foot device according to the image and the motion posture information; determining a game input of the user in the virtual reality device according to the motion state, and inputting the game in the virtual reality device Shown in .
The method of claim 1 wherein the state of motion of the foot device comprises at least a direction of motion and a distance of movement of the foot device.
The method according to claim 1 or 2, wherein the method further comprises:

The virtual reality device monitors whether a particular game input occurs;

If so, a haptic feedback signal is generated that wirelessly transmits the haptic feedback signal to the foot device to cause the foot device to haptic feedback to the user's foot.
The method of claim 3 wherein said particular game input is a force applied to a foot of a game member in a scene presented by said virtual reality device.
The method according to claim 3 or 4, wherein the wirelessly transmitting the haptic feedback signal to the foot device to cause the foot device to perform tactile feedback on the user's foot comprises:

The haptic feedback signal is wirelessly transmitted to the vibration motor of the foot device such that the force of the foot is fed back by the vibration motor.
The method according to any one of claims 1-5, wherein the camera on the virtual reality device captures an LED module of the foot device to obtain an image of the LED module during the movement of the foot, and Before acquiring the motion posture information of the foot device collected by the inertial measurement unit of the foot device, the method further includes:

Selecting one game member from a plurality of game members in the scene presented by the virtual reality device, and establishing a corresponding relationship between the selected game member and the user.
The method of claim 6, wherein displaying the game input in the virtual reality device comprises:

The determined game input of the user in the virtual reality device is embodied on a game member selected from the virtual reality scene.
A game input device for a virtual reality device, comprising:

a first acquiring module, configured to acquire an image of the LED module during a movement of the foot obtained by the camera on the virtual reality device and the LED module of the foot device;

a second acquiring module, configured to acquire motion posture information of the foot device collected by the inertial measurement unit of the foot device;

a determining module, configured to determine a motion state of the foot device according to the image and the motion posture information;

And a display module, configured to determine a game input of the user in the virtual reality device according to the motion state, and display the game input in the virtual reality device.
The device according to claim 8, wherein the state of motion of the foot device comprises at least a direction of motion and a distance of movement of the foot device.
The device according to claim 8 or 9, wherein the device further comprises:

a monitoring module, configured to monitor, by the virtual reality device, whether a specific game input occurs;

And a transmitting module, if yes, generating a haptic feedback signal, wirelessly transmitting the haptic feedback signal to the foot device to cause the foot device to perform tactile feedback on the user's foot.
The apparatus according to claim 10, wherein said specific game input is a function of a force of a foot of a game member in a scene presented by said virtual reality device.
The device according to claim 10 or 11, wherein the sending module is further configured to:

The haptic feedback signal is wirelessly transmitted to the vibration motor of the foot device such that the force of the foot is fed back by the vibration motor.
The device according to any one of claims 8 to 12, wherein the device further comprises:

And establishing a correspondence module, configured to select a game member from a plurality of game members in the scene presented by the virtual reality device, and establish a correspondence between the selected game member and the user.
The device according to claim 13, wherein the display module is further configured to:

The determined game input of the user in the virtual reality device is embodied on a game member selected from the virtual reality scene.
A game input device for a virtual reality device, comprising: a memory for storing instructions, wherein the instructions are for controlling the processor to perform operations according to any one of claims 1 to 7 A game input method of the virtual reality device described.
A virtual reality system, comprising: a first foot device, a second foot device, and a virtual reality wearing device, wherein the first foot device is provided with a first LED module and a first inertial measurement unit, The second foot device is provided with a second LED module and a second inertial measurement unit; the virtual reality wearing device comprises a game input device of the virtual reality device according to any one of claims 8-14.
The virtual reality system according to claim 16, wherein the first LED module and the second LED module are infrared LED modules, and the first LED module emits a first wavelength infrared, the second LED The module emits a second wavelength of infrared light.