RU206671U1 - VIRTUAL REALITY INTERACTION CONTROLLER - Google Patents

Abstract

The utility model relates to input devices for interaction in virtual reality, and in particular, to a controller for training shooting and practicing skills in handling small arms in virtual simulators and simulators. The technical result, which manifests itself in solving the above problem, is the expansion of the arsenal of technical means of the interaction controller in virtual reality. Controller for interaction in virtual reality, containing a body made in the form of imitation of firearms, containing a magazine, a trigger and a bolt with a striker, while the body contains a store presence sensor, a shutter position sensor, vibration isolation, a virtual reality tracker, a status control module. 6 c.p. f-ly, 2 dwg

Description

FIELD OF TECHNOLOGY

The utility model relates to input devices for interaction in virtual reality, and in particular, to a controller for training shooting and practicing tactical and technical skills in handling small arms in virtual simulators and simulators.

LEVEL OF TECHNOLOGY

With the development of virtual reality, devices and systems of interaction in a virtual environment have become widespread. Such devices and systems help expand functionality in a virtual environment and affect the user experience as a whole, on a par with the technologies of VR headsets themselves, expanding the boundaries of the immersion level. Currently, there are a huge variety of devices for interaction in virtual reality, for example: gamepads, joysticks, game controllers, etc.

Thus, universal controllers such as the Vive controller from the NTS company, the touch controller from the Oculus company, etc. have become widespread. They are most often used to interact with VR (virtual reality) game consoles. This type of controller provides interaction with any objects in virtual reality. For example, they allow you to take any objects, shoot weapons, interact with any objects in virtual reality, etc.

The disadvantages of such controllers include a low level of immersion and realism due to their design features (controller weight, universal controller body, tactile response, etc.). Also, such controllers are not intended for teaching and training professional skills in simulators and virtual simulators, where a low level of immersion and similarity with real objects can lead to extreme consequences.

In addition to universal controllers, there are also controllers designed to perform highly specialized actions, such as weapon simulators, welding machine simulator, etc. Such controllers, as a rule, provide high realism due to the similarity to real objects in appearance and imitation of functions inherent in the real object (for example, recoil, aiming, firing a shot, etc.) for which these objects were created.

So, from the prior art known game controller for interaction in virtual reality disclosed in US patent No. US 6569019 B2 (patent holder: COCHRAN WILLIAM), publ. May 27, 2003. The controller contains a body made in the form of a rifle and a set of sensors for positioning and tracking movements in virtual space. The specified controller provides intuitive control of objects in virtual space and a high level of realism due to the repetition of the controls of real objects (trigger, stock, muzzle, etc.), which makes shooting, aiming, holding the controller for the user as natural as interaction with a real rifle.

The disadvantages of this solution is the impossibility of its use in simulators and virtual simulators for training in shooting, because, despite the partial coincidence of the appearance of the controller with the rifle, the specified controller does not exactly repeat the real weapon in terms of weight and size characteristics and appearance, which is critical when learning to handle weapons and shooting. Also, the controller does not provide for the possibility of reloading, movement of the rifle elements (movement of the bolt) and recoil that occurs when a real shot is made, which is also critical for virtual simulators.

A controller is also known from the prior art, in particular in the form of a revolver for simulating shooting in virtual reality, disclosed in US patent No. US 10234240 B2 (patentee:

SHOOTING SIMULATOR LLC), publ. 03/19/2019. The specified controller exactly repeats the revolver and contains such elements as the trigger, the drum, the handle, the barrel, the bike. The controller is made with the ability to translate into virtual reality the position of the weapon in space using an optical tracking system located on the rail mechanism under the barrel of the weapon simulator. Also, the controller is configured to load blank cartridges into the drum to recreate the recoil made when firing and simulate the discharge of the specified drum.

The disadvantages of this solution is that this controller is not applicable for use in virtual simulators simulating self-loading (automatic, semi-automatic) pistols, since this type of weapon simulators is equipped with bolts and magazines, interaction with which is an important part of the process of learning shooting and practicing skills in handling weapons. Also, the use of an optical tracking system has disadvantages such as line-of-sight problems and may be adversely affected by ambient light and infrared radiation.

A common disadvantage of existing solutions in this field of technology is the lack of a controller for training in shooting and practicing skills in handling weapons in a virtual simulator that generates real recoil and tracks, and translates the main elements of a weapon simulator (bolt, magazine) into virtual reality to ensure a high level of immersion and realism. Also, this kind of controller must be compatible with an inertial tracker and be able to track the moment of the shot.

ESSENCE OF THE TECHNICAL SOLUTION

This technical solution is aimed at eliminating the disadvantages inherent in existing solutions known from the prior art.

The solution to a technical problem or a technical problem is to create a new controller designed for interaction in virtual reality.

The technical result, which manifests itself when solving the above problem, is to expand the functionality of the controller for interaction in virtual reality by tracking the position of the shutter, tracking the availability of the store and determining the moment the shot is fired.

An additional technical result, which manifests itself in solving the above problem, is the expansion of the arsenal of technical means for this purpose.

These technical results are achieved through the implementation of a controller for interaction in virtual reality, comprising: a body made in the form of an imitation of a firearm containing a magazine, a trigger and a shutter, while the body contains: a store presence sensor configured to send a signal about the presence of a simulator magazine weapons to the status control module; a shutter position sensor configured to send a shutter position signal of the weapon simulator to the status monitoring module; vibration isolation, made with the possibility of damping vibrations and vibrations that occur when firing and moving in space of the weapon simulator; a virtual reality tracker configured to broadcast a set of weapon simulator state data received from the state control module to virtual reality; a state control module containing an inertial measuring module configured to: receive signals from a store presence sensor and a weapon simulator shutter position sensor; determining the moment of firing a weapon simulator; formation of a set of data on the state of the weapon simulator, including: the position of the shutter, the presence of a magazine, orientation in space, the execution of a shot; transferring a set of data on the state of the weapon simulator to the virtual reality tracker.

In one of the private variants of the controller implementation, the virtual reality tracker is located on vibration isolation.

In another particular embodiment of the controller, the moment of firing the shot is determined by receiving a signal from the inertial measuring module about exceeding the permissible vibration level of the weapon simulator.

In another particular embodiment of the controller, the acceptable vibration level of the weapon simulator is a plateau level generated by the moving average method within the selected time window.

In another particular embodiment of the controller, after detecting a shot, the state control module stops detecting a shot for a predetermined time interval to block multiple responses to a completed shot.

In another particular embodiment of the controller, the bolt position sensor consists of a magnet installed in the bolt of the weapon simulator and a Hall sensor installed in the handle of the weapon simulator.

In another particular embodiment of the controller, the magazine presence sensor consists of a magnet installed in the magazine of the weapon simulator and a Hall sensor installed in the handle of the weapon simulator.

BRIEF DESCRIPTION OF DRAWINGS

The features and advantages of this technical solution will be disclosed further from the following detailed description and the accompanying drawings, in which:

FIG. 1 shows an example of implementation of an interaction controller in virtual reality.

FIG. 2 shows a diagram of the definition of a shot by the internal mechanics of the interaction controller in virtual reality.

DETAILED DESCRIPTION

Below will be described the terms and concepts necessary for the implementation of this technical solution.

Virtual reality (BP, English virtual reality, VR, artificial reality) is a world created by technical means, transmitted to a person through his sensations: sight, hearing, touch and others. Virtual reality simulates both exposure and responses to exposure. To create a convincing complex of sensations of reality, computer synthesis of properties and reactions of virtual reality is performed in real time.

Sensor is a collective term that can mean: measuring transducer; primary measuring transducer; sensitive element.

Vibration isolation - the ability of an obstacle (vibration isolator, vibration support, vibration isolation) to isolate the structure from vibration propagating along it.

FIG. 1 shows an example of implementation of the interaction controller in virtual reality 100. The specified controller 100 comprises a housing 110 made in the form of a simulated weapon, containing a store presence sensor (not shown), a shutter position sensor (not shown), vibration isolation 120, a virtual reality tracker 130 and a control module states (not shown).

The elements of the claimed controller 100 are fixed between themselves and the supporting elements of the structure using a wide range of assembly operations, for example, screwing, joining, soldering, riveting, etc., depending on the most suitable method of fastening the elements.

Housing 110 is a simulated firearm. The body 110 includes the main elements of a firearm, such as a frame with a barrel and a trigger guard, a bolt with a drummer, a firing mechanism, a handle, a magazine. The housing 110 may also include a recoil-simulating mechanism, such as compressed air or a mechanical spring, to simulate the recoil associated with firing a shot. In a specific embodiment, a pneumatic pistol PM-658K is selected as a simulator of a firearm as a simulator of a standard PM-56-A-125 due to the maximum coincidence of weight and size characteristics and the presence of an imitation of the shutter stroke when fired. However, it is obvious to a person skilled in the art that any other model of both pneumatic and combat pistols can be used as a simulator of a firearm, for example, a Gletcher PM, TT, Glock 17, etc. can be used as a simulator of a firearm.

The main requirement when choosing a case 110 is to ensure maximum similarity to a real weapon (presence of a magazine, imitation of the shutter travel, imitation of recoil) for a high level of immersion of the user in virtual reality and improving the process of learning shooting and weapon handling skills.

The shutter position sensor and the magazine presence sensor are measuring means configured to detect the presence of a simulated weapon magazine, for example, a pressure sensor, a squeeze sensor, etc., and the bolt position of a simulated weapon, for example, a linear displacement sensor, a position sensor based on the Hall effect, etc. The shutter position sensor and the magazine presence sensor are connected to the status monitoring module. A Hall effect position sensor is used as the gate position sensor and the magazine presence sensor in a particular embodiment. To implement the position sensor, a Hall sensor is installed in the handle of the housing 110, and magnets are installed in the magazine and bolt carrier. When each of the axes of the magnets and the position sensor coincide, a signal is generated, which is sent to the status control module, where the received signal is further processed.

Vibration decoupling 120 provides reliable and continuous tracking of the position in space to the VR tracker 130 when firing. The main function of vibration isolation 120 is to isolate the tracker 130 from vibrations generated in the device 100.

In the process of training or training in shooting and weapon handling skills using interaction controllers in virtual reality, there are situations when, when a weapon simulator is suddenly moved or a series of shots is fired, strong oscillations of the weapon simulator occur, which affect the internal accelerometer of the virtual reality inertial tracker, reducing the accuracy of positioning the weapon simulator in space, the level of immersion of the user, and also lead to desynchronization of the position of the weapon simulator in space and in virtual reality. Such undesirable effects may not greatly affect the gameplay of an ordinary user, however, they are completely unacceptable when training police officers, collectors, military personnel, etc. not limited to where high accuracy and a high level of immersion of the trainee is required, since any inaccuracy in training can lead to extreme consequences in a real situation.

To eliminate the vibrations of the tracker 130 that occur at the time of a shot or movement of the weapon, vibration isolation 120 is used, which is two plates connected to each other by shock absorbers that damp the resulting vibrations. In one embodiment, vibration decoupler 120 may consist of a plate that is attached to the weapon simulator body 110 using shock absorbers. A vibration damping plate, vibration mount, etc., but not limited to, can also be used as vibration isolation 120.

It should also be noted that in the present description of the claimed solution, the term "vibration isolation" refers to a structure that dampens vibrations caused by certain factors. Such factors, as mentioned above, may be, for example, abrupt movement of the device 100, shaking of the device 100, etc., but are not limited to.

Vibration decoupler 120 also includes an area for attaching a tracker 130, as shown in FIG. 1. It will be obvious to the specialist that any vibration isolation design can be used that dampens the arising vibrations in the weapon simulator and is designed to install a virtual reality tracker. The material from which the vibration isolation plate 120 is made can be selected: carbon, plastic, aluminum, etc.

The virtual reality tracker 130 is designed to determine the position of an object in space and to recreate the position of the body in virtual space (VR). In addition, the tracker 130 is capable of broadcasting incoming events to virtual reality. Also, the tracker 130 contains connectors for connecting controller elements, for example, a status monitoring module. In one embodiment, tracker 130 is a virtual reality inertial tracker mounted on a weapon simulator for translating the simulated weapon's position in space and a dataset of the weapon simulator's state into virtual reality. Tracker 130 may include one or more accelerometers and / or gyroscopes for tracking the movement of body 110 of controller 100. In another embodiment, tracker 130 may be an optical tracker and include a set of position sensors tracked by cameras.

The inertial tracker can be a commercially available inertial tracker such as the Vive ™ tracker from HTC. However, it will be apparent to one skilled in the art that any virtual reality inertial tracker can be used. The transmission of data on the position in space and the state of the weapon simulator from the tracker 130 to virtual reality is carried out using any of the known wired or wireless data transmission means, for example, a GSM modem, a GPRS modem, an LTE modem, a 5G modem, a satellite communication module, an NFC module, Bluetooth and / or BLE module, Wi-Fi module, etc.

The status monitoring module can be a controller board, controller, microcontroller, etc. The condition monitoring module also contains an inertial measurement module and an ADC. The state control module is configured to receive signals from the shutter position sensors and the presence of a magazine, process the received signals, determine the moment of the shot (the schemes for determining the moment of the shot will be described in more detail in the description below), generate a set of data on the state of the weapon simulator based on the data received from a shutter position sensor, a magazine presence sensor and data on the execution of a shot, transmitting a set of data about the state of the weapon simulator to the virtual reality tracker 130. The status monitoring module in a particular embodiment is configured to be connected to the tracker 130 via a wired connection, however, it is obvious to a person skilled in the art that wireless means of connection can also be used.

Using the controller 100 for interaction in virtual reality allows you to determine the moment of the shot and control the position of the main elements of the specified controller 100 (the position of the shutter, the position of the store), as well as translate them into virtual reality. In this case, virtual reality is understood as a specific technical tool that generates the virtual world. So, for example, the controller 100 is configured to broadcast data on the position of the shutter, the presence of a store, orientation in space, as well as data on the execution of a shot, to a computer, smartphone, virtual console (Oculus Rift, Playstation VR, etc.), independent glasses or virtual reality helmets, etc. not limited to. The main area of application for the controller 100 is training in shooting and weapon handling in virtual simulators and simulators. However, said controller 100 is also intended for use in VR games.

A VR simulator, in comparison with a VR game, allows you to form behavioral models and practice skills, simulating situations and reproducing the situation as close as possible to life. The features of the simulators include the realistic physics of the behavior of objects, a high degree of detailing of objects, the training process as close as possible to real conditions.

To meet the high demands of VR simulators, the 100 controller provides a high level of user immersion in virtual reality by fully replicating the functions of real weapons. By broadcasting and tracking the position of the shutter and magazine of the controller 100, as well as the presence of recoil when firing, the user can see in virtual reality the movements that he makes on the specified controller 100, which increases the user's level of immersion in virtual reality and expands the possibilities of interaction with the virtual environment.

Next, let's move on to consider a typical scenario for the controller 100 in a virtual reality simulator.

The user starts training in shooting and handling weapons in the virtual simulator. Skills that a user can practice using controller 100 may include reloading a weapon (replacing a magazine), putting a weapon on alert (cocking a bolt), and so on. The type of training depends on the level of training of the user and the specifics of his field of activity. So, for the military, a scenario of hostilities in the field can be reproduced, for the police - a scenario for the arrest of a criminal, for collectors - a scenario for a robbery of a collector's transport, etc. When the user interacts with the controller 100, said controller 100 continuously broadcasts, using the virtual reality tracker 130, its position in space into virtual reality. The broadcast of the position in space occurs in parallel with other actions that the user performs on the controller 100 and which are also broadcast into virtual reality.

Thus, when the user makes a shot on the controller 100 or manually moves the shutter to charge it, the status control module receives a signal from the shutter position sensor about the movement of the shutter of the controller 100. When using a Hall effect sensor as a shutter position sensor, into the shutter a magnet is placed on the controller 100, and a Hall effect position sensor is located in the controller handle. In the state where the gate of the controller 100 is displaced from the home position, the axis of the gate magnet is also displaced with respect to the handle, whereby a gate displacement signal is sent to the status monitoring module. When the axis of the magnet coincides with the position sensor, a signal is also sent to the status monitoring module to return the gate to its original position.

After receiving a signal by the status control module about interaction with the gate, the status control module processes the received data using an ADC and sends the processed data to the tracker 130. The tracker 130 translates the received data into virtual reality via wired or wireless communication.

A similar approach is used when determining the presence of a store using a store presence sensor in the controller 100. When a user interacts with the store of the controller 100, the status monitoring module receives a signal from the store presence sensor to change the position of the store. For example, when a store is discharged, the user receives a signal in virtual reality about the need to replace the store. To replace the magazine, the user removes the magazine from the controller 100 and reinserts it. Obviously, when performing a replacement operation, the user can interact with several stores. For example, a Hall effect sensor can be used as the magazine position sensor, as well as to monitor the gate position of the controller 100. For this, a Hall effect position sensor is placed in the handle of the controller 100, and a magnet is placed in the controller 100 magazine. When the magazine is removed from the controller 100, the magazine presence sensor sends a signal to the status monitoring module about the displacement of the magnet axis from the handle. When the magazine is installed in the controller 100, the magazine presence sensor sends a signal to the status monitoring module about the coincidence of the axes of the magnet and the handle.

After receiving a signal by the status control module about interaction with the store, the status control module processes the received signal using an ADC and sends the processed data to the tracker 130. The tracker 130 translates the received data into virtual reality.

Tracking the position of the shutter and the presence of the store allows for synchronization between the actions of the user performed on the controller 100 and the image seen by the user in virtual reality. So, thanks to such synchronization, the user, when manually retracting the shutter or firing a shot, or replacing the magazine, sees in real time the shutter movement and the withdrawal of the magazine in virtual reality, which increases tactile communication and the level of immersion in the virtual environment.

When a user fires a shot, by pulling a trigger such as a trigger of the controller 100, the condition monitoring module determines the moment the shot is fired using one of two shot detection schemes. When the trigger of the controller 100 is pressed, the bolt striker moves and hits the cartridge to fire. In this case, upon impact, a recoil occurs, caused by the released energy of the bullet, which moves the striker in the opposite direction from the impact to feed the next cartridge from the magazine and make the next shot. In this case, as a recoil mechanism in the controller 100 can be used compressed air, a spring, etc., imitating the energy of the live cartridge and moving the striker to the position opposite to the impact after the shot is fired. The recoil energy causes vibrations and vibrations in the controller 100, which in turn lead to positioning errors in the space of the tracker 130. To eliminate such vibrations in the tracker 130 without reducing the recoil force in the controller 100, vibration isolation 120 (described above) is used. Tracker 130 is attached to said vibration isolation 120, which provides damping of vibrations that occur when the controller 100 is moved or fired in said tracker 130.

Returning to the schemes for determining the moment of firing the shot, the state control module is configured to determine the moment when the shot is fired by means of an inertial measuring module and by means of internal mechanics.

To determine the moment of the shot by means of the inertial measuring module, the status control module continuously interrogates the inertial measuring module and processes the data obtained by the moving average method. Based on the collected data, the condition monitoring module generates the vibration plateau level of the controller 100. The plateau level is formed within a certain time window. When the permissible vibration level, which is the plateau level, is exceeded, the inertial measuring module sends a signal to the condition monitoring module. Thus, when the user presses the trigger of the controller 100, the shutter striker of the controller 100 strikes, which causes a strong vibration. After the inertial measuring module detects the excess of the permissible vibration level, the inertial measuring module sends a signal about the exceeding of the permissible vibration level to the condition monitoring module. The condition monitoring module calls the shot processing function based on the received data. While the shot processing function is in progress, the status control module also blocks further shot detection for a certain time. For example, after detecting a shot, the status control module sends a control signal to the inertial measuring module to stop measuring the vibration level for 100 ms. This eliminates multiple responses to a perfect shot. To fix the shot in virtual reality, after completing the processing of the shot, the state control module sends a signal about the perfect shot to the tracker 130.

The scheme for determining the shot by internal mechanics is disclosed in FIG. 2.

Spring loaded contacts 210 are installed in magazine 220 and are closed when trigger 230 is depressed. It will be apparent to those skilled in the art that compression sensors, etc., may be used instead of spring loaded contacts 210. Spring loaded contacts 210 are connected to a status monitoring module (not shown). When the user presses the trigger 230, contacts 210 are closed and the status monitor receives a signal that a shot has been fired. Further, the status control module calls the shot processing function. To fix the shot in virtual reality, after completing the processing of the shot, the state control module sends a signal about the perfect shot to the tracker 130.

The scheme for determining the shot can be selected depending on the rate of fire of the simulated weapon. So, if the controller 100 is made in the form of a submachine gun, then it is more expedient, to increase the accuracy of determining the shot, to use the internal mechanics of determining the shot, because high rate of fire creates strong fluctuations, due to which errors accumulate in the inertial measuring module, leading to incorrect formation of the plateau level and, consequently, incorrect determination of the moment of the shot.

Thus, the submitted application materials describe a virtual reality interaction controller designed to train shooting and weapon handling skills in a virtual simulator and simulator.

Modifications and improvements to the above described embodiments of the present technical solution will be apparent to those skilled in the art. The foregoing description is presented only as an example and does not imply any restrictions for the purpose of implementing other particular embodiments of the claimed technical solution, which does not go beyond the scope of the claimed scope of legal protection. Structural elements such as microcontrollers, blocks, modules, etc., described above and used in this technical solution, can be implemented using electronic components used to create digital integrated circuits.

Claims (21)

1. Controller for interaction in virtual reality, containing: - a body made in the form of an imitation of a firearm containing a magazine, a trigger and a bolt, while the body contains: - a magazine presence sensor, configured to send a signal about the presence of a weapon simulator magazine to the status control module; - a bolt position sensor, configured to send a signal about the bolt position of the weapon simulator to the status control module; - vibration isolation, made with the possibility of damping vibrations and vibrations arising from a shot and movement in the space of the weapon simulator; - a virtual reality tracker capable of broadcasting a set of data on the state of the weapon simulator, received from the state control module, into virtual reality; - a state control module containing an inertial measuring module, configured to: - receiving signals from the store presence sensor and the bolt position sensor of the weapon simulator; - determining the moment of the weapon simulator shot; - formation of a data set on the state of the weapon simulator, including: - shutter position, - store availability, - orientation in space - making a shot; - transfer of a set of data on the state of the weapon simulator to the virtual reality tracker. 2. The device according to claim 1, characterized in that the virtual reality tracker is located on vibration isolation. 3. The device according to claim 1, characterized in that the moment of the shot is determined by receiving a signal from the inertial measuring module about exceeding the permissible vibration level of the weapon simulator. 4. The device according to claim 2, characterized in that the permissible vibration level of the weapon simulator is a plateau level formed by the moving average method within the selected time window. 5. The device according to claim. 1, characterized in that after detecting a shot, the state control module stops detecting a shot for a predetermined time interval to block multiple responses to a perfect shot. 6. The device according to claim. 1, characterized in that the bolt position sensor consists of a magnet installed in the bolt of the weapon simulator and a Hall sensor installed in the handle of the weapon simulator. 7. The device according to claim 1, characterized in that the magazine presence sensor consists of a magnet installed in the weapon simulator magazine and a Hall sensor installed in the weapon simulator handle.

Images