KR102527513B1 - Wheelchair boarding device capable of rotating, forward and backward, and virtual reality application, and virtual reality application method using the same - Google Patents

Abstract

The present invention relates to a wheelchair boarding device that can rotate, forward and backward, and apply virtual reality, and more particularly, rotates left and right in place using a roller that separates the rotation of two wheels, using a method similar to that of a wheelchair. It relates to a wheelchair boarding device capable of applying rotation, forward and backward, and virtual reality that can simulate a wheelchair in conjunction with VR, AR, and XR contents,
bathchair; After boarding the wheelchair, it is attached to the lower part of the two wheel parts of the wheelchair that can move freely in place, and the rotation is separated from each other; includes, recognizing the operation of the roller to practically the same as using a wheelchair Left and right rotation is possible in place, and simulation can be performed through the wheelchair simulation unit in conjunction with VR, AR, and XR contents (14), and the virtual motion simulated through the wheelchair simulation unit is implemented on the VR screen.

Description

Wheelchair boarding device capable of rotating, forward and backward, and virtual reality application, and virtual reality application method using the same

The present invention relates to a wheelchair boarding device that can rotate, forward and backward, and apply virtual reality, and more particularly, fixes the central axis of two wheels of a wheelchair and reflects rotation information or separates the rotation of the two wheels. It is about a wheelchair boarding device capable of rotation, forward and backward, and virtual reality application that can simulate a wheelchair in conjunction with VR, AR, and XR contents when left and right turns are practically similar to wheelchair use.

It is also called Mixed Reality (MR) because it combines the real world with the virtual world with additional information in real time and shows it as a single image. One of the ways to realize augmented reality is a wearable computer. In particular, a computer display device worn on the head enables augmented reality by superimposing computer graphics and text on the real environment that the experiencer sees in real time.

Most of the content provision methods that apply virtual space to sports are used to provide exercise effects to users in the form of bicycles or treadmills. In this form of augmented reality content, it is difficult to induce continuous use by reducing the effect by half because it is difficult to give a feeling that the movement of the experiencer is actually reflected in the same way as the movement in space.

Realism must be maximized in order to interest the experiencer, but most of the current virtual reality interfaces are attempts to overcome this by using tools such as real space. In reality, this artificial form only allows the experiencer to move in place, but it is difficult to expect tangible effects from the experiencer because movement occurs only in the virtual space (screen).

As a problem to be solved, the present invention is a device capable of freely using a wheelchair in place by boarding a wheelchair, and when used on a roller (other devices are also possible) with two wheels separated from each other, it recognizes the motion of the two wheels and actually uses the wheelchair. A wheelchair boarding device that can be applied to various virtual reality sports contents as it can rotate, forward and backward, and simulate a wheelchair that can be applied to virtual reality in conjunction with VR, AR, and XR contents by turning left and right in place in a similar way to use. is aimed at providing

In addition, the present invention is able to implement actual physical motions while watching the contents of the screen, so that temporal driving physical quantities such as forward, backward, and rotation can be reflected in motion-based information of two wheels by riding a wheelchair on the device. The purpose of the present invention is to provide a wheelchair boarding device that can be applied to various virtual reality sports contents.

In order to solve the above problems, the present invention is a wheelchair; After boarding the wheelchair, it is attached to the lower part of the two wheel parts of the wheelchair that can move freely in place, and the rotation is separated from each other; includes, recognizing the operation of the roller to practically the same as using a wheelchair Left and right rotation is possible in place, and simulation can be performed through the wheelchair simulation unit in conjunction with VR, AR, and XR contents, and the virtual motion simulated through the wheelchair simulation unit is implemented on the VR screen.

In exercising or training through the wheelchair, a plurality of virtual reality contents including wheelchair marathon, wheelchair ice hockey, wheelchair basketball, and dodgeball are provided.

at least one sensor that detects temporal driving physical quantities of forward, backward, and rotation based on motion-based information of the roller; The wheelchair simulation unit operably connected to the at least one sensor and the at least one camera generates a 3D space coordinate system in conjunction with VR, AR, and XR contents, and the 3D space coordinate system is located at the first first coordinate of the 3D space coordinate system. A 3D path connecting the next second coordinate of is generated and displayed.

The present invention includes a position determination unit for determining the position of a specific mixed reality experiencer within a set area of a wheelchair capable of moving freely in place; a virtual reality content extractor extracting virtual reality content corresponding to the position or behavior of the wheelchair; Characterized in that it includes; a display control unit that controls virtual reality content according to a wheelchair that can move freely in the set area to be displayed.

A person image generation module for generating a person image according to VR, AR, and XR contents from the wheelchair simulation unit; further includes.

It further includes a background generating module for generating background information and background size information based on the person image generating module.

A sound generating module that receives sound information and volume information from the experiencer and generates VR sound information by reflecting the volume information to the sound information; further includes.

In the case of a doubles game, the present invention includes the steps of determining the locations of mixed reality experiencers within a preset area; extracting virtual reality content corresponding to the action or location of the mixed reality experiencer; setting virtual reality coordinates of the virtual reality content based on the locations of the mixed reality experiencers; and controlling the display device of the mixed reality experiencer to display the virtual reality content at a location corresponding to the corresponding virtual reality coordinates.

The present invention is a device that can freely use a wheelchair in place by boarding a wheelchair, and when used on a roller (other devices are also possible) in which the rotation of two wheels are separated, the operation of the two wheels is recognized and practically similar to the use of a wheelchair. can be used.

In addition, the present invention can be applied to exercising or training through a wheelchair. This device can be applied to various virtual reality contents such as wheelchair marathon, wheelchair ice hockey, wheelchair basketball and dodgeball.

In addition, the present invention can improve the inconvenience of using contents and interlocking because it is impossible to keep an eye on the direction of the screen to reflect the motion of turning when virtual motion is implemented as a VR screen.

In addition, the present invention is able to implement actual physical motions while watching the contents of the screen, so that temporal driving physical quantities such as forward, backward, and rotation can be reflected in motion-based information of two wheels by riding a wheelchair on the device. It is an innovative device.

1 is a conceptual diagram illustrating the use of a wheelchair boarding device capable of rotation, forward/backward, and virtual reality application according to an embodiment of the present invention.
Figure 2 is a configuration diagram of a wheelchair boarding device capable of rotation, forward and backward, and application of virtual reality according to an embodiment of the present invention.
3 is a configuration diagram of a wheelchair boarding device capable of rotation, forward/backward, and virtual reality application including a sensor according to another embodiment of the present invention.
4 is a block diagram of a wheelchair boarding device capable of rotation, forward/backward, and virtual reality application including a position determining unit according to another embodiment of the present invention.
5 is a configuration diagram of a wheelchair boarding device capable of rotating, forward and backward, and applying virtual reality including a person image generation module according to another embodiment of the present invention.
6 is a configuration diagram of a wheelchair boarding device capable of rotation, forward/backward, and virtual reality application including gloves according to another embodiment of the present invention.
7 is an actual device developed according to one embodiment of a wheelchair boarding device capable of rotation, forward and backward, and application of virtual reality according to another embodiment of the present invention.
8 is an actual device of a wheelchair boarding device that fixes the central axis of two wheels of a wheelchair and reflects rotational information of each according to another embodiment of the present invention.

In order to fully understand the present invention, preferred embodiments of the present invention will be described with reference to the accompanying drawings. Embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be construed as being limited to the examples described in detail below. This embodiment is provided to more completely explain the present invention to those skilled in the art. Therefore, the shapes of elements in the drawings may be exaggerated to emphasize a clearer explanation. It should be noted that in each drawing, the same members are sometimes indicated by the same reference numerals. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention are omitted.

As shown in Figures 1 and 2, the present invention is a wheelchair (11); After boarding the wheelchair 11, it is attached to the lower part of the two wheels 12 of the wheelchair 11, which can move freely in place, and rollers 13 separated from each other in rotation.

By recognizing the operation of the roller 13, it is possible to rotate left and right in place, practically the same as using a wheelchair, and it can be simulated through the wheelchair simulation unit 15 in conjunction with VR, AR, and XR contents 14, , The simulated virtual motion through the wheelchair simulation unit 15 is implemented on the VR screen 16.

In exercising or training through the wheelchair 11, a plurality of virtual reality contents including wheelchair marathon, wheelchair ice hockey, wheelchair basketball, and dodgeball are provided.

As shown in Figure 3, at least one sensor (13-1) for detecting the motion-based information of the roller (13) forward, backward, and temporal driving physical quantity of rotation; The wheelchair simulation unit 15 operatively connected to the at least one sensor and the at least one camera generates a 3D spatial coordinate system in conjunction with the VR, AR, and XR contents 14, and the first 3D spatial coordinate system of the 3D spatial coordinate system A 3D path connecting 1 coordinate to the next second coordinate of the 3D spatial coordinate system is generated and displayed.

For example, it is attached to the lower part of the two wheels 12 of the wheelchair 11 that can move freely in place, and the rotation is controlled by rotation or forward/backward at the first first coordinate of the rollers 13 whose rotation is separated from each other. When 2 coordinates are set, a 3D path according to them is created and displayed on the VR screen 16.

As another example, in the case of a wheelchair marathon, if the second coordinates after moving to some extent from the first coordinates at the start of the marathon are set, a 3D path is created accordingly and displayed on the VR screen 16.

As shown in FIG. 4, a position determination unit 21 for determining the position of a specific mixed reality experiencer within a set area of the wheelchair 11, which can move freely in place; a virtual reality content extraction unit 22 that extracts virtual reality content corresponding to the position or behavior of the wheelchair 11; and a display control unit 23 that controls virtual reality content to be displayed according to the wheelchair 11 capable of freely moving in the set area.

As shown in FIG. 5, the wheelchair simulation unit 15 includes a person image generation module 17 for generating a person image H according to VR, AR, and XR contents 14; a background generating module 18 for generating background information and background size information based on the person image generating module 17; and a sound generating module 19 that receives sound information and volume information from the experiencer and generates VR sound information by reflecting the volume information on the sound information.

In this simulation environment, virtual environment sensing data is collected by using a sensor that detects temporal (over time) driving physical quantities of forward, backward, and rotation based on motion-based information of two wheels, and the virtual environment sensing data Converting into real environment sensing data, and using the real environment sensing data to generate learning data for learning an artificial intelligence model, providing a wheelchair boarding device that can rotate, forward and backward, and apply virtual reality using an artificial intelligence model You may.

An experiencer response information collection module for collecting biometric information including electrocardiogram data, respiration data, and brainwaves of the experiencer to provide a realistic experience in the case of a game that consumes a lot of muscle strength among the above-mentioned virtual sports games; The emotional change of the experiencer is identified through the biometric information collected by the experiencer response information collection module, virtual reality contents to be output according to the biometric information of each experiencer are extracted, and the output order, frequency and frequency of each extracted virtual reality content are determined. can also be set.

As another embodiment, the present invention can work with VR, AR, and XR contents, among which, as an apparatus for controlling an XR device according to XR contents, selecting at least one XR (Extended Reality) object image from an image DB. , The XR includes Virtual Reality (VR), Augmented Reality (VR), or Mixed Reality (MR), and the XR object image is an image of an object including XR information, , and rendering the XR object image to give additional effects according to one or more sports activities, thereby extending the sports action according to the movement of two wheels to the XR content graphic, thereby actually increasing the effect of using a wheelchair.

As shown in FIG. 6, in various virtual reality sports contents such as wheelchair ice hockey, wheelchair basketball, and dodgeball, a smart glove that measures and converts hand movements required in fields that need to sensitively detect hand movements to add a sense of reality. can provide

For example, the glove 100 formed in the shape of a hand so that the experiencer can wear it; A plurality of detection sensors 200 formed for each finger portion of the glove 100 and changing electrical properties according to the movement of the finger; It includes a hand movement signal processing unit 400 that converts hand movements into data using changes in electrical properties of the plurality of detection sensors 200 .

In addition, the glove 100 may include a plurality of sensor units for sensing the experiencer's movement, blood pressure, body temperature, stress index, muscle tone, skin conductance, body moisture, heart rate, and the experiencer's bio-signals.

As shown in FIGS. 7 and 8, the central axis of the two wheels 12 of the wheelchair according to another embodiment of the present invention is fixed to the bottom plate 30 and the rotation information of the rollers 13 whose rotation is separated from each other. It is the actual device of the wheelchair boarding device that reflects the

The central axis of the two wheels 12 can be freely rotated by being inserted in the middle of a pair of bottom plates 30 with a long lower part and a narrow upper part in a state away from the ground, and various sensors are attached to the bottom plate 30 It can be.

Hereinafter, as a method for implementing the present invention, in the case of a doubles match using a wheelchair boarding device capable of rotation, forward and backward, and virtual reality application, determining the location of mixed reality experiencers in a preset area; extracting virtual reality content corresponding to the action or location of the mixed reality experiencer; setting virtual reality coordinates of the virtual reality content based on the locations of the mixed reality experiencers; controlling the display device of the mixed reality experiencer to display the virtual reality content at a position corresponding to the corresponding virtual reality coordinates; obtaining location information of the virtual reality device; acquiring special effect data of wheelchair marathon, wheelchair ice hockey, wheelchair basketball, and dodgeball; and displaying virtual reality data including special effect data of the virtual object on the virtual reality device based on the location information and the special effect data.

As another embodiment, the present invention includes obtaining real scenario data; recognizing property information of a real target object among the real scenario data, and determining special effect data of a virtual object matched with the property information; and displaying virtual reality data including the special effect data of the virtual object on a virtual reality device based on the special effect data of the virtual object.

As another embodiment, the present invention is a method for controlling an XR device that provides at least one virtual avatar in various virtual reality sports contents such as wheelchair tennis and ice hockey, which uses a camera to recognize an experiencer located around the XR device. step; displaying at least one real object and a virtual avatar around the XR device; and determining the position and direction according to the motion-based information of the two rollers based on temporal driving physical quantities of forward, backward, and rotation.

11 : Wheelchair
12: two wheels
13: roller
13-1: Sensor
14 : VR, AR, XR contents
15: Wheelchair simulation unit
17: Person image generation module
18: background generation module
19: sound generating module
21: position determination unit
22: virtual reality content extraction unit
23: display control unit
30: bottom plate

Claims (8)

wheelchair (11);
After boarding the wheelchair 11, the roller 13 is attached to the lower part of the two wheels 12 of the wheelchair 11, which can move freely in place, and rotates separately from each other;
A wheelchair simulation unit that recognizes the motion of the roller 13, enables left and right rotation in place, practically the same as using a wheelchair, and realizes simulated virtual motion on a VR screen in conjunction with VR, AR, and XR contents 14. (15);
A position determination unit 21 for determining the position of a specific mixed reality experiencer within a set area of the wheelchair 11, which can move freely in place;
a virtual reality content extraction unit 22 that extracts virtual reality content corresponding to the position or behavior of the wheelchair 11;
A display controller 23 that controls virtual reality content according to the wheelchair 11, which can move freely in the set area, to be displayed,
at least one sensor (13-1) for detecting the motion-based information of the roller (13) and temporal driving physical quantities of forward, backward, and rotation;
The wheelchair simulation unit 15 operatively connected to the at least one sensor and the at least one camera generates a 3D spatial coordinate system in conjunction with the VR, AR, and XR contents 14, and the first first step of the 3D spatial coordinate system After moving a certain distance in the 3D spatial coordinate system from 1 coordinate, a 3D path connecting the next second coordinate is created and displayed on the VR screen 16,
The wheelchair simulation unit 15 includes a character image generation module 17 for generating a character image H of the experiencer according to VR, AR, and XR contents 14;
a background generating module 18 for generating background information and background size information based on the person image generating module 17;
A sound generating module 19 for receiving sound information and volume information from the experiencer and generating VR sound information by reflecting the volume information on the sound information;
In the simulation environment, virtual environment sensing data is collected by using a sensor that detects temporal driving physical quantities according to the passage of time of forward, backward, and rotation based on the motion-based information of two wheels, and the virtual environment sensing data is converted to the real environment. Converting into sensing data, using the real environment sensing data to generate learning data for learning an artificial intelligence model and using the artificial intelligence model, a wheelchair boarding device capable of rotation, forward and backward, and virtual reality application. The method of claim 1,
In exercising or training through the wheelchair, a wheelchair capable of rotation, forward movement, and virtual reality application, characterized in that providing a plurality of virtual reality contents including wheelchair marathon, wheelchair ice hockey, wheelchair basketball, and dodgeball boarding device.

delete delete delete delete delete delete

Images