KR20210009418A - System and Method for recognizing senses in vertual reality space - Google Patents

Abstract

Disclosed is a system for recognizing sense to recognize an event occurring to a user in virtual reality with realistic sense. The system comprises: a computer device in which an application executed in virtual reality is installed; a suit executing the application, worn by a user, and including a plurality of separated electro-conducting line patterns and an electrode connected thereto; and a current application device communicatively connected to the computer device and applying a current to the electrode. The current application device generates a current of waveform matching skin sensation corresponding to an event occurring while executing the application in virtual reality to apply the current to a selected electrode.

Description

System and method for recognizing senses in vertual reality space

The present invention relates to a system and method for recognizing a sense in a virtual reality space.

Virtual Reality or Augmented Reality means that a specific environment or situation is created as 3D content with a three-dimensional effect through a computer, and the person using the 3D content is interacting with the actual surrounding situation and environment. It is a generic term for the human-computer interface that makes it look like it is.

In this way, with the universalization of virtual reality technology 3D content, various digital devices that can provide more immersive virtual reality services are being developed.

For example, a head mounted display (HMD) is applied for the display of 3D content and sound output, and a wearing suit with a sensor is applied to input commands from the user. As in Korean Patent No. 1656025, a physical-based sensor is used. A control method that recognizes the user's motion is also proposed.

In addition, digital tactile sensation such as vibration can be recognized through a technology such as haptics, for example, through a touch screen, a mouse, or a suit worn by a user.

However, the digital tactile sensation is still limited to vibration, and for example, a user who plays a shooting game (FPS) in a virtual reality space cannot output the sensation he feels when he is shot. In other words, there is no known way to realistically feel skin sensations such as pain or itching that occur in virtual reality.

Accordingly, an object of the present invention is to provide a sensory recognition system that enables a user to perceive an event occurring in a virtual reality with a realistic sense.

It is an object of the present invention to provide a sensory recognition system that can easily implement a realistic sense in response to the type and size of an event.

The object of the above is a computer device in which an application to be executed in virtual reality is installed, a suit worn by a user while executing the application and having a plurality of separated electrically conductive line patterns and electrodes connected thereto, and a communication connection to the computer device And a current application device that applies a current to the electrode, and the current application device generates a current of a waveform matched to the skin sensation corresponding to an event that occurs while executing the application in virtual reality, It is achieved by a sensory perception system in a virtual reality space, characterized in that applying to the selected electrode.

Preferably, the computer device includes: a location mapping unit that maps a body position of a user object of the application to a position of an electrode of the suit and stores the mapping in a database; An event analysis unit that analyzes an event that occurs to a user in the application and determines a type of the event and a body position of the user object; A code extraction unit for extracting an event code and an electrode code of the suit mapped to the body position of the user object from the database based on the analysis information determined by the event analysis unit; And a main control unit controlling the execution of the application and operation of each part.

Preferably, the current application device comprises: an electrode position determining unit that codes and stores electrodes installed in the suit, and selects a specific electrode based on the electrode code of the suit received from the computer device; A waveform generator configured to filter a current of a specific waveform from a battery based on the event code received from the computer device; And a control unit for applying a current of the generated specific waveform to an electrode selected by the electrode position determining unit.

Preferably, the computer device and the current applying device may be implemented by being integrated into a single device.

The object of the above is a computer device in which an application to be executed in virtual reality is installed, a suit worn by a user while executing the application and having a plurality of separated electrically conductive line patterns and electrodes connected thereto, and a communication connection to the computer device It is applied to a sensory recognition system in a virtual reality space consisting of a current application device that applies current to the electrode, and when an event occurs to a user while the application of the computer device is running in virtual reality, the type of the event and the Determining a body position of a user object where an event occurs; Extracting an event code and an electrode code of the suit mapped to the body position of the user object from the database based on the determination result; Transmitting, by the computer device, the extracted event code and electrode code to the current application device; Filtering, by the current application device, to generate a current of a specific waveform from a battery based on an event code received from the computer device, and selecting a specific electrode based on the electrode code of the suit received from the computer device; And applying a current of the specific waveform to the selected electrode so that a user feels a skin sensation caused by an event.

According to the present invention, the user can realistically feel the execution effect by delivering a skin sensation corresponding to an event occurring to the user in an application executed in virtual reality.

In addition, the virtual skin sensation is matched with the waveform of the current so that sensations can be easily recognized.

Moreover, by adjusting the current intensity, the intensity of the event can be realized realistically.

1 is a block diagram showing the sensory perception system of the present invention.
2 is a functional block diagram of a computer device.
3 is a functional block diagram of a current application device.
4 is a flow chart showing the sensory recognition method of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as generally understood by those of ordinary skill in the technical field to which the present invention belongs, unless otherwise defined in the present invention, and is excessively comprehensive. It should not be construed as a human meaning or an excessively reduced meaning.

In the following description, in order to describe the sensory perception system and method of the present invention, a first-person shooter (FPS), which is a kind of shooting game, is described as an example. It refers to a game where you fight with weapons or tools on the same screen as.

However, the present invention is not limited thereto, and can be applied to all kinds of applications that generate events that may affect a user's skin sensation.

1 is a block diagram showing the sensory perception system of the present invention.

The sensory recognition system includes a suit 110 including an electrically conductive line pattern 111 and an electrode 112, a current application device 200, and a computer device 300.

The suit 110 is a garment worn by a user using a virtual reality device, and may be made of, for example, a garment fabric, and an electrically conductive line pattern 111 is formed on the inner surface thereof.

The line pattern 111 may be composed of an electrically conductive silicone rubber layer, and it is formed by mixing conductive powder with a silicone resin as a binder to provide high electrical conductivity and adhesion to the fabric, so that when the suit 110 is bent and pulled, By withstanding, electrical conductivity can be maintained.

Therefore, the suit 110 can be conveniently washed due to the excellent adhesion, elasticity, and flexibility of the electrically conductive silicone rubber layer constituting the line pattern 111, and the suit 110 is not damaged even after washing.

A plurality of line patterns 111 are formed, one end is electrically connected to the pattern forming apparatus 200, and an electrode 112 is formed at the other end, and the electrode 112 may be an electrically conductive pad or a metal snap. have.

As will be described later, the electrode 112 serves to transmit a skin sensation corresponding to an event occurring in an executed program to the human skin through a current waveform.

An FPS program is installed in the computer device 300, a database 310 related to the FPS program is provided, and all event information affecting a corresponding user is stored in the database 310.

The computer device 300 may be a Windows-based compatible computer or a device equipped with an operating system that can be particularly applied to the present invention, and is collectively referred to as a computer device.

2 is a functional block diagram of a computer device.

The location mapping unit 340 maps the location of the body image of the user object of the FPS and the location of the electrode 112 of the suit 110 for the FPS and stores it in the database 310.

As will be described later, since the location of each electrode 112 connected to the current applying device 200 is specified, the location mapping unit 340 receives the location information and maps the body image location of the user object provided by the FPS.

At this time, it is necessary to consider the density of the electrodes 112 installed in the suit 110, although there is no problem in the case where the body position of the user object provided by the FPS and the position of the electrode 112 are matched on a one-to-one basis, the user provided by the FPS When the body position of the object is more dense, the body image positions of a plurality of user objects may be mapped to correspond to the position of one electrode 112.

The event analysis unit 320 serves to analyze an event occurring to a user in the FPS, and determines the type of the event and a body position of the generated user object.

For example, as shown on the screen of FIG. 1, when a shot is shot at the left shoulder by an opponent's shooting in the FPS, the event analysis unit 320 indicates that the type of event is'gunshot' and the user object The position of the gunshot is detected from the fact that the position on the body is the'shoulder part'.

In addition, since the FPS designates the intensity of the gunshot, the intensity information of the gunshot may be classified into'strong, medium, weak' and included.

The code extraction unit 330 is based on the analysis information provided by the event analysis unit 320 at the request of the control unit 310, from the database 310, the event code and the body image location of the user object and the mapped suit 110 Extract the electrode code.

The transmission/reception unit 350 transmits the event code extracted at the request of the control unit 310 and the electrode code of the suit to the current application device 200.

The control unit 310 may be a microprocessor and controls the execution of the FPS and the operation of each part 320, 330, 340, and 350.

The FPS executed in the computer device 300 may be displayed through the large screen display 130 or may be displayed through a head mount display (HMD) 120 mounted by a user.

The current application device 200 is connected to the computer device 300 through a short-range wireless communication method including wired or wireless, for example, RF, Wi-Fi, and Bluetooth.

The current application device 200 may be configured to be mounted on a waist like a belt or worn on a wrist like a wrist watch.

3 is a functional block diagram of a current application device.

The electrode position determining unit 240 codes the electrode 112 installed in the suit 110 and stores it in the memory 230, and transmits the electrode position code to the computer device 300 as described above, and the position mapping unit 340 ) Maps the body position of the user object provided by the FPS and the position of the electrode 112 of the suit 110.

The waveform generator 220 filters the current of a specific waveform from the battery 260 based on the event code received from the computer device 300.

The electrode position determining unit 240 selects a specific electrode from among the electrodes 112 stored in the memory 230 based on the electrode code of the suit received from the computer device 300.

The control unit 210 may be a microprocessor, and applies a current of a specific waveform to the electrode 112 selected by the electrode position determination unit 240 so that the user feels sensation in the corresponding body part.

Hereinafter, the sensory recognition method of the present invention will be described in detail with reference to FIGS. 1 to 4.

4 is a flow chart showing the sensory recognition method of the present invention.

For ease of understanding, when the user wears the suit 110, the HMD 120, and the FPS installed in the computer device 300 is executed in virtual reality, the user responds to the gunshot wound in the shoulder part The explanation is limited to the process of feeling pain.

When an event of getting a gunshot wound to the shoulder by an opponent's shooting occurs while executing the FPS in virtual reality, the event analysis unit 330 of the computer device 300 indicates that the type of the event is'gunshot', and the user object of the FPS It is determined from the fact that the position of the body image is the'shoulder part', and the strength of the gunshot can be further determined.

The code extraction unit 330 receives the event code from the database 310 and the electrode code of the suit mapped to the body image position of the user object based on the analysis information determined by the event analysis unit 320 at the request of the control unit 310. Extract.

The control unit 310 of the computer device 300 transmits the event code and the electrode code extracted through the transmission/reception unit 350 to the current application device 200.

The waveform generator 220 of the current applying device 200 filters the current of a specific waveform from the battery 260 based on the event code received from the computer device 300.

The waveform of the current applied from the battery 260 may be composed of a square wave, a sawtooth wave, a sine wave, a pulse wave, or a combination thereof by filtering, or may have a symmetric, asymmetric and monophasic or biphasic form. have.

Such a waveform of the current may be prepared through a number of experiments to respond to various types of sensations felt by the human body, such as pain, tingling, itching, and tingling.

At this time, as described above, the intensity of the gunshot is additionally transmitted, and a current having a magnitude corresponding to the intensity of the gunshot can be generated by adjusting the intensity of the current.

In addition, the electrode position determining unit 240 selects a specific electrode from among the electrodes 112 stored in the memory 230 based on the electrode code of the suit received from the computer device 300.

As described above, when a current of a specific waveform is generated and the electrode 112 is selected, the controller 210 applies a current of a specific waveform to the selected electrode 112 so that the user feels a painful sensation due to a gunshot wound in the shoulder. Let's do it.

As described above, if the intensity of the gunshot wound is large, the intensity of the current is increased to make the pain feel more, and if the intensity is small, the intensity of the current can be reduced to make the pain less felt.

In the above embodiment, the sensory recognition system has been exemplified that the current application device 200 and the computer device 300 are separated from each other, but is not limited thereto. For example, when the current application device 200 is provided with a microprocessor and an operating system is installed, the function of the computer device 300 may be absorbed and implemented as a single integrated device.

Although the above has been described with the focus on the embodiments of the present invention, it goes without saying that various changes can be made at the level of those skilled in the art. Therefore, the scope of the present invention is limited to the above-described embodiments and cannot be interpreted, and should be interpreted by the claims set forth below.

110: suit
111: line pattern
112: electrode
120: HMD
130: large screen
200: current application device
300: computer device

Claims (3)

A computer device with an application installed in virtual reality, a suit worn by a user while executing the application and having a plurality of separated electrically conductive line patterns and electrodes connected thereto, and a current connected to the computer device and connected to the electrode It consists of a current application device that applies
The current application device transmits a sense matching to an event occurring in virtual reality due to the execution of the application to the human skin with a corresponding current waveform and current intensity through the line pattern,
The current waveform corresponds to the type of sense, the current intensity corresponds to the strength of the sense,
The computer device,
A location mapping unit for mapping a body position of a user object and a position of an electrode of the suit in the virtual reality and storing it in a database;
An event analysis unit configured to analyze an event occurring in the user object in the virtual reality and determine the type of the event and a body position of the user object;
A code extraction unit for extracting an event code and an electrode code of the suit mapped to the body position of the user object from the database based on the analysis information determined by the event analysis unit; And
It includes a main control unit for controlling the execution of the application and the operation of each part,
The current application device,
An electrode position determining unit that codes and stores the electrodes installed in the suit, and selects a specific electrode based on the electrode code of the suit received from the computer device;
A waveform generator configured to filter a current having a specific waveform and intensity from a battery based on the event code received from the computer device; And
And a control unit for applying the generated current to the electrode selected by the electrode position determining unit. In claim 1,
The sensory recognition system of a virtual reality space, characterized in that the computer device and the current application device are integrated and implemented as a single device. A computer device with an application installed in virtual reality, a suit worn by a user while executing the application and having a plurality of separated electrically conductive line patterns and electrodes connected thereto, and a current connected to the computer device and connected to the electrode It is applied to the sensory perception system of a virtual reality space composed of a current applying device that applies
Determining a type of the event and a body position of the user object at which the event occurs when an event provided to the user object in virtual reality occurs due to the execution of the application on the computer device;
Extracting an event code and an electrode code of the suit mapped to the body position of the user object from the database based on the determination result;
Transmitting, by the computer device, the extracted event code and electrode code to the current application device;
Filtering, by the current application device, to generate a current of a specific waveform and intensity from a battery based on an event code received from the computer device, and selecting a specific electrode based on the electrode code of the suit received from the computer device; And
A method for recognizing a sense of a virtual reality space, characterized in that by applying a current of the specific waveform and intensity to the selected electrode, a user feels a sense of the type and intensity corresponding to the event.

Images