KR19980028623A - Improved Virtual Reality Input with Force Feedback - Google Patents

Abstract

The present invention relates to a virtual reality input device having a force feedback function, when a user manipulates an input unit to manipulate a virtual environment, a corresponding operation signal is provided to the virtual reality system, and the virtual environment is controlled through the virtual reality system. In this case, when a reaction is required to the user, the vibrator mounted on a predetermined portion of the input device is vibrated according to the driving of the driving unit based on the driving control signal from the virtual reality system, so that the user manipulates the virtual environment through the input device. You can feel the reaction caused by. Accordingly, the present invention can implement an advanced three-dimensional stereoscopic reality world in virtual reality in a virtual environment.

Description

Improved Virtual Reality Input with Force Feedback

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input device of a virtual reality (hereinafter referred to as VR), and in particular to an operation (or movement) based on user manipulation using interaction in a virtual environment realized by a virtual reality system. The present invention relates to a virtual reality input device having a force feedback function suitable for having a real feeling such as a touch or a touch.

In general, virtual reality means that in a virtual environment of a three-dimensional stereo image generated by a virtual reality system, a user listens to a three-dimensional sound while the user inputs (eg, a datasuit, a head mounted display (HMD), Through the manipulation of input means such as Spaceball, Dataglove, etc., it means that the virtual environment created by the virtual reality system can be felt like the real world.

On the other hand, an essential element of the virtual reality is that the user has a sense of being completely immersed in the virtual environment created by the virtual reality system. Specifically, the virtual environment created by the virtual reality system has meaning with the real world. By following a similar rule, you need to create a variety of stimulating environments.

At this time, a method of sensing such a virtual environment may be seeing, hearing, feeling, and the like. As a conventional input device, a data glove, an HMD, a data suit, a data shoe, and a space are described. Ball, and the user may use any one of these input devices in a virtual environment generated by the virtual reality system (eg, kicking or catching a ball during a game in a soccer game in a three-dimensional environment). Etc.) will be realized.

However, the input device of such a conventional virtual reality system is mostly unidirectional, that is, inputs a desired command to the virtual reality system according to the user's operation without interaction between the virtual reality system and the user. There is no limit to feeling the reality in space). That is, users can only feel the seeing effect and the three-dimensional hearing sounding effect displayed on the screen.

Therefore, in the virtual environment, users will be able to feel a greater sense of reality (or liveliness) if they can add to the visual and auditory effects obtained by these conventional methods in addition to the effects felt by touching. This will enable the realization of true 3D stereoscopic virtual reality.

The present invention has been made in view of the above-mentioned point, and equipped with at least one vibrator in the input device for the virtual reality system, by using the built-in vibrator can realize the interaction between the system and the input device according to the movement It is an object of the present invention to provide a virtual reality input device having a feedback function.

In accordance with one aspect of the present invention, there is provided an input device for providing a virtual environment operation command signal for a virtual environment operation according to a user operation to a virtual reality system having a virtual environment virtual environment setting function. Means for generating a plurality of command signals for manipulating the sensed virtual environment, and converting each generated command signal to A / D; Predetermined signal processing for each command signal provided from the A / D conversion means is performed, and the signal is modulated into a wire-transmittable signal and provided to the virtual reality system through a wired interface line, and the virtual through the interface line. Control means for receiving respective reaction signals for sensory response according to each operation in a virtual environment provided from a real system; Means for D / A converting the reaction signals for each sensory response provided from the control means and generating respective drive control signals corresponding to the converted reaction signals; And an oscillator for generating a vibration of a predetermined level based on each drive control signal from the control signal generating means.

According to another aspect of the present invention, there is provided an input device for providing an operation command signal for operating a virtual environment according to a user operation to a virtual reality system having a virtual environment setting function for a virtual reality. Means for generating a plurality of command signals for manipulating the sensed virtual environment, and converting each generated command signal to A / D; To perform a predetermined signal processing for each command signal provided from the A / D conversion means for transmission to the virtual reality system, for the sensory response according to each operation in the virtual environment received from the virtual reality system Control means for performing signal processing of each reaction signal; Modulating each command signal provided from the control unit into a radio transmitting signal, and then transmitting the air wave at a predetermined direction to provide the virtual reality system to the virtual reality system, wherein the respective modulated reactions are transmitted and received from the virtual reality system. Wireless transmitting / receiving means for demodulating the signal into the original path and then providing the signal to the control means; Means for D / A converting the reaction signals for each sensory response provided from the control means and generating respective drive control signals corresponding to the converted reaction signals; Power supply means for providing a power source for generation of the reaction signal for the received sensory response; A vibrator driven according to the power supplied from the power supply means to generate a vibration of a predetermined level; And a switching means for switching the supply of power provided from the power supply means to the vibrator in response to the drive control signal from the drive control signal generating means. .

Figure 1 is a schematic block diagram of an improved virtual reality input device having a force feedback function according to an embodiment of the present invention

2 is a schematic block diagram of an improved virtual reality input device having a force feedback function according to another embodiment of the present invention.

3 illustrates an example of employing a data glove as an improved virtual reality input device according to the present invention.

4A is a schematic illustration of a head mounted display (HMD) input device having multiple vibrators in accordance with the present invention.

4B is a schematic illustration of a data chute input device having multiple vibrators in accordance with the present invention.

Figure 4c is an illustration of a data shoe input device having a plurality of vibrators in accordance with the present invention

<Description of the code | symbol about the principal part of drawing>

110: operation block 112: A / D conversion block

114: control block 116: transmission and reception block

118: D / A conversion block 120: power block

124: switching block 126: oscillator

The above and other objects and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention described below with reference to the accompanying drawings by those skilled in the art.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

First, in the present invention, an image is displayed through an interactive communication (interaction) between an input device (eg, a data glove, a head mounted display (HMD), a data suit, a data shoe, a space ball, a data sox, etc.) and a virtual reality system. By allowing the user to sense not only the visual feeling through the sound and the auditory feeling through the sound, but also the sensory feeling (feel), the user is more filled with reality (or reality) for any motion (or action) in the 3D virtual reality space. The ultimate goal is to realize an advanced three-dimensional stereoscopic reality world, which will be realized by the preferred embodiment described below.

EXAMPLE

Example 1

Figure 1 shows a schematic block diagram of an improved virtual reality input device having a force feedback function according to an embodiment of the present invention.

In the figure, reference numeral 100 denotes an input device side, and reference numeral 200 denotes a virtual reality that performs bidirectional communication with the input device side 100 through a wired interface line when a virtual environment is set according to the operation of the system. Represents a system. The input device side 100 according to the present invention also includes an operation block 110, an A / D conversion block 112, a control block 114, a D / A conversion block 118, and a vibrator 126. do.

In the present invention, for example, a data glove, an HMD, a data chute, a data shoe, a data sock, a space ball, or the like may be adopted as the input device.

Referring to FIG. 1, the operation block 110 generates an operation signal of a user desired operation, for example, grabbing or touching a specific object, in a virtual environment created on a virtual reality system according to a user's operation. In the case of employing the data glove as shown in FIG. 3 as the input device 100, for example, position information of the hand such as the x, y, z coordinates by a position tracker attached to the back of the hand of the glove. Will be detected and the bending information of each finger will be detected. In this case, the position information of the hand may be represented by an orientation indicating a position representing the three-dimensional coordinates of the hand in the space and the direction of the palm.

Next, the A / D conversion block 112 converts various types of operation signals in the analog form generated by the operation block 110 into digital signals, and each of the converted digital operation signals is controlled in the next stage. Provided to block 114.

On the other hand, the control block 114 is configured to, for example, perform a two-way communication with the virtual reality system 200 through a wired interface line (L1, L2 of FIG. 1) (or two-way communication line) composed of a microcomputer. In the virtual environment generated by the virtual reality system 200, the virtual reality system 200 transmits various manipulation signals through a line L1 such that any action desired by a user, for example, picking up or moving an object, can be performed. To provide. Here, the virtual reality system may be a typical virtual system for processing a typical 3D stereoscopic image, or may be an image processing device such as a PC capable of graphic processing of a 3D stereoscopic image.

In addition, the control block 114 is a reaction to any action (or action) in the virtual environment according to the present invention, for example, when kicking the ball with the foot when running a soccer game of 3D stereoscopic image through a virtual reality system. When a reaction signal (or interaction signal) for the senses or the like is received from the virtual reality system 200 via the line L2, predetermined signal processing (noise removal, level amplification, etc.) for the received reaction signal is performed, where The processed signal is provided to the next stage D / A conversion block 118. At this time, the reaction signal input to the control block 114 through the line L2 is a digital signal.

Next, the D / A conversion block 118 converts the digital type reaction signal (actual oscillator drive signal) provided from the control block 114 into an analog signal, where the analog reaction signal, That is, the vibrator drive signal is output to the vibrator 126, so that the vibrator 126 will vibrate at a predetermined intensity. Therefore, the user will sense the feeling (or touch) of grabbing or touching an object through the vibration of the vibrator.

On the other hand, according to the present invention, the vibrator 126 mounted on the input device side 100 and transmitting a sensory feeling (feel) to a user for an action (an operation in a virtual environment) instructed by the user is an input device. It may be one or a plurality depending on the type of, as shown in Figures 3 and 4, when the input device is a data glove, HMD, data suit, data shoes, etc. Will be mounted on the part, and if the input device is a mouse, a space ball, etc., only one oscillator could be employed.

4A, 4B, and 4C, respectively, refer to a vibrator mounted in accordance with the present invention, and the vibrators mounted on the respective parts in this way may be applied to a corresponding operation when a certain operation is performed in a virtual environment according to a user's operation. Each is driven individually based on the corresponding reaction signal (drive signal). In the present invention, when employing a space ball or a mouse as an input device, it may be considered to employ only one vibrator at the center of the space ball or mouse.

Next, as shown in FIG. 3, a process of performing a sensory interaction between the data glove and the virtual reality system, which is an input device having a plurality of vibrators, in the case of employing a data glove as an input device. It demonstrates.

3 illustrates an example of employing a data glove as an improved virtual reality input device according to the present invention.

In the figure, reference numeral 10 includes an A / D conversion block 112, a control block 114, and a D / A conversion block 118 of FIG. 1 as a controller on the input device side. Further, reference numerals a, b, c, d, e, and f denote vibrators which are mounted on the back of the data glove (or the palm) and the respective parts of the finger according to the present invention. In addition, the reference symbol SL is a sensor and a signal line for detecting the position information of the hand and the bending information of the finger when the user performs various operations while wearing the data glove for the operation of the virtual reality system, that is, according to the user's operation. The operation signal is generated and transmitted to the controller 10, and when the drive signal for driving each vibrator is output from the controller 10, the drive signal is transmitted to the corresponding vibrator. The IFL denotes an interface line and performs a data interface for bidirectional communication between the controller and the virtual reality system (200 in FIG. 1).

In this case, although only a structure in which a plurality of vibrators are mounted at predetermined intervals on the back of the hand of the glove is shown in FIG. 3, it is preferable to mount the plurality of vibrators on the palm part of the glove. Thus, the entire part of the glove (back of the hand and the palm, etc.) By mounting a plurality of vibrators in the user will be able to feel a higher sense of reality or reality when operating in a virtual environment.

Thus, when a virtual reality system is powered on and a user wears a data glove equipped with a plurality of vibrators (a, b, c, d, e, f) as described above, an object (eg Position of the hand (ie, coordinates) and finger movements detected by the sensor when the user grabs the glove and grabs the glove, the sensor and the signal line (SL1, SL2, SL3, SL4, SL5) , To the controller 10 via SL6. That is, referring to FIG. 1, the position and motion signals generated by the operation block 110 are input to the control block 114 via the A / D conversion block 112.

As an example, assuming that the user has taken the corresponding action by using the thumb, index finger, and middle finger to take a corresponding action, the signal sensed through the sensor and signal lines SL1, SL2, SL3 is sent to the control block 114. Will be provided.

Next, a command signal (that is, hand position information and finger bending information, etc.) that has undergone a predetermined signal processing (modulation for transmission, level amplification, etc.) in the control block 114 is transmitted through the virtual reality system (line L1). 200, and as a result, the corresponding action (or action) in the virtual environment formed in the virtual reality system, that is, the virtual person existing in the virtual environment, will catch the object (ball) using the thumb, the index finger and the middle finger. . Here, the lines L1 and L2 of FIG. 1 correspond to the wired interface line IFL shown in FIG. 3.

At this time, the virtual reality system 200 detects the moment when the object (ball) in the virtual environment is in contact with the virtual person's hand and generates a reaction signal on the line L2 to touch the touch. That is, when the coordinate values of the outermost surface of the virtual hand and the outer coordinate values of the ball coincide with each other and / or date and time, respectively, formed along the outer edge of the virtual palm, the virtual reality system 200 detects the corresponding reaction signal and detects the corresponding reaction signal. Occurs on line L2.

As a result, the input device side 100 of FIG. 1 drives the vibrator through the control block 114 and the D / A conversion block 118, that is, three sensors and signal lines SL1 as shown in FIG. , SL2, SL3) drives the vibrators b1, b2, c1, c2, c3, d1, d2, and d3 (if the ball is picked up with the fingertips, the vibrators a1, b1 and c1 are driven) The user will be sensibly aware of the feeling of picking up the ball. In other words, the interaction between the input device and the virtual reality system allows the user to feel a certain behavior. At this time, by controlling the vibration strength of the vibrator flexibly to vary the sense of the user according to the degree of catching the ball (that is, the force of catching the ball) it will be possible to realize a higher sense of reality or reality.

On the other hand, in the above embodiment has been described as to enable the user to recognize the sensory feeling by performing the two-way communication using the reaction by embedding the vibrator according to the present invention in one of several types of input device, this concept To further expand, a more certain and realistic game, assuming that a user plays a soccer game in a virtual environment of a virtual reality while wearing a data glove, an HMD, and a data suit including an input device including a plurality of vibrators You will enjoy it. In other words, you can feel a sense of contact with any object that you can contact, such as the ball, the goal, other virtual characters (soccer players), and the floor of the playground (ie, kicking the ball or colliding with another person). Therefore, the user can enjoy almost the same realism as playing a real soccer game.

As described above, according to the present embodiment, the user can fully and surely react to a certain action in the virtual environment, that is, the sensory feeling, by using the vibrator, thereby further improving the virtual reality in the virtual environment. Realize the 3D stereoscopic virtual reality world.

Example 2

2 is a schematic block diagram of an improved virtual reality input device having a force feedback function according to another embodiment of the present invention.

Referring to FIG. 2, the present embodiment differs from Embodiment 1 described above in that two-way communication for interaction between the input apparatus 100 and the virtual reality system 200 is performed by wireless rather than wired.

Accordingly, as shown in FIG. 2, the input device side 100 according to the present embodiment further includes a transmission / reception block 116 for two-way wireless communication with the virtual reality system 200, and the input device 100. It has a configuration difference in that it further includes a power supply source that supplies driving power to the vibrator, that is, a power block 120 and a switching block 124, the control operation is substantially the same.

In this case, the transmission / reception block 116 is a block provided on a conventional remote controller and performs a wireless transmission / reception function including an infrared diode and the like, and the command signal provided from the control block 114 (ie, hand position information and Modulates the finger bending information, etc.), and then wirelessly transmits the signal with directivity, and also modulates the modulated signals received by the airwaves transmitted from the virtual reality system 200, that is, the modulated reaction signals for interaction, into the original signals before modulation. To the control block 114.

On the other hand, the power block 120 is to generate the power required to drive the vibrator 126, such a power block 120 can be configured using a battery or the like to generate a voltage of about 5V, for example. will be. In addition, the switching block 124 switches the power supply to the vibrator 126 by switching its contact based on the output signal (actual switching signal) from the D / A conversion block 118, and FIGS. 3 and 4. As shown in FIG. 2, when the input device includes a plurality of vibrators, only the desired specific vibrator (ie, the vibrator corresponding to the reaction signal) is driven through the contact switching of the switching block 126. Of course, also in this case as in the above-described embodiment 1 can be adjusted to the strength of the vibration, this vibration intensity control, for example, it will be possible to implement through the variable size of the supply current value.

Therefore, unlike the first embodiment, the present embodiment differs only in performing wireless two-way communication between the input device and the virtual reality system, and thus substantially the same result, that is, the reaction to a certain action in the virtual environment using the vibrator, In other words, by making the user feel the sensory feeling sufficiently and surely, it is possible to realize an advanced three-dimensional stereoscopic reality world in virtual reality in a virtual environment.

Claims (28)

An input device for providing an operation command signal for operating a virtual environment according to a user's operation to a virtual reality system having a virtual environment setting function for a virtual reality, Means for generating a plurality of command signals for manipulating a virtual environment sensed according to a user's operation, and converting each generated command signal to A / D; Predetermined signal processing for each command signal provided from the A / D conversion means is performed, and the signal is modulated into a wire-transmittable signal and provided to the virtual reality system through a wired interface line, and the virtual through the interface line. Control means for receiving respective reaction signals for sensory response according to each operation in a virtual environment provided from a real system; Means for D / A converting the reaction signals for each sensory response provided from the control means and generating respective drive control signals corresponding to the converted reaction signals; And An oscillator for generating a vibration of a predetermined level based on each drive control signal from the control signal generating means Improved virtual reality input device having a feedback function consisting of. The virtual reality input device of claim 1, wherein the input device is a data glove. The virtual reality input device of claim 1, wherein the input device is a head mounted display. 2. The virtual reality input device of claim 1, wherein the input device is a data suit. The virtual reality input device having a feedback function according to claim 1, wherein the input device is a data shoe. 2. The virtual reality input device of claim 1, wherein the input device is a data sox. 7. The virtual reality input device according to any one of claims 2 to 6, wherein each input device includes a plurality of vibrators arranged at predetermined intervals along their outer surfaces. . 8. The virtual reality input device of claim 7, wherein each of the plurality of vibrators generates a vibration having a variable intensity in accordance with the driving control signal. 9. The virtual reality input device of claim 1, wherein the input device is a space ball. 10. The virtual reality input device of claim 9, wherein the space ball includes one vibrator at an inner central portion thereof. The virtual reality input device of claim 10, wherein the vibrator generates a vibration having a variable intensity according to the driving control signal. The virtual reality input device of claim 1, wherein the input device comprises at least two combinations of a data glove, a head mounted display, a data suit, a data shoe, and a data sox. 13. The virtual reality input device according to claim 12, wherein each of the input devices includes a plurality of vibrators arranged at predetermined intervals along their outer surfaces. The virtual reality input device of claim 13, wherein each of the plurality of vibrators generates vibrations having a variable intensity in accordance with the driving control signal. An input device for providing an operation command signal for operating a virtual environment according to a user's operation to a virtual reality system having a virtual environment setting function for a virtual reality, Means for generating a plurality of command signals for manipulating a virtual environment sensed according to a user's operation, and converting each generated command signal to A / D; To perform a predetermined signal processing for each command signal provided from the A / D conversion means for transmission to the virtual reality system, for the sensory response according to each operation in the virtual environment received from the virtual reality system Control means for performing signal processing of each reaction signal; Modulating each command signal provided from the control unit into a radio transmitting signal, and then transmitting the air wave at a predetermined direction to provide the virtual reality system to the virtual reality system, wherein the respective modulated reactions are transmitted and received from the virtual reality system. Wireless transmitting / receiving means for demodulating the signal into the original path and then providing the signal to the control means; Means for D / A converting the reaction signals for each sensory response provided from the control means and generating respective drive control signals corresponding to the converted reaction signals; Power supply means for providing a power source for generation of the reaction signal for the received sensory response; A vibrator driven according to the power supplied from the power supply means to generate a vibration of a predetermined level; And And a switching means for switching the supply of power provided from the power supply means to the vibrator in response to a drive control signal from the drive control signal generating means. 16. The virtual reality input device of claim 15, wherein the input device is a data glove. 16. The virtual reality input device of claim 15, wherein the input device is a head mounted display. 16. The virtual reality input device of claim 15, wherein the input device is a data suit. 16. The virtual reality input device of claim 15, wherein the input device is a data shoe. 16. The virtual reality input device of claim 15, wherein the input device is a data sox. 21. The virtual reality input device according to any one of claims 16 to 20, wherein each of the input devices each includes a plurality of vibrators arranged at predetermined intervals along their outer surfaces. . 22. The virtual reality input device of claim 21, wherein each of the plurality of vibrators generates a vibration having a variable intensity in accordance with the driving control signal. 16. The virtual reality input device of claim 15, wherein the input device is a space ball. 24. The virtual reality input device of claim 23, wherein the space ball includes one oscillator at an inner central portion thereof. 25. The virtual reality input device of claim 24, wherein the vibrator generates a vibration having a variable intensity in accordance with the drive control signal. 16. The virtual reality input device of claim 15, wherein the input device comprises at least two combinations of a data glove, a head mounted display, a data chute, a data shoe, and a data sock. 27. The virtual reality input device of claim 26, wherein each of the input devices includes a plurality of vibrators arranged at predetermined intervals along their outer surfaces. 28. The virtual reality input device of claim 27, wherein each of the plurality of vibrators generates a vibration having a variable intensity in accordance with the driving control signal.