KR20170076534A - Virtual reality interface apparatus and method for controlling the apparatus - Google Patents

Abstract

The present disclosure relates to a technique for providing an image to a user in a virtual reality and allowing the user to feel the reality through manipulated sensory stimulation. The present disclosure can be utilized in many industrial areas such as games, education, medical care, journalism, etc. based on the above-described technology. The present disclosure discloses a virtual reality interface device and a method for controlling the same using a user's hand.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual reality interface device,

A virtual reality interface device, and a control method.

Recently, devices for providing images to users by using a virtual reality device have been developed. Virtual reality technology enables users to feel reality through manipulated sensory stimulation and can be used in many industrial fields such as games, education, medical care, journalism.

Unlike a conventional flat panel display in which only a screen of a predetermined size is displayed, it is possible to experience a full 360-degree field of view using a virtual reality apparatus. This allows the user to feel immersive as if they were moving to another world. Virtual reality technology not only provides the user with a sense of sight, hearing, etc., but also enhances immersion by making the user feel tactile.

A virtual reality interface device, and a control method. The present invention also provides a computer-readable recording medium on which a program for causing the computer to execute the method is provided. The technical problem to be solved by this embodiment is not limited to the above-mentioned technical problems, and other technical problems can be deduced from the following embodiments.

A virtual reality interface apparatus according to a first aspect includes: a source for generating a magnetic field; A motion detector for obtaining coordinates of a user's hand based on the generated magnetic field; And a virtual reality providing device that reflects the coordinates of the user's hand received from the motion detector on the virtual reality based on a change in the position of the source in accordance with the movement of the user.

Further, the virtual reality providing apparatus may be detachable from the source.

The virtual reality providing apparatus can correct the coordinates of the user's hand based on the position of the source received from the motion detector on the basis of a part of the user's body based on the change in the position of the source in accordance with the movement of the user have.

Further, the movement of the user may be the head movement of the user, and a part of the user's body may be the chest of the user.

The virtual reality providing apparatus further includes: a communication interface for communicating with the motion detector; A sensor for detecting movement of the user; And a processor for obtaining the coordinates of the user's hand by correcting coordinates of the user's hand received from the motion detector on the basis of a part of the user's body.

Further, the virtual reality providing apparatus may further include a display for displaying to the user a virtual reality reflecting the coordinates of the user's hand.

Further, the communication interface can transmit the virtual reality reflecting the coordinates of the user's hand to an external display device.

In addition, the virtual reality providing apparatus can generate the vibration generation signal based on the object coordinates in the virtual reality and the coordinates of the user's hand.

Further, the motion detector may include a part of the motion detector including a bent part, and a part of the bent part may be mounted on a part of the user's hand.

In addition, the motion detector may position at least one sensor, which senses movement of the user's finger, on at least one side of the motion detector.

A method of controlling a virtual reality interface device according to a second aspect includes obtaining coordinates of a user's hand based on a magnetic field generated at a source; Detecting a change in the position of the source in accordance with the movement of the user; And reflecting the coordinates of the obtained hand of the user to the virtual reality based on the change in the position of the sensed source.

According to a third aspect, there is provided a computer-readable recording medium having recorded thereon a program for causing a computer to execute a method of controlling a virtual reality interface device.

1 is a block diagram illustrating a configuration of a virtual reality interface apparatus according to an embodiment.
2 is a diagram for explaining the operation of the virtual reality interface apparatus according to an embodiment.
3 is a view for explaining the operation of the virtual reality interface apparatus according to another embodiment.
4 is a block diagram illustrating a configuration of a virtual reality providing apparatus according to an embodiment.
5 is a block diagram illustrating a configuration of a source according to an embodiment.
6 is a block diagram illustrating a configuration of a motion detector according to an embodiment.
7 is a diagram for explaining a method of controlling a virtual reality interface apparatus according to an embodiment.
8 is a view for explaining an operation using a neck joint as a reference point for correcting a head movement of a user.
9 is a diagram for explaining a method of controlling a virtual reality interface apparatus that reflects finger motion information according to an embodiment.
10 is a view for explaining a form of a motion detector according to an embodiment.
11 is a view for explaining a sensor of a motion detector according to an embodiment.
12 is a flowchart illustrating a method of controlling a virtual reality interface apparatus according to an embodiment.
13 is a flowchart illustrating a process of providing a virtual reality in a method of controlling a virtual reality interface device according to an embodiment.
FIG. 14 is a flowchart illustrating a process of generating vibration in the motion detector according to an embodiment.
15 is a diagram for explaining fields of motion data generated by a motion detector according to an embodiment.
16 is a diagram for explaining a field of motion data generated by a motion detector according to an embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will now be described in detail with reference to the accompanying drawings. The following examples are intended to illustrate the invention and are not intended to limit or limit the scope of the invention. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

As used in this disclosure, the terms " comprising " or " comprising " or " comprising ", etc. should not be construed as necessarily including a plurality of elements or steps, Or may further include additional components or steps.

Although the terms used in this disclosure have been described in general terms that are currently used in consideration of the functions referred to in this disclosure, they are intended to encompass various other terms depending on the intention or circumstance of the skilled artisan, . Accordingly, the terms used in the present disclosure should not be construed as merely the names of the terms, but rather on the meaning of the terms and throughout the present disclosure. Also, the singular expressions include plural meanings unless the context clearly dictates singular.

The " above " and similar indications used in this specification (especially in the claims) may refer to both singular and plural. Further, if there is no description explicitly specifying the order of the steps describing the method according to the present disclosure, the steps described may be performed in any suitable order. The present disclosure is not limited by the order of description of the steps described.

The phrases such as "in one embodiment" appearing in various places in this specification are not necessarily all referring to the same embodiment.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented with various numbers of hardware and / or software configurations that perform particular functions.

Also, the connection lines or connection members between the components shown in the figures are merely illustrative of functional connections and / or physical or circuit connections. In practical devices, connections between components can be represented by various functional connections, physical connections, or circuit connections that can be replaced or added.

The embodiments relate to a virtual reality interface device and a control method, and a detailed description thereof will be omitted with respect to matters widely known to those skilled in the art to which the following embodiments belong. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining a configuration of a virtual reality interface apparatus 1000 according to an embodiment. 1, the virtual reality interface apparatus 1000 may include a virtual reality providing apparatus 100, a source 200, and a motion detector 300. [

The source 200 is attachable to and detachable from the virtual reality providing apparatus 100 and the virtual reality providing apparatus 100 is user-wearable or wearable. In one embodiment, the source 200 is fixed or attached to the virtual reality providing device 100 and is physically adjacent, but not interlocked, while the virtual reality providing device 100 and the motion detector 300 communicate And may be wirelessly or wire-connected through the interfaces 110 and 310 to transmit and receive data.

In one embodiment, the virtual reality providing apparatus 100 and the motion detector 300 are connected by a wireless communication method such as Bluetooth, and the following initial connection is made as an example. In the initial connection, the virtual reality providing apparatus 100 searches for a peripheral device via Bluetooth and performs a pair connection with the motion detector 300, or performs a specific connection of the virtual reality providing apparatus 100 through the NFC mounted on the motion detector 300 A pair connection is automatically made when the motion detector 300 is recognized. After the initial connection is established, when the virtual reality providing apparatus 100 is executed, the connection is attempted every time the power of the motion detector 300 is turned on, so that the motion detector 300 can be used immediately.

In one embodiment, the virtual reality providing apparatus 100 provides the user with an image of a space different from the space where the user is. For example, a user can view an image of a foreign city by using the virtual reality providing apparatus 100 indoors. The user can move the whole body or only the head. The virtual reality providing apparatus 100 can adjust the size of the image according to the moving direction of the user when the entire body of the user moves. In addition, the virtual reality providing apparatus 100 may provide different images according to the movement and / or direction of the user's head when the user's head moves.

The virtual reality providing apparatus 100 may be a head mounted display, a VR headset, a virtual reality apparatus, a PC, a laptop, a smart TV, a mobile phone, a PDA, a smart terminal, And the like. In addition, the virtual reality providing apparatus 100 may be a pair of glasses, a hair band, a watch, etc., having a communication function and a data processing function.

The motion detector 300 may be in the form of a handheld hand held by a user or a wearable type worn on the palm of a hand. The motion detector 300 may be configured as a left hand and a right hand, and may be used individually or simultaneously.

2 is a diagram for explaining the operation of the virtual reality interface apparatus 1000 according to an embodiment. Referring to FIG. 2, in an embodiment, the virtual reality providing apparatus 100 is manufactured in a form to be worn on a user's head such as a head mounted display, a VR headset, and a virtual reality apparatus, May also be a device that displays content.

In addition, when the entire body of the user moves, the virtual reality providing apparatus 100 can adjust the size of the image according to the moving direction of the user. When the user's head moves, the virtual reality providing apparatus 100 displays different images according to the movement and rotation direction of the user's head . Also, in a virtual reality, a user interface of a hand or other shape can be displayed in accordance with the position and angle of an actual user's hand according to the contents.

3 is a diagram for explaining the operation of the virtual reality interface apparatus 1000 according to another embodiment. 3, the virtual reality providing apparatus 100 may be a personal computer (PC), a laptop, a smart TV, a mobile phone, a PDA, a smart terminal, a game machine, or the like.

The virtual reality providing apparatus 100 provides a virtual reality to the external display apparatus 400 and the virtual reality is displayed through the external display apparatus 400. [ The virtual reality providing apparatus 100 may be connected to the external display apparatus 400 through a wired or wireless communication interface 110 and may transmit the screen displayed on the virtual reality providing apparatus 100 to the external display apparatus 400 As shown in FIG. In addition, a user interface of a hand or other shape can be displayed in accordance with the position and angle of an actual user's hand according to contents in a virtual reality.

FIG. 4 is a block diagram illustrating a configuration of a virtual reality providing apparatus 100 according to an embodiment. As shown in FIG. 4, the virtual reality providing apparatus 100 may include a communication interface 110, a sensor 120, a processor 130, and a display 140.

The communication interface 110 may perform communication with various types of external devices according to various communication methods. The communication interface 110 may include at least one of various types of wireless communication chips such as a Bluetooth chip, a Wi-Fi chip, a mobile communication chip, a Zigbee chip, an NFC (Near Field Communication) chip and an infrared communication chip. The Bluetooth chip and the Wi-Fi chip can communicate with each other via the Bluetooth method and the WiFi method, respectively. When a Bluetooth chip or a Wi-Fi chip is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The Bluetooth chip can support short range wireless communication based on the Bluetooth 4.0 (BLE) protocol. The mobile communication chip refers to a chip that performs communication according to various communication standards such as 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), and Long Term Evolution (LTE). The ZigBee chip supports short-range wireless communication corresponding to one of the IEEE 802.15.4 standards and can be used for low-speed data transmission between devices at distances of around 20 meters. The NFC chip refers to a chip operating in a short-range wireless communication system using the 13.56 MHz band among various RF-ID frequency bands.

In addition, the virtual reality providing apparatus 100 may be connected to the motion detector 300 through a communication interface 110 in a wireless or wired manner to transmit and receive data. The communication interface 110 may be connected via a network and the network may be a wired network such as a local area network (LAN), a wide area network (WAN), or a value added network (VAN) A mobile radio communication network, a satellite communication network, or the like.

The sensor 120 may sense the movement of the user through the sensors and may transmit the sensed information to the processor 130. The sensor 120 may be a sensor such as a magnetic sensor, a gyroscope sensor, an acceleration sensor, an optical sensor, a camera sensor, an ultrasonic sensor, an infrared sensor, a temperature / humidity sensor, And an RGB sensor (illuminance sensor), but the present invention is not limited thereto. The function of each sensor can be intuitively deduced from the name by those skilled in the art, so a detailed description will be omitted.

The processor 130 may perform overall control of the virtual reality providing apparatus 100. [ The processor 130 may use the communication interface 110 to perform communication with external devices. In addition, the processor 130 may perform a control operation corresponding to a user operation when a user operation is performed through the user interface.

The processor 130 may include at least one of RAM, ROM, a CPU, a GPU (Graphic Processing Unit), and a data bus. RAM, ROM, CPU, GPU, etc. may be interconnected via a data bus. The CPU accesses a memory (not shown) and performs booting using the O / S stored in the memory (not shown). Then, various operations are performed using various programs, contents, data stored in a memory (not shown). ROM stores a set of commands for booting the system and the like. For example, when the turn-on command is inputted and power is supplied, the CPU copies the O / S stored in the memory to the RAM according to the instruction stored in the ROM, You can run it to boot the system. When the booting is completed, the CPU copies various programs stored in the memory (not shown) to the RAM, executes the program copied to the RAM, and performs various operations. The GPU displays the screen on the display 140 when the booting of the virtual reality providing apparatus 100 is completed.

In one embodiment, the GPU may generate a screen displaying an electronic document containing various objects such as content, icons, menus, and the like. The GPU calculates attribute values such as coordinate values, shape, size, color, etc., which each object will be displayed according to the layout of the screen. The GPU can then generate screens of various layouts including objects based on the computed attribute values. The screens generated in the GPU may be provided to the display 140 and displayed in each area of the display 140, respectively.

The memory (not shown) may store a program for processing and controlling the processor 130, and may store data input to or output from the virtual reality providing apparatus 100. [ The memory (not shown) may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) A disk, and / or an optical disk. Programs stored in a memory (not shown) can be classified into a plurality of modules according to their functions.

The display 140 displays the virtual reality according to the execution of the virtual reality program and displays the object in the virtual reality controlled by the processor 130 to the virtual reality. The display 140 may be implemented as various types of displays such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active matrix organic light-emitting diode (AM-OLED), a plasma display panel . The display 140 may be embodied as being flexible, transparent or wearable.

The names of the configurations of the virtual reality providing apparatus 100 may vary. In addition, the virtual reality providing apparatus 100 according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or further other additional components may be included. For example, the virtual reality providing apparatus 100 may include the display 140, but may omit the display 140 and display it on the external display device 400 via the communication interface 110. [ That is, the components may be added or subtracted depending on the type or characteristics of the virtual reality providing apparatus 100.

5 is a block diagram illustrating a configuration of a source 200 according to an embodiment. Referring to FIG. 5, the source 200 may include a processor (not shown) and a magnetic field generator 210. A processor (not shown) controls the magnetic field generator 210, and the magnetic field generator 210 generates a magnetic field by passing current through the triaxial coil. That is, the AC frequency of a specific frequency is generated in three axes.

The names of the configurations of the source 200 described above may be different. Further, the source 200 according to the present disclosure may be configured to include at least one of the above-described elements, and some of the elements may be omitted or further include other additional elements.

6 is a block diagram illustrating a configuration of a motion detector 300 according to an embodiment. 6, the motion detector 300 may include a communication interface 310, a sensor 120, an input unit 330, an output unit 340, and a processor 350.

The communication interface 310 can perform communication with various types of external devices according to various types of communication methods. The communication interface 310 may include at least one of various types of wireless communication chips such as a Bluetooth chip, a Wi-Fi chip, a mobile communication chip, a Zigbee chip, an NFC (Near Field Communication) chip, and an infrared communication chip. The Bluetooth chip and the Wi-Fi chip can communicate with each other via the Bluetooth method and the WiFi method, respectively. When a Bluetooth chip or a Wi-Fi chip is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The Bluetooth chip can support short range wireless communication based on the Bluetooth 4.0 (BLE) protocol. The mobile communication chip refers to a chip that performs communication according to various communication standards such as 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), and Long Term Evolution (LTE). The ZigBee chip supports short-range wireless communication corresponding to one of the IEEE 802.15.4 standards and can be used for low-speed data transmission between devices at distances of around 20 meters. The NFC chip refers to a chip operating in a short-range wireless communication system using the 13.56 MHz band among various RF-ID frequency bands.

In addition, the motion detector 300 may be connected to the virtual reality providing apparatus 100 via a communication interface 310 to transmit or receive data wirelessly or by wire. The communication interface 310 may be connected via a network and the network may be a wired network such as a local area network (LAN), a wide area network (WAN), or a value added network (VAN) Or any type of wireless communication interface 310, such as a mobile radio communication network or a satellite communication network.

In addition, the communication interface 310 may use a proximity communication module for initial position calibration. The proximity communication module may be composed of a communication module such as an NFC, an infrared communication module, and an ultrasonic communication module. When the motion detector 300 approaches the source 200 or the virtual reality providing apparatus 100 a predetermined distance or more, it can sense this through the proximity communication module and issue an initial position correction command to the processor 350.

The sensor 320 may sense the user's movement through the sensors and transmit the sensed information to the processor 350. [ The sensor 320 may be a sensor such as a magnetic sensor, a gyroscope sensor, an acceleration sensor, an optical sensor, a camera sensor, an ultrasonic sensor, an infrared sensor, a temperature / humidity sensor, And an RGB sensor (illuminance sensor), but the present invention is not limited thereto. Magnetic field sensors can include amplifiers, analog-to-digital converters (ADCs), bandpass filters, and the like, as well as three-axis coils. When the intensity of the electric current generated by the magnetic field generated by the magnetic field generator 210 of the source 200 is induced in the three-axis coil of the magnetic sensor of the motion detector 300, the intensity of the current generated by the motion detector 300 ) Can be obtained, and the motion can be detected through this.

In one embodiment, finger motion information is obtained via the sensor 320. The proximity sensor refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or infrared rays. . The results detected by the sensor 320 are transmitted to the processor 350. The function of each sensor can be intuitively deduced from the name by those skilled in the art, so a detailed description will be omitted.

The input unit 330 can receive a predetermined signal from outside or from a user. The input unit 330 may include at least one of a button, a key pad, a dome switch, a touch pad (contact type capacitance type, pressure type resistive type, infrared ray detection type, surface ultrasonic wave conduction type, A piezo effect method, etc.), a jog wheel, a jog switch, and the like, but is not limited thereto. For example, the button may transmit the user's input to the processor 350 via the pressed state information of the physical button.

The output unit 340 may be used to output the generated signal to the outside. The output unit 340 may include a vibration actuator, a speaker, an illumination, and the like. The vibration actuator generates vibration according to the control signal of the processor 350. [ The speaker can output audio data. The speaker can output the sound wave containing the data to the outside. Illumination can emit light. The illumination may include a light emitting device such as an LED, and may transmit data through flashing of light.

The processor 350 may perform overall control of the motion detector 300. The processor 350 may use the communication interface 310 to communicate with external devices. The processor 350 may output a predetermined signal to the outside through the output unit 150 or may receive a predetermined signal from the outside through the input unit 160. [ In addition, the processor 350 receives the sensed data from the sensor 320, acquires signal values for each axis, and calculates coordinates indicating the position and direction of the hand.

The processor 350 obtains the magnetic field vector at each position using the measured values of the three-axis sensor 320 coil of the motion detector 300 with respect to the origin of the triaxial magnetic field generated at the source 200 and the magnetic field source Calculates the position and the rotation value of the motion detector 300 by the magnetic field formula, and transmits the position and the rotation value to the virtual reality providing device 100 through the communication interface 310.

  In one embodiment, the processor 350 generates the data shown in Figures 7 and 8 using the sensor 320 measurements. For example, the data shown in FIGS. 7 and 8 may be generated according to the Bluetooth communication standard. In one embodiment, the processor 350 controls the output 340 to represent feedback appropriate for user input or content context. For example, when the user interface of the user's hand and the surrounding object on the virtual reality meet, the vibration is generated by the vibration actuator of the output unit 340. In addition, the processor 350 may include at least one of RAM, ROM, CPU, GPU (Graphic Processing Unit) and a data bus. RAM, ROM, CPU, GPU, etc. may be interconnected via a data bus.

The names of the constructions of the motion detector 300 described above may be different. Further, the motion detector 300 according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components.

7 is a diagram for explaining a method of controlling the virtual reality interface apparatus 1000 according to an embodiment. Referring to FIG. 7, a process of transferring data between the virtual reality providing apparatus 100, the source 200, and the motion detector 300 is shown.

In step 710, the source 200 may generate a magnetic field (S 710).

The motion detector 300 may sense the magnetic field through the sensor 320 and calculate the position and orientation of the hand based on the intensity of the magnetic field generated at the source 200 to determine The coordinates of the user's hand are acquired (S720).

In operation 730, the motion detector 300 transmits coordinates of the user's hand acquired by the virtual reality providing apparatus 100 (S 730). In operation 740, the virtual reality providing apparatus 100 transmits the coordinates of the user's hand to the motion detector 300. The coordinates of the user's hand versus the source acquired from the source (S740).

The source 200 may be attached to the virtual reality providing device 100 and the user may wear or wear the virtual reality providing device 100 so that the virtual reality providing device 100 ) As well as the position of the source 200 (S 750).

In step 760, the virtual reality providing apparatus 100 detects a change in the position of the source 200 by the sensor 120 (S760). Therefore, it is necessary to reflect a change in the position and angle of the source in accordance with the movement of the user.

In step 770, the coordinates of the user's hand received from the motion detector 300 are reflected on the virtual reality based on the change in the position of the detected source 200 (S770). Hereinafter, how the virtual reality is reflected will be described according to an exemplary embodiment.

In one embodiment, based on a change in the position of the sensed source 200 as the user moves, the coordinates of the user's hand with respect to the source 200 are corrected on the basis of a portion of the user's body, The coordinates of the user's hand can be reflected in the virtual reality. Since it is for correcting the movement of the user, it is better that the part of the user's body is less influenced by the movement of the user.

According to one exemplary embodiment in which the virtual reality providing apparatus 100 is a VR headset, in step 750, the source 200 is attached to the virtual reality providing apparatus 100, and the user places the virtual reality providing apparatus 100 in the head The position of the source 200 as well as the virtual reality providing apparatus 100 changes when the user moves his or her head. Accordingly, at step 770, coordinates indicating the position and angle of the user's hand with respect to the source 200 are displayed on the user's chest, based on the change in the position of the sensed source 200 according to the head movement of the user And the coordinates of the hand of the calibrated user can be reflected in the virtual reality.

8 is a view for explaining an operation using the neck joint as a reference point in order to correct the movement of the user's head according to the change of the position of the source 200. [ The coordinates of the user's hand based on the source 200 acquired by the motion detector 300 may be referred to as the position of the user's chest on the basis of the positional change of the source 200 according to the movement of the user's head An exemplary matrix operation for calibrating by reference and obtaining the coordinates of the user's hand is described.

Based on the magnetic field generated by the source 200, the motion detector 300 measures the intensity of the induced current to calculate the position of the motion detector 300 and the slope of the three axes relative to the source 200. At this relative position, the position and slope of the actual hand are calculated by reflecting the inclination of the virtual reality providing apparatus 100 and the movement of the neck joint. Details are given below.

Since the source 200 is detachable to the virtual reality providing apparatus 100, it can have different coordinate values depending on the direction of the head even if the position of the user's hand is not moved. This is because the reference coordinate system of the source 200 serving as a reference of the position also rotates as the head rotates. The position and the rotation data measured by the sensor 320 become the local coordinate system based on the source 200. In order to calculate the absolute coordinates and the rotation value of the hand movement in the actual user space, It is necessary to correct the motion of the robot 200.

The correction for the rotation of the source 200 is made in consideration of the inclination of the source 200 and the head movement of the person. Since the user's head is rotated around the neck joint, the position correction of the source 200 is calculated by adding the movement of the source 200 to the position of the neck joint and the rotation value of the source 200.

According to one embodiment, since the rotation value of the source 200 attached to the virtual reality providing apparatus 100 is equal to the rotation value of the virtual reality providing apparatus 100, the sensor 120 of the virtual reality providing apparatus 100, The rotation value of the data can be applied, and the position value of the source of the wood-base reference can be known through measurement (Calibration).

In this embodiment, to provide a coordinate system that uses the position of the chest as a reference point, the definition of each parameter is as follows, and the following calculation procedure is followed.

Input P ': Relative position value of the motion detector in the source reference coordinate system

Input R ': Relative rotation value of the motion detector in the source reference coordinate system

S: Moving operation from the virtual reality device to the neck joint

R: rotation calculation of virtual reality providing device

B: Movement from the neck joint to the final reference frame, chest

Final position P = B * R * S * Input P '

Final angle R = R * Input R '

Final position Pc = input P '* S * R * B

Final angle Rc = input R '* R

The measured values according to one embodiment are as follows.

The current relative position input P 'from the source 200 measured from the motion detector 300 is converted to a matrix according to Equation 1, assuming X = 30 cm, Y = 0 cm, Z = 100 cm.

[Equation 1]

Assuming that the face length of the user is 30 cm and the head of the user is about 10 cm from the virtual reality providing apparatus 100, the movement calculation S from the virtual reality providing apparatus 100 to the neck joint, ) Is determined by Equations (2) and (3). R is expressed in Euler angles.

&Quot; (2) "

&Quot; (3) "

Since the chest is the reference point, the movement calculation from the neck joint to the final reference coordinate system, the chest, is determined by Equation (4).

&Quot; (4) "

The position of the motion detector 300, which corrects the head movement of the user with respect to the chest, is determined by a matrix operation according to Equation (5).

&Quot; (5) "

Converting the final position P to a vector value yields the final position Pc.

Thus, the position of the final corrected motion detector 300 is X = 0.3 cm, Y = 0.21 cm, and Z = 1.1 cm.

라고 가정하고, 수학식 6에 따라 매트릭스로 변환한다. The current relative rotation value input R 'from the source 200 measured from the motion detector 300

And converts it into a matrix according to Equation (6).

 &Quot; (6) "

The rotation value of the motion detector 300, which corrects the user's head motion based on the chest, is determined by a matrix operation according to Equation (7).

 &Quot; (7) "

Converting the final position R to a vector value yields the final position Pc.

이다.Thus, the angle of the final corrected motion detector 300 is

to be.

와

와 같은 절대 좌표를 구할 수 있다.Through an exemplary matrix operation such as Equations (1) to (7), the user's hand relative to the chest of the user

Wow

Can be obtained.

9 is a diagram for explaining a method of controlling a virtual reality interface apparatus 1000 that reflects finger motion information according to an embodiment. Referring to FIG. 9, the process of transmitting information between the virtual reality providing apparatus 100, the source 200, and the motion detector 300 is shown.

In step 910, the source 200 may generate a magnetic field (S910).

In step 920, the motion detector 300 may sense the magnetic field through the sensor 320 to calculate the position and orientation of the hand based on the strength of the magnetic field generated at the source 200, (S920).

In step 930, the motion detector 300 may sense the user's finger movement through the sensor 320 (S930). In one embodiment, a magnetic field sensor is used to sense the magnetic field, and a light sensor is used to sense finger motion.

In operation 940, the motion detector 300 transmits coordinates of the user's hand and finger motion information to the virtual reality providing apparatus 100 (S940).

In operation 950, in accordance with the finger motion information transmitted in operation 940, the virtual reality providing apparatus 100 receives coordinates of the user's hand and finger motion information from the motion detector 300 with respect to the source 200 (S 950) .

In operation 960, the source 200 may be attached to the virtual reality providing apparatus 100, and the user may wear or wear the virtual reality providing apparatus 100, so that if the user moves, the virtual reality providing apparatus 100 ) As well as the position of the source 200 (S960).

In step 970, the virtual reality providing apparatus 100 senses a change in the position of the source 200 by the sensor 120 (S970). Therefore, it is necessary to reflect a change in the position and angle of the source in accordance with the movement of the user.

In step 980, the coordinates of the user's hand received from the motion detector 300 are reflected on the virtual reality based on the change in the position of the sensed source 200, and the finger motion information is also reflected on the virtual reality (S 980) .

In one embodiment, the information that the motion detector 300 transmits to the virtual reality providing device 100 includes information such as the type and state of the motion detector 300, the shape of the hand, May also be included.

10 is a view for explaining a form of the motion detector 300 according to an embodiment.

The motion detector 300 includes a form in which any part is bent. Accordingly, a part of the bent shape can be mounted on any part of the user's hand. In one embodiment, the bent shape may be a central portion, an upper portion or a lower portion, or it may be flexible in shape to allow it to bend to the hands of each user.

Also, according to embodiments, only a portion of the motion detector 300 may be in a bent shape, or all may be in a bent shape. In addition, any part of the user's hand resting on some or all of the motion detector 300 can vary widely, such as the back of the hand, the palm, the finger, between the palm and the back of the hand,

In one embodiment, as shown in Fig. 10, the free finger movement of the user is possible by placing the bent shape of the U-shaped motion detector 300 between the user's thumb and index finger. It is needless to say that the shape of the right-handed and left-handed motion detectors 300 may be different from each other, and the mounting portion may be different.

11 is a view for explaining a sensor 320 of the motion detector 300 according to an embodiment. Referring to FIG. 11, at least one sensor 320 sensing the movement of a user's finger may be positioned on at least one side of the motion detector 300.

In one embodiment, the sensor 320 may include, but is not limited to, an optical sensor, a camera sensor, an ultrasonic sensor, and an infrared sensor.

In one embodiment, a sensor 320 is disposed on one side of the palm side of the motion detector 300 to sense the degree of bending of the finger. According to embodiments, the position of the sensor 320 may be, but is not limited to, the front, back, top, bottom, both sides, or the entirety of the motion detector 300.

Also, in one embodiment, one or more sensors 320 may be arranged in a row. Information on the position of the user's hand as well as the shape of the user's hand, the degree of bending of each finger, the angle of the user's hand, and the degree of rotation can be obtained through the placed sensor 320, It can be reflected in the virtual reality in a consistent manner.

12 is a flowchart for explaining a method of controlling the virtual reality interface apparatus 1000 according to an embodiment.

In step 1210, the motion detector 300 obtains the coordinates of the user's hand based on the magnetic field generated in the source 200 (S1210). The motion detector 300 senses a magnetic field signal generated at the source 200 through the sensor 320 and calculates the position and angle of the user's hand through the processor 350 to determine the position of the user based on the source 200 Obtain the coordinates of the hand.

In operation 1220, the virtual reality providing apparatus 100 detects a change in the position of the source 200 according to the movement of the user (S 1220). When the position of the source 200 changes according to the movement of the user, the virtual reality providing apparatus 100 can detect a change in the intensity of the magnetic field through the magnetic field sensor and know the change in the position of the source 200.

In step 1230, the virtual reality providing apparatus 100 reflects the coordinates of the user's hand obtained based on the change in the position of the detected source 200 in the virtual reality (S1230). The virtual reality providing apparatus 100 receives the coordinates of the user's hand acquired from the motion detector 300 after step 1210 and corrects it to match the positional change of the source 200 via the processor 130, .

13 is a flowchart illustrating a process of providing a virtual reality in a method of controlling the virtual reality interface apparatus 1000 according to an embodiment.

Step 1310, following method 1200, provides a virtual reality that reflects the coordinates of the user's hand after step 1230 of FIG. Here, the virtual reality provided by the virtual reality providing apparatus 100 may include not only coordinates of the user's hand but also finger motion information of the user.

The provision of the virtual reality means that the virtual reality providing apparatus 100 displays the virtual reality to the user or the virtual reality providing apparatus 100 transmits the virtual reality to the external display apparatus 400, Or the virtual reality providing apparatus 100 and the external display apparatus 400 both display virtual reality. Further, in a virtual reality in which the coordinates of the user's hand are reflected, a user interface of a hand or other shape can be displayed in accordance with the position and angle of the hand according to the contents.

FIG. 14 is a flowchart illustrating a method of generating vibration in the motion detector 300 according to an embodiment. In one embodiment, method 1400 of FIG. 14 leads to method 1200 of FIG.

In step 1410, after the coordinates of the user's hand are reflected on the virtual reality (S 1230), the virtual reality providing apparatus 100 calculates the coordinates of the surrounding objects in the virtual reality (S 1410).

In step 1420, the virtual reality providing apparatus 100 determines whether the coordinates of the object in the calculated virtual reality and the coordinates of the user's hand overlap within a predetermined range (S 1420).

In step 1430, when the virtual reality providing apparatus 100 determines that the virtual reality providing apparatus 100 is overlapped, the vibration is generated through the vibration actuator of the output unit 340 in the motion detector 300 (S 1430).

In step 1440, when the virtual reality providing apparatus 100 determines that the virtual reality providing apparatus 100 is not overlapped, the motion detector 300 interrupts the vibration generation through the command of the processor 350 (S1440). If the original vibration has not occurred, no change occurs.

In one embodiment, if the virtual reality providing device 100 determines that the coordinates overlap, it may cause the vibration to occur as an output, but in addition to generating the vibration, the haptic, along with the interaction on the virtual reality, And there may be various embodiments such as sound or light output.

15 is a diagram for explaining fields of motion data generated by the motion detector 300 according to an embodiment.

In FIG. 15, the motion detector 300 recognizes the intensity of the induced current, detects the motion of the user, and generates motion data on the motion of the sensed user. In one embodiment, the motion data for a user's motion may include one or more selected from Data Start, device type, device state, message type, hand position information, hand rotation information, finger motion information, button information, have.

The motion detector 300 transmits motion data on the motion of the user to the virtual reality providing apparatus 100. The virtual reality providing apparatus 100 corrects the received motion data in accordance with the motion of the user, Thereby controlling the operation of the object.

16 is a diagram for explaining a field of motion data generated by the motion detector 300 in detail according to an embodiment. Returning to FIG. 15, the motion detector 300 may detect motion of a user including at least one selected from Data Start, device type, device state, message type, hand position information, hand rotation information, finger motion information, button information, The motion data generated by the motion detector 300 will be described in detail with reference to FIG.

In one embodiment, Data Start notifies the start of the message and is used for message integrity verification. The device type displays information on whether the motion detector 300 is for the left hand or right hand. For example, 1 for left hand and 2 for right hand. The device status indicates the current status of the motion detector 300. For example, Disconnected is in the disconnected state, Calibrating is in the initial setting adjustment state, Disabled is in the connected state, but the operation is stopped by the user, and Connected is in a state of transmitting / receiving normal data.

The message type indicates the type of the current message. For example, Information is about device information, and Action is about device motion information. The hand position information indicates the relative position of the virtual reality providing apparatus 100 with respect to the source 200 in the x, y, z coordinate system, and the hand rotation information indicates the rotation relative to the source 200 of the virtual reality providing apparatus 100 Values are displayed as x, y and z axis rotation values. The finger motion information expresses the inclination value of each finger as a real value between 0 and 1. For example, 0 means that the finger is completely flat, and 1 means that the finger is bent to the maximum. The button information represents a pressed state of a physical button. The Data End informs the end of the data and is used to check the integrity of the data.

By this disclosure, the motion of the user's hand can be more accurately reflected in the virtual reality, and it is possible to interact with the content through the haptic. This can provide the user with a real immersion feeling in the virtual reality. In addition, there is an advantage in that the user is provided not with simple sentimental content but with participatory content.

Meanwhile, a method for controlling a virtual reality interface according to an embodiment of the present invention can be realized by a general-purpose digital computer that can be created as a program that can be executed by a computer and operates the program using a computer-readable recording medium Can be implemented. Such a computer readable recording medium includes a storage medium such as a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD ROM, DVD, etc.). In addition, a plurality of computer-readable recording media may be distributed over networked computer systems, and data (e.g., program instructions and code) stored on distributed recording media may be stored on at least one computer Lt; / RTI >

So far, the embodiments have been mainly described. It will be understood by those skilled in the art that the disclosed embodiments may be embodied in various other forms without departing from the essential characteristics thereof. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention in accordance with the embodiments is set forth in the appended claims rather than the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the scope of the invention.

The terms " part, "" module, " and the like, as used herein, refer to a unit that processes at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software.

"Module" may be embodied by a program stored on a storage medium that can be addressed and that may be executed by a processor.

For example, "part" or "module" may include components such as software components, object oriented software components, class components and task components, Microcode, circuitry, data, databases, data structures, tables, arrays, and variables, as will be appreciated by those skilled in the art.

Claims (20)

A source generating a magnetic field;
A motion detector for obtaining coordinates of a user's hand based on the generated magnetic field; And
A virtual reality providing device for reflecting the coordinates of the hand of the user received from the motion detector to the virtual reality based on a change in the position of the source according to the movement of the user;
And a virtual reality interface device.
The method according to claim 1,
Wherein the virtual reality providing device is detachable from the source.
The method according to claim 1,
Wherein the virtual reality providing apparatus is configured to set coordinates of a hand of a user based on a position of the source received by the motion detector as a reference of a part of the user's body based on a change in position of the source in accordance with movement of the user To the virtual reality interface device.
The method according to claim 1,
Wherein the virtual reality providing apparatus is configured to set coordinates of the hand of the user based on the position of the source received by the motion detector on the basis of the change in the position of the source in accordance with the head movement of the user, A virtual reality interface device.
The method according to claim 1,
The virtual reality providing apparatus includes:
A communication interface for communicating with the motion detector;
A sensor for sensing movement of the user;
A processor for correcting coordinates of a user's hand received from the motion detector based on a part of the user's body to obtain coordinates of the user's hand;
And a virtual reality interface device.
6. The method of claim 5,
The virtual reality providing apparatus includes:
Further comprising a display for displaying to the user the virtual reality reflecting the coordinates of the user's hand.
6. The method of claim 5,
Wherein the communication interface comprises:
And transmits the virtual reality reflecting the coordinates of the user's hand to an external display device.
The method according to claim 1,
The virtual reality providing apparatus includes:
And generates a vibration generating signal based on the coordinates of the object in the virtual reality and the coordinates of the hand of the user.
The method according to claim 1,
The motion detector comprising:
Wherein a portion of the motion detector includes a bent shape and a portion of the bent shape is mounted to any portion of the user's hand.
The method according to claim 1,
The motion detector comprising:
And at least one sensor for sensing movement of the user's finger on at least one side of the motion detector,
Obtaining coordinates of the user's hand based on the magnetic field generated at the source;
Detecting a change in the position of the source according to a movement of the user; And
Reflecting coordinates of the obtained hand of the user to a virtual reality based on a change in the position of the detected source;
Wherein the virtual reality interface device is a virtual reality interface device.
12. The method of claim 11,
Further comprising the step of attaching said source generating a magnetic field to a virtual reality providing device,
Wherein the acquiring comprises:
And obtains the coordinates of the user's hand based on the magnetic field generated at the attached source.
12. The method of claim 11, wherein the step of reflecting the coordinates of the obtained hand of the user to the virtual reality comprises:
And adjusting the coordinates of the hand of the user based on the position of the source based on a change in the position of the detected source in accordance with the movement of the user, How to control the device.
14. The method of claim 13, wherein the movement of the user is head movement of the user, and a portion of the body of the user is the chest of the user.
12. The method of claim 11,
And displaying the virtual reality reflecting the coordinates of the user's hand to the user.
12. The method of claim 11,
And transmitting the virtual reality reflecting the coordinates of the user's hand to an external display device.
12. The method of claim 11,
And generating a vibration generating signal based on the coordinates of the object in the virtual reality and the coordinates of the reflected hand of the user.
18. The method of claim 17,
The step of generating the vibration generating signal includes:
Calculating object coordinates in the virtual reality;
Determining whether the object coordinates and the coordinates of the reflected user's hand overlap within a predetermined range; And
Generating vibration based on the determination;
Wherein the virtual reality interface device is a virtual reality interface device.
12. The method of claim 11,
The step of acquiring the coordinates of the user's hand comprises:
And further obtaining finger movement information of the user using at least one sensor located at one side of the motion detector that obtains the coordinates of the user's hand.
A computer-readable recording medium having recorded thereon a program for causing a computer to execute the method according to any one of claims 11 to 19.

Images