KR101936617B1 - Detachable movement detection device and virtual reality contents operating system using the device - Google Patents

Abstract

The present invention relates to a detachable movement detection device and a virtual reality content operation system using the same. According to the present invention, by using a movement detection device detachably mounted on a user's foot or shoe, a dedicated scaffold or exclusive shoe is not needed, High, and motion precision is high because it measures the movement of the user through the optical sensor.

Description

TECHNICAL FIELD [0001] The present invention relates to a detachable movement detection device and a virtual reality content operation system using the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a removable movement detection device and a virtual reality content management system using the same. More particularly, the present invention relates to a technology for detecting and simulating movement of a user using an optical sensor.

With the rapid development of IT technology, contents of 3D reality (Virtual Reality, VR) that combines video technology and various sensor technologies are being released. In other words, in addition to the operation using a keyboard, a mouse, a joystick, and the like as a conventional PC game or an arcade game, a wider range of motion is reflected in the game by using a wearable device or a footrest provided with a sensor.

Through this, the user can enjoy a variety of contents such as sports, battle, and the like through the virtual reality realized by the 3D stereoscopic screen through the headset or the like.

In such 3D virtual reality contents, it is also necessary to reflect the user's walking or not. That is, in the existing PC game, if the game is reflected in the game through the keyboard or mouse input, the 3D virtual reality game allows the user to reflect the actual walking.

In order to reflect the user's actual walking on the VR contents, a special design should be made on shoes or footsteps, and several related technologies have been disclosed.

In Korean Patent Laid-Open No. 10-2016-0135314 ('How to generate an input in a front-facing locomotion system'), a sensor is installed on a platform, A sensor provided on the platform senses the movement of the user and detects the movement of the user. However, it is difficult to commercialize a large number of sensor devices in a wide area of the platform because of the increase in the unit price.

Further, a technique of detecting movement (walking) using a dedicated shoe with a roller is also disclosed. However, in the case of the exclusive shoe having the rollers, there is a risk of malfunction due to contamination of the rollers, and there is a problem in that it is necessary to prepare exclusive shoes of various sizes when installing in a store used by many people.

In addition, since the conventional motion detection techniques use a capacitance sensor, a pressure sensor, or a roller provided in a dedicated shoe, which are provided on a platform, a difference may occur in response time when motion is reflected on the game , And the motion accuracy is not high.

Disclosure of Invention Technical Problem [8] The present invention has been made in order to solve the problems of the conventional art as described above, and it is an object of the present invention to provide a motion detection device, And to provide a technique for enabling the user to detect the movement (walking) of the user.

It is another object of the present invention to provide a technology for allowing a motion of a user to be reflected on a content more smoothly by allowing a motion sensor to be detected with high accuracy using an optical sensor.

In order to accomplish the above object, a detachable movement detection device according to the present invention includes a front body and a rear body mounted on front and rear sides of a user's foot or shoe, respectively, for receiving light emitted to the ground and calculating and transmitting coordinate motion information Wherein the front body and the rear body respectively include LEDs for illuminating light on the ground; An optical sensor for receiving the light reflected from the surface illuminated by the LED; A DSP for analyzing light received through the optical sensor and calculating coordinate motion information; And a transmission module for wirelessly transmitting the coordinate motion information calculated by the DSP.

The front body and the rear body may be connected and fixed to prevent the front body and the rear body from being separated from the user's foot or shoe.

According to another aspect of the present invention, there is provided a virtual reality content management system comprising: a movement sensing device mounted on a foot or a shoe of a user for receiving light radiated on the ground to calculate and transmit coordinate movement information; And a content operation unit that receives the coordinate movement information from the movement detection device, generates avatar movement information corresponding to the coordinate movement information, and reflects the avatar movement in the content.

Here, the movement detection device may be the movement detection device described above.

In addition, the content operation unit may include: a communication processing unit for receiving coordinate movement information from the movement detection device; A coordinate processing unit for generating avatar motion information corresponding to the coordinate movement information received by the communication processing unit; And a simulation processing unit for simulating the avatar movement on the content according to the avatar motion information generated by the coordinate processing unit.

As described above in detail, in the virtual reality content management system according to the present invention, there is an advantage that a dedicated footrest or exclusive shoe is not needed by using a movement sensing device that is detachably mounted on a user's foot or shoe. In other words, conventionally, in order to detect movement such as walking of a user, a large number of sensors must be provided in a wide area of the platform itself. Therefore, the unit price of the scaffold was inevitably increased. Also, in the case of using the exclusive shoe provided with the rollers, since it is necessary to prepare various shoes for various users having different foot sizes, it is difficult to use the shoe in the store etc. and since the roller may contain foreign substances, There was a problem to give.

However, according to the present invention, since the front body and the rear body of the movement sensing device having the optical sensor are respectively fitted to the front or back of the user's foot or the shoes already worn, and then fixed through the connecting portion, It is highly competitive in price. In addition, there is no fear of malfunction due to foreign matter.

In the present invention, since the optical sensor for detecting the movement of the coordinates is used several hundred times per second, motion accuracy is high and the time for reflecting the movement of the user in the movement of the avatar in the content is very short. That is, there is a limit to the number of sensors that can be installed on a wide area of a platform. In addition, if the user moves only a part of the foot plate when walking, the number of sampling for the user's movements is more limited. Therefore, the precision for expressing the motion is low depending on the limited sampling number. However, if an optical sensor having several hundred sampling times per second is used as in the present invention, the motion accuracy will naturally increase.

In addition, if optical sensors are provided in front of and behind each of the movement detecting devices, measurement errors occurring in any one optical sensor can be compensated by another optical sensor.

1 is a view for explaining a virtual reality content management system according to an embodiment of the present invention;
FIG. 2 is a view for explaining a movement sensing device mounted on a user's shoe in the virtual reality content management system shown in FIG. 1; FIG.
3 is a block diagram for explaining the configuration of the motion detection device shown in Fig.
4 is a diagram for explaining a coordinate change recognized by a movement detection device when the user moves forward;
FIG. 5 is a diagram for explaining a coordinate change recognized by a movement sensing device when a user changes direction and makes a walk. FIG.
6 is a diagram for explaining a coordinate change recognized by the movement detection device when the user switches the direction in place;

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. However, some configurations which are not related to the gist of the present invention may be omitted or compressed, but the configurations omitted are not necessarily those not necessary in the present invention, and they may be combined by a person having ordinary skill in the art to which the present invention belongs. .

In addition, each component, server, and system described below does not necessarily have to be an independent component or server that performs each function, but may be implemented as one or more programs or one or more servers or a collection of one or more systems, May be shared.

FIG. 1 is a view for explaining a virtual reality content management system according to an embodiment of the present invention. FIG. 2 is a view for explaining a movement sensing device mounted on a user's shoe in the virtual reality content management system shown in FIG. And FIG. 3 is a block diagram for explaining the configuration of the movement sensing device shown in FIG.

Prior to the description, the 3D virtual reality contents can be various forms such as an avatar that replaces a user in a virtual space, enjoys sports, carries a weapon, and enjoys a battle game. It can also be a form of exploring a virtual space with a first person view without an avatar. Hereinafter, an example in which an avatar replacing a user among various virtual reality contents plays a battle game while carrying a weapon is explained.

1 to 3, a virtual reality content management system according to an embodiment of the present invention includes a headset 10, a content operation unit 20, a footstep 30, a user support means 40, 50 and a movement sensing device 60. [

The headset 10 may be made in the form of glasses, goggles or helmets that can be worn on the user's head, and is provided to output images and sound to the user. The headset 10 may further include a gyro sensor or an acceleration sensor to detect head movement of the user. The headset 10 can transmit and receive a signal to and from the content operation unit 20 through a wireless communication method such as Bluetooth or the like and can transmit and receive signals to and from the content operation unit 20 through a cable connection.

The content operation unit 20 is a device capable of driving virtual reality contents, that is, a program such as a game, and refers to a normal desktop computer, a notebook computer, a video game machine, or the like. Of course, the content operation unit 20 may be a mobile device such as a smart phone or a tablet PC, and the function of the content operation unit 20 may be installed in the headset 10 if necessary. In other words, the content operation unit 20 includes various hardware and software components necessary for driving the game program. However, in the present embodiment, a change in the coordinate information recognized through the movement detection device 60 may be reflected on the content Are visualized through Fig.

The content operation unit 20 includes a communication processing unit 21, a coordinate processing unit 22, and a simulation processing unit 23.

The communication processing unit 21 is provided for connecting a communication channel with the headset 10, the operating device 50, and the movement detecting device 60 and transmitting and receiving information.

The coordinate processing unit 22 processes avatar (character) motion information in the game by processing the coordinate movement (coordinate change) of the movement sensing device 60 received through the communication processing unit 21. [ Of course, it may not be a game using an avatar. In this case, movement information according to a user's foot motion is generated. In addition, the coordinate processing unit 22 may generate screen motion information, inorganic motion information, and the like based on the sensor information mounted on the headset 10 or the operation device 50. Although not shown in the drawing, when a separate wearable device is mounted on the user's body and a signal detected by the wearable device is received by the communication processing unit 21, the coordinate processing unit 22 performs a sitting, As shown in FIG.

The simulation processing unit 23 calculates various kinds of motion information (movement information) generated by the coordinate processing unit 22 to simulate the movement of the avatar in the game in the 3D game environment, the movement of the screen, or the operation of the weapon.

The footstep 30 refers to a platform on which a user can perform a game. The footrest 30 may be made of any material as long as it is not made of a glass or mirror material through which light is transmitted or diffused. However, it is preferable to be made of a slippery material with low friction so that the user can slide well when walking. Of course, in the present invention, no sensor is provided on the foot plate 30. [ Therefore, even if there is no footrest 30, the user can be positioned on the smooth ground rather than the glass or the mirror to enjoy the game. However, it is shown that a foot plate 30 is installed to obtain more accurate motion information.

The user support means 40 is made in the form of wrapping around the user's approximate waist position and secured to a frame extending from the footrest 30. [ The user support means 40 is provided to prevent the user from falling over during the game or to prevent the user from leaving the area outside the footstep 30. [ That is, if the user wears the headset 10, only the image output from the headset 10 is displayed, but the actual surroundings are not visible. Thus, the user may lose balance and fall, which prevents the user support means 40 from supporting the user ' s waist. When the user performs walking, the user can escape to the outside of the footrest 30. When the waist portion of the user is restrained within the user support means 40, the user does not move out of the footrest 30 and the foot is slid on the footrest 30 I will walk in the foot. In other words, it takes action similar to walking on a trade mil. The user support means 40 may be provided with a separate door so that the user may enter the user support means 40.

The operation device 50 is a device for inputting various user commands required for a game. For example, the operation device 50 may be a classical input device such as a keyboard, a joystick, or the like, or may be manufactured in the form of a sports tool such as a weapon such as a gun or a racquet. The operation device 50 may be provided with a user command input unit such as a lever or a button and further includes a gyro sensor or an acceleration sensor so that the motion information of the operation device 50 can be transmitted to the content operation unit 20 have. In this embodiment, a device of the total type is shown as an example of the operating device 50. [

The movement detection device 60 is detachably mounted on the user's foot or shoe so as to acquire motion information (movement information) when the user is walking, and transmit the acquired motion information to the content operation unit 20. [ The movement sensing device 60 includes a front main body 61, a rear main body 62, and a connection portion 63.

The front main body 61 is fitted to the front portion of the user's foot or shoe and the rear main body 62 is fixed to the rear portion of the user's foot or shoe. The connecting portion 63 is a part for tightening after connecting the front body 61 and the rear body 62 and is provided to prevent the movement detecting device 60 after being worn from detaching from the user's foot or shoe. The connecting portion 63 may be made of various types of connectable members such as elastic bands and clips or a Velcro type.

The front main body 61 includes a first LED 61a, a first optical sensor 61b, a first DSP 61c and a first transmission module 61d. The rear main body 62 includes a second LED 62a, 2 optical sensor 62b, a second DSP 62c, and a second transmission module 62d. The LEDs 61a and 62a, the optical sensors 61b and 62b, the DSPs 61c and 62c and the transmission modules 61d and 62d having the same component names in the front main body 61 and the rear main body 62 have the same function operation Only the configuration of the front main body 61 will be described.

The first LED 61a is provided for irradiating light of a specific wavelength to the ground, that is, the foot plate 30. [ For example, the first LED 61a can emit red light having a wavelength of 610 to 700 nm, which has a shorter wavelength and a shorter reflection speed and less distortion.

The first optical sensor 61b is configured to receive the light reflected from the pedestal 30 by being irradiated from the first LED 61a and the first DSP 61c is connected to the first optical sensor 61b And calculates the coordinate movement of the front body 61 by analyzing the light. The first DSP 61c can detect very precise movement because it calculates the movement of the coordinates several hundred times per second. The coordinate change information calculated by the first DSP 61c is transmitted to the content operation unit 20 via the first transmission module 61d in a short distance wireless communication scheme such as Bluetooth.

If the headset 10, the operation device 50 and the movement sensing device 60 are interlocked with the content operation unit 20 in a wireless communication manner without a separate cable, a battery for power supply is mounted on each device .

Hereinafter, a process in which a user's movement (gait) is reflected on the game in the virtual reality content management system according to the embodiment of the present invention described above with reference to FIGS. 4 to 6 will be described.

4 is a diagram for explaining a coordinate change recognized by the movement sensing device 60 when the user wearing the foot sensing device 60 on the foot or shoe is advanced on the foot platform 30. FIG.

The movement detection device 60 is worn on the left and right sides of the user's feet, respectively. The front body 61 and the rear body 62 are mounted on the left foot and the front body 61 and the rear body 62 are mounted on the right foot. At this time, optical sensors 61b and 62b are provided on the left and right movement sensing devices 60, respectively, and optical sensors 61b and 62b are provided on the right and left movement sensing devices 60, respectively, . That is, a total of four optical sensors are provided for one user. When the user moves forward or backward while walking, motion can be grasped even if only one optical sensor operates on each foot. Hereinafter, the movement of coordinates measured through the optical sensor on the left front of the movement sensing device 60 worn on the user's foot is referred to as 60 LF, and the movement of the coordinates measured through the optical sensor on the right front is referred to as 60RF I will explain it after considering it.

If the user makes a walk from the left foot, he lifts the foot on the back and pushes it forward, then pushes the foot behind the left foot and pushes it forward again. If you are walking on a regular ground, your left foot and your right foot will go ahead and back in succession. However, if the user is constrained within the user support means 40, the substantially waist portion of the user will not advance by the user support means 40. Therefore, when the left foot is pulled forward and pulled, the movement sensing device 60 mounted on the left foot slides on the foot plate 30 as it is, and comes back to the rear. The same is true of the right foot.

Therefore, if the user starts to walk from the left foot while being restrained within the user support means 40, the movement of the left front coordinate (60LF) and the movement of the right front coordinate ( 60RF will be measured at the optical sensors 61b, 62b and then calculated at the DSPs 61c, 62c.

The movement of such coordinates is repeatedly measured several hundred times per second, and information on the coordinate change is transmitted to the content operation unit 20 through the transmission modules 61d and 62d.

Accordingly, upon reception of the coordinate movement information (coordinate change information) in the communication processing unit 21 of the content operation unit 20, the coordinate processing unit 22 processes the coordinate movement information to generate the avatar movement information in the game, The controller 23 controls the avatar movement in the game according to the avatar movement information generated by the coordinate processing unit 22. [

The coordinate processing unit 22 calculates the movement distance of the left and right coordinates (that is, the length of 60LF or 60RF, which is proportional to the stride), the number of movements, and the number of movements of the left and right coordinates in correspondence with the coordinate change information sent from the movement sensing device 60, The speed is calculated together with the previously stored reference information to generate precise avatar motion information.

The coordinate processing unit 22 also generates avatar motion information by totally computing the coordinate change information sent from the front body 61 and the rear body 62 of the movement sensing device 60. That is, the characteristics of coordinate changes measured by the front main body 61 and the rear main body 62 are almost the same when the robot is a simple forward walking. However, a change in the coordinate either forward or backward may not be properly measured due to the walking habits of each user or the subtle errors of the specific photosensors 61b and 62b. Therefore, considering both of the coordinate changes measured in the front body 61 and the rear body 62, any one measurement error can be compensated.

5 is a diagram for explaining a coordinate change recognized by the movement sensing device 60 when the user changes the walking direction.

That is, if the user starts to walk from the left foot as shown in (1) of FIG. 5 but wants to change the direction to 1 o'clock, the starting point of the next right foot pedestrian ② will fall further from the starting point of ①, The starting point will be close to the starting point of ②.

That is, the coordinate processing unit 22 of the content operation unit 20 receives the information about the coordinate change as shown in FIG. 5 from the movement sensing device 60, And the motion processing unit 23 reflects the motion information on the game.

6 is a diagram for explaining a coordinate change recognized by the movement detection device 60 when the user changes direction in the stop state. That is, the coordinate change measured by the movement sensing device 60 in the 'left turn' operation.

If the user performs the left-handed operation in the stopped state, the heel is supported largely on the ground, so that the toe does not change greatly and the forearm relatively changes greatly. That is, as shown in FIG. 6, the movement of the left front coordinate 60LF and the right front coordinate 60RF draws a large arc counterclockwise, and the movement of the left rear coordinate 60LL and the right rear coordinate 60RL Draw a small arc in a counterclockwise direction.

The coordinate processing unit 22 detects all the coordinate movements 60LF, 60LL, 60RF, and 60RL when the movement detecting device 60 detects the coordinates movements 60LF, 60LL, 60RF, 60RL, and then generates the avatar motion information. Accordingly, the simulation processing unit 23 reflects the leftward movement of the avatar in the game.

As described above in detail, in the virtual reality content management system according to the present invention, there is an advantage that a dedicated footrest or a dedicated footwear is not needed by using the movement sensing device 60 detachably mounted on the user's foot or shoe. In other words, conventionally, in order to detect movement such as walking of a user, a large number of sensors must be provided in a wide area of the platform itself. Therefore, the unit price of the scaffold was inevitably increased. Also, in the case of using the exclusive shoe provided with the rollers, since it is necessary to prepare various shoes for various users having different foot sizes, it is difficult to use the shoe in the store etc. and since the roller may contain foreign substances, There was a problem to give.

However, in the present invention, the front body 61 and the rear body 62 of the movement sensing device 60 having the optical sensors 61b and 62b are respectively fitted to the front or rear of the user's foot or the shoes already worn, 63, it is not necessary to use the exclusive footrest 30 or the exclusive shoes, so that the price competitiveness is high. In addition, there is no fear of malfunction due to foreign matter.

In the present invention, since the optical sensor for detecting the movement of the coordinates is used several hundred times per second, motion accuracy is high and the time for reflecting the movement of the user in the movement of the avatar in the content is very short. That is, there is a limit to the number of sensors that can be installed on a wide area of a platform. In addition, if the user moves only a part of the foot plate when walking, the number of sampling for the user's movements is more limited. Therefore, the precision for expressing the motion is low depending on the limited sampling number. However, if the optical sensors 61b and 62b, which are sampled hundreds of times per second as in the present invention, are used, the motion accuracy is naturally increased .

In addition, if optical sensors 61b and 62b are provided in front of and behind the movement sensing device 60, measurement errors occurring in any one optical sensor can be compensated by another optical sensor.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, And additions should be considered as falling within the scope of the claims of the present invention.

10: Headset
20: Content Operation Department
21:
22: Coordinate processor
23: Simulation processor
30: Scaffolding
40: user support means
50: Operation device
60: Movement detection device
61: front body
61a: the first LED
61b: a first optical sensor
61c: the first DSP
61d: first transmission module
62:
62a: the second LED
62b: second optical sensor
62c: My 2DSP
62d: second transmission module
63: Connection
60LF: left front coordinate movement
60LL: left rear coordinate movement
60RF: Right front coordinate movement
60RL: Right rear coordinate movement

Claims (5)

And a front body and a rear body mounted on front and rear sides of the user's foot or shoe, respectively, for receiving light emitted from the ground and calculating coordinate motion information,
The front body and the rear body respectively include:
LEDs for illuminating the ground;
An optical sensor for receiving the light reflected from the surface illuminated by the LED;
A DSP for analyzing light received through the optical sensor and calculating coordinate motion information; And
And a transmission module for wirelessly transmitting the coordinate motion information calculated by the DSP,
The front body is fitted to the front of the user's foot or shoe, the rear body is fitted to the back of the user's foot or shoe,
And a connecting part for preventing the front body and the rear body from being separated from the foot or the shoe of the user by connecting and fixing the front body and the rear body with the elastic band by a clip or a Velcro system, device.
delete A movement detecting device mounted on a foot or a shoe of a user and receiving light irradiated to the ground to calculate and transmit coordinate movement information; And
And a content operation unit that receives the coordinate movement information from the movement detection device and generates avatar movement information corresponding to the coordinate movement information and reflects the avatar movement in the content,
Wherein the movement detection device is the movement detection device of claim 1.
delete The method of claim 3,
The content-
A communication processing unit for receiving coordinate movement information from the movement sensing device;
A coordinate processing unit for generating avatar motion information corresponding to the coordinate movement information received by the communication processing unit; And
And a simulation processing unit for simulating the avatar movement on the content according to the avatar motion information generated by the coordinate processing unit.

Images