KR20190067978A - Canoe simulator using Virtual Reality - Google Patents

Abstract

The present invention relates to a virtual reality-based canoe simulator (1). Accordingly, the virtual reality-based canoe simulator (1) comprises: a canoe hull (3); a sensor unit (8) disposed on the canoe hull (3) and configured to detect a motion of the canoe hull (3); a motion unit (7) configured to operate the canoe hull (3) in accordance with a motion of a user; a paddle (6) in which a motion of the paddle is transmitted to a control unit (9), and the motion is reflected to a motion of the canoe when the user holds the paddle and actually paddles; effectors (F, W) configured to realistically realize environmental factors such as wind, water, and vibration that can be felt in torrents; a goggle type virtual reality device (5); and the control unit (9) configured to control the motion unit (7), the sensor unit (8), the paddle (6), and the effectors (F, W). According to the present invention, a user is able to experience actual canoe rafting in a virtual reality.

Description

Canoe simulator using Virtual Reality

The present invention relates to a canoe simulator using a virtual reality, and more particularly, to a canoe simulator using a canoe, a motion platform, and a virtual reality device (VR device) so as to experience canoe rafting in a virtual reality, And can also perform a customized experience by reflecting the physical condition of each user, thereby enabling a more effective experience.

In general, a canoe is an elongated ship made without a key or a keel. These canoes were originally meant to be made of logs, but in recent years, canoes of various structures have been developed.

In particular, recently, rafting by canoeing in rapids has become widespread.

As the canoe rafting is popularized in this way, canoe rafting is presented in a variety of ways, for example, a canoe simulator.

That is, a canoe hull, various sensors, and a drive unit for rolling, pitching, and yawing a canoe are interlocked with each other.

When the user tilts the canoe in a certain direction while the user is seated on the canoe hull, the sensor detects this and activates the drive unit, so that the canoe hull is also tilted in the corresponding direction, Make it possible to experience.

However, since the conventional canoe simulator is a simple method in which a canoe is moved in accordance with a movement of a user as a method of experiencing by a simulator installed in an indoor space, it is difficult to expect a visual effect, so that a user can feel a feeling of riding a canoe There is a problem that there is a limit to feel.

(Document 1) Korean Patent Application No. 10-2014-28928 entitled "

SUMMARY OF THE INVENTION Accordingly, the present invention has been made in order to solve the above problems, and it is an object of the present invention to provide a video game system capable of actually experiencing canoe rafting in a virtual reality by linking a canoe, a motion platform, and a virtual reality And to provide a canoe simulator capable of enhancing sensory and visual effects.

In addition, it is possible to implement a customized experience by reflecting the physical condition of each user and realizing an environment similar to that of actually experiencing the canoe, thereby providing a canoe simulator capable of more effectively experiencing canoe rafting.

In order to realize the object of the present invention described above,

A canoe hull 3;

A sensor unit 8 disposed on the canoe hull 3 for sensing movement of the canoe hull 3;

A motion unit 7 for driving the canoe hull 3 in conjunction with the movement of the user;

A paddle 6 that is moved to the control unit 9 and reflected in the motion of the canoe when the user is gripped and actually wet;

An effector (F, W) which can realistically realize environmental factors such as wind, water and vibration, which can be felt in a rapids;

A goggle type virtual reality device 5 worn by a user; And

A canoe using a virtual reality apparatus including a motion unit 7, a sensor unit 8, a paddle 6, effectors F and W, and a control unit 9 for controlling the virtual reality apparatus 5 And provides the simulator 1.

The canoe simulator using this virtual reality has the advantage of enhancing the sensory and visual effects by realizing canoe rafting in virtual reality by linking the canoe, the motion platform, and the virtual reality device (VR device).

The present invention relates to a method for calculating a variation of a canoe hull by linearly computing a variation amount of a canoe hull through a first calculation module, calculating a posture data of paddles by a second calculation module, The third computation module interlocks with the load cell and the elongation measurement sensor and reflects the output values of the first and second computation modules to control the fluctuation amount of the canoe hull in a tertiary manner so that an environment similar to the actual rafting situation is implemented and experienced There are advantages to be able to.

1 is a view showing a canoe simulator using a virtual reality according to an embodiment of the present invention.
FIG. 2 is a schematic view showing the structure of the canoe simulator shown in FIG. 1. FIG.
3 is a schematic view showing a structure of a sensor unit, a paddle, and a control unit of the canoe simulator shown in FIG.
4 is a block diagram schematically showing the structure of the sensor unit shown in FIG.
5 is a perspective view showing the virtual reality apparatus shown in FIG.
6 is a block diagram illustrating the structure of the virtual reality apparatus shown in FIG.

Hereinafter, a canoe simulator using a virtual reality according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

As shown in FIGS. 1 to 6, the present invention relates to a canoe simulator 1 using a virtual reality, in which a canoe and a virtual reality machine 5 are interlocked with each other, .

Referring to FIG. 1, a canoe simulator 1 using a virtual reality apparatus comprises a canoe hull 3; A sensor unit 8 disposed on the canoe hull 3 for sensing movement of the canoe hull 3; A motion unit 7 for driving the canoe hull 3 in conjunction with the movement of the user; A paddle 6 that is moved to the control unit 9 and reflected in the motion of the canoe when the user is gripped and actually wet; An effector (F, W) which can realistically realize environmental factors such as wind, water and vibration, which can be felt in a rapids; A goggle type virtual reality apparatus 5 for reproducing an image of a rafting place; And a control unit 9 for controlling the motion unit 7, the sensor unit 8, the paddle 6, and the effectors F and W. [

In this canoe simulator 1,

The canoe hull 3 has the same shape as an actual canoe. Therefore, the user can feel the feeling of being able to ride the actual canoe by sitting on the canoe hull 3.

The sensor unit 8 has a purpose of sensing the movement of the canoe hull 3 and transmitting a signal to the control unit 9 and feeding back the signal through the motion unit 7. [

The sensor unit 8 includes a vibration sensor S1 for sensing the vibration of the canoe hull 3, a temperature sensor S2 and a humidity sensor S4, an anemometer S3, a gyro sensor And a sensor S5.

The vibration sensor S1 is a sensor for detecting the vibration of the canoe hull 3, and a sensor applicable to the vibration source and the frequency is determined. The vibration sensor S1 may be of various types, for example, a piezoelectric acceleration system and a cantilever vibration system.

The anemometer (S3) measures the velocity of the air blown from a fan (f) disposed around the canoe hull (3). At this time, the fan F is arranged around the canoe hull 3 in order to realize a real rafting atmosphere as described later, and the wind is sprayed. The anemometer S3 measures the wind speed And transmits a signal to the control unit 9 so that the control unit 9 can adjust the rotation speed of the fan F. [

The load cell S6 measures the weight of the user. The load cell S6 is attached to the inner bottom of the canoe so that the weight of the user is automatically measured when the user rides on the canoe hull 3. Then, the measured body weight is transmitted to the control unit 9.

The elongation measurement sensor S7 measures the user's key. The elongation measurement sensor S7 is disposed at a position adjacent to the canoe hull 3, and is an ultrasonic wave type or a laser type. The elongation measuring sensor S7 is disposed at an upper portion of the user's head and measures the elongation of the user by measuring the time of reflection by irradiating the top of the head with ultrasonic waves or a laser.

Therefore, when the user approaches the canoe hull 3, the user's height is automatically measured, and the measured elongation value can be transmitted to the control unit 9.

The gyro sensor is attached to the canoe hull 3 and senses the inclination of the X-axis and the Y-axis direction and the direction of the swing. The gyro sensor senses the tilt and swirling direction of the canoe hull 3 and transmits a signal to the control unit 9. [

Therefore, the control unit 9 can grasp the current canoe state in real time.

As described above, the signal sensed by the sensor unit 8 is transmitted to the control unit 9, and the control unit 9 calculates the kinematic and kinematic motion of the canoe, And drives them appropriately.

As shown in FIG. 3, the control unit 9 includes an input module M for receiving moving picture data received from the virtual reality unit 5 and data transmitted from the sensor unit 8; A first calculation module (M1) for primarily calculating X, Y and Z axis variations of the canoe hull (3) by moving picture data inputted through the input module (M); Y and Z of the canoe hull 3 reflecting movement of the paddle by grasping the position and speed of the paddle by the signal received from the gyro sensor S5 of the paddle and interlocking with the output value of the first calculation module M1 A second calculation module (M2) for secondarily calculating an axial variation amount; And an output module M4 for controlling the motion unit 7 based on the X, Y, and Z axis variation values calculated by the first and second calculation modules M2.

In this control section,

The moving picture data received from the virtual reality apparatus 5, that is, the moving picture data for the river rafted by the canoe, includes not only image data but also data on the direction, speed and intensity of the rapids.

Accordingly, the first calculation module M1 calculates the X, Y, and Z-axis movement amounts of the canoe hull 3 based on the torrent data included in the moving image data. The calculated result value is transmitted to the control unit 9 through the output module M4 and the control unit 9 reflects the result value of the second and third calculation modules M3 and transmits it to the motion unit 7 And the motion of the motion unit 7 enables the canoe hull 3 to move in accordance with the state of the rapids.

That is, the second calculation module M2 grasps the current position and speed of the paddle 6 by the signal received from the gyro sensor S5 of the paddle 6, and outputs the result to the first calculation module M1 To the X, Y, and Z axis movement amounts computed by the above-described method.

For example, when the user wets the paddle 6 to the left, the control unit 9 reflects this to change the direction of the canoe hull 3 to the left, The influence of the rapids is reflected in the movement of the actual canoe hull 3 by reducing the direction and speed of the conversion.

Of course, when the left rapids flow in the same direction as the traveling direction of the canoe hull 3, the switching direction and the speed of the canoe hull 3 are increased by reflecting this.

In this manner, the direction and inclination of the canoe hull 3 are controlled in accordance with the movement of the paddle 6, and the external environmental factors such as the rapids in the moving image are also reflected, .

The control unit 9 applies the weight and elongation value received from the load cell S6 and the elongation measurement sensor S7 to the output value of the second calculation module M2 so that the X of the canoe hull 3 reflecting the physical condition of the user , And a third computation module (M3) for computing the Y and Z axis variations in a tertiary manner.

The third calculation module M3 can roll, pitch, and yaw the canoe hull 3 by reflecting the physical condition of the canoe occupant.

In other words, since each occupant has different physical conditions, the angle and speed at which the canoe is tilted differ when the occupant is tilted to one side while boarding the canoe. By reflecting this data in the simulation, You can experience.

In order to differently apply each physical condition as described above, the data received from the load cell S6 and the elongation measurement sensor S7 can be calculated by the third calculation module M3 to calculate the tilting and rotation speed of the canoe .

For example, if the occupant tilts the body to the left by 15 degrees, the canoe tilts to the left, the weight of the canoe tilts when the lightweight, tall passenger tilts, and when the heavy and tall passenger tilts And the rotational speed also differ.

Also, when the paddle is wet when the canoe is tilted, there is a difference in the degree to which the canoe reacts when the weight is light and the tall passenger gets wet with the paddle and when the heavy weight and tall passenger gets wet do.

Therefore, in the present invention, the load cell S6 and the elongation measurement sensor S7 are interlocked with the third calculation module M3, and the control unit controls the motion unit by the signal of the third calculation module M3, And may operate to correspond to the physical condition of the actual occupant.

On the other hand, the motion unit 7 can perform rolling, pitching, and yawing of the canoe hull 3 by implementing three-axis motion in the X, Y, and Z axes.

Such a motion unit 7 comprises a base 11; The canoe hull 3 can be rolled, pitched and yawed by implementing the three-axis motion of the canoe hull 3 in the X, Y and Z axes by being projected upwardly on the base 11 and connected to the hull 3 of the canoe, (Not shown).

The cylinder 13 includes a pneumatic and hydraulic cylinder 13 and is connected to the control unit 9 to operate each other by a signal from the control unit 9. [

That is, when the one-side cylinder 13 advances upward along the Z-axis direction and the other cylinder 13 advances downward along the Z-axis direction, the canoe hull 3 is inclined accordingly.

As described above, the plurality of cylinders 13 are driven along different forward and backward trajectories, so that the canoe hull 3 can also be inclined or turned in various directions.

Therefore, the user can feel as if he or she actually rides a canoe while sitting on the canoe hull 3.

On the other hand, when the user holds the paddle 6 and gets wet, the movement of the paddle 6 can be transmitted to the control unit 9 and reflected in the motion of the canoe.

That is, the gyro sensor S5 is also mounted on the paddle 6, and the gyro sensor S5 is connected to the control unit 9 by a wireless system. Accordingly, when the user wets the paddle 6, a signal for this movement is transmitted to the controller 9, so that the controller 9 can grasp the position and movement of the paddle 6 in real time.

The controller 9 detects the position of the paddle 6 and reflects the position of the paddle 6 to the movement of the canoe hull 3. For example, when the paddle 6 is wetted to the left, To control the motion unit 7 so that the direction can be switched.

The control unit 9 drives the motion unit 7 to reflect the direction change and inclination of the canoe hull 3 in accordance with the position and direction of the paddle 6 so that the canoe hull 3 is made to correspond to the direction Tilt or turn direction, reflecting intensity and flow of rapids during this process.

That is, data on the intensity and flow of the torrent in the streaming video implemented in the virtual reality apparatus 5 is transmitted to the control unit 9, and the control unit 9 controls the operation of the motion unit 7 by reflecting this .

For example, when the user wets the paddle 6 to the left, and the control unit 9 reflects the motion of the motion unit 7 to turn the direction of the canoe hull 3 to the left by driving the motion unit 7, When flowing in the direction opposite to the direction of the hull 3, by reducing the direction and speed of switching, the influence of the rapids is reflected in the movement of the actual canoe hull 3.

Of course, when the left rapids flow in the same direction as the traveling direction of the canoe hull 3, the switching direction and the speed of the canoe hull 3 are increased by reflecting this.

In this manner, the direction and inclination of the canoe hull 3 are controlled in accordance with the movement of the paddle 6, and the external environmental factors such as the rapids in the moving image are also reflected, .

On the other hand, the effectors F and W can realistically realize environmental factors such as wind, water, and vibration that can be felt in the rapids. These effects F and W are constituted by a fan F for blowing wind and a water sprayer W capable of blowing water so that these components are interlocked with the control unit 9. [

Accordingly, the controller 9 causes the water sprayer W to operate by actuating the water injector W to actually implement the stream condition implemented in the moving image, for example, the intensity of the torrent, and by driving the fan F, can do.

At this time, the control unit 9 can reproduce water spray and wind in a similar environment by driving the water injector W and the fan by referring to the torrent data and the attitude data of the canoe hull.

As described above, the effectors F and W can experience a realistic experience by realizing the actual environment in the case of canoe rafting.

Meanwhile, the virtual reality apparatus 5 reproduces real river rafting course as a 3D virtual space, and recreates actual real space using a high-quality texture and high polygon mesh.

The virtual reality machine 5 will be described in more detail. The virtual reality machine 5 includes a frame 60 that can be worn on the head in the form of an eyeglass; An image processing unit 62 mounted on the inner side of the frame and processing image or motion image data of a stream; A display unit 64 for displaying the processed image data; A 3D image processing unit 66 for displaying the image on a screen as a three-dimensional moving image in a panoramic format; And an interface unit 68 for displaying information such as characters on the screen and selecting a river.

When the user selects the specific rafting place, the virtual reality apparatus 5 can experience the corresponding place by displaying the actual image of the corresponding rafting place.

At this time, each configuration can be provided with an image for the tourist spot by interlocking with an operation program installed in the virtual reality machine (5) server.

In this case, technologies of FlashPix, IIP, Photo Vista, Object Modeler, and Reality Studio are used to provide 3D images, ShapeSnatcher technology for 3D virtual space production is used, Cult3D technology is used for virtual space construction.

In addition, visual quality can be improved through object modeling optimization, and texturing can be optimized using bump and normal map. We optimized the performance by developing and applying the optimized LOD algorithm and applied the dynamic object application technique of OOD (Object on Demand) method.

And 360-degree 360-degree video images can be obtained 360 degrees or 360 degrees by using gear 360 or high-profile multi-point camera.

Also, by connecting images acquired through multiple cameras to a single image, a wide view of the image is provided to provide increased sense of presence and immersion, and the degree of freedom of the user point of view is increased.

In order to generate an image, a 360-degree background is divided into several angles, and the photographs of the front and back sides are photographed while overlapping each other by about 3 minutes. The stitch algorithm is applied to each of the images, A panoramic image can be generated.

The user selects the desired stream through the user interface unit 68 while wearing the virtual reality apparatus 5 and the virtual reality unit 5 of the server transmits the data of the selected stream to the virtual reality apparatus 5).

The virtual reality device 5 implements the received stream data on the display so that the user experiences a rafting experience with the stream.

Hereinafter, the operation of the canoe simulator according to an embodiment of the present invention will be described in more detail.

In the case of canoe rafting, the passenger is first boarded on the canoe hull 3. At this time, the weight and height of the passenger are automatically measured by the load cell S6 and the elongation measurement sensor S7 and transmitted to the control unit 9.

After boarding, the target stream is selected through the user interface unit 68 while the virtual reality apparatus 5 is worn.

The virtual reality apparatus 5 implements the moving image data on the display on the display.

The passenger grips the paddle 6 to follow the flow of the implemented stream, and is properly wetted in the X, Y, and Z-axis directions. In addition, the passenger rafts along the rapids by tilting the canoe appropriately.

At this time, the controller 9 drives the motion unit 7 in accordance with the torrent data about the direction, speed, and intensity of the torrent included in the displayed moving picture data received through the input module, And then primarily diverts or tilts.

When a passenger gets wet or tilts the paddle 6, a position signal is outputted from the gyro sensor S5 of the paddle 6 and the gyro sensor S5 attached to the canoe hull 3 to the control unit 9 . The control unit 9 calculates the position signal and the torrent data by the second calculation module M2 and controls the canoe hull 3 through the motion unit 7 so that the canoe hull 3 ) Is secondarily corrected.

For example, when the user wets the paddle 6 to the left, the control unit 9 reflects this to change the direction of the canoe hull 3 to the left, The influence of the rapids is reflected in the movement of the actual canoe hull 3 by reducing the direction and speed of the conversion.

Of course, when the left rapids flow in the same direction as the traveling direction of the canoe hull 3, the switching direction and the speed of the canoe hull 3 are increased by reflecting this.

Therefore, when the canoe hull 3 is turned and tilted according to the rapids and the passenger is wetted or tilted by the paddle 6, the direction of the canoe hull 3 and the inclination of the canoe hull 3 are tilted secondarily The posture of the canoe hull 3 can be adjusted.

After correcting the directional change and inclination of the canoe hull 3 in the primary and secondary directions as described above, the control unit 9 controls the weight and height of the occupant received from the load cell S6 and the elongation measurement sensor S7, And controls the canoe hull 3 in a tertiary manner.

That is, in order to apply differently according to the physical condition of each occupant, the third calculation module M3 calculates data received from the load cell S6 and the elongation measurement sensor S7 to calculate the tilting and rotation speed of the canoe can do.

For example, if the occupant tilts the body to the left by 15 degrees, the canoe tilts to the left, the weight of the canoe tilts when the lightweight, tall passenger tilts, and when the heavy and tall passenger tilts And the rotational speed also differ.

In addition, when the canoe is tilted and the paddle 6 is wetted, a lightweight, small tall passenger wets the paddle 6, and when the heavy weight and heavy passenger wets the paddle 6, There is a difference in the degree of the reaction.

Therefore, in the present invention, the load cell S6 and the elongation measurement sensor S7 are interlocked with the third calculation module M3, and the control unit 9 controls the motion unit 7 ), The canoe can operate to correspond to the physical condition of the actual occupant.

In this manner, the control unit 9 adjusts the posture of the canoe hull 3 over the first to third heights so that the rider can experience rafting in an environment similar to an actual situation.

On the other hand, the present invention can realistically realize environmental factors such as wind, water, and vibration that can be felt in rapids during the rafting experience simulation.

That is, the control unit 9 causes the water sprayer W to operate by actually operating the water injector W to actually implement the stream condition implemented in the moving image, for example, the intensity of the torrent, and by driving the fan F, can do.

Claims (7)

A canoe hull 3;
A sensor unit 8 disposed on the canoe hull 3 for sensing movement of the canoe hull 3;
A motion unit 7 for driving the canoe hull 3 in conjunction with the movement of the user;
A paddle 6 that is moved to the control unit 9 and reflected in the motion of the canoe when the user is gripped and actually wet;
An effector (F, W) capable of realizing environmental factors of wind, water and vibration which can be felt in a torrent;
A goggle type virtual reality apparatus 5 for reproducing an image of a rafting place; And
A canoe using a virtual reality apparatus including a motion unit 7, a sensor unit 8, a paddle 6, effectors F and W, and a control unit 9 for controlling the virtual reality apparatus 5 Simulator (1). The method according to claim 1,
The sensor unit 8 includes a vibration sensor S1 for sensing vibration of the canoe hull 3, a temperature and humidity sensor S4, an anemometer S3, a gyro sensor S5 for measuring the direction and tilt, A load cell S6 for measuring the weight, and an extension measuring sensor S7 for measuring the key. 3. The method of claim 2,
The control unit 9 includes an input module M for inputting moving picture data received from the virtual reality unit 5 and data transmitted from the sensor unit 8; A first calculation module (M1) for primarily calculating X, Y and Z axis variations of the canoe hull (3) by moving picture data inputted through the input module (M); Y and Z of the canoe hull 3 reflecting movement of the paddle by grasping the position and speed of the paddle by the signal received from the gyro sensor S5 of the paddle and interlocking with the output value of the first calculation module M1 And a second calculation module (M2) for secondarily calculating an axial variation amount. The motion unit (7) is controlled by the X, Y, and Z axis variation values calculated by the first and second calculation modules Canoe simulator using virtual reality device (1). The method of claim 3,
The control unit applies the weight and elongation values received from the load cell S6 and the elongation measurement sensor S7 to the output value of the second calculation module M2 so that the X, Y, and Z axes of the canoe hull 3, And a third calculation module (M3) for calculating the variation amount in a tertiary manner. 5. The method of claim 4,
The motion unit 7 includes a base and an upper portion protruding on the base to be connected to the hull 3 of the canoe to perform forward and contraction motions so that the canoe hull 3 can realize the three axis motions of the X, , A plurality of cylinders (13) capable of pitching and yawing. The method of claim 3,
A gyro sensor is mounted on the paddle 6 and the gyro sensor S5 is connected to the control unit 9 by a wireless system so that when the user wets the paddle 6, The control unit 9 can recognize the position and movement of the paddle 6 in real time. The method of claim 3,
The effectors F and W include a fan F for blowing wind and a water sprayer W capable of blowing water so that the water sprayer W is operated by the control unit 9 to blow the water spray And a fan (F), so that the wind can be blown.

Images