KR102569659B1 - Systeme for providing virtual experience for survival swimming based on extended reality - Google Patents

Abstract

The present invention relates to an augmented reality-based survival swimming virtual experience system, and the problem to be solved is a device capable of physically environmental simulation of survival swimming while providing audio-visual education through virtual reality images for survival swimming education. By providing the same effect as actually experiencing survival swimming, it is to increase effectiveness while safely educating survival swimming.
For example, a survival swimming program management unit providing a virtual reality image equipped with a scenario for a virtual experience of survival swimming for each situation and a drive control signal according to the virtual reality image; a virtual reality image display unit that reproduces and displays the virtual reality image; a motion sensor unit generating motion data according to a user's movement; A boarding unit for holding a user so that a basic swimming posture is maintained during virtual floating in water; and a driving unit for driving the boarding unit to change its position, inclination, and direction. and a driving control unit configured to drive the boarding unit so that the position, inclination, and direction of the boarding unit are forcibly changed in the basic swimming posture according to the driving control signal, and control driving such that the position, inclination, and direction of the boarding unit are adjusted according to the motion data. Disclosed is an extended reality-based survival swimming virtual experience system that includes.

Description

Survival swimming virtual experience system based on extended reality {SYSTEME FOR PROVIDING VIRTUAL EXPERIENCE FOR SURVIVAL SWIMMING BASED ON EXTENDED REALITY}

An embodiment of the present invention relates to a survival swimming virtual experience system based on augmented reality.

Survival swimming is not a swimming education centered on traditional strokes, but a method to develop practical swimming skills that enable effective response in emergency situations. It refers to training essential and basic methods for survival.

In relation to such survival swimming education, there has been development of educational tools that produced VR contents in the past. These survival swimming VRs can be used as necessary content for non-face-to-face education due to COVID-19 by developing virtual reality such as metaverse that can reproduce situations in which survival swimming is necessary, realizing substantial experience-oriented education and training instructors It can be regarded as an educational tool that can enhance initiative.

However, in the conventional survival swimming VR training method, after experiencing an indirect experience of survival swimming with virtual reality video contents in a space where the experiencer cannot directly experience survival swimming, an instructor in an actual swimming pool based on indirect education separately from this It is operated in the form of survival swimming lessons under the guidance of

Accordingly, the conventional survival swimming VR education has a disadvantage in that the educational contents learned through virtual reality are not effectively reflected during education or training in the actual field, and thus the effectiveness of survival swimming is reduced.

Patent Publication No. 10-2020-0020337 (published date: February 26, 2020) Registered Patent Publication No. 10-1859745 (registration date: May 14, 2018)

An embodiment of the present invention provides an audio-visual education through virtual reality images for survival swimming education and at the same time provides a device capable of physically and environmentally simulating survival swimming, thereby providing the same effect as actually experiencing survival swimming. Provides an extended reality-based survival swimming virtual experience system that can increase effectiveness while safely teaching survival swimming.

In the augmented reality-based survival swimming virtual experience system according to an embodiment of the present invention, a survival swimming program manager that provides virtual reality images equipped with scenarios for virtual survival swimming experiences for each situation and a drive control signal according to the virtual reality images. ; a virtual reality image display unit that reproduces and displays the virtual reality image; a motion sensor unit generating motion data according to a user's movement; A boarding unit for holding a user so that a basic swimming posture is maintained during virtual floating in water; and a driving unit for driving the boarding unit to change its position, inclination, and direction. and a driving control unit configured to drive the boarding unit so that the position, inclination, and direction of the boarding unit are forcibly changed in the basic swimming posture according to the driving control signal, and control driving such that the position, inclination, and direction of the boarding unit are adjusted according to the motion data. includes

In addition, the survival swimming program manager includes a virtual reality intro video having a story for each situation, a survival swimming method training video, a virtual reality game video linked with the driving control signal and the motion data, and a virtual reality ending having a story for each situation. The virtual reality images are provided in order of images, and when the virtual reality game images are played, a game is played to perform a preset mission, and whether or not the user passes the game mission is determined according to the motion data, and when the game mission is passed, the game is played. A virtual reality ending video may be provided.

In addition, the virtual reality image display unit may include at least one of a head mount display (HMD) for reproducing and displaying the virtual reality image and a surround display installed to surround the boarding unit.

In addition, the motion sensor unit, each gripped by the user's hand, a controller for generating a user control signal for interaction with the virtual object appearing in the virtual reality image; a motion tracker that detects a position of at least one body part among the user's head, chest, wrist, waist, and ankle and generates motion data for each part of the user's body; And it may include a tracker wearable band coupled to each of the motion tracker and for wearing the motion tracker on each body part of the user.

In addition, the boarding unit may include a boarding seat for boarding a user in a prone state; a seat belt for fixing the user so that the user does not escape from the boarding seat; and at least one of an elastic material and a foldable elastic structure that is connected to the lower portion of the boarding seat, covers the driving unit located inside, extends and contracts in the vertical direction according to the driving of the driving unit, and enables torsional deformation in the left and right directions. It may include a support cover made in the manner of.

In addition, the drive unit includes a first servomotor and a second servomotor installed under the boarding seat and disposed in a line on left and right sides of the boarding seat, and driving the first servomotor and the second servomotor. a first actuator for adjusting the inclination of the boarding seat in the left and right directions through; a link interface including a support plate on which the first actuator is installed, and a first joint link and a second joint link installed on the lower portion of the support plate and arranged in a line with respect to the front and rear of the boarding seat; and a first servomotor cylinder connected to the first joint link and installed in a vertical direction with respect to the boarding seat to adjust the height of the boarding seat, and connected to the second joint link and installed in a vertical direction with respect to the boarding seat. and a second servomotor cylinder for adjusting the height of the boarding seat, and adjusting the inclination of the boarding seat in the front and rear directions by driving the first servomotor cylinder and the second servomotor cylinder. A second actuator may be included.

In addition, the link interface may further include a link rail connected between the lower surface of the support plate and the second joint link and disposed in the longitudinal direction of the support plate to slide the second joint link in the forward and backward directions. can

In addition, the drive control unit drives the first servomotor cylinder and the second servomotor cylinder such that the inclination of the front and rearward direction is changed after the boarding seat is moved up and down according to the drive control signal before receiving the motion data. are respectively controlled, but when the motion data is received, driving of the first servomotor and the second servomotor may be respectively controlled so that an inclination of the boarding seat to the left and right is changed according to the motion data.

According to the present invention, by providing audio-visual education through virtual reality images for survival swimming education and at the same time providing a device capable of physically environmental simulation for survival swimming, it provides the same effect as actually experiencing survival swimming. It is possible to provide an extended reality-based survival swimming virtual experience system that can increase effectiveness while safely educating survival swimming.

1 is a schematic diagram showing the entire configuration and the relationship between configurations of an augmented reality-based survival swimming virtual experience system according to an embodiment of the present invention.
2 is a flowchart illustrating a configuration and reproduction sequence of a virtual reality video provided through a survival swimming program management unit according to an embodiment of the present invention.
3 and 4 are diagrams showing a partial reproduction screen of a virtual reality image according to an embodiment of the present invention.
5 is a diagram showing the configuration of a motion sensor unit according to an embodiment of the present invention.
6 is a view showing detailed configurations of a boarding unit and a driving unit according to an embodiment of the present invention.
7 is a diagram illustrating a driving method of a driving unit according to a basic driving control signal and control of a driving control unit according to an embodiment of the present invention.

The terms used in this specification will be briefly described, and the present invention will be described in detail.

The terms used in the present invention have been selected from general terms that are currently widely used as much as possible while considering the functions in the present invention, but these may vary depending on the intention of a person skilled in the art or precedent, the emergence of new technologies, and the like. In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, not simply the name of the term.

When it is said that a certain part "includes" a certain component throughout the specification, it means that it may further include other components without excluding other components unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. .

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily carry out the present invention. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

1 is a schematic diagram showing the entire configuration and the relationship between components of an augmented reality-based survival swimming virtual experience system according to an embodiment of the present invention, and FIG. 2 is a virtual survival swimming program provided through a management unit according to an embodiment of the present invention. 3 and 4 are diagrams showing a partial playback screen of a virtual reality image according to an embodiment of the present invention, and FIG. 5 is a motion sensor unit according to an embodiment of the present invention. Figure 6 is a diagram showing the detailed configuration of a boarding unit and a driving unit according to an embodiment of the present invention, Figure 7 is a driving unit according to the control of a basic drive control signal and a driving control unit according to an embodiment of the present invention It is a diagram shown to explain the driving method of.

Referring to FIG. 1 , the augmented reality-based survival swimming virtual experience system 1000 according to an embodiment of the present invention includes a survival swimming program management unit 100, a virtual reality image display unit 200, a motion sensor unit 300, boarding It may include at least one of the unit 400, the driving unit 500, the driving control unit 600, and the meta communication unit 700.

The survival swimming program management unit 100 may provide a virtual reality image equipped with a scenario for virtual experience of survival swimming for each situation and a drive control signal according to the virtual reality image.

As shown in FIG. 2 , the survival swimming program manager 100 includes a virtual reality intro video having a story for each situation, a survival swimming method training video, a virtual reality game video linked with driving control signals and motion data, and a video for each situation. It is possible to provide virtual reality images in order of virtual reality ending images having a story. Here, while playing a game that performs a preset mission when playing a virtual reality game video, it is possible to determine whether or not the user passes the game mission according to the motion data, and provide a virtual reality ending video when the game mission is passed.

Hereinafter, various examples for each scenario of the virtual reality image according to the present embodiment will be described.

Afternoon view of the boarding of the S1 vessel from the waterfront port
A scene is created to board a yacht to experience an uninhabited island. With the sound of the sea port, the navigator (with the clamor to board the ship) All passengers who boarded for this uninhabited island experience, please fasten your seat belts.
Cheol-su boarding the S2 ship
Sailor (with a loud noise as they board the ship) All passengers who boarded for this uninhabited island experience, please fasten your seat belts.
S3 Runs toward the uninhabited island in style. Voice narration (with the sound of yachts cutting the sea) The islands of the archipelago in the wonderful sea run excitedly at high speed for about 10 seconds with the surrounding scenery.
S4 With a roar and impact, the lower part of the boat hits a rock wall and water begins to enter. Navigator (Urgent distress notification with the sound of water rising from the bottom)
[Educational goal: Teaching frog stroke in dog paddle as the main purpose]
Passengers!! This yacht has collided with a reef and is in an emergency situation. From now on, I will teach you how to swim for survival. Everyone, please wear life jackets first.
Navigator (the sound of water rising from the bottom gets louder) If you don't have a life jacket, find a plastic bag or styrofoam with high buoyancy nearby)
Navigator (water fills up from the bottom) After the water fills more than half of the stomach, swim through the water and escape through the survival swimming method I am telling you now.
S5 Frog Swimming Video Training
S6 dog paddle video training (10 seconds video)
A scene of trying to escape from the belly of S7 by survival swimming method (30 seconds video)
The navigator (the entrance is visible and most of the water is filled up, creating an underwater scene) Frogstroke Dog paddle freestyle to reach the entrance within 30 seconds. If it is not reached within 30 seconds, it is announced that it is drowned, and it is forcibly switched to a scene on the sea outside the boat to assume that it is alive, and a comment is made to swim to the island.
S8 The ship's bagat is eventually deployed to a floating situation in the sea, and survival swimming is performed until reaching a small island with a reef 50 meters ahead by survival swimming (30 seconds) (wave sound production) Frog swimming, dog swimming must be reached within 30 seconds, and at this time, directional speed is sensed and simulated, and if it is reached quickly, it ends with a welcome comment of survival.
In case of escaping from the boat, escape tips and swimming methods are taught, and if the swimming method is not followed, you may drown in the water.
S9 Finished after creating a scene of a wonderful uninhabited island similar to the island from King Kong (10 seconds).

<Scenario of survival swimming in a sunken ship>

In the afternoon when people are bathing in the S1 beach, they move deeper and deeper to collect shellfish. Narrator (with the sound of bathing) I went deeper and deeper to pick up bigger clams at the beach today.
S2 A sudden tide turns my body into a state of floating on the sea. The narrator (a sudden rising tide hits me and makes me float in the sea water) No life jacket or anything at all. Narrator (with the sound of waves) If I can't swim, I'll die.
S3 backstroke video training (20 seconds video)
S4 Leaf Floating Stroke Video Training (20 seconds video)
[Educational Goal: Teaching backstroke leaf-climbing as the main purpose]
S5 Trying to reach the beach from the sea by survival swimming (30-second video) Narrator (directed by sea scene) Survival by surviving for 1 minute using backstroke, jumping, etc. At this time, directional speed is sensed and simulated, and if it is reached quickly, the scene is switched to the land. If it is not reached within 30 seconds, it is notified that the person drowned and forcibly switched back to the scene in the sea to inform that he died and close.

<Survival Swim Experience Scenario When Falling on the Beach>

Excitingly run on a yacht in the S1 Reservoir. Narrator (with the sound of a yacht) I am running on a yacht today on Cheongpyeong Lake.
S2 A sudden turn overturns the yacht and I fall into the reservoir. The narrator (my body is floundering over the reservoir) No life jacket or anything at all. Narrator (with the vibe of the reservoir) If I can't swim, I'll just die. Let's start learning the freestyle stroke.
S3 Freestyle Video Training (20 sec video)
S4 Trying to reach the land from the middle of the reservoir in freestyle (1-minute survival) [Education goal: Freestyle map as the main purpose]
S5 Trying to reach the beach from the sea by survival swimming (30-second video) Narrator (directed by sea scene) Survival by enduring 1 minute with backstroke, jumping, etc., or reaching the entrance within 1 minute with frog stroke, dog paddle freestyle At this time, directional speed is sensed and simulated, and if it is reached quickly, the scene is switched to the land. If it is not reached within 30 seconds, it is notified that the person drowned and forcibly switched back to the scene in the sea to inform that he died and close.

<Survival Swim Experience Scenario in Case of Falling into a Reservoir>

Excitingly run on a yacht in the S1 Reservoir. Narrator (with the sound of a sailboat) Today I am running on a yacht on Cheongpyeong Lake.
S2 A sudden turn overturns the yacht and I fall into the reservoir. The narrator (my body is floundering over the reservoir) No life jacket or anything at all. Narrator (with the vibe of the reservoir) If I can't swim, I'll just die. Let's start learning the freestyle stroke.
S3 Freestyle Video Training (20 sec video)
Trying to reach the land in the middle of S4 Reservoir in freestyle (1 minute survival)
[Education goal: freestyle instruction as the main purpose]
Narrator (Directed by a sea scene) Survival must be done by enduring one minute with backstroke, wading, etc., or reaching land within one minute with frogstroke, dog paddle, freestyle, etc. At this time, directional speed, etc. are sensed and simulated, and if the scene is reached quickly, the scene is switched to land. If it is not reached within 1 minute, it is notified that he has drowned, and the scene in the reservoir is forcibly switched back to inform that he has died, and the deadline.

<Survival Swim Experience Scenario in Case of Falling into a Reservoir>

The driving control signal provided when the survival swimming program starts from the survival swimming program management unit 100 is a signal for instructing the initial driving (basic movement) of the driving unit 500 so that the user can physically feel the basic environment for survival swimming. For example, if you press the 1st (150mm), 2nd (100mm), and 3rd (50mm) buttons before starting to experience survival swimming, the second servomotor cylinder 532 moves the boarding part ( 400) can be raised and lowered.

At this time, after the user boards the boarding unit 400 and the seat belts 400 are all coupled, the first actuator 510 and the second actuator 520 are converted to a state in which they can start to operate, thereby activating the start button When is pressed, the first and second actuators 510 and 520 start to operate, and a virtual reality image for experiencing survival swimming may be played. When the survival swimming experience is started by the start button, the first servomotor cylinder 531 goes up, and the second servomotor cylinder 532 goes down (150mm) so that the boarding part 400 can be brought into a horizontal state. do.

In addition, the height of the first servo motor cylinder 531 rises by about 300 mm at the start of step 1, by about 400 mm at the start of step 2, and by 500 mm at the start of step 3, so that the survival swimming experience can begin. At this time, it can be raised up to 550 mm, and the positions of the ends of the first servomotor cylinder 531 and the second servomotor cylinder 532 coincide, so that the boarding part 400 can be leveled.

In this way, when the survival swimming program management unit 100 starts the survival swimming program, the driving unit 500 controls mechanical settings for starting the user's survival swimming experience and driving control signals for controlling basic physical motions for the survival swimming experience. can provide.

The virtual reality image display unit 200 receives the virtual reality image from the survival swimming program management unit 100 in real time and reproduces the virtual reality image through the display device so that the user can watch the corresponding virtual reality image.

At this time, the display device according to the present embodiment is a means for reproducing and displaying virtual reality images in the form of a HMD (Head Mount Display) or a surround display installed to surround the boarding unit 400 as shown in FIG. can be implemented If the device for reproducing and displaying virtual reality images is applied as an HMD, the user can directly wear it on the head when experiencing survival swimming, and as the HMD is equipped with a motion tracker, the position of the user's head can also be tracked. . The surround display is a large display device implemented in a form surrounding the practice space for survival swimming experience, that is, the space where the boarding unit 400 is installed, and provides audiovisual information about the surrounding environment when the user experiences survival swimming even without wearing an HMD. to be provided.

As shown in FIGS. 3 and 4 , in the virtual reality image according to this embodiment, all virtual objects displayed in the image may be 3D modeled and displayed. For example, virtual objects such as buoys, ships, reefs, virtual characters, backgrounds (sky, water (sea, river)) can be 3D modeled to provide users with a sense of immersion in survival swimming experience. In addition, effects and shader effects can be given to the 3D modeled virtual object to provide a deeper sense of immersion to the user.

The motion sensor unit 300 may generate motion data according to a user's motion.

As shown in FIG. 5 , the motion sensor unit 300 may include at least one of a controller 310, a motion tracker 320, and a band worn by the tracker 330.

The controller 310 can generate a user control signal for interaction with a virtual object appearing in a virtual reality image, each gripped by a user's hand.

For example, each story may be different depending on the scenario for each situation, but in the process of jumping from a ship into the sea, the user catches the ship's fence, wears a life jacket, or pushes an obstacle, etc. A corresponding user control signal may be generated in a situation requiring an action, and the generated user control signal may be transmitted to the driving control unit 600 . At this time, the user control signal transmitted to the driving control unit 600 may be applied to control the driving unit 500 so that the user can physically feel an action performed by the user on the object.

On the other hand, the user control signal can also serve as an information input means, that is, an interface means, for education through virtual reality images and mission performance in the course of the survival swimming experience.

The motion tracker 320 may detect the position of at least one body part among the user's head, chest, wrist, waist, and ankle to generate motion data for each user's body part. More specifically, the motion tracker 320 generates three-dimensional coordinate information in which a unique identification signal is sensed based on a plurality of motion sensor modules attached to the user and a unique identification signal received from each motion sensor module, and generated It may include a location tracking module that tracks the absolute location of each motion sensor module in the experience space based on 3D coordinate information and generates motion data for each body part of the user based on the tracked location information.

The tracker wearing band 330 is coupled with the motion tracker 320 (motion sensor module), and the motion tracker 330 can be worn on each part of the user's body (head, chest, wrist, waist, ankle, etc.), respectively. there is.

The boarding unit 400 can hold the user so that the user's basic swimming posture (lying face down) is maintained during virtual underwater buoyancy for survival swimming experience.

As shown in FIG. 6 , the boarding unit 400 may include at least one of a boarding seat 410, a safety belt 420, and a support cover 430.

The boarding seat 410 can board the user in a prone state. Here, the prone state means a basic posture for allowing the user to virtually practice survival swimming, and may have an area and size for mainly supporting the upper body of the user and allowing the user to ride. Although the boarding seat 410 may be formed in a substantially rectangular parallelepiped, the structure of the boarding seat 410 is not limited in this embodiment. However, the boarding seat 410 may be provided with an appropriate cushion member so that the user can safely and stably perform survival swimming in a prone state, and it is preferable to have a groove structure that can stably seat the user's chest and stomach. do.

The seat belt 420 may fix the user so that the user does not separate from the boarding seat 410 . The seat belt 420 may include at least one main seat belt covering one side of the boarding seat 410 and the other side, and sub seat belts covering shoulders and thighs.

The support cover 430 is connected to the lower part of the boarding seat 410, covers the driver 500 located inside, extends and contracts in the vertical direction according to the driving of the driver 500, and twists and deforms in the left and right directions. To enable this, at least one of an elastic material and a foldable elastic structure may be used. The support cover 430 is made of a cylindrical or square pillar shape and can freely bend in front, back, left and right directions, and can be made of a structure in which the side is folded and unfolded according to the vertical height adjustment.

The driving unit 500 can be driven so that the vertical position, inclination, and direction of the boarding unit are changed. To this end, the driving unit 500 may include at least one of a first actuator 410 , a link interface 520 , and a second actuator 530 , as shown in FIG. 6 .

The first actuator 410 may include a first servomotor 511 and a second servomotor 512 . The first servomotor 511 and the second servomotor 512 are installed under the boarding seat 410 and may be arranged in a line on the left and right sides of the boarding seat 410 . That is, the first servomotor 511 and the second servomotor 512 are disposed on the lower left and right sides of the boarding seat 410, respectively, so that the first servomotor 511 and the second servomotor 512 are It is possible to adjust the inclination of the boarding seat 410 in the left and right direction through the downward driving.

The link interface 520 may include a support plate 521 , a first joint link 522 and a second joint link 523 , and a link rail 524 .

The support plate 521 may have the first actuator 410 installed thereon and may have a substantially rectangular flat shape.

The first joint link 522 and the second joint link 523 are installed under the support plate 521, but may be arranged or arranged in a line with respect to the front and rear of the boarding seat 410, and the first servomotor cylinder 531 and the second servomotor cylinder 532 may be rotatably connected to each other.

The link rail 524 is connected between the lower surface of the support plate 521 and the second joint link 523, and is disposed in the longitudinal direction of the support plate 521 to move the second joint link 523 forward and backward. It may include a for sliding. More specifically, the end of the second servomotor cylinder 532 is rotatably coupled to the second joint link 523, and in this state, the first servomotor while the second servomotor cylinder 532 moves up and down. The support plate 521 may be tilted due to a height difference with the cylinder 531 . At this time, the tilt angle range of the support plate 521 may be expanded while the second joint link 523 slides along the link rail 524 .

The second actuator 530 may include a first servomotor cylinder 531 and a second servomotor cylinder 532 . The first servomotor cylinder 531 is connected to the first joint link 522 and installed in a vertical direction with respect to the boarding seat 410 to adjust the height of the boarding seat 410, and the second servomotor cylinder 532 ) Is connected to the second joint link 523 and is installed in a vertical direction with respect to the boarding seat 410 to adjust the height of the boarding seat 410. The first servomotor cylinder 531 and the second servomotor cylinder 532 control the height of the support plate 521 and the inclination of the front and rear sides of the support plate 521 through an elevating drive, thereby controlling the height of the boarding seat 410 and the front and rear sides. Tilt can be adjusted.

The drive control unit 600 drives the boarding unit 400 so that the position, inclination, and direction of the boarding unit 400 are forcibly changed in the basic swimming posture according to the driving control signal, and the position, inclination, and Driving can be controlled so that the direction is adjusted.

The drive control unit 600, before receiving motion data from the motion sensor unit 300, raises and lowers the boarding seat according to the drive control signal received from the survival swimming program management unit 100 and changes the inclination of the boarding seat forward and backward. The driving of the first servomotor cylinder 531 and the second servomotor cylinder 532 are respectively controlled, but when motion data is received, the inclination of the boarding seat 410 to the left and right is changed according to the received motion data. Driving of the servomotor 511 and the second servomotor 512 may be controlled, respectively.

First of all, in the initial driving state in which the motion sensor unit 300 does not operate or in the initial setting state when boarding, the first servomotor cylinder 531, the second servomotor cylinder 532, and the first actuator 510 operate on the boarding unit (400) can be lowered gradually. After that, an operation to implement a motion that plunges the user upside down is performed. At this time, the motion of throwing the user upside down is approximately doubled when the first servomotor cylinder 531 descends or moves up by 10 mm, and the second servomotor cylinder 532 doubles ( 20 mm), and then, when the second servo motor cylinder 532 moves up to 150 mm, the first servo motor cylinder 531 continuously descends, so that a motion of being driven backwards may be achieved.

Thereafter, when motion data for both arms is detected, the first and second actuators 510 and 530 are operated to level the first and second actuators 510 and 530 until the initial start, and when motion data for holding only one arm is generated among the motion data for both arms, the corresponding The first actuator 510 (however, within an angular range of about 30 degrees) may be moved so that the arm side is raised. That is, when a state tilted by 30 degrees is sensed, the tilted direction can be controlled to rise by about 3 to 5 degrees. The operation of the first actuator 510 is such that the motion tracker 320 mounted on one arm moves about 3 degrees in 0.5 seconds or 1 second when swimming (freestyle), and when both arms move alternately, It can reciprocate about 3 degrees. When the motion trackers 320 mounted on both arms move forward at the same time, the second servomotor cylinder 532 can go up and down by about 3 to 5 degrees and repeat the motion (that is, implement breaststroke (frog swim) motion). . When the virtual reality game ends, it can be returned to the original stage.

The meta communication unit 700 includes a first meta communication unit 710 for wired or wireless communication between the survival swimming program management unit 100 and the virtual reality image display unit 200, the survival swimming program management unit 100 and the driving control unit 600. ) may include a second meta communication unit 720 for wired or wireless communication between the motion sensor unit 300 and a third meta communication unit 730 for wired or wireless communication between the motion sensor unit 300 and the driving control unit 600. The meta communication unit 700 is a means for communication within the augmented reality-based survival swimming virtual experience system 1000 according to the present embodiment, and can be implemented in various communication methods such as Wi-Fi, Bluetooth, and Internet communication.

What has been described above is only one embodiment for implementing the augmented reality-based survival swimming virtual experience system according to the present invention, and the present invention is not limited to the above embodiment, and as claimed in the following claims Anyone with ordinary knowledge in the field to which the present invention pertains without departing from the gist of the present invention will say that the technical spirit of the present invention exists to the extent that various changes can be made.

1000: Survival swimming virtual experience system based on extended reality
100: Survival Swimming Program Management Department
200: virtual reality image display unit
210: HMD
220: surround display
300: motion sensor unit
310: controller
320: motion tracker
330: tracker wearing band
400: boarding unit
410: Boarding seat
420: seat belt
430: support cover
500: driving unit
510: first actuator
511: first servomotor
512: second servomotor
520: link interface
521: support plate
522: first joint link
523: second joint link
524: link rail
530: second actuator
531: first servomotor cylinder
532: second servomotor cylinder
600: driving control unit
700: meta communication department
710: first meta communication unit
720: second meta communication unit
730: 3rd meta communication unit

Claims (8)

a survival swimming program management unit providing a virtual reality image equipped with a scenario for virtual experience of survival swimming for each situation and a driving control signal according to the virtual reality image;
a virtual reality image display unit that reproduces and displays the virtual reality image;
a motion sensor unit generating motion data according to a user's movement;
A boarding unit for holding a user so that a basic swimming posture is maintained during virtual floating in water; and
a driving unit that drives the boarding unit to change its position, inclination, and direction; and
A driving control unit configured to drive the boarding unit so that the position, inclination, and direction of the boarding unit are forcibly changed in the basic swimming posture according to the driving control signal, and control driving such that the position, inclination, and direction of the boarding unit are adjusted according to the motion data. include,
The boarding unit,
a boarding seat for boarding a user in a prone state;
a seat belt for fixing the user so that the user does not escape from the boarding seat; and
At least one of an elastic material and a foldable elastic structure that is connected to the lower portion of the boarding seat, covers the drive unit located inside, extends and contracts in the vertical direction according to the drive of the drive unit, and enables torsional deformation in the left and right directions. Including a support cover made in the manner,
the driving unit,
A first servomotor and a second servomotor installed under the boarding seat and disposed in a row on the left and right sides of the boarding seat, and the first servomotor and the second servomotor drive the boarding seat. a first actuator for adjusting the inclination in the left and right directions;
a link interface including a support plate on which the first actuator is installed, and a first joint link and a second joint link installed on the lower portion of the support plate and arranged in a line with respect to the front and rear of the boarding seat; and
A first servomotor cylinder connected to the first joint link and installed in a vertical direction with respect to the boarding seat to adjust the height of the boarding seat, and connected to the second joint link and installed in a vertical direction with respect to the boarding seat A second servomotor cylinder is installed to adjust the height of the boarding seat, and the first servomotor cylinder and the second servomotor cylinder are driven to adjust the inclination of the boarding seat in the front and rear directions. An extended reality-based survival swimming virtual experience system comprising two actuators.
According to claim 1,
The survival swimming program management department,
The virtual reality images are provided in the order of a virtual reality intro video having a story for each situation, a survival swimming method training video, a virtual reality game video linked with the driving control signal and the motion data, and a virtual reality ending video having a story for each situation. do,
When the virtual reality game video is played, a game for performing a preset mission is played, the motion data determines whether or not the user passes the game mission, and the virtual reality ending video is provided when the game mission is passed. Survival swimming virtual experience system based on extended reality.
According to claim 1,
The virtual reality image display unit,
An augmented reality-based survival swimming virtual experience system comprising at least one of a head mount display (HMD) for reproducing and displaying the virtual reality image and a surround display installed to surround the boarding unit.
According to claim 1,
The motion sensor unit,
a controller that is gripped by a user's hand and generates a user control signal for interaction with a virtual object appearing in the virtual reality image;
a motion tracker that detects a position of at least one body part among the user's head, chest, wrist, waist, and ankle and generates motion data for each part of the user's body; and
An augmented reality-based survival swimming virtual experience system, characterized in that it includes a tracker wearing band coupled to the motion tracker and for wearing the motion tracker on each body part of the user.
delete delete According to claim 1,
The link interface,
The extended reality base further comprising a link rail connected between the lower surface of the support plate and the second joint link and disposed in the longitudinal direction of the support plate to slide the second joint link in the forward and backward directions. Survival Swimming Virtual Experience System.
According to claim 1,
The drive control unit,
Before receiving the motion data, the driving of the first servomotor cylinder and the second servomotor cylinder are controlled to change inclination with respect to the front and rear after the boarding seat is moved up and down according to the drive control signal, respectively, When the data is received, the driving of the first servomotor and the second servomotor are respectively controlled so that the inclination of the left and right sides of the boarding seat is changed according to the motion data. .