WO2023234456A1

WO2023234456A1 - Vr image and content providing system and method for underwater monitoring

Info

Publication number: WO2023234456A1
Application number: PCT/KR2022/008243
Authority: WO
Inventors: 김기주
Original assignee: 동명대학교산학협력단
Priority date: 2022-05-31
Filing date: 2022-06-10
Publication date: 2023-12-07
Also published as: KR20230166615A

Abstract

The present invention provides a VR image providing system for underwater monitoring, the system comprising a water mat, a motion detection device, an output device for virtual experience, a terminal, and a management server. More specifically, provided is a VR image and content providing system that enables individuals to observe underwater environments realistically by using VR.

Description

System and method for providing VR video and content for underwater monitoring

The present invention is a result of support from the Busan University Innovation Research Complex Development Project (IURP2201) of the Busan Institute for Industrial Science and Innovation (BISTEP), and relates to a system and method for providing VR images and content for underwater monitoring. In more detail, the present invention relates to a method using a VR image and content provision system for underwater monitoring that allows individuals to realistically observe the underwater environment using VR (Virtual Reality).

Recently, in order to solve the depletion of land resources and population density, development of the ocean has accelerated, and underwater structures such as marine plants, marine bridges, and underwater tunnels are being built. Accordingly, the demand for technology for monitoring the environment of aquatic organisms living in the water is also increasing.

For such underwater monitoring, a method in which divers dive under the water and directly capture and inspect images of underwater life has been used.

However, this conventional monitoring method of capturing underwater images not only carries the risk of human accidents, but is also affected by conditions such as divers, weather, and the sea, so there are limitations in image acquisition time and range. In addition, since underwater environment analysis experts had to analyze the underwater environment based on two-dimensional images that lacked realism, there was a problem that the accuracy of the analysis results inevitably decreased.

Furthermore, the conventional monitoring method for aquatic life, etc. has the problem that underwater environment analysis experts have to analyze the underwater environment based on two-dimensional images that lack realism, which inevitably reduces the accuracy of the analysis results.

Therefore, in order to obtain information necessary for location recognition in the underwater environment, various studies have been conducted on monitoring underwater life using virtual reality (VR), including the search for underwater objects using underwater image information. come.

In general, virtual reality (VR) is an interface between humans and information processing devices that creates a specific environment or situation with an information processing device such as a computer, making it as if the person using it is interacting with the actual surrounding situation. says These virtual reality technologies can provide users with environments that are difficult or restrictive to experience in the real world.

Furthermore, in order for users to feel a sense of reality through virtual reality, information acquired through the user's five senses, such as sight, hearing, and touch, must be provided. Accordingly, systems and methods applying the virtual reality (VR) have also recently been greatly highlighted.

Using virtual reality, which has these features and functions, it is possible to more accurately identify and analyze the state of the underwater environment to monitor current aquatic life than conventional technologies in order to minimize direct and indirect impacts from the underwater environment. There has been a demand for the development of systems and methods that can easily understand data and utilize results efficiently.

Therefore, the present invention was created to solve this problem, by providing users or parties who want to attempt underwater monitoring with VR (virtual reality) images based on underwater image information using an image capture device such as Camel, The purpose is to provide a VR video and content provision system and method for underwater monitoring that can further increase the sense of reality by introducing virtual reality.

In addition, the present invention provides a VR video and content provision system and method for underwater monitoring that can maximize educational effects by ensuring the user's stability and inducing a realistic sense of presence and immersion in order to provide the user with a realistic experience of the underwater environment. There is a purpose.

In addition, the purpose is to provide a VR video and content provision system and method for underwater monitoring that allows underwater experience educators to have an intuitive experience by simulating virtual underwater images based on information selected through underwater environment experience. .

Therefore, in order to achieve this purpose, the present invention is a VR video and content provision system for underwater monitoring, in which a detection sensor is installed, a water mat for allowing the user to feel the physical sensation of water while lying down, and a water mat for detecting the user's motion. A motion detection device consisting of an image capture device and an image recognition module, a virtual experience output device that is worn on the user's head and provides a virtual reality image, and data received from the detection sensor of the water mat and the motion detection device. A terminal capable of controlling the virtual reality content output to the virtual experience output device and transmitting content information about the underwater virtual experience to the virtual experience output device, and transmitting content information about the underwater virtual experience to the virtual experience output device and the terminal according to the content information. It is characterized by including a management server that runs and monitors the progress of the marine virtual experience.

In addition, the detection sensor is characterized in that the underwater environment is recognized by the user's vision, hearing, and tactile senses.

Additionally, the virtual reality content is characterized by including a user avatar that experiences the underwater environment.

In addition, the bottom of the water mat further includes a driving means for driving the water mat, a wind volume controller that provides wind for a realistic experience, and a spray controller that provides water droplets.

Therefore, the present invention generates underwater images as VR images and provides them directly to the user, while also monitoring the underwater, thereby increasing the sense of reality for the underwater images. Accordingly, if you want to experience the underwater environment based on VR images, It has an excellent effect of increasing the accuracy and reliability of the underwater experience.

In addition, it has the effect of providing a realistic and practical underwater education environment while ensuring safety for educators who want to receive education about the underwater environment.

1 is a schematic configuration diagram of a VR image providing system for underwater monitoring according to an embodiment of the present invention.

Figure 2 is a diagram showing an award mat.

Figure 3 is a detailed block diagram of an output device for virtual experience.

Figure 4 is an example screen of virtual reality (VR) content.

Figure 5 is a relationship diagram between a terminal and a content device.

Figure 6 is a detailed block diagram of the management server.

Figure 7 is a flowchart of a method for providing VR images for underwater monitoring according to an embodiment of the present invention.

Figure 8 is a block diagram for explaining the configuration of the VR education device.

Figure 9 is a block diagram for explaining the configuration of a display device.

Figure 10 is a block diagram for explaining the configuration of a server.

Figure 11 is a flowchart illustrating a method of providing VR-based marine education using a VR education device.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. Before explaining the present invention, it should be noted that in adding reference numerals to components in each drawing, the same components are given the same reference numerals as much as possible even if they are shown in different drawings. .

Additionally, in the following description of the present invention, if a detailed description of a related known function or configuration is judged to unnecessarily obscure the gist of the present invention, the detailed description will be omitted.

In addition, it should be noted in advance that the terms used in this application are only used to describe specific embodiments, and are not intended to limit the invention, and that singular expressions also mean plural expressions unless the context clearly indicates otherwise. I want to leave it.

Figure 1 is a schematic configuration diagram of a VR image providing system for underwater monitoring according to an embodiment of the present invention, Figure 2 is a diagram showing an aquatic mat, Figure 3 is a detailed block diagram of an output device for virtual experience, and Figure 4 is an example screen of virtual reality (VR) content, Figure 5 is a diagram of the relationship between the terminal and the content device, Figure 6 is a detailed block diagram of the management server, and Figure 7 is underwater monitoring according to an embodiment of the present invention. It is a flowchart of a method for providing VR images, FIG. 8 is a block diagram for explaining the configuration of a VR education device, FIG. 9 is a block diagram for explaining the configuration of a display device, and FIG. 10 is a block diagram for explaining the configuration of a server. It is a block diagram for, and Figure 11 is a flow chart to explain a method of providing VR-based marine education using a VR education device.

Hereinafter, the overall configuration of the VR image providing system for underwater monitoring according to the present invention will be described with reference to FIGS. 1 and 2.

First, looking at Figure 2, the user can experience a virtual underwater environment by lying on the water mat 100 floating on the water provided in any space containing water.

A detection sensor (S) is installed on the water mat 100, allowing the user to lie down and directly feel the physical sensation of the water, thereby promoting more realism in the virtual (VR) underwater experience.

Furthermore, at the bottom of the water mat 100, a driving means (not shown) for driving the water mat 100 and an air volume controller (not shown) that provides wind for a more realistic experience of a virtual underwater environment, and A mist regulator (not shown) that provides water droplets is included.

Therefore, since the water mat 100 has a predetermined driving means formed at the bottom, it is possible to actively simulate the physical properties of water (speed, amount, frequency, wavelength, etc. of water movement). desirable.

The description of driving the water mat 100 using the driving means and the detailed configuration and operational relationship of the air volume controller and the spray controller will be omitted since they are well-known techniques.

Meanwhile, it is preferable that the detection sensor (S) includes a tilt sensor, an acceleration sensor, an inertial sensor, etc., so that it can output data that can express the physical properties of water, such as the speed, amount, frequency, and wavelength of water movement. .

And, as shown, the aquatic mat 100 is formed with a sensory sensor (S) to enable the user lying on the aquatic mat 100 to perceive various underwater environments through the visual, auditory, and tactile senses.

Therefore, the sensory sensor (S) is mounted so that the user can feel the physical sensation of water while lying down. Furthermore, the sensory sensor (S) includes a tilt sensor, an acceleration sensor, an inertial sensor, etc. It is desirable to be able to output data that can express the physical properties of water, such as the speed, amount, frequency, and wavelength of movement.

The motion detection device 200 is composed of an image capture device 210 and an image recognition module (not shown) to detect the body motion of a user lying on the front of the water mat 100.

It is desirable that the motion detection device 200 be equipped with a predetermined motion recognition marker (not shown) on the user's body so that the motion detection device 200 can more effectively recognize the user's motion.

The output device 300 for virtual experience is worn on the user's head and provides a virtual reality (VR) image.

The virtual reality content output through the virtual experience output device 300 includes virtual reality content from the user's first-person perspective (not shown) or virtual reality content from the user's third-person perspective (not shown).

The first-person and third-person virtual reality content preferably includes a user avatar who experiences survival swimming, and the user avatar moves in conjunction with each other by matching the body motion data detected from the motion detection device 200 described above. It would be desirable to do so.

Hereinafter, the functions of virtual reality content output through the virtual experience output device 300 will be described with reference to the drawings.

Referring to FIG. 3, when describing the output device 300 for a virtual experience, the output device 300 for a virtual experience includes a header unit 310, a speaker 320, a breathing sensor 330, and a control unit 340. It is composed including.

The header unit 310 visually provides underwater virtual reality content according to the user's gaze. Among the underwater virtual reality content, video signals are input through the video signal input unit 350. This image corresponds to an image when the user is located at a certain location underwater.

Among the underwater virtual reality content, a voice signal is input through the voice signal input unit 360, and this signal is output through the speaker 320. The sound output through the speaker 320 corresponds to the sound when the user is located at a predetermined position underwater.

Underwater virtual reality content is provided through the video signal input unit 350 and the audio signal input unit 360.

The breathing sensor 330 detects whether and to what extent the user is inhaling or exhaling.

The control unit 340 controls each component of the virtual experience output device 300 and reflects the user's breathing state measured by the breathing sensor 330 in the content.

The virtual experience output device 300 is provided as an interface by manufacturing a header part 310, a breathing sensor 330, and a speaker 320 to be worn on the user's face.

In another method, the virtual experience output device 300 is configured in the form of a mask and can be worn on the user's face. In this case, it can be attached to the face using a fixing band (not shown).

In addition, the control unit 340 obtains user information in real time from the virtual experience output device 300 and controls the virtual experience output device 300 using the obtained data.

*Figure 4 is an example screen of the virtual reality (VR) content.

As shown in the drawing, the actual underwater state obtained through video and audio is shown to the user through virtual reality content of the virtual experience output device 300. In particular, the virtual content screen naturally changes depending on the water depth shown on the left side of the screen, and the amount of oxygen, salinity, density, water temperature, and pressure change depending on the water depth.

The terminal 400 receives data from the detection sensor (S) of the water mat 100 and the motion detection device 200 and turns on/off the virtual reality content output to the virtual experience output device 300. It can be done, and it can be controlled.

The terminal 400 generates or receives marine content reflecting information on the surrounding marine environment based on Points of Interest (POI) when creating a point of interest from the content device 500, which will be described later.

Hereinafter, the content device 500 will be described with reference to FIG. 5 .

The content device 500 consists of an underwater environment information providing server 510 that provides underwater environment information, and an underwater content providing server 520 that provides content reflecting the underwater environment information. The terminal 400 provides peripheral information. Create marine content that reflects underwater environment information. Accordingly, the application is downloaded and executed in the terminal 400.

That is, when the corresponding application of the terminal 400 is run and a point of interest is created, location information and date information are transmitted to the underwater environment information providing server 510, and the underwater environment information providing server 510 receives the received information. Based on the location information and time information, underwater environment information that can check the current area's tide, water depth, weather, water temperature, wind direction, wind speed, wave height, and wave direction is generated, and this is transmitted to the terminal 400, and the terminal 400 ) generates underwater content based on the received underwater environment information, transmits it to the underwater content providing server 520 and requests it to be stored for each content, and the underwater content providing server 520 creates each content reflecting the underwater environment information. By converting the content into a database, the process of registering the content is completed.

And, the terminal 400 connects to the underwater content providing server 520, receives content reflecting marine environment information based on the content ID, and displays it on the screen, so that the content registered in the terminal 400 By organizing the underwater environment information and the current underwater environment information, each user can obtain safe and excellent underwater activity results by viewing content and obtaining underwater environment information in accordance with the dynamically changing underwater environment. will be.

At this time, the terminal 400 can be configured to compare past underwater environment information and current underwater environment information based on location information and date information, and confirm the difference or receive guidance.

In addition, when the terminal 400 takes pictures of underwater activities or the results of underwater activities and registers them, it can be configured to secure and automatically store underwater environment information based on the current location and date to create underwater content. .

When the terminal 400 executes a related application to generate content and explains the display of content reflecting underwater environment information, for example, when the application of the terminal 400 is activated, a tiled image appears on the screen. When activated through the point of interest registration button (not shown) to set and register the current location displayed through a map (not shown) that allows you to receive an image and check the current location as an area of interest, the terminal ( The location information and date information of the current location where 400) is located are transmitted from the underwater environment information providing server 510, and the corresponding underwater environment information is transmitted to generate content.

Furthermore, when you access the underwater content providing server 520 through the terminal 400 and receive a sharing URL that allows you to share the content you created, you can share it through SNS or messages such as Kakao Talk, Twitter, or Instagram. It is transmitted to the shareee through , so that each shareee can access the underwater content providing server 520 through the shared URL and check the content reflecting the underwater environment information.

The management server 600 transmits content information about the underwater virtual experience to the virtual experience output device 300 described above, and configures the virtual experience output device 300 and the terminal 400 according to the content information. It can be operated and the progress of the user's underwater virtual experience can be monitored in real time.

Hereinafter, the management server 600 will be described with reference to the drawings.

Figure 6 is a detailed block diagram of the management server 600, which includes a communication unit 410, a server control unit 620, and a storage unit 630.

The communication unit 610 performs communication with the virtual experience output device 300. The communication unit 610 transmits content information about the ocean virtual experience to the virtual experience output device 300, and reports the progress of the underwater virtual experience and the user's biological condition from the virtual experience output device 300. Receive information about

The server control unit 620 controls the delivery of content information so that the virtual experience output device 300 is operated according to the content information about the marine virtual experience. At this time, content information may be selected by user input received from the external terminal 400, or may be directly input by a server input unit (not shown).

The server control unit 620 monitors the progress of the user's marine virtual experience. The server control unit 620 may analyze the progress of each user's marine virtual experience and perform evaluation. That is, the server control unit 620 can evaluate the user's experience difficulty level, progress speed, experience completion status, etc.

Preferably, the server control unit 620 can use the evaluation results to calculate the parts that the user is lacking or supplementary parts and provide them to the user.

The server control unit 620 monitors the user's biological condition. The server control unit 620 controls the virtual experience output device 300 so that the marine virtual experience ends when the user's biological condition remains unstable for a certain period of time compared to a preset standard.

Here, the preset standard refers to a normal biological state. Through this, users can prevent underwater safety accidents in advance.

The storage unit 630 stores content information about the marine virtual experience. The storage unit 630 stores information on evaluation results and biological conditions for each user. The storage unit 630 may be a flash memory type, hard disk type, media card micro type, card type memory (e.g. SD or XD memory, etc.), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory, magnetic disk. , and may include at least one storage medium among optical disks.

Hereinafter, a method of providing VR images for underwater monitoring according to the present invention will be described with reference to FIG. 7. Descriptions that overlap with the previously described embodiments will be omitted to some extent.

As shown, the method of using a virtual reality (VR) imaging system according to an embodiment of the present invention is a water mat 100 equipped with a detection sensor (S) and manufactured so that the user can feel the physical sensation of water while lying down. , a motion detection device 200 that detects the user's body movements, an experiential output device 300 that is worn on the user's head and outputs virtual reality content, and a detection sensor (S) of the water mat 100 and a terminal 400 capable of receiving data values from the motion detection device 200 and controlling virtual reality content output to the experiential output device 300, and the marine environment through the user's sight, hearing, and touch. It relates to a method of using a virtual reality (VR) imaging system including a content device 500 that creates a perceptible underwater environment.

First, there is a step (S10) of operating the motion detection device 200 to detect the user's body motion.

The S10 collects the user's body motion data through detection of the user's body motion.

There is a step (S20) in which the user wears the experiential output device 300 that outputs virtual reality content on his head. It is fixed to the head through the header portion 310, and detailed descriptions of this will be omitted as they are well-known. Also, I would like to make it clear that it is not limited to the method of fixing it to the head.

The virtual reality content is linked to the user's first-person or third-person perspective by matching body motion data detected from the motion detection device 200 through the user avatar. It works.

Next, the user lies down on the water mat 100 (S30), and the user equipped with the experience output device 300 lies on the water mat 100 and is ready to execute a virtual underwater experience.

Data values output from the detection sensor (S) and the motion detection device 200 of the water mat 100 are output to the experiential output device 300 and are reflected in virtual reality content (S40).

In other words, the underwater environment can be recognized through the user's visual, auditory, and tactile senses through the detection sensor (S), and the motion of the body is sensed from the motion detection device (200), allowing the user to freely move and move around underwater. It can give you a feeling.

In the next step, the management server 600 goes through a step of controlling the operation of the experiential output device 300 and the content device 500 (S50).

Here, the experiential output device 300 is waterproofed to enable acquisition and provides augmented reality or virtual reality images, and the content device 500 displays the underwater environment so that the marine environment is perceived by the user's visual, auditory, and tactile senses. Create.

The management server 600 transmits content information about the marine virtual experience to the experiential output device 300 and the content device 500, respectively, so that the experiential output device 300 and the content device 500 transmit the content information. Operate accordingly.

At this time, the experiential output device 300 and the content device 500 may be driven in conjunction with each other.

It is characterized by including a step (S60) in which the user experiences a virtual underwater environment through the reflected virtual reality content.

The motion detection device 200, which detects the user's body motion, includes a camera 210 and an image recognition module (not shown), and a detection sensor (S) of the water mat 100 and a motion detection device. It is preferable that the data values output from 200 be reflected in the virtual reality content output to the experiential output device 300 so that they can be directly projected from the experiential output device 300 or the terminal 400. do.

In the final step, the management server 00 monitors the progress of the maritime virtual experience performed through step S60 (S70).

The management server 600 can perform evaluation by analyzing the progress of each user's virtual experience, such as the underwater environment. That is, the management server 600 can evaluate the user's experience difficulty level, progress speed, experience completion status, etc. More preferably, the management server 600 can use the evaluation results to calculate the parts that the user lacks or complement and provide them to the user.

Additionally, the present invention can be used as an experiential education platform for an underwater environment based on virtual reality or augmented reality (Advanced Reality) using the terminal 400.

Hereinafter, a drawing will be attached to explain the virtual reality (VR)-based underwater environment experience education platform and the method of providing virtual reality (VR)-based underwater environment experience education.

Referring to FIG. 8, the VR education device 700 may include an HMD 710, a VR motion unit 720, and a display device 730.

The HMD 710 is worn on the user's head and has a glasses-shaped display unit, so that the 3D image received from the display device 730 can be output to the glasses-shaped display unit. Additionally, the HMD 710 can transmit the movement of the user's head (head tracking information) to the display device 730 and receive a 3D image according to the movement.

The motion recognition unit 720 is mounted on both hands of the user and can recognize the user's motion. At this time, the motion recognition unit 720 is mounted on the user's hand, has a motion sensor mounted on the joint area to recognize the user's joint movement, and is equipped with a vibration sensor to receive notifications according to the movement.

In addition, the motion recognition unit 720 is equipped with a laser and transmits an input signal by transmitting a laser to the display unit 733 of the display device 730, or serves as an interface such as touch, grab, and UI manipulation according to preset operations. You can also perform .

To this end, the motion recognition unit 720 generates reference position information when driven, and at this time, the reference position information can be displayed on the display screen of the display unit 733 by displaying the motion recognition unit 720 as a virtual hand such as a cursor. It becomes information that exists.

At this time, when movement occurs due to the movement or operation of the motion recognition unit 720, the virtual hand will be correspondingly displayed on the display screen of the display unit 733 based on the reference position information of the motion recognition unit 720. You can.

The display device 730 is a terminal installed with an app for providing educational services such as an underwater environment, and can provide educational content through communication with the server 800 and provide a UI (User Interface) for controlling the app.

The display device 730 performs user authentication when running the app, logs in, receives information from the user through the UI or selects customized content provided by the terminal 400, and transmits it to the server 800. You can receive simulation VR images that match user requests.

In addition, the display device 730 displays a VR image applied to the simulation received from the server 800 of the virtual hand according to the user motion recognized by the motion recognition unit 720 through the display unit 733, and displays the same VR image through the display unit 733. Images can also be displayed on the HMD (710). At this time, the VR image is a 360° image provided according to the movement of the HMD 710, and the display unit 733 can mirror and output the display image provided on the HMD 710.

FIG. 9 is a block diagram for explaining the configuration of the display device 730 of FIG. 8. The display device 730 may include a communication unit 731, a memory 732, a display unit 733, a control unit 734, and a remote provision unit 735.

The display device 730 serves to output marine images suitable for educational content information.

The display device 730 can transmit and receive wireless data with the server 800 through the communication unit 731, and can also transmit and receive data with the HMD 710 and the motion recognition unit 720 by being wired or wirelessly connected.

Data for driving, etc. may be stored in the memory 732, and VR marine image content to be simulated and played back in the display unit 733 may be stored.

The display unit 733 mirrors and displays the VR image output on the HMD 710 under the control of the control unit 734, and displays a cursor corresponding to the movement of the motion recognition unit 720 on the simulation content received from the server 800. It can be displayed by applying (not shown).

The control unit 734 controls the overall operation of the display device 730 and controls content received from the server 800 according to control commands (movement information, etc.) received from the HMD 710 and the motion recognition unit 720. This can be output to the HMD 710 and the display unit 733.

The remote provider 735 supports remote control of the terminal 400 through the server 800, and if you receive support for underwater video education remotely through the remote provider 735 or need help with training, Guides can be received through the terminal 400, and user-customized content executed by the terminal 400 can also be played through the display unit 733.

FIG. 10 is a configuration block diagram for explaining the server 800 of FIG. 8. As shown, the server 800 may include a DB 710, a content provider 720, a calculation unit 730, and a remote support unit 740.

The DB 710 may include an underwater environment DB, an educational content DB, a management DB, etc.

*The underwater environment DB can store information on various facilities and devices for building underwater environment facilities. For example, this may include fish/coral reef experience education, deep sea experience education, high pressure experience education, low water temperature experience education, low light experience education, and strong current experience education.

In addition, the underwater environment DB stores 3D images for each object (various images) of the education, the location of underwater creatures, etc., and contains content information about marine virtual education.

The educational content DB can store educational content such as preliminary training for virtual underwater experience, and step-by-step courses for learning induction and indirect experience can be matched and stored for each content.

Here, the course may be a preset action guided according to the learning purpose of each content. For example, educational content can be a variety of content about marine virtual experience, underwater tidal current experience, and the shape of structures (corals, caves, etc.) that model structures that actually exist in the ocean.

The management DB can store and manage management information of individual training participants, such as training participant information, customized content management, current participant training evaluation level, progress, etc.

The content provider 820 provides the content requested from the VR device 700 and the content remotely played by the terminal 400 to the corresponding VR device 700, and provides an underwater environment DB for marine experience or underwater life observation. When requesting content according to selection, an object matching the information selected by the user among objects stored in the underwater environment DB may be provided to the VR device 700. At this time, the selected object may be simulated and provided.

Alternatively, the object may be transmitted as is and simulated in the VR device 700.

At this time, the VR image displayed on the display unit 733 and the HMD 710 is placed in a pre-stored location whenever an object is selected through the UI and can be displayed as a simulation.

Additionally, objects in the constructed virtual underwater environment may be moved to a location according to user settings by the motion recognition unit 720.

In this way, when selecting an arbitrary underwater area, a simulation is provided in which each object (devices suitable for the underwater environment, etc.) selected by the user is automatically placed in an appropriate position, allowing the user to intuitively perceive the underwater environment.

Once the underwater environment is established, the content provider 820 can extract a plurality of necessary video contents and missions based on the corresponding information and provide a content list so that step-by-step learning can be performed.

The remote support unit 830 provides an environment for remote control of the terminal 400. At this time, remote control of the terminal 400 may be performed at the user's request or when the terminal 400 provides user-customized content.

When the construction of the underwater image environment is completed, the remote support unit 830 transmits the environmental information of the underwater image constructed through the terminal 400 and requests remote consultation to enable remote consultation between the VR device 100 and the terminal 400. make it happen.

At this time, consultation can take place in various forms such as real-time video chat, voice chat, and text chat.

Hereinafter, a method of providing VR-based marine education using the VR education device 700 will be described with reference to the drawings. We will omit the explanation of the platform and mediation described above to some extent. It is self-evident that the 'educator' mentioned below is the person who receives education on the underwater environment or the ocean.

Referring to FIG. 11, when an educator logs in through execution on the VR education device 700, a UI (User Interface) for building an underwater environment can be provided according to the educator's selection. When constructed in this way, underwater education can be performed by playing customized content according to the educator's learning stage.

When the educator selects the type of content education in the UI using the motion recognition unit 720, the display device 730 transmits information about the selected education to the server 800 (S110).

Next, the server 800 simulates and provides objects corresponding to the selected educational information, and the VR education device 700 can output a simulated VR image to the HMD 710 (S120). Additionally, the VR image of the HMD 710 may be mirrored and output on the display unit 733.

If the educator wishes to change the course, he or she may change the existing selected course to the desired course through the motion recognition unit 720.

Then, when the corresponding content is constructed through the selection of education, the server 800 can provide the corresponding underwater education based on the selected education (S130).

If there is a request for consultation by an educator, the corresponding information may be transmitted through the server 800 to the terminal of the administrator in charge of managing education (not shown). Through the administrator terminal, the administrator can check the content of the educator's consultation and respond to it through the server 800.

Next, the VR education device 100 can transmit the completion of education preparation to the server 800, and at the same time, the server 800 can provide underwater-related video content selected by the educator (S140).

Educators can perform education and learning in a virtual underwater environment through VR underwater images output to the HMD 710 and perform each movement using the motion recognition unit 720 (S150).

At this time, the educator's execution of underwater education and learning is transmitted to the administrator terminal through the server 800, and the administrator monitors it in real time through the administrator terminal. If the educator needs help, remote control can be performed from the outside. You can also (S160).

The administrator terminal may simultaneously monitor the educational activities of at least one educator.

Next, through monitoring the learning stages and performance of the educator's underwater education, the administrator selects relevant content for the educator's underwater education performance and content judged to be learning that requires reinforcement from the administrator's perspective as user-customized content to provide customized training. It can also be performed (S170).

At this time, the administrator can easily select content tailored to the educator through a collection of content related to the educator and a search service.

In this way, user-customized content selected by the administrator can be played on the VR education device 700 through remote control, and the server 800 provides customized training for the education matched to the content or the education selected in the terminal 400. This can be provided through education.

While the educator is performing underwater education and learning, the administrator performs monitoring and remote control in real time, and when the underwater education (learning) is completed, the VR education device (700) sends a signal to the server (800) that the underwater education has been completed. Transmit to (S180).

Those skilled in the art to which the present invention pertains as described above will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. Therefore, the above-described embodiments should be understood as illustrative and not restrictive.

The scope of the present invention is indicated by the appended claims rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

100: water mat 200: motion detection device

210: Video recording device

300: output device 310: head part

320: Speaker 330: Respiration sensor

340: Control unit 350: Video signal input unit

360: Voice signal input unit 400: Terminal

500: Content device 510: Underwater environment information provision server

520 ; Underwater content provision server 600: Management server

610: Communication unit 620: Server control unit

630: Storage unit S: Detection sensor

700: VR education device 710: HMD

720: Motion recognition unit 730: Display device

800: Server 810: DB

820: Content provision department 830: Remote support department

Claims

In the VR video and content provision system for underwater monitoring,

A water mat equipped with a detection sensor to allow users to lie down and feel the physical sensation of water;

A motion detection device consisting of an image capture device and an image recognition module to detect the user's motion;

A virtual experience output device worn on the user's head to provide a virtual reality image;

A terminal capable of controlling virtual reality content output to the virtual experience output device by receiving data from the detection sensor and the motion detection device of the water mat; It includes a management server that transmits content information about the underwater virtual experience to the virtual experience output device, drives the virtual experience output device and the terminal according to the content information, and monitors the progress of the marine virtual experience. A VR video and content provision system for underwater monitoring, characterized in that:
According to paragraph 1,

The detection sensor is a VR video and content provision system for underwater monitoring, characterized in that the underwater environment is recognized by the user's vision, hearing, and tactile senses.
According to paragraph 2,

The detection sensor includes a tilt sensor, an acceleration sensor, and an inertial sensor, and outputs data expressing the physical properties of water speed, water amount, and wavelength. A VR video and content provision system for underwater monitoring.
According to paragraph 1,

A VR video for underwater monitoring, characterized in that the bottom of the water mat further includes a driving means for driving the water mat, an air volume controller that provides wind for a realistic experience, and a spray controller that provides water droplets. Content provision system.