KR20160020136A - Training system for treating disaster using virtual reality and role playing game - Google Patents

Abstract

The present invention relates to a training system for preparing against disaster using virtual reality and RPG, more particularly relates to an effective system for setting various disasters in virtual reality, realizing a training program system for preparing against accident and using the training program system. A variable platform apparatus for a training simulator based on the virtual reality of the present invention comprises: a contents operation unit for managing various training contents corresponding to real working environment and determining a scenario for training contents to be operated by the training simulator based on the virtual reality; an image output unit for providing training contents selected by a user with a stereoscopic image by using an augmented reality technique; a user working tool unit for supporting one or more feedbacks from a visual sense, auditory sense, touch sense and smell sense so that the user can feel the same as in the real working environment according to the scenario of the training contents determined by the contents operation unit, based on a working tool similar to a working tool used in the real world; and a tracking unit for tracking in real time the user and working environment condition and generating input information of the training simulator based on the virtual reality according to the tracking result.

Description

[0001] The present invention relates to a virtual reality and RPG-

The present invention relates to a disaster situation coping education system utilizing virtual reality and RPG, and more particularly, to a system for setting a disaster situation as a virtual reality and implementing a training program system capable of coping with a safety accident, will be.

In recent years, due to the sudden increase in the number of school disasters and school safety accidents, the interest in school safety education has been heightened and the school safety education has been checked. However, the safety education has been insufficient due to unstructured safety education and non - specialist safety education. The need for an all-round safety education control tower to play a central role in school safety education has increased. Safety education is boring and inconclusive and does not really help. At present, the safety education is composed of text and simple video and is not a practical education for student safety education.

There is also a lot of problematic education about the actual situation. For example, existing training methods using actual tools in relation to fire include the use of consumable materials, limited training space, facility management issues, risk of novice safety hazards due to voltage, current, heat release, spatter, There are many difficulties such as passive response to training. In other words, the field requires highly skilled workers, but the problems listed above are obstacles to the efficient training process.

In order to solve these problems, it is necessary to create a virtual environment that is the same as the actual work environment, to minimize the difficulties caused by the above problems in the created virtual environment, Simulators have been developed. Virtual reality based training simulator is implemented with digital contents based on real-time simulation of training and training situation on the field, and has input / output interface device that user can directly interact with contents, . Using this, it is possible to carry out training with high economic efficiency and efficient process such as reduction of cost related to training and reduction of safety accident. Simulation systems are being developed to cope with various situations such as space, aviation, military, medical, education, and industrial sites. However, in the conventional virtual reality based training simulators, various work scenarios that can flexibly cope with all situations at the work site are not presented. Therefore, it has a limitation that it can not support the technical demand of consumers who want a virtual training-based simulator that can actively cope with various work sites and situations, and it is difficult to generate interest.

On the other hand, current computer games are able to control 3D digital graphic animation data such as Lineage <NCsoft> and Pristone Tail by game programming and control the video on a computer keyboard or a game machine in real time and enjoy the game. This is because unlike conventional 2D animation, 3D stereoscopic graphics are much better than real 3D scenes, and 3D stereoscopic virtual reality graphics are most effective for getting the most effective experience learning in safety education.

That is, many improvements are still needed in terms of efficiently presenting and responding to contents and contents of contents, inducing interest, and acquiring realistic and practical methods.

It is necessary for the educated person to take a picture of himself / herself and apply it to his character so that he / she can enjoy the education like experiencing various types of thinking as if he / she actually experienced it. We need a system that can realize mutual conversation through a single messenger of contents by using RPG and virtual reality in a specific space as well as a system for conveniently acquiring various contents. It should also be able to provide feedback on the content of the training and to be able to run on a wider variety of devices.

For this purpose, the present invention aims to implement various disaster situations and implement them through RPG and virtual reality.

First, it is not even in school. It is not a formal 'time-consuming' educational process. The safety education control tower is constructed as a systematic safety education. Secondly, the video and text education are not static education. The students lead the story in the center of safety accident and naturally form consciousness about safety. The third is to make safety education suitable for children's eye level by making content suitable for each stage level. Promote all-round safety education.

This design is composed of contents of safety education contents which can be easily installed and interlocked with software and general PC, so active safety education contents which enable students to learn safety education on their own body while playing games happily without regard to time and place to be.

Software scenario creation - Virtual reality 3D map construction - 3D graphic data creation - Character modeling - Computer programming / Equipped with a single messenger for sharing opinions and mutual opinions / Creating character after substituting room photos to implement individual identity / It should be developed so that users can play together.

In the hardware section, the screen glass covers the entire eyeball to provide full stereoscopic effect and immersion, and allows feedback through the Pen Tablet.

3D contents are created and applied to various safety education and safety accidents space.

It implements the safety education through the reality, and after wearing the screen glasses, the face is synthesized character in the virtual safety accident expected area, and the safety accident is overcome by the item and the safety action.

In the process, many students in the content play together and share and communicate with each other through the messenger attached to the contents. After experiencing the feedback through the Pen Tablet, etc., regardless of the specific device such as PC, Tablet, Mobile It should be able to operate on all devices. It is designed to use safety devices such as fire extinguishers and fire hydrants to indirectly use and experience through input devices (keyboard and mouse, etc.), and to develop emergency response measures such as CPR through all devices.

The system of the present invention accomplishes safety awareness not only for the awareness of safety accident but also for the experience of the children in the mountains among the mountains as well as for the active experience education through interest inducement. PC, and mobile, it is possible to freely work anywhere, and it is possible to cultivate the primary processing ability for safety accident as well as education. With the establishment of the control tower of safety education, it is possible to enjoy not only the contents of the safety education of the IT powerhouse but also the economic effect which can not be converted into money by the prevention of the safety accident of the future students. And Ansan safety experience hall cost 45 billion won). In addition, the production of this product will be produced jointly by industry and academia, and it will be expected to benefit from employment creation and academic value. Exports to the world can be expected through the "Global Safety Experience Training" have.

Through the inducement of interest, more practical education is provided, learning efficiency is improved, and feedback system is provided.

FIG. 1 is a view for explaining the construction of a variable platform apparatus for a virtual reality-based training simulator according to the present invention.
2 is a diagram for explaining in detail the detailed configuration of the video output unit of FIG.
3 is a diagram for explaining in detail the detailed configuration of the user work tool unit of FIG.
FIG. 4 is a diagram for explaining in detail the detailed structure of the tracking unit of FIG. 1;
5 is a diagram for explaining in detail the detailed configuration of the user interface unit of FIG.
6 is a diagram for explaining in detail the detailed configuration of the content management unit of FIG.
FIG. 7 is a diagram for explaining in detail the detailed configuration of the system management unit of FIG. 1;

Hereinafter, the present invention will be described.

FIG. 1 is a view for explaining the construction of a variable platform apparatus for a virtual reality-based training simulator according to the present invention. 1, a variable platform device 100 according to the present invention includes an image output unit 200, a user task tool unit 300, a tracking unit 400, a user interface unit 500, a content operation unit 600, And a system management unit 700. First, the variable platform device 100 of the present invention can be divided into three parts in the configuration of an upper part A / a middle part B / a lower part C, B) / subcontracting method C, the implementation method of the detailed components 200 to 700 may be replaced with a similar technology, or a part of the components may be omitted. The video output unit 200 provides a hardware device for presenting a training content to a user as a stereoscopic video using augmented reality technique in a form suitable for the user (worker) body and work environment. The user operation tool unit 300 is a hardware device that receives the same feeling (sight, hearing, tactile sense and smell) as that of the field work, using the same working tool as the real working scenario, to provide. The tracking unit 400 provides a hardware device that generates input information of the platform device 100 by tracking the user environment and the working environment using the platform device 100 in real time. The user interface unit 500 provides software for controlling the operation of the platform apparatus 100 using a graphical user interface (GUI) designed in a simple manner. The content management unit 600 provides software for determining content contents of the simulator. The system protection unit 700 provides a hardware device for the management and maintenance of the simulator.

FIG. 2 is a diagram for explaining the detailed configuration of the video output unit 200 of FIG. 1 in detail. 2, the image output unit 200 includes a stereoscopic display unit 210, a mixed reality-based information visualization unit 220, an LMD-based information visualization unit 230, and a variable platform control unit 240 Respectively. The stereoscopic display unit 210 utilizes a stereoscopic image apparatus that outputs left and right images separately, and determines a size and an arrangement structure of the stereoscopic image apparatus according to requirements of a task training scenario. The mixed reality-based information visualization unit 220 expresses additional information based on the mixed reality technology in a three-dimensional space of the image presented by the stereoscopic display unit 210. At this time, information is expressed using the see-through technique used in Augmented Reality.

The variable platform control unit 240 may be configured such that if the preceding two components 210,220 have a physical structure (e.g., size and weight) that the user can not carry, then the structure may be spatially and temporally Change the structure of an element. To this end, the variable-type platform control unit 240 receives physical information related to the user's body (for example, measurement values such as height and weight, and bio-signal monitoring information such as blood pressure, electromyogram, and electrocardiogram) (Not shown) capable of acquiring a signal. And a manual and automatic control unit (not shown) for receiving the information of the user interface unit 500 and changing the structure in a form required by the user. In addition, the image output unit 200 of the present invention includes a face-wearable display device for mixed reality environment and an LMD-based information visualization unit 230, A limitation of the spatial representation area of the display unit 210 and a simultaneous participation condition of a plurality of users. The mixed reality-based information visualization unit 220 and the LMD-based information visualization unit 230 receive and output the rendering result of the content operation unit 600, and control the stereoscopic image and the LMD image Exchange signals.

FIG. 3 is a diagram for explaining in detail the detailed configuration of the user work tool unit 300 of FIG. 3, the user task tool unit 300 of the present invention includes a task tool 310 specialized for a scenario, a task tool implementation unit 320 for each scenario, and a support unit 350, The tool 310 is implemented by the scenario-specific work tool implementer 320. The scenario-specific work tool implementer 320 is implemented to include other forms and functions according to the training scenarios. In more detail, the scenario-specific work tool implementer 320 receives the control information of the content management unit 600 to implement the multi-sensory feedback effect. The scenario-specific work tool implementation unit 320 implements the basic hardware configuration of the work tool 310 through the process shown below. a) A real work tool 321 used in a virtual work space to be implemented by a field or training simulator is acquired by 3D graphics modeling or an automation tool such as a 3D scanner to acquire three-dimensional shape and surface material information do. b) digitize the three-dimensional shape and surface material information using three-dimensional modeling 322; c) Finally, I / O-related parts (input sensors and output elements) necessary for the training scenarios are added inside the work tool. The task tool 310 specialized in the scenario thus implemented supports multi-sensory feedback in association with the support unit 350. [ The support unit 350 includes a visual feedback support unit 352, a tactile feedback support unit 352, a hearing feedback support unit 352, a smell feedback support unit 352, and a tracking support unit 330. The visual feedback support unit 352 delivers feedback information related to the work tool 100 to the worker by outputting information that stimulates the visual sense. The haptic feedback support 352 communicates feedback information associated with the task tool 100 to the worker with an output of physical and cognitive forces. The auditory feedback support unit 352 outputs the input / output information using the sound effect to the operator. The olfactory feedback support unit 352 provides input and output of information using the olfactory sense organ. The tracking support unit 330 exchanges information when acquiring a part or all of the position and attitude information of the work tool 100 in cooperation with the tracking unit 400. [

4 is a detailed view for explaining the detailed configuration of the tracking unit 400 of FIG. 4, the tracking unit 400 of the present invention includes a sensor based tracking information generating unit 410, a virtual sensor based tracking information generating unit 420, and a data DB based tracking information generating unit 430 . The sensor-based trace information generation unit 410 acquires physical data by attaching a sensor to a specific object in a contact or non-contact manner in order to measure a position, an attitude, a pressure, an acceleration, and a temperature. The virtual sensor-based trace information generating unit 420 is a virtual sensor that is simulated by software. The virtual sensor-based trace information generating unit 420 includes a physical sensor value measured by the sensor-based trace information generating unit 410, Output value or by converting the value of the third device through the user interface (for example, converting the input data value of the keyboard directional key into a value of the specific axis of the three-dimensional position sensor and presenting it). The data DB-based trace information generation unit 430 simulates the trace data recorded in the database DB as being generated by the current sensor at a predetermined period of time, and delivers the trace data to the other input values. The information of the tracked object is transmitted to the content management unit 600 and used as input data for the representation and simulation of the virtual entity.

FIG. 5 is a diagram for explaining in detail the detailed configuration of the user interface unit 500 of FIG. Referring to FIG. 5, the user interface unit 500 of the present invention includes a GUI operating unit 510 and a simulator control unit 520.

The GUI operating unit 510 enables a user to input operation setting of a platform apparatus and setting a scenario-related parameter based on a GUI (Graphic User Interface). Then, it exchanges information with the content management unit 600 to display the current status of the platform device. The simulator control unit 520 takes charge of exchanging posture change and guidance information of the variable platform apparatus with the video output unit 200 according to the training scenario conditions. The simulator control unit 520 includes a software function (a sequential program start-up by a batch process, and the like) that automates a series of drive processes for operating and managing an entire simulator in which a plurality of sensors, drivers, End) and a control signal generating device (power control and network communication).

FIG. 6 is a diagram for explaining the detailed configuration of the content management unit 600 of FIG. 1 in detail. 6, the content operation unit 600 includes a tracking data processing unit 610, a real-time operation simulation unit 620, a real-time result rendering unit 630, a user interface control unit 640, a user- (650), a network-based training DB (660), and a sensory feedback controller (670). The tracking data processing unit 610 processes the tracking information generated from the actual and virtual objects to be tracked through the tracking unit 400. The real-time job simulation unit 620 simulates the same situation as the reality based on the field scenarios utilizing the training simulator by software (computationally). To this end, the real-time task simulation unit 620 calculates a real-time task simulation result by using the simulation result of the real-time task simulator 622, which is stored in the actual experiment DB 622, Based on the experimental data of the experiment. Meanwhile, when various information is to be delivered to the user through the work interface and the output display device according to the scenario of using the simulator, the real-time job simulation unit 620 outputs the simulated result as an event format, and outputs the sensed feedback control unit 670 To the user operation tool unit (300).

In addition, the real-time job simulation unit 620 may be configured to perform various operations based on various job conditions and a plurality of users'

Work-based collaborative work environment is supported. In addition, the real-time simulation is calculated by using the training-related information that has been calculated in the past or performed in association with the network-based training DB 660. The calculated result is displayed on the video output unit 200 through the real-time result rendering unit 630. The multi-sensory feedback (visual, auditory, tactile, olfactory-related display device, and output device) control signals synchronized with this are processed through the sensory feedback controller 670. The 'user adaptive' function, which is a feature of the platform apparatus proposed by the present invention, is implemented mainly on the user-centered, variable platform control unit 650. The user-centered, variable-type platform control unit 650 processes the collected physical information (e.g., physical information and biometric information) of the user, the status information of the training content and the simulator hardware to determine the change information of the platform The user interface unit 640, and the user interface unit 500,

Handles the transmission of information.

FIG. 7 is a diagram for explaining the detailed configuration of the system management unit 700 of FIG. 1 in detail. Referring to FIG. 7, the system management unit 700 of the present invention includes a progress status output unit 710, a protection unit 720, a decomposition and connection support unit 730, and a remote management unit 740. The progress status output unit 710 allows a plurality of external observers to know the progress of the simulation content without being disturbed by the limited simulator workspace. The protection unit 720 provides for the installation and management of the platform device. The disassembly and linkage support unit 730 supports the movement of the platform device and facilitates the simultaneous installation of a plurality of platform devices. The remote management unit 740 manages a plurality of electronic control modules and a computer system connected to the platform apparatus proposed by the present invention. More specifically, the remote management unit 740 exchanges commands and status information through the remote control device and the wired / wireless network through operations such as operation and termination of each system, and setting of work conditions processed by the user interface unit 500 And processes the delivery of commands and messages so that they can be managed.

Claims (1)

A content type platform apparatus for a virtual reality based training simulator, comprising: a content management unit for managing various training content corresponding to an actual work environment and determining a scenario of training content to be operated in the virtual reality based training simulator; An image output unit for presenting the training content selected by the user as a stereoscopic image using an augmented reality technique; The user may use one or more of visual, auditory, tactile, and olfactory senses so that the user can feel the sensation felt in the actual working environment according to the scenario of the training contents determined by the content operation unit, User action tool to support sensory feedback; And a tracking unit for real time tracking user and work environment conditions to generate input information of the virtual reality based training simulator.

Images