KR101262848B1 - Apparatus of reconfigurable platform for virtual reality based training simulator - Google Patents

Abstract

The present invention relates to a variable platform apparatus for a virtual reality-based training simulator, and more particularly, to a variable-type platform apparatus for managing a variety of training contents corresponding to an actual work environment and determining a scenario of training content to be operated in a virtual reality-based training simulator; An image output unit for presenting the training content selected by the user as a stereoscopic image using an augmented reality technique; Based on the work tools similar to the work tools used in actual work, one or more senses such as sight, hearing, tactile sense, and sense of smell can be sensed so that the user can feel the sensation in the actual work environment according to the scenario of the training contents determined by the content management section User work tools to support feedback; And a tracking unit for generating input information of a virtual reality-based training simulator by tracking user and work environment conditions in real time. According to the present invention, an arbitrary worksite requiring a training and training process can be visualized on a real-time simulation basis, and thus can be widely used in all fields for advancing a scenario through user's activities.

Virtual, work, simulator, training, adjustable, platform, content

Description

[0001] APPARATUS OF RECONFIGURABLE PLATFORM FOR VIRTUAL REALITY BASED TRAINING SIMULATOR [0002]

The present invention relates to a variable platform apparatus and method for a virtual reality based training simulator. More particularly, the present invention relates to an apparatus and method for adapting a platform of a virtual reality-based training simulator by accommodating various work environments and user-oriented requirements.

Existing training methods using actual tools include the use of consumable materials, limited training space, management of facilities, voltage, current, heat emission, risk of safety risk for beginners by spatters, and passive response to training There are many difficulties. In other words, the field requires highly skilled workers, but the problems listed above are obstacles to the efficient training process.

In order to solve these problems, it is necessary to create a virtual environment that is the same as the actual work environment, to minimize the difficulties caused by the above problems in the created virtual environment, Simulators have been developed.

Virtual reality based training simulator is implemented with digital contents based on real-time simulation of training and training situation on the field, and has input / output interface device that user can directly interact with contents, . Using this, it is possible to carry out training with high economic efficiency and efficient process such as reduction of cost related to training and reduction of safety accident. Simulation systems are being developed to cope with various situations such as space, aviation, military, medical, education, and industrial sites.

However, in the conventional virtual reality based training simulators, various work scenarios that can flexibly cope with all situations at the work site are not presented.

Therefore, it has a limitation that it can not support the technical demand of consumers who want a virtual training-based simulator capable of actively coping with various work sites and situations.

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above problems,

The object of the present invention is to provide a variable platform device for a virtual reality-based training simulator capable of actively coping with various work sites and situations by accommodating user-oriented requirements.

In particular, by presenting an example of a virtual welding training simulator as an embodiment of the present invention, various welding work posture scenarios that are not solved by existing technologies are supported, and a feeling (visual, auditory, tactile, And the like) to be experienced by the user in the same manner.

A variable platform device for a virtual reality based training simulator of the present invention includes a content management unit for managing various training contents corresponding to an actual working environment and determining a scenario of training content to be operated in the virtual reality based training simulator; An image output unit for presenting the training content selected by the user as a stereoscopic image using an augmented reality technique; The user may use one or more of visual, auditory, tactile, and olfactory senses so that the user can feel the sensation felt in the actual working environment according to the scenario of the training contents determined by the content operation unit, User action tool to support sensory feedback; And a tracking unit for generating input information of the virtual reality based training simulator by tracking user and work environment conditions in real time.

According to the present invention, the following effects can be expected.

By replacing the cost required to construct the same training system as the actual working environment and the consumable cost due to the consumption of the training material with the virtual reality data, the economic gain can be achieved through cost reduction.

Particularly, in the case of the virtual welding training simulator shown in the embodiment of the present invention, it is possible to more effectively utilize the training space, the preparation time, and the post-training work time according to various work structures, It can reduce the risk of injury and can help to train skilled workers.

In addition, the present invention can be widely applied to all fields for advancing scenarios through user's activities by visually visualizing any work site requiring a training and training process based on a real-time simulation.

The present invention will now be described in detail with reference to the accompanying drawings. Hereinafter, a repeated description, a known function that may obscure the gist of the present invention, and a detailed description of the configuration will be omitted. Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art. Accordingly, the shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.

Prior to describing the present invention, the present invention relates to a variable platform apparatus and method for a virtual reality-based training simulator, and proposes a platform apparatus capable of implementing various training task scenarios in which a user carries out a specific tool.

In addition, a design and operation method of a welding work training simulator is presented as a concrete example.

FIG. 1 is a view for explaining the construction of a variable platform apparatus for a virtual reality-based training simulator according to the present invention.

1, a variable platform device 100 according to the present invention includes an image output unit 200, a user task tool unit 300, a tracking unit 400, a user interface unit 500, a content operation unit 600, And a system management unit 700.

First, the variable platform device 100 of the present invention can be divided into three parts in the configuration of an upper part A / a middle part B / a lower part C, B) / subcontracting method C, the implementation method of the detailed components 200 to 700 may be replaced with a similar technology, or a part of the components may be omitted.

The video output unit 200 provides a hardware device for presenting a training content to a user as a stereoscopic video using augmented reality technique in a form suitable for the user (worker) body and work environment.

The user operation tool unit 300 is a hardware device that receives the same feeling (sight, hearing, tactile sense and smell) as that of the field work, using the same working tool as the real working scenario, to provide.

The tracking unit 400 provides a hardware device that generates input information of the platform device 100 by tracking the user environment and the working environment using the platform device 100 in real time.

The user interface unit 500 provides software for controlling the operation of the platform apparatus 100 using a graphical user interface (GUI) designed in a simple manner.

The content management unit 600 provides software for determining content contents of the simulator.

The system protection unit 700 provides a hardware device for the management and maintenance of the simulator.

Hereinafter, each of the components shown in FIG. 1 will be described in detail with reference to the drawings.

FIG. 2 is a diagram for explaining the detailed configuration of the video output unit 200 of FIG. 1 in detail.

2, the image output unit 200 includes a stereoscopic display unit 210, a mixed reality-based information visualization unit 220, an LMD-based information visualization unit 230, and a variable platform control unit 240 Respectively.

The stereoscopic display unit 210 utilizes a stereoscopic image apparatus that outputs left and right images separately, and determines a size and an arrangement structure of the stereoscopic image apparatus according to requirements of a task training scenario.

The mixed reality-based information visualization unit 220 expresses additional information based on the mixed reality technology in a three-dimensional space of the image presented by the stereoscopic display unit 210. At this time, information is expressed using the see-through technique used in Augmented Reality.

The variable platform control unit 240 may be configured such that if the preceding two components 210,220 have a physical structure (e.g., size and weight) that the user can not carry, then the structure may be spatially and temporally Change the structure of the element.

To this end, the variable-type platform control unit 240 receives physical information related to the user's body (for example, measurement values such as height and weight, and bio-signal monitoring information such as blood pressure, electromyogram, and electrocardiogram) (Not shown) capable of acquiring a signal. And a manual and automatic control unit (not shown) for receiving the information of the user interface unit 500 and changing the structure in a form required by the user.

In addition, the image output unit 200 of the present invention can be applied to a face-wearable display device for a mixed reality environment and Korean Patent Laid-Open Publication No. 0809479 (Layered Multiple Displays for Immersive and Interactive Digital The LMD-based information visualization unit 230 is provided as in the contents of Int. Conf. Of Entertainment Computing, UK, 2006. The limitation of the spatial representation area of the stereoscopic display unit 210 and the simultaneous participation And realizes the function of visualizing the discrimination of information about the condition.

The mixed reality-based information visualization unit 220 and the LMD-based information visualization unit 230 receive and output the rendering result of the content operation unit 600, and control the stereoscopic image and the LMD image Exchange signals.

FIG. 3 is a diagram for explaining in detail the detailed configuration of the user work tool unit 300 of FIG.

3, the user task tool unit 300 of the present invention includes a task tool 310 specialized in a scenario, a task tool implementation unit 320 for each scenario, and a support unit 350, The work tool 310 is implemented by the scenario-specific work tool implementer 320.

The scenario-specific work tool implementer 320 is implemented to include other forms and functions according to the training scenarios. The scenario-specific work tool implementation unit 320 receives the control information of the content operation unit 600 and implements the multi-sensory feedback effect.

The scenario-specific work tool implementation unit 320 implements the basic hardware configuration of the work tool 310 through the process described below.

a) A real work tool 321 used in a virtual work space to be implemented by a field or training simulator is acquired by 3D graphics modeling or an automation tool such as a 3D scanner to acquire three-dimensional shape and surface material information do.

b) digitize the three-dimensional shape and surface material information using three-dimensional modeling 322;

c) Finally, I / O-related parts (input sensors and output elements) necessary for the training scenarios are added inside the work tool.

The task tool 310 specialized in the scenario thus implemented supports multi-sensory feedback in association with the support unit 350. [

The support unit 350 includes a visual feedback support unit 352, a tactile feedback support unit 352, a hearing feedback support unit 352, a smell feedback support unit 352, and a tracking support unit 330.

The visual feedback support unit 352 delivers feedback information related to the work tool 100 to the worker by outputting information that stimulates the visual sense. The haptic feedback support 352 communicates feedback information associated with the task tool 100 to the worker with an output of physical and cognitive forces. The auditory feedback support unit 352 outputs the input / output information using the sound effect to the operator. The olfactory feedback support unit 352 provides input and output of information using the olfactory sense organ. The tracking support unit 330 exchanges information when acquiring a part or all of the position and attitude information of the work tool 100 in cooperation with the tracking unit 400. [

4 is a detailed view for explaining the detailed configuration of the tracking unit 400 of FIG.

4, the tracking unit 400 of the present invention includes a sensor based tracking information generating unit 410, a virtual sensor based tracking information generating unit 420, and a data DB based tracking information generating unit 430 .

The sensor-based trace information generation unit 410 acquires physical data by attaching a sensor to a specific object in a contact or non-contact manner to measure a position, an attitude, a pressure, an acceleration, and a temperature.

The virtual sensor-based trace information generating unit 420 is a virtual sensor that is simulated by software. The virtual sensor-based trace information generating unit 420 includes a physical sensor value measured by the sensor-based trace information generating unit 410, Output value or by converting the value of the third device through the user interface (for example, converting the input data value of the keyboard directional key into a value of the specific axis of the three-dimensional position sensor and presenting it).

The data DB-based trace information generation unit 430 simulates the trace data recorded in the database DB as being generated by the current sensor at a predetermined period of time, and delivers the trace data to the other input values.

The information of the tracked object is transmitted to the content management unit 600 and used as input data for the representation and simulation of the virtual entity.

FIG. 5 is a diagram for explaining in detail the detailed configuration of the user interface unit 500 of FIG.

Referring to FIG. 5, the user interface unit 500 of the present invention includes a GUI operating unit 510 and a simulator control unit 520.

The GUI operating unit 510 enables a user to input operation setting of a platform apparatus and setting a scenario-related parameter based on a GUI (Graphic User Interface). Then, it exchanges information with the content management unit 600 to display the current status of the platform device.

The simulator control unit 520 takes charge of exchanging posture change and guidance information of the variable platform apparatus with the video output unit 200 according to the training scenario conditions. The simulator control unit 520 includes a software function (a sequential program start-up by a batch process, and the like) that automates a series of drive processes for operating and managing an entire simulator in which a plurality of sensors, drivers, End) and a control signal generating device (power control and network communication).

FIG. 6 is a diagram for explaining in detail the detailed configuration of the content operating unit 600 of FIG.

6, the content operation unit 600 includes a tracking data processing unit 610, a real-time operation simulation unit 620, a real-time result rendering unit 630, a user interface control unit 640, a user- (650), a network-based training DB (660), and a sensory feedback controller (670).

The tracking data processing unit 610 processes the tracking information generated from the actual and virtual objects to be tracked through the tracking unit 400.

The real-time job simulation unit 620 simulates the same situation as the reality based on the field scenarios utilizing the training simulator by software (computationally).

To this end, the real-time task simulation unit 620 calculates a real-time task simulation result by using the simulation result of the real-time task simulator 622, which is stored in the actual experiment DB 622, Based on the experimental data of the experiment.

Meanwhile, when various information is to be delivered to the user through the work interface and the output display device according to the scenario of using the simulator, the real-time job simulation unit 620 outputs the simulated result as an event format, and outputs the sensed feedback control unit 670 To the user operation tool unit (300).

In addition, the real-time job simulation unit 620 supports a network-based collaborative work environment in response to various job conditions and a plurality of users' participation. In addition, the real-time simulation is calculated by using the training-related information that has been calculated in the past or performed in association with the network-based training DB 660. The calculated result is displayed on the video output unit 200 through the real-time result rendering unit 630. The multi-sensory feedback (visual, auditory, tactile, olfactory-related display device, and output device) control signals synchronized with this are processed through the sensory feedback controller 670.

The 'user adaptive' function, which is a feature of the platform apparatus proposed by the present invention, is implemented mainly on the user-centered, variable platform control unit 650.

The user-centered, variable-type platform control unit 650 processes the collected physical information (e.g., physical information and biometric information) of the user, the status information of the training content and the simulator hardware to determine the change information of the platform , And processes the collection of related information and the transfer of change information via the user interface unit 640 through the user interface control unit 640.

FIG. 7 is a diagram for explaining the detailed configuration of the system management unit 700 of FIG. 1 in detail.

Referring to FIG. 7, the system management unit 700 of the present invention includes a progress status output unit 710, a protection unit 720, a decomposition and connection support unit 730, and a remote management unit 740.

The progress status output unit 710 allows a plurality of external observers to know the progress of the simulation content without being disturbed by the limited simulator workspace.

The protection unit 720 provides for the installation and management of the platform device.

The disassembly and linkage support unit 730 supports movement of the platform device and facilitates simultaneous installation of a plurality of platform devices.

The remote management unit 740 manages a plurality of electronic control modules and a computer system connected to the platform apparatus proposed by the present invention. More specifically, the remote management unit 740 exchanges commands and status information through the remote control device and the wired / wireless network through operations such as operation and termination of each system, and setting of work conditions processed by the user interface unit 500 And processes the delivery of commands and messages so that they can be managed.

In the above, FIGS. 1 to 7 illustrate the construction and operation of a comprehensive model of the core features proposed by the present invention.

According to the present invention having the above-described configuration, economical benefits can be obtained by replacing the cost required for constructing the training system of the actual work environment and the consumable cost due to the consumption of the training material to a virtual reality system and digital data have.

 And it is expected to reduce the risk of potential safety accidents in actual working environment.

In particular, in the case of the 'virtual welding training simulator' presented in the embodiment of the present invention to be described later, it is possible to more efficiently utilize the training space, the preparation time, and the post-training work time according to various work structures, It can reduce the risk of accidents and can help train skilled workers.

In addition, the present invention can be utilized in all fields that visualize any work phenomenon requiring education and training process on the basis of real-time simulation and proceed the scenario through the user's physical activity.

Hereinafter, embodiments of the present invention will be described with reference to the results of applying some functions of the present invention to specific and limited examples of 'welding training scenario'.

FIG. 8 is an exemplary diagram illustrating a configuration of a virtual welding training simulator according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 8, the virtual welding training simulator of the present invention is designed so that the user can work inside the simulator. To this end, the simulator of the present invention includes an image output unit 1200, a user operation tool unit 1300, a tracking unit 1400, a user interface unit 1500, a content operation unit 1600, and a system management unit 1700 .

The video output unit 1200 presents the welding training contents to the user as a stereoscopic video using augmented reality technique in a form suitable for the user's body information and the welding training task scenario.

The user operation tool unit 1300 incorporates a virtual sound effect and a vibration effect based on the same external shape (welding torch shape) and function as the work tool on the spot. In other words, it provides a hardware device that can receive the same feeling (visual, auditory, tactile, and olfactory) as the field work with the same interaction method as the field work based on the same work tool as in the real work scenario.

The tracking unit 1400 generates the input information of the virtual welding training simulator by real-time tracking of the user and the working environment using the virtual welding training simulator.

The user interface unit 1500 provides a user interface for controlling the operation conditions of the virtual welding training simulator, controlling the change of the mechanism portion, and analyzing the results of the operation.

The content management unit 1600 stores various software programs for virtual welding training.

The system management unit 1700 is responsible for protection of the entire system and output of external observer information. More specifically, as shown in FIG. 11, the system management unit 1700 is provided with an output port for external display so that the external observer can view the work contents in the training simulator.

Each of the booths has a hinge-type connection unit so that a plurality of welding training booths can be connected to the system management unit 1700, and an internal image is displayed on an external monitoring monitor through a monitor router (KVM switch) So that it can selectively output. At this time, the outer case of each booth is preferably made of a transparent material so that the inside can be seen.

In addition, the system management unit 1700 includes a remote management module. Here, the remote management module is used to control the power management and system control of a virtual welding training simulator including a plurality of PCs and electronic sensors such as electronic sensors, by a user (for example, a training teacher) Based portable system management device.

In addition, a training simulator is provided with a web server capable of processing an Internet service, so that contents of the user interface unit 1500 can be controlled by a web browser, The system can be easily controlled.

FIG. 9 is a diagram for explaining the detailed configuration of the video output unit 1200 of FIG. 8 in detail.

9, the stereoscopic display unit 1210 of FIG. 9 includes a planar stereoscopic display 1211 for separating left and right binocular visual images and presenting them to a user, and a stereoscopic display unit for displaying a stereoscopic image in a use space of the user's operation tool unit 1300 And a translucent reflecting mirror and a filter portion 1212 for reflecting light. At this time, the translucent reflecting mirror and filter unit 1212 facilitate separation and presentation of left and right visual images due to irregular reflection of the image reflected from the planar stereoscopic display 1211 and polarizing effect. As an implementation example, a reflective mirror with a transmittance of 70% and a quarter wave retarder filter were attached. That is, in the case of the LCD panel stereoscopic image panel and the LCD shutter eyeglass in general, the phase is reversed when reflected to the mirror, so that the stereoscopic image can not be seen.

In order to solve such a problem, the present invention solves the problem that the phase is inverted by providing a retarder on the reflection mirror so that the stereoscopic image reflected on the mirror surface can be normally viewed.

The values of d1, d2, θ1, and θ2 of the variable platform control unit 1240, the user body information measurement unit 1241 and the stereoscopic display unit 1210 are used for control in the variable platform control unit 1240 in FIG.

The user body information measuring unit 1241 includes a sensor for measuring the size of the user's elongation. The user interface unit 1500 determines the height value setting of the simulator determined according to the job scenario based on the value measured by the sensor, and adjusts the height of the simulator so that the designated training job can be performed A display device structure change by a user's operation or a motor drive unit to automatically move to a designated position).

The variable-type platform control unit 1240 controls the variable platform controller 1240 such that h (height value of the stereoscopic display unit 1210), pi (rotation value of the stereoscopic display unit 1210), and stereoscopic image structure D2,? 1,? 2 are adjusted so as to be visible at the designated position.

The optimal values for the respective variables are stored in advance in the job database, and the simulator outputs a guidance message to the user to modify the stereoscopic display portion 1210 to a specified value. At the same time, a sensor (rotation, height, and movement distance measurement sensor) for detecting the corresponding value is provided in each element to monitor the structural transformation process of the simulator.

In the embodiment of the present invention, as shown in the figure of the variable platform control unit 1240 in FIG. 9, the related variable setting values of the stereoscopic display unit 1210 for the ceiling-front-down view work are stored in advance. And an algorithm for correcting some of the values by reflecting them. The pressure distribution measuring sensor installed at the bottom of the simulator of the user body information measuring unit 1241 tracks the distribution of the pressure according to the position and weight distribution of the user's foot, and utilizes the information as the work posture guide and the training condition monitoring information.

The LMD-based information visualization unit 230, which is not shown in FIG. 9, has a disadvantage of the narrow stereoscopic image subspace of the presented stereoscopic display module 1210 (not a complete visual immersion type display device, It can be used to supplement image presentation space for virtual work environment visualization and visualization function of personal information and public information for multi - party participation).

FIG. 10 is an exemplary view for explaining a work tool applied to a virtual welding training simulator according to the present invention.

Referring to FIG. 10A, a work tool (welding torch) according to an embodiment of the present invention is implemented based on three-dimensional model data obtained through a three-dimensional scanning process of a welding tool used in the field.

The welding torch has an internal layout space to accommodate various output devices (tactile, olfactory, auditory, visual, etc.) to support multiple sensory feedback effects. Then, the physical shape of the work tool is produced by using the 3D printing technology at the time of production.

The inside of the welding torch is equipped with an infrared light sensor or a reflection sensor for tracking 6 degrees of freedom (position and orientation). In order to simulate the three-dimensional sound effect, a small-sized speaker is embedded in the end portion of the welding torch where the sound is generated in the actual welding operation, or a plurality of holes are provided in the front of the speaker So that the sound spreads radially. Thus, the mono sound output alone moves the working tool in the user's hand, thereby changing the position of the sound source, thereby supporting three-dimensional spatial sound feedback.

As a visual feedback function for guiding the use of the working tool, a laser pointing device is built in the working tool so that the position where the virtual welding bead is generated can be displayed. Using a lens with a focal length that matches the CTWD (Contact Tip to Work Distance) and an optical pattern to be used, the pattern should be clearly visible when the end of the welding torch and the welding torch are at proper distances. To convey visual feedback about the working distance. Inside the work tool, a mini vibration motor is built in to reproduce the vibration effect generated in specific welding work conditions.

In addition, a tactile feedback support unit 1362 formed in a detachable form is additionally mounted on the planar stereoscopic display device 1211 so that a physical object and an image coexist in the same space, (See Fig. 10 (b)).

In other words, the user can obtain the tactile feedback effect due to the physical contact between the welding torch and the base material because the actual model of the shape coinciding with the virtual welding base block coincides with the three-dimensional space, This is possible.

In addition, in the embodiment of the present invention, a heating unit and a cooling unit having a fast heating and cooling speed are built in the welding torch portion to express the heat sensation of the welding flame, and the heat effect generated in the welding operation is transmitted to the user.

FIG. 11 is an exemplary view for explaining a tracking unit applied to a virtual welding training simulator according to the present invention. FIG.

Referring to FIG. 11, the tracking unit 1400 according to the embodiment of the present invention detects a position of a user's head (eye position & orientation) in order to accurately generate a stereoscopic image and a space of a stereoscopic display device in which a virtual welding base material is visualized. And posture must be accurately tracked. To this end, a camera-based tracking sensor 1331 was attached to the tracked object. In addition, a stable tracking space 1412 based on a plurality of cameras is defined through a 3D simulation-based pre-simulation calculation process of a space capable of stably tracking an object using a minimum number of cameras. That is, in the image acquisition in each of the three camera-based sensor tracking devices 1411, the information of the space input through the camera lens can be defined in a form similar to a cone. In the case of a camera that obtains two-dimensional image information, it is necessary to have at least two pieces of image information so that the three-dimensional position of the target can be restored. Therefore, in order to use the least number of cameras and to keep stable tracking, And a virtual welding base material, a welding torch, and a marker attached to the stereoscopic glasses worn by the user are included in the interior.

Also, in the embodiment of the present invention, a multi-camera based stable tracking space 1412 is implemented in order to use the minimum number of cameras and minimize the size of the simulator system.

FIG. 12 is an exemplary view for explaining a user interface unit applied to a virtual welding training simulator according to the present invention. FIG.

The user interface unit of the present invention is implemented on the touch screen on the basis of a graphic-user-interface (GUI) so that data can be easily input. Further, a joint can be provided at the connecting link portion so that the user can easily operate the apparatus, and the height can be freely adjusted.

Fig. 12 shows an example in which training work conditions are set, a device change guide, visualization of a training guide information, and execution of a program for analysis of a work result.

12, the user selects a specific task scenario 1511 and outputs a change guide of the hardware based on the difference between the current state and the target state measured from the sensors attached to the inside of the simulator apparatus 1521 ).

The user changes the system to the target form (or operates the automatic transfer device using the motor) (1522). In the embodiment, the user can adjust the display height h, the display unit rotation value?, The rotation value? Of the reflection mirror unit, and the distance value d of the reflection mirror unit in accordance with the system guide.

After the adjustment work, the user interface section visualizes the learning contents of the work guide, and after completion of the training work, the work result analysis tool is executed to perform the result analysis and evaluation process (1523).

As shown in FIG. 12, the result of the welding work (three-dimensional bead shape) is visualized and the three-dimensional object is easily rotated by the touch screen interaction, and the working parameters related to the welding section value at the desired position are examined. In addition, the training contents can be inquired and updated.

13 is a view for explaining a content operating unit applied to a virtual welding training simulator according to the present invention.

Referring to FIG. 13, a field test environment is constructed for various kinds of welding work conditions by a preliminary work for the real-time work simulation unit 1620, and experimental specimens are prepared to determine the external shape and cross-sectional structure of the weld bead And DB for experimental test sample was constructed. In addition, a database for virtual experiment samples was constructed using a numerical model based on the algorithm for generating weld beads in terms of supplementing the experimental test sample DB. Then, we implemented the optimization based real - time virtual simulation (1621) by learning the neural network which can output the bead shape of hardened state according to various input values by using the DB for the constructed experimental sample.

The real-time operation simulation unit 1620 determines the appearance of the welding bead based on the movement of the user's operation tool unit 1300 and the input of the training operation setting condition value 1610. [ Then, the real-time result rendering unit 1630 visualizes and stores information in the network-based training DB 1660, or obtains a result of a preliminary work on a specific condition from the DB and performs rendering.

In a case where a specific condition is satisfied according to the progress of the real-time training work (for example, vibration, sound, and visual feedback event occurrence condition is satisfied), the multi-sensory feedback control unit 1670 transmits a message to the user operation tool unit 1300 Outputs the same physical effects (eg, sound and vibration) and task guide information as the task. The user interface control unit 1640 and the user-centered platform control unit 1650 perform functions associated with the user interface unit 1500.

14 is a view for explaining a system management unit applied to a virtual welding training simulator according to the present invention.

Referring to FIG. 14, the system management unit 1700 of the present invention includes an output port for an external display so that an external observer can view the content of the internal stereoscopic display and the contents of the touch screen monitor, as shown in FIG. In addition, a plurality of welding training booths are connected and installed so that they can be connected and operated (see FIG. 16). Then, it can selectively output the internal image to the external monitoring monitor through the monitor router (KVM switch).

As shown in the upper left figure of FIG. 8, the outer case is made of a transparent material so that the inside can be seen.

The system management unit 1700 shown in FIG. 14 is a system in which a user (e.g., a training teacher) outside the training booth apparatus can easily control power management and system control of a virtual welding training simulator including a plurality of PCs and electronic devices such as electronic sensors, And communicates with a portable wireless communication terminal (e.g., smart phone, PDA, mobile phone, etc.) equipped with a web browser through a remote management unit (not shown). Accordingly, the user can remotely control the virtual welding training simulator using the web browser of the portable wireless communication terminal.

FIG. 15 is an exemplary view for explaining an operation method and an installation example of a virtual welding training simulator according to the present invention, and the respective reference numerals are as follows.

1: Virtual Welding Training Simulator in a Protective Transparent Case

2: System operation with central control switch (power on) or portable control unit

3: Setting of work environment (welding method, welding rod, base material type, voltage, current, welding posture, etc.)

4a: Outputting a message for changing the position of the display device to fit the selected working posture

5a and 6a: a process of manually changing the platform to suit the working posture (or automatic change using the motor drive)

7a: Best Practices Guide for selected welding tasks

8a: Stereo image wearing glasses for stereoscopic display

9a: Observation of virtual work guide information projected in real space training work space using stereoscopic display device

10a: Frontal view work training conducted

10b: Do the following work training exercises

10c: Performing training on top (ceiling) view

11: Check the work results visualized on the touch screen (three-dimensional model structure of bead pattern, cross-section structure and training element measurement graph)

12: If you want other (posture) work training, go to 'work environment setting step with reference number 3'

13: End of the job

A: A display device for simultaneously displaying images output to the stereoscopic display device and images output to the touch screen monitor for an observer outside the simulator

I: Example of installation of virtual welding training simulator similar to industrial welding training laboratory

16 is an illustration of a training room based on a virtual welding training simulator according to the present invention. 17 and 18 are views showing an example of a configuration (for educational institutions) of a virtual training simulator according to the present invention.

As described above, according to the present invention, it is possible to more effectively utilize the training space, the preparation time, the training time after the training, etc. according to various work structures and reduce the risk of the novice safety accident, It can help train skilled workers. In addition, visualization of arbitrary work sites that require training and training processes based on real-time simulation can be widely used in all fields for driving scenarios through user's activities.

Some of the steps of the present invention can be implemented as computer readable code on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, CD-RW, magnetic tape, floppy disk, HDD, optical disk, magneto optical storage, , Transmission over the Internet). The computer readable recording medium may also be distributed over a networked computer system and stored and executed in computer readable code in a distributed manner.

As described above, an optimal embodiment has been disclosed in the drawings and specification. Although specific terms have been employed herein, they are used for purposes of illustration only and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, those skilled in the art will appreciate that various modifications and equivalent embodiments are possible without departing from the scope of the present invention. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

FIG. 1 is a view for explaining the construction of a variable platform apparatus for a virtual reality-based training simulator according to the present invention.

2 is a diagram for explaining in detail the detailed configuration of the video output unit of FIG.

3 is a diagram for explaining in detail the detailed configuration of the user work tool unit of FIG.

FIG. 4 is a diagram for explaining in detail the detailed structure of the tracking unit of FIG. 1;

5 is a diagram for explaining in detail the detailed configuration of the user interface unit of FIG.

6 is a diagram for explaining in detail the detailed configuration of the content management unit of FIG.

FIG. 7 is a diagram for explaining in detail the detailed configuration of the system management unit of FIG. 1;

FIG. 8 is an exemplary diagram illustrating a configuration of a virtual welding training simulator according to an embodiment of the present invention. Referring to FIG.

FIG. 9 is a diagram for explaining the detailed configuration of the video output unit of FIG. 8 in detail.

FIG. 10 is an exemplary view for explaining a work tool applied to a virtual welding training simulator according to the present invention.

FIG. 11 is an exemplary view for explaining a tracking unit applied to a virtual welding training simulator according to the present invention. FIG.

FIG. 12 is an exemplary view for explaining a user interface unit applied to a virtual welding training simulator according to the present invention. FIG.

13 is a view for explaining a content operating unit applied to a virtual welding training simulator according to the present invention.

14 is a view for explaining a system management unit applied to a virtual welding training simulator according to the present invention.

15 is an exemplary view for explaining an operation method and an installation example of a virtual welding training simulator according to the present invention.

16 is an illustration of a training room based on a virtual welding training simulator according to the present invention.

17 and 18 are views showing an example of a configuration (for educational institutions) of a virtual training simulator according to the present invention.

Description of the Related Art

100: variable platform device 200: video output unit

210: stereoscopic display unit 220: mixed reality-based information visualization unit

230: LMD-based information visualization unit 240: Variable platform control unit

300: User action tool 310: Scenario-specific action tool

320: Scenario-specific work tool implementation section 350: Support section

400: tracking unit 410: sensor-based tracking information generating unit

420: virtual sensor-based tracking information generation unit 430: data DB-based tracking information generation unit

500: user interface unit 510: GUI control unit

520: simulator control unit 600:

610: tracking data processing unit 620: real-time job simulation unit

630: Real-time result rendering unit 640: User interface control unit

650: User-centric, variable platform control

660: network-based training DB 670: sensory feedback control

700: system management unit 710: progress status output unit

720: Protection section 730: Disassembly and connection support section

740:

Claims (10)

The present invention relates to a variable platform apparatus for a virtual reality based training simulator, A content management unit for determining a scenario of training content corresponding to the virtual reality based training simulator; A video output unit for presenting a training content selected by a user as a stereoscopic video; A user task tool for supporting sensory feedback of sight, hearing, tactile sense, and sense of smell so that the user can feel a sensation felt in an actual working environment according to a scenario of the training content determined by the content managing unit; And And a tracking unit for generating the input information of the virtual reality based training simulator by tracking the user and the working environment state in real time through the sensor and transmitting the input information to the content management unit, Wherein the user task tool unit comprises: a visual feedback support unit for delivering visual sensory feedback information related to a virtual work tool to the user; a tactile feedback support unit for transmitting sensory feedback information of a tactile sense related to the virtual work tool to the user; An auditory feedback support unit for delivering auditory sense feedback information related to a virtual work tool to the user and a sense feedback support unit for delivering sense sense feedback information related to the virtual work tool to the user A Variable Platform Device for Virtual Reality Based Training Simulator. The method according to claim 1, The content operating unit A tracking data processing unit for processing tracking information generated from actual and virtual objects to be tracked; A simulation unit for calculating a real time simulation corresponding to the same situation as the reality; A rendering unit that provides a result of rendering the real-time simulation to a user through the image output unit; A sensory feedback controller for processing the multi-sensory feedback control signal corresponding to the rendered result; A platform control unit for determining change information of the platform based on the variable information collected around the user; And A user interface control unit for processing change information of the platform by providing the change information of the platform to the user, Based virtual reality-based training simulator. The method according to claim 1, The image output unit Wherein the training content selected by the user is presented as a stereoscopic image using an augmented reality technique. The method according to claim 1, The image output unit A display unit for determining a size and an arrangement structure of the stereoscopic image device according to a requirement corresponding to the scenario of the training content; A mixed reality-based information visualization unit for displaying additional information based on mixed reality technology in a three-dimensional space of the image presented by the display unit; And And a variable platform control unit for changing the video presented by the display unit and the additional information corresponding to the user and the task scenario. delete delete The method according to claim 1, The tracking unit A sensor-based tracking information generation unit for acquiring physical data by attaching the sensor to a specific object in a contact or non-contact manner; A data DB based trace information generation unit for simulating trace data recorded in the database as being generated by the sensor; And A virtual sensor based tracking information generation unit for generating the input information by applying an output value of the data DB based tracking information generation unit to physical data in the sensor based tracking information generation unit; Based virtual reality-based training simulator. delete delete delete

Images