KR101990790B1 - System for collective collaboration training of ship based virtual reality - Google Patents

Abstract

The present invention relates to a virtual reality (VR)-based collective collaboration training system for a ship and, more specifically, to a virtual training system providing time and space capable of performing virtual training with respect to an emergency situation occurring in a ship (in particular, navy) to increase management and combat capabilities of the ship. According to the present invention, to separately control operation data for the virtual training, a connection control unit and a training control unit are separated in hardware such that a network load can be adjusted, thereby realizing an environment smoothly performing a collective training for a plurality of clients. Moreover, to be differentiated from an existing training system providing a virtual environment with time and space based on a scenario, the system provides, as a virtual environment, time and space rendered by CAD modeling based on the corresponding ship (or battleship), thereby increasing training efficiency of trainees. According to the present invention, the system comprises a wearing gear and a server.

Description

BACKGROUND OF THE INVENTION Field of the Invention [0001] The present invention relates to a virtual cooperative training system for a ship,

The present invention relates to a virtual reality-based marine collective collaboration training system.

Specifically, the present invention provides a virtual training system capable of improving ship management and combat capability by providing a virtual environment in which time and space capable of virtual training for emergency situations that may occur in a ship (particularly, the navy)

In order to separately control the operation data for the virtual training, the connection control unit and the training control unit are separated from each other by hardware so that the network load can be adjusted. Thus,

In addition, the time and space rendered by the CAD modeling based on the ship (or the ship) is provided as a virtual environment so as to have differentiation from the conventional training system that provides the space-time based on the scenario as a virtual environment, Virtual reality based marine collective collaboration training system.

In recent years, technologies that enable specific experiences in virtual environments, such as virtual reality, mixed reality, and augmented reality, have matured and are spreading devices.

On the other hand, since ship-related accidents are increasing, the introduction of the safety and health management system is underway.

In particular, the Navy has been experiencing fire accidents in the past four years, including 20 fire accidents, 9 explosions, 7 gun accidents, and 470 vehicle related accidents. Since naval accidents occur mainly in the ocean, Depending on the ability, there is a large difference in the scale of the loss, which can lead to casualties that could result in casualties.

In addition, there was a sudden and frustrating incident in the Navy, such as the Second Battle of Yeonpyeong in 2002 and the Cheonan Battle in 2010, and it is possible to deal with such an emergency more effectively. Because of,

In recent years, VR simulations based on virtual reality are underway in the Navy.

Regarding simulation training techniques using virtual reality, Patent Publication No. 10-1744689 describes a combat management system using a virtualization function and a method of operating the combat management system.

The above technology relates to a combat management system using a virtualization function and a method of operating the combat management system. The combat management system using a virtualization function is a device that performs functions of a combat management system. The combat management system includes a plurality of information processing apparatuses 100 ); And provides an exhibition screen of the battle management system.

This technique includes a plurality of display processing apparatuses 200 for generating a virtual machine for operating the multi-function console 400 of the combat management system; A data storage 300 for storing information of the virtual machine according to a virtual machine policy operated in the exhibition processing apparatus 200 and storing setting information of the multifunction console 400; A plurality of multifunctional consoles (400) connected remotely to an exhibition screen provided by the exhibition processing device (200) and displaying and controlling the combat management system on the exhibition screen; And a plurality of soft key panel devices 500 for controlling the combat management system together with the multifunction console 400 as a sub screen of the multifunction console 400. [

In addition, Japanese Patent Application Laid-Open No. 10-1498610 discloses a tactical training device, a simulation training interlocking method, and a simulation training monitoring method by interlocking a character and a trainer in a virtual environment.

The above technique relates to a tactical simulator training apparatus in which a character and a trainer operate in a virtual environment.

The above-described technique includes an operation recognition unit 110 for recognizing an operation of a trainee through a motion recognition sensor; A sensing glove (120) for recognizing a signal of a trainee through a motion recognition sensor and interlocking with a virtual electric field; An imaging temporal section 130 for receiving the virtual electric field image data from the image generating section 210 and visually providing the virtual environment to the trainee; A simulator 140 for transmitting the information on the weapon operation and the aim point information recognized by the motion recognition sensor to the image generator 210; And an impact vest 150 that generates a shock to the trailblazer as a result of the training simulation. And the simulation system (200) includes an image generation unit (210) for generating a virtual environment in real time; And a training simulation server (220) for collecting data related to the operation of the personal wearing equipment (100) from the image generating unit (210) of the plurality of trainees and then transmitting training simulation data to each trainee. And the like.

Also, in Patent Registration No. 10-1153231, there is described a simulation system for training a small battalion battle skill.

The purpose of this technique is to provide combat training according to various climates and conditions at an indoor combat training center equipped with a combat training ground simulation equipment and various sensors using computer and video equipment, It provides a small battlefield training simulation system that can improve the combat ability of the combatant without experience,

The battlefield training simulation system for a small battalion battalion is divided into a plurality of training rooms 110 and an indoor battle training center 100 provided with a screen 112 and an image projection device 111 and a speaker device 113 for making the inside of the training room into a virtual battle environment, , A personalizer (115) for shooting a virtual target appearing on the screen of the indoor combat training field, a laser sensor device (117) for sensing an impact point on a virtual target by the personalizer, The loudspeaker device 113 and the training room environment control device 119 according to the battle training program and controls the laser sensor device 117 and the attitude recognition An aggregation and control device 120 for collecting the combat trainer's attitude sensed by the sensor device 114 and shooting information for the personalization period of the combat trainers, And a control computer 140 for providing and controlling a combat-type combat training program and computing arithmetic processing of the virtual combat training information collected by the counting and controlling device to evaluate the training scores for each combatant and generate calibration information have.

The above-described techniques describe simulated drills based on virtual reality, but they can not be said to be training simulation techniques specialized for a ship or a ship, which is different from the present invention proposed by the present applicant.

However, an electro-optic system simulator system of the vessel described in Patent Registration No. 10-1523261 and a training method using the system are described.

The technique covers simulated training techniques that can be used in traps,

Specifically, an electronic optical system simulator system of a trap including the input device 10, the electro-optical system simulator 20, the image distribution recording device 30, the multifunction console 40, and the information processing device 50 is constructed , And the naval ship's combat system simulation exercise is performed, the electro-optical system simulator 20 implements a real-time simulated image with the combat system equipment, and implements a simulation image (HDTV / IR) Electronic system training is performed by interlocking with the multifunctional console 40 showing the display device.

Therefore, in the existing electro-optic system training, it was excluded from the scope of mock training, or simply procedure-oriented training, which resulted in the restriction of the training of the crews to the equipment operation and the training of the combat system. It is described that the practical operation of the electro-optic system, which is very important when checking, can be used to increase the effectiveness of the training and to improve the ability to master the equipment and to improve the combat power.

However, in the case of the above-described technique, only the training based on the general scenario is possible, and the training scenario prepared for the audiovisualized simulation environment can not be provided according to the traps. Therefore, the present invention differs from the present invention proposed by the present applicant.

Therefore, even if training is carried out based on the above-described technique, the ability of the trainees to cope with in an actual emergency can not be avoided.

Registered Patent Publication No. 10-1744689 (published on June 20, 2017) Registered Patent Publication No. 10-1498610 (Announced 2015.03.09) Patent Registration No. 10-1153231 (Announcement of Mar. 13, 2012) Patent Registration No. 10-1523261 (Bulletin of May 27, 2015)

SUMMARY OF THE INVENTION It is an object of the present invention to provide a virtual training system capable of improving the ship management and combat capability by providing a virtual environment in which time and space capable of virtual training for an emergency situation that may occur in a ship (particularly,

In order to separately control the operation data for the virtual training, the connection control unit and the training control unit are separated from each other by hardware so that the network load can be adjusted. Thus,

In addition, the time and space rendered by the CAD modeling based on the ship (or the ship) is provided as a virtual environment so as to have differentiation from the conventional training system that provides the space-time based on the scenario as a virtual environment, And to provide a virtual reality based marine group collaborative training system.

In order to achieve the above-mentioned object, the virtual reality based marine group cooperative training system according to the present invention comprises:

Ensure that virtual training is available, including wear equipment and servers,

The server comprises:

A client interlocking unit for interlocking with the wearing equipment; A connection control unit for controlling connection of the client to be connected and connecting to the virtual training; An on-line processing unit including a training control unit for conducting and controlling training to enable a client connected through the connection control unit to perform virtual training; And

A trap 3D CAD conversion unit for generating trap information through rendering information based on 3D CAD; And an offline processing unit including a scenario generating unit for generating a training scenario.

At this time,

Connecting the client groups linked through the client interworking unit to connect the client groups so as to be virtual training information,

And the training information is shared among the group clients that have been connected.

In addition,

And a training scenario is received from the scenario generating unit of the offline processing unit, and training is performed and controlled in accordance with the scenario while receiving the trapping information from the trapping 3D CAD converting unit and implementing the virtual training information.

Further, the trap 3D CAD conversion unit may include:

And a rendering information receiving module that receives rendering information based on 3D CAD from a CAD application program.

According to the virtual reality-based group collective collaboration training system of the present invention,

The user is able to improve the ability to cope with the initial response in an actual emergency by conducting the emergency response training in the same real environment as the ship, and to simulate the engagement in various virtual environments in place of the actual equipment in the engagement training The ability to respond to actual engagements can be improved.

The provider can be expanded to VR maintenance service linked to the existing ship safety diagnosis service, and it can be very useful in industry because it can make profit through system sales.

FIG. 1 is a schematic representation of a server constituting a virtual reality-based group collective collaboration training system according to the present invention.
FIG. 2 is a diagram for explaining an outline of a connection control unit and a training control unit of a server constituting a virtual reality-based group collective collaboration training system according to the present invention.

The terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings and the inventor can properly define the concept of the term to describe its invention in the best possible way And should be construed in accordance with the principles and meanings and concepts consistent with the technical idea of the present invention.

Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention and are not intended to represent all of the technical ideas of the present invention. Therefore, various equivalents And variations are possible.

Before describing the present invention with reference to the accompanying drawings, it should be noted that the present invention is not described or specifically described with respect to a known configuration that can be easily added by a person skilled in the art, Let the sound be revealed.

The present invention relates to a virtual reality-based marine collective collaboration training system.

Specifically, the present invention provides a virtual training system capable of improving ship management and combat capability by providing a virtual environment in which time and space capable of virtual training for emergency situations that may occur in a ship (particularly, the navy)

In order to separately control the operation data for the virtual training, the connection control unit and the training control unit are separated from each other by hardware so that the network load can be adjusted. Thus,

In addition, the time and space rendered by the CAD modeling based on the ship (or the ship) is provided as a virtual environment so as to have differentiation from the conventional training system that provides the space-time based on the scenario as a virtual environment, Virtual reality based marine collective collaboration training system.

The present invention will be described with reference to the accompanying drawings.

FIG. 1 is a schematic representation of a server constituting a virtual reality-based marine collective collaborative training system according to the present invention. FIG. 2 is a block diagram of a virtual reality-based marine collective collaboration training system according to the present invention. And Fig.

Prior to the description with reference to the drawings, the present invention comprises a wearer and a server that a trainee wears.

In this case, the wearing equipment includes an HMD (Head Mounted Display), which is mainly used for VR in the virtual simulation training, and a controller, which allows the trainee to grasp the trainee's behavior in the training.

Such wearing equipments are already well known in various virtual reality simulation techniques in the prior art, so a detailed description thereof will be omitted.

The server transmits and receives control information according to the controller by transmitting and receiving information to and from the wearing equipment, and transmits the audiovisual information to the wearer (HMD) so that the trainer can visually and audibly .

1, the server includes an on-line processing unit for performing on-line training control; And an offline processing unit that provides an interface capable of manual operation by an administrator to prepare for training control in an off-line manner, and interworking with an on-line processing unit for training control.

In addition, it further includes a communication unit for communication between the server and the wearing equipment, a storage unit for storing additional information (e.g., trainee information, etc.), and the like, but these are configurations that can be sufficiently predicted by a person skilled in the art Are omitted here.

The online processing unit includes a client interlocking unit for interlocking with the wearing equipment of the client (trainee); A connection control unit for controlling connection of the client to be connected and connecting to the virtual training; And a training control unit for receiving training information from the offline processing unit so that the client connected through the connection control unit can perform the virtual training, receiving the trap information, and implementing the virtual training information and proceeding and controlling the training according to the scenario.

At this time, the connection control unit connects the groups of connected and connected clients through the client interworking unit, performs connection processing so as to connect with predetermined virtual training information, and performs network load balancing.

In addition, training information can be transmitted and received between the groups of connected clients.

In addition, the offline processing unit providing the trap information and the training scenario to the training control unit includes a trap 3D CAD conversion unit for converting and generating trap information based on 3D CAD through rendering; And a scenario generating unit for generating a training scenario.

At this time, the scenario generating unit may generate scenarios of various environments to be used for the virtual training information. In the scenario generation, a conventional generating technique that enables information inputted based on TEXT to be sequentially executed is applied.

As an example of such a training scenario, as shown in FIG. 1, there may be scenarios for advancing and extinguishing fire in a pit when a fire occurs, scenarios for repairing equipment in a pit, and scenarios for engaging There may be.

In addition, the trap 3D CAD conversion unit renders the designed model through the CAD application program in cooperation with the 3D CAD, and converts the model into visual map information to be used for the virtual training information.

The converted map information and the training scenarios are transmitted to the on-line processing unit so that they can be utilized as virtual training information through the control of the training control unit.

The 3D CAD conversion unit may include a rendering information receiving module that receives rendering information designed through 3D CAD.

In this case, the input of the rendering information may be a 3D CAD rendering file having an extension of .dwg, .cad, etc. from another terminal (desktop, notebook, etc.).

According to the design condition, the trap 3D CAD conversion unit may include a rendering error detection module; Error criticality determination module; Real - life storage module; A comparison module; And a weight setting module.

The rendering error detecting module detects an error included in the rendering information received through the rendering information receiving module.

In this case, the error refers to a connection site error of a line on a CAD sketch included in the rendering information. In this case, if the connection portion between the lines is not connected, or when the sketch is made, And the like.

The detection of such an error may be possible by comparing the actual photograph of the trap stored in the real image storage module with the rendering information. In this case, the real image of the trap is preferably configured to have real image information in various directions for comparison with the rendering information Do.

For example, if it is assumed that the rear deck is a trapeze, the rendering information in a state where the deck is viewed in the trailing direction from the trailing end and the real image information are compared with the rendering information, desirable.

The real-life information may be stored in the real-life storage module.

The comparison module compares the rendering information with the real image information as described above. Specifically, the comparison module has a function of finding the real image information to be compared with the rendering information from the information stored in the real image storage module, And a function of finding a different area on the pixel by comparing the rendering information.

At this time, to find the real image information that is the same as the rendering information, the information stored in the real image storage module is compared one by one to search for the same or similar (for example, 90%) on the pixel.

Alternatively, in order to improve the accuracy, the comparison module may rotate the rendering screen of the rendering information so that the real-world information and the rendering information are completely identical when similar real-world information is confirmed, so that the comparison module can have the same direction as the real-world information. This can be done by applying the rendering manipulation technology embedded in the CAD application so that the rendering rotation can be made automatically through the pixel comparison in the comparison module.

In addition, when the real image information to be compared is retrieved, the comparison module compares the real image information with the rendering information, and determines whether the area (%) of the different pixels on the pixel is equal to or larger than a predetermined value (%).

As a result of the comparison of the comparison module, if the number of different pixels exceeds the predetermined value (%), the error criticality discrimination module recognizes that the error is serious and informs the administrator that the rendering information needs to be corrected. The function of the notification may be enabled while the error criticality determination module communicates with a separate terminal, or a notification unit and a notification module may be further provided so that the notification of the popup type may be made possible.

At this time, in determining the seriousness of the error of the rendering information, the error criticality determination module can determine whether the area exceeds the predetermined value (%) by applying a weight to the area (%) of the different pixels.

For example, assuming that there are two areas with different pixels in the rendering information inside the control part of the vessel, one area is the rendering representing the control panel and the remaining one area is rendering representing the ceiling, Rendering is an important element in virtual training, but the ceiling may not.

In such a case, if the two areas are equally weighted and the error is determined, if there is an error only in the ceiling area, the correction is forced even though the error does not need to be corrected in some cases, thereby performing an unnecessary operation Therefore, according to another embodiment of the present invention, it is possible to efficiently determine an error by setting a weight for each region.

For this purpose, a weight setting module may be included. In this case, the weight setting module sets a weight for each pixel region in the real image information.

For example, if we assign three weights to one real-world information, A-control panel-weight (70%), B-chair-weight (20%), C- Assuming that,

If it is assumed that the predetermined value is 60%, if the comparison result of the comparison module indicates that the different pixel area of the A area is 55%, the B area is 65%, and the C area is 70%

The area A is (55% + 70%) / 2 = 62.5%

The area B is (65% + 20%) / 2 = 42.5%

C region is (70% + 20%) / 2 = 45%, and the weighted final value is calculated.

In this case, when an error is judged only in the area B or area C, the actual area value (%) exceeds the predetermined value (%), but if the weight value is set, it does not exceed the predetermined value (%). However,

Even if the error is discriminated in the A area as described above, it does not actually exceed the predetermined value (%). However, if the weight is set, it is determined that the error exceeds the predetermined value (%).

In other words, in the process of virtual training, it is possible to overze the critical area to increase the efficiency unless it is an overly large error. In case of a critical area, even a small error can be judged as a serious error in the system through the weight.

It should be understood that the foregoing description of the present invention has been presented for illustrative purposes only and is not to be construed as limiting the scope of the present invention as defined by the appended claims.

Claims (4)

Ensure that virtual training is available, including wear equipment and servers,
The server comprises:
A client interlocking unit for interlocking with the wearing equipment; A connection control unit for controlling connection of the client to be connected and connecting to the virtual training; An on-line processing unit including a training control unit for conducting and controlling training to enable a client connected through the connection control unit to perform virtual training; And
A trap 3D CAD conversion unit for generating trap information through rendering information based on 3D CAD; And an offline processing unit including a scenario generating unit for generating a training scenario,
Wherein the trap 3D CAD conversion unit comprises:
A rendering information receiving module that receives rendering information based on 3D CAD from a CAD application program;
A rendering error detection module for detecting an error included in the rendering information received through the rendering information reception module;
A real image storage module for storing real image information of a ship,
A comparison module for comparing the rendering information with real image information,
An error criticality determination module for recognizing and recognizing that the error is significant when the comparison result of the comparison module indicates that the different pixels exceed the predetermined value,
And a weight setting module for presetting a weight for each pixel region in the real image information,
As a result of comparison of the comparison module,
In conducting virtual training based on weights,
For unimportant areas,
Even if pixels different between the rendering information and the real image information exceed the predetermined value (%),
And when it exceeds the predetermined value (%) even if the weight is applied, it is determined to be an error.
The method according to claim 1,
The connection control unit,
Connecting the client groups linked through the client interworking unit to connect the client groups so as to be virtual training information,
And the training information is shared among the group clients to which the connection processing has been performed.
The method according to claim 1,
The training control unit,
Wherein the virtual training information is received and received from the scenario generating unit of the offline processing unit, and the virtual training information is implemented by receiving the trapping information from the trapping 3D CAD converting unit to progress and control the training according to the scenario. Ship Collaborative Collaborative Training System.
delete

Images