KR20220069697A - Maintenance tranining system of armored car by team using virtual reality - Google Patents

Abstract

The present invention provides an armored vehicle maintenance training system for team units using virtual reality to improve military organization capability according to systematic commands and work distribution during maintenance training by evaluating communication in the process of dealing with failure situations and performing maintenance among team members as well as training evaluation on the completion of operation of a three-dimensional object during the maintenance training for team units. According to the present invention, a maintenance mission previously assigned to each of the armored vehicles is performed during the maintenance training of the armored vehicles on a team basis to determine whether the maintenance is completed, and team members are enabled to identify the cause of the failure by using the maintenance checklist of the armored vehicles and conduct a training evaluation of the team unit through voice recognition for an overall decision-making process among the team members for efficient maintenance, thereby strengthening the organizational power through the maintenance training of the team unit and securing the efficiency of the maintenance training.

Description

Team unit armored vehicle maintenance training system using virtual reality {MAINTENANCE TRANINING SYSTEM OF ARMORED CAR BY TEAM USING VIRTUAL REALITY}

The present invention relates to a team unit armored vehicle maintenance training system using virtual reality, and more particularly, to improve the maintenance knowledge and proficiency of armored vehicles that require high risk and high skill to trainees, the actual use of 3D virtual reality It relates to a team-based armored vehicle maintenance training system using virtual reality that can provide the same education, training and evaluation environment as armored vehicle maintenance.

Recently, virtual reality-based games, cinemas, and simulators are being made that allow trainees to experience a virtual environment by applying VR or AR technology. By adding visual and cognitive experiences and additional bodily sensations using virtual reality or augmented reality technology to give an experience similar to a realistic experience, it can be used industrially beyond the entertainment dimension.

Virtual reality refers to an interface between a human and a computer that makes a specific environment or situation into a computer and makes it as if the person using it is interacting with the real surroundings and environment. This virtual reality has been applied to the training system and developed into an immersive virtual environment technology that enhances the immersion effect of training by allowing trainees to wear virtual reality interaction equipment and participate in a virtual training environment. This immersive virtual reality technology is applied not only for training, but also to the design analysis system field, allowing trainees to directly immerse themselves in the virtual environment at the product design stage and use the product, reflecting the analysis results in the design to improve product quality. It is also used for

As a prior art related to the maintenance training system, in the virtual maintenance training system using virtual reality in Korean Patent Publication No. 10-1636360, the first control signal related to the three-dimensional position and vibration information in the mechanic's virtual space is applied to the position track device and the haptic device. a training performing device including a controller for receiving from a remote controller and controlling to transmit a three-dimensional image related to virtual maintenance training to a task screen; and connected to the virtual maintenance control device, selects a type of virtual maintenance training, generates a second control signal for controlling the training environment, and performs virtual maintenance training based on the first control signal and the second control signal It consists of a training control device to perform. In addition, when a plurality of mechanics collaborate, they can perform different tasks at the same time or on multiple screens, and it is stated that the work performance information of other mechanics is displayed on the mutually assigned screen. In the case of maintenance training, there is a problem that not only the evaluation of the completion of simulation through 3D object manipulation in the virtual environment performed by each mechanic, but also the evaluation of the initial failure situation between teams, division of duties, and mutual communication during failure action cannot be evaluated.

Republic of Korea Patent Publication No. 10-1636360 (2016.07.06)

The present invention has been devised to solve the above problems, and an object of the present invention is not only training evaluation on the completion of 3D object manipulation during team unit maintenance training, but also in the process of coping with failure situations between team members and performing maintenance. This is to provide an armored vehicle maintenance training system in a team unit using virtual reality that can improve the military organization ability according to the systematic command and division of duties even during maintenance training by evaluating the communication of the vehicle.

In order to solve the above problems, the team unit armored vehicle maintenance training system using virtual reality, which is an embodiment of the present invention, includes an output unit including a display unit for displaying an image and a headset for outputting audio, and training content selected by the trainee. A virtual reality driving unit that controls to execute images and sounds of a virtual simulation using a virtual object, which is a three-dimensional model, through an output unit, a microphone and a training management server that converts the trainee's voice into electrical voice signals, and various information necessary for virtual reality execution And a virtual reality execution unit including a communication unit for transmitting and receiving data, a mission scenario for team training selected through an input unit and a manager terminal for generating an operation signal for instructing a change in the motion of an object in virtual reality implemented in the virtual reality execution unit A training evaluation unit that records conversations between team members when performing a mission provided to the virtual reality execution unit and performs a communication evaluation on the conversation contents, a database and virtual training unit that creates and manages various information for armored vehicle maintenance training and data It may include a training management server including a communication unit for performing communication.

According to an embodiment of the present invention, the training evaluation unit converts the recorded voice data into text using a speech to text (STT) algorithm, extracts keywords from the converted text, and the extracted keywords are stored in advance in the mission scenario. It is characterized in that the communication evaluation is performed by determining whether the keyword matches the existing keyword.

According to an embodiment of the present invention, the mission scenario is characterized in that the failure marker information indicating the inoperability of the virtual object and the change in appearance is generated so that the failure occurrence according to the selected failure occurrence scenario occurs.

According to the present invention as described above, since armored vehicle maintenance training is performed through virtual reality, civil complaints due to noise problems caused by unit maneuvering are prevented, and training costs are greatly reduced because there is no need to actually consume expensive weapons or use expensive fuel can save

In addition, during team-level armored vehicle maintenance training, each team performs the pre-assigned maintenance mission and judges the completion of the maintenance. As the decision-making process can be evaluated by team unit through voice recognition, organizational power can be strengthened through team unit maintenance training and the effectiveness of maintenance training can be secured.

1 is a schematic diagram of a team unit armored vehicle maintenance training system using virtual reality according to an embodiment of the present invention.
Figure 2a is a block diagram for explaining the virtual training unit according to an embodiment of the present invention, Figure 2b is a block diagram for explaining the training management server.
3 is a flowchart illustrating a process of performing and evaluating a mission assigned to a team according to an embodiment of the present invention.
4 is a flowchart illustrating a process of evaluating team training using voice data during team training according to an embodiment of the present invention.
5A to 5E are diagrams illustrating screens displayed in a training management server according to an embodiment of the present invention.
6 is a diagram illustrating three-dimensional maintenance training contents displayed in a virtual training unit according to an embodiment of the present invention.
7A and 7B are diagrams illustrating three-dimensional maintenance training contents provided during team training according to a mission according to an embodiment of the present invention.

The detailed description below is merely an example, and only shows an embodiment of the present invention. Also, the principles and concepts of the present invention are provided for the most useful and easy to explain purposes.

Accordingly, it is not intended to provide a detailed structure more than necessary for a basic understanding of the present invention, and, of course, various forms that can be implemented in the substance of the present invention by those of ordinary skill in the art are illustrated through the drawings.

Hereinafter, the configuration and operation of the preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram of a team unit armored vehicle maintenance training system using virtual reality according to an embodiment of the present invention, FIG. 2A is a block diagram illustrating a virtual training unit according to an embodiment of the present invention, and FIG. 2B is a block diagram for explaining the training management server.

1 to 2B, the team unit armored vehicle maintenance training system using virtual reality includes a virtual training unit 100 and a training management server 200 connected to the virtual training unit through a network 10.

The virtual training unit 100 may provide virtual reality to the trainee using training content stored in advance in a storage unit (not shown) for armored vehicle maintenance training or stored in advance in the management server 200 . The training management server 200 may provide training content for armored vehicle maintenance training to the virtual training unit 100 , and receive training completion data of the trainee training according to the training content or the mission scenario from the virtual training unit 100 and train Evaluation management and training schedule management for each trainee and rider can be performed.

The virtual training unit 100 may include a virtual reality execution unit 110 and an input unit 120 .

The virtual reality execution unit 110 includes an output unit 111 including a display unit for displaying an image and a headset for outputting audio, an image of a virtual simulation using a virtual object that is a three-dimensional model according to the training content selected by the trainee, and The virtual reality driving unit 112 that controls the sound to be executed through the output unit 111, the microphone 113 that converts the trainee's voice into an electrical voice signal, and the training management server 200, and various information necessary for virtual reality execution and It may include a communication unit 114 for transmitting and receiving data. The virtual reality execution unit 110 may be formed of a head-mounted device (HMD).

The virtual reality driving unit 112 may generate a virtual object for a three-dimensional virtual simulation according to the training content to provide an armored vehicle maintenance training means to the trainee. For example, the virtual reality driving unit 112 may simulate a change in motion, such as assembling or disassembling a virtual object, through 3D animation in response to a trainee's manipulation according to an action of the input unit 120 . The training content may be a 3D model and a moving image made of virtual objects, and when the training content is a moving image, the virtual reality driving unit 112 may control the moving image to be executed through an output unit.

The input unit 120 may be a wired or wireless device that generates an operation signal for instructing a change in the motion of an object in virtual reality implemented by the virtual reality execution unit 110, and may include a gamepad, HTC Vive Controller, or tactical haptics controller. (TacticalHaptics Controller) or the like. The input unit 120 may be gripped or worn by a trainee's hand.

The training management server 200 performs data communication with the controller 210 for controlling the overall operation required for the maintenance training of the armored vehicle, and the database 220 and the virtual training section 100 for generating and managing various information for the maintenance training of the armored vehicle. It may include a communication unit 230 that performs.

The database 220 may include a trainee management 221 , an education management 222 , an evaluation management 223 , training contents 224 , and a mission scenario 226 . 5A is a main screen for armored vehicle maintenance training, and the main screen displays the course status, the number of training contents, the number of trainees, etc. can be done FIG. 5B is a screen for managing individual trainees, and the trainee management 221 can be performed for each individual trainee by classifying them into military number, rank, name, special skill, affiliation, rider, date of entry and expected completion date. As a screen for managing education, the education management 222 can be performed by classifying the course name for each class, the task name of each course, the number of minor tasks, etc. Educational management 222 may be performed by providing related training contents for each small task. 5e is a screen for managing training content, and it is possible to manage the training content 224 to implement 3D virtual reality by classifying it into a content file name, a content name, a content code, and the like.

The mission scenario 226 is scenario information for executing individual training of trainees or team training in a team unit, and the communication unit 230 by generating mission information according to the selected scenario through the manager terminal 20 (refer to FIG. 1 ) and the keypad, etc. It can be transmitted to the virtual training unit 100 through. At least one or more scenarios displayed on the manager terminal 20 (eg, failure of the armored vehicle power transmission system, driving equipment failure, steering system failure, fuel equipment failure, failure occurrence mission that requires maintenance of electrical and electronic equipment failures, etc.) etc.) is selected, failure marker information such as inoperability of the virtual object and change in appearance is generated so that a failure occurs according to the selected failure scenario in the shape of an armored vehicle made of a plurality of virtual objects (refer to FIG. 7A ). Applicable to armored vehicles.

Therefore, when the mission according to the mission scenario 226 is given for each individual or team, the trainee is in a state in which it is not possible to know what kind of failure occurred in the currently occurring armored vehicle, so the cause of the failure must first be identified using the maintenance checklist. For example, in contrast to the case of performing a mission that directly provides failure information such as a lack of transmission oil due to a power train failure, the trainee must first identify the cause of the failure, so knowledge of the overall maintenance of the armored vehicle is required. Such a mission scenario requires a qualitatively higher maintenance skill, so the efficiency of maintenance training can be increased. The mission scenario 226 may include voice evaluation criteria information for maintenance procedures, important keywords, important sentences, etc., which are essential when responding to each scenario, and the voice evaluation criteria information is a process of evaluating during training for each team unit, which will be described later. can be used for

The training management server 210 may include a training evaluation unit 211 capable of executing training content and receiving training completion information according to the virtual training unit 100, and evaluating training according to the training completion information. The training evaluation unit 211 may perform a simulation evaluation to determine whether the operation of the trainee's object through the input unit 120 is properly performed in response to a training operation required in virtual reality according to the training content or the mission scenario. . In addition, the training evaluation unit 211 records the voice conversation content between each team member in performing maintenance according to the mission scenario when not only the simulation evaluation but also the team evaluation is made, and performs communication evaluation according to the voice. can

Maintenance training between team members according to the mission scenario 226 will be described in detail with reference to FIGS. 3 and 4 .

3 is a flowchart illustrating a process of performing and evaluating a mission assigned to a team according to an embodiment of the present invention.

Referring to FIG. 3 , the manager groups predetermined trainees through the manager terminal 20 and sets them as team member information, and the control unit 210 of the management server uniquely identifies the HMD device according to the team member information input through the manager terminal. By controlling the communication unit 230 using the number, a common conversation channel between team members may be created, and the conversation contents between the team members may be stored in a storage unit (not shown) as voice data. After the chat channel is created, the control unit may transmit the mission content according to the selected mission scenario to the team members through the manager terminal 20 to give a team mission (S30). According to the mission assigned to the team training, failure marker information such as inoperability of the virtual object and change in appearance can be generated so that a failure occurs according to the mission, and this can be applied to the armored vehicle (see FIG. 7 ). Referring to FIG. 7 , when the appearance of the virtual object changes, the failure marker information is displayed externally so that team members can be visually identified, but when an electrical or electronic device is abnormal, it is impossible to visually identify the failure, and the team members can identify such failures with the naked eye. The cause must first be determined using the equipment checklist. In judging the cause of such failure first, the conversation between each team member becomes an important element of training evaluation. For example, when a team member is given a mission, a manager is first elected through a voice communication channel, and the manager must assign the task to each team member with the fault check range on the equipment checklist to each team member. In order to continuously identify the cause of the failure, the team members must report the failure inspection results assigned to them to the manager, and finally determine the defective part of the armored vehicle and perform maintenance on the defective parts (objects). In carrying out such maintenance, many conversations will come and go during mutual cooperation according to the divided work order among each team member, and accordingly, the maintenance order of the manager and report contents according to the maintenance order may be included. For example, referring to the maintenance screen of the virtual reality of FIG. 7b, the cause of the failure is engine failure due to coolant failure (here, only one failure cause is exemplified, but during team training, a mission scenario having a failure cause corresponding to at least the team member is provided. ), the team member in charge of the maintenance uses the 19mm open wrench 60 to adjust the tension of the lock screw 50 of the idle pulley installed between the coolant pump pulley and the engine tamper pulley. In the case of operation through 120, the virtual training unit 100 may detect a trainee's manipulation in virtual reality (S31) and control the lock screw to rotate according to the manipulation of the open wrench (S32). Continuously, the virtual training unit 100 may transmit the training result information to the management server 200 through the communication unit 114 by detecting the number of rotations of the lock screw, which is a virtual object, by the trainee's manipulation. The training evaluation unit 211 of the management server 200 may perform simulation evaluation to determine whether the received training result information has been manipulated by the number of rotations. Such simulation evaluation may be evaluated as whether the operation of the virtual object required by the training content displayed with the maintenance training guideline at the bottom shown in FIG. 6 was successful. In addition, the training evaluation unit 211 may execute a communication evaluation based on the conversation between team members recorded during mission performance, which will be described with reference to FIG. 4 .

4 is a flowchart illustrating a process of evaluating team training using voice data during team training according to an embodiment of the present invention.

Referring to FIG. 4 , first, the training evaluation unit 211 of the management server converts the recorded voice data into text using a Speech to Text (STT) algorithm (S40), and extracts keywords from the converted text (S41). ). For example, if the converted text is "The engine abnormality is being maintained by adjusting the tension of the lock screw of the idle pulley installed between the coolant pump pulley and the engine tamper pulley using a 19mm open wrench," the key keyword is virtual It can be 'coolant pump pulley', 'engine tamper pulley', 'idling pulley', 'lock screw', '19mm', 'open wrench', 'tension', which are the part names of the object. Next, the training evaluation unit 211 determines whether the extracted core keyword matches the keyword stored in advance in the mission scenario (S42). Although the keyword was described as an example of the communication evaluation method, it can also be judged through whether the time sequence of the converted text and the equipment procedure sequence on the preset mission scenario are compared to determine the matching rate or whether important sentences are included. Finally, the training evaluation unit generates an evaluation list according to the result of the determination of whether the keyword matches or not, and converts it into evaluation scores (S43) to evaluate communication can be performed.

Therefore, by performing only the conventional simulation evaluation, i.e., the evaluation is performed only by the user's operation of the object, the trainee diagnoses the cause of the failure and makes the maintenance act according to the combination of the parts to be expressed by voice, as if verbal evaluation. It can be judged whether the trainee has extensive maintenance knowledge about the causes of failure. In addition, the mission executed during maintenance training of the conventional armored vehicle directly provided the cause of the failure, but the present invention generates failure marker information according to the mission scenario and assigns the mission to the trainee accordingly. By providing a virtual reality environment that induces collaboration among other team members, it is possible to improve the military organization ability during maintenance and at the same time increase the efficiency of maintenance.

In the above, the present invention has been described in detail through representative embodiments, but those of ordinary skill in the art to which the present invention pertains can make various modifications to the above-described embodiments without departing from the scope of the present invention. will understand

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the claims described below as well as the claims and equivalents.

100: virtual training unit 110: virtual reality execution unit
120: input unit 200: training management server
1000: maintenance training system

Claims (3)

An output unit 111 including a display unit for displaying an image and a headset for outputting audio, and an output unit 111 to output images and sounds of a virtual simulation using a virtual object that is a three-dimensional model according to the training content selected by the trainee The virtual reality driving unit 112 that controls to run through, the microphone 113 that converts the trainee's voice into an electrical voice signal, and the training management server 200 and the communication unit 114 that transmits and receives various information and data necessary for virtual reality execution Virtual reality execution unit 110 comprising a,
An input unit 120 that generates an operation signal for instructing a change in the motion of an object in virtual reality implemented in the virtual reality execution unit 110, and
A training evaluation unit 211 that performs communication evaluation on the conversation contents by recording the conversation contents between team members when performing the mission provided to the virtual reality execution unit for the mission scenario for team training selected through the manager terminal, the armored vehicle maintenance training Team unit armored vehicle maintenance training using virtual reality including a training management server 200 including a database 220 for generating and managing various types of information and a communication unit 230 for data communication with the virtual training unit 100 system.
The method of claim 1,
The training evaluation unit 211 converts the recorded voice data into text using a speech to text (STT) algorithm (S40), extracts keywords from the converted text, and the extracted keywords are stored in advance in the mission scenario. An armored vehicle maintenance training system in a team unit using virtual reality, characterized in that the communication evaluation is performed by determining whether it matches the keyword.
The method of claim 1,
The mission scenario is an armored vehicle maintenance training system for a team unit using virtual reality, characterized in that the failure marker information indicating the inoperability of the virtual object and the change in appearance is generated so that a failure occurs according to the selected failure scenario.

Images