KR20090003079A - Secondary image painting training system and method - Google Patents

Abstract

A virtual painting training system and method are provided to reproduce and virtualize an input/output unit and a painting simulation in real time to prevent waste of training materials through virtualization and enable smooth communication between a teacher and students. A virtual paining training system includes a display device(100) displaying a virtual screen, an operating unit(120) by which a student responds to the virtual screen, a data processor(110) for processing a response of the student, and a data generator(113) for generating a painting image of a ship according to the response of the student.

Description

Virtual painting training system and method {SECONDARY IMAGE PAINTING TRAINING SYSTEM AND METHOD}

The present invention relates to a virtual training system, and more particularly to a virtual painting training system and method of a ship.

The present invention is derived from the research conducted as part of the IT new growth engine core technology development project of the Ministry of Information and Communication and the Ministry of Information and Telecommunication Research and Development. [Task Management Number: 2005-S-604-02, Title: Development of realistic Virtual Engineering technology] ]

The representative purpose of virtual reality technology is to allow a user to obtain a virtual experience. In other words, the user can experience a virtual scenario that is the same as or physically impossible. Because of this feature, it is used as a solution to overcome disadvantages such as safety accidents and economic factors in the field situation, and is used for education, training, and entertainment in defense, medical and industrial sites.

Representative examples of virtual training systems can be found in the defense and medical sector, and in a broad sense include virtual education and entertainment systems. The general goal of the training system is to allow trainees to acquire skills that are available in the field, thus facilitating skill acquisition using the same interface as the real world and visualization techniques that simulate the physical situation in the field. It is important that the interaction skills be harmonized with related skills, such as teaching / training.

Conventionally, there has been a case of simulating virtual spray painting in consideration of industrial painting work, but there are limitations such as no support of monotonous 2D plane and thickness measurement function and no haptic feedback. Photorealistic painting rendering technology is practiced in the field of computer graphics, but it lacks real-time processing ability to integrate with virtual reality systems or is limited to simulation for painting tools such as brushes from an artistic point of view.

In particular, the painting work in the shipbuilding process is a work that requires a large number of skilled workers because it is a part that greatly affects the schedule of the entire work process and the quality of the ship. However, since the turnover rate is high due to poor working conditions, an efficient training system for skilled worker discharge and retraining is required. Specifically, a large amount of water used as a special paint and a substitute for trainee training is consumed, and materials are wasted, and when using actual paint materials, it is impossible to use a long time training and use toxic paint, and it is normal to wear a gas mask. Due to the non-communicable, limited training structures, paint drying time, difficult progress, and limited training space, only a small number of participants participate in the training.

The present invention is to solve the above-mentioned problems, an object of the present invention is to propose a technique for reproducing the same situation of the field work by applying a virtual reality technology in the field of painting of the ship.

It is another object of the present invention to focus on a stereoscopic display device capable of visualizing a measurement-based virtual model into a full-size work space, a work interface consistent with field situations, realistic spray painting visualization, and support for various working environments and training scenarios. It is to provide a virtual painting training system.

In order to achieve the above object, the present invention provides a display device for displaying a virtual screen; An operation unit for an educator to respond to the virtual screen; And it provides a virtual painting training system comprising a data processor for processing the response of the educator.

Here, the virtual screen is characterized by displaying an image for painting the vessel.

The display device may be any one of a large display screen, a wearable display screen, and a multiple display screen.

The data processor may reflect the teacher's response on the virtual screen and display the same on the display device.

And, the data processing unit, a data creation unit for making the response of the educator to the display data; And a data correction unit for correcting the data created by the data creation unit.

In addition, the data creation unit is characterized in that for the painter's response to the painted image of the vessel.

According to another embodiment of the invention, the step of displaying a virtual image of the ship; An educator performing a virtual painting on the interface on which the image is displayed; And it provides a virtual painting training method comprising the step of modifying and displaying the virtual image in accordance with the virtual painting.

Here, the displaying of the virtual image is performed through any one of a large display screen, a wearable display screen, and a multiple display screen.

The virtual painting step is performed by the educator on the interface.

In addition, the step of modifying the virtual image, characterized in that made by modifying the painting of the vessel in accordance with the virtual painting.

The effects of the virtual painting training system and method according to the present invention described above are as follows.

First, virtual paint spraying and visualization eliminates waste of training materials in the field-based training system through real-time reproduction and visualization of input and output devices and spray painting simulations, so that users get the same experience as the field situation. In addition, the toxic shortcomings of special paints are replaced with virtual paints, thereby reducing the inconvenience of wearing a mask, so that smooth communication between teachers and students is possible.

Second, the use of virtual materials improves the efficiency of recycling and co-utilization of experimental materials and spaces, which can educate a large number of students at any given time, which in turn improves the efficiency of the training system.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention that can specifically realize the above object will be described.

The same components as in the prior art are given the same names and the same reference numerals for convenience of description, and detailed description thereof will be omitted.

The virtual painting training system according to the present invention is applied by spraying and painting in the same pattern as the actual spray painting according to distance or angle, and approximation of a laminated model for simulation and a real-time visualization simulation of the film thickness or spray amount on which the paint is deposited. Based on the formula, it is calculated and painted differently according to distance or angle. Specifically, in order to present a high level of spatial presence, a CAVE type device using a large projection screen and an HMD type device in which a head tracking function is linked can be used.

1 is a block diagram of one embodiment of a virtual painting training system according to the present invention, and FIG. 2 is a flowchart of one embodiment of a virtual painting training method according to the present invention. Hereinafter, the virtual painting training method according to the present invention with reference to FIGS. 1 and 2 as follows.

The display device 100 according to the present exemplary embodiment includes a data processor 110 and an operation unit 120. The data processing section includes a data creating section 113 and a data correcting section 116. Specifically, it is as follows. The system has an input, a central main processing module and a system output at the top. In addition, in order to actively cope with the implementation of any training scenario, the structure supports the integration of various VR input devices and image output devices. The operating system used to run the system may utilize a general-purpose product such as Microsoft's Windows. In addition, it is composed of a program library for building a plurality of display and rendering clusters, a program library for interworking with various VR input devices, and an image processing program module for processing image images.

In this embodiment, the H / W environment includes four high-definition projectors and two rendering cluster PCs, a tracking device and a tracking server PC, and a stereo face mounted display (FFM) for four-channel output of a wall display. PC with dual channel output, spray gun unit and air pump, and FMD with optical and video see-through are integrated.

In the present embodiment, for the purpose of supporting various usage scenarios, an output display device according to a user's working environment may be used as a large immersive screen device, a wearable display device, and a multiple display device utilizing the advantages of the previous two systems. present. In addition, the unit display device configuring each individual display device may selectively visualize a stereoscopic image or a single mono image using binocular disparity.

First, a large immersive stereoscopic display device is selected as a display platform for building the same virtual environment as the field, and is a design matter considering the following technical matters. First, considering the installation space and cost of the immersive display, the CAVE type device for constructing a fully immersive environment requires a large space and high installation and maintenance costs. Therefore, a device is needed for a large number of trainees to practice. Therefore, it is manufactured in the size of 150cm (width) x 200cm (height) in consideration of the ease of movement arrangement between lecture rooms and the range of movement moving up and down and left and right in a stable fixed position posture due to the characteristics of painting operation work.

Second, stereoscopic vs. There is a problem with the mono display selection. Therefore, although the mono display is convenient for observers other than the main practitioner (tester), the stereoscopic image presentation device in which head tracking (head or eye movement tracking) is linked is required for the representation of the three-dimensional structure. Therefore, we develop a fixed display system for the classroom and a mobile display-based system for field work training, and present a multi-dimensional image mixed presentation display device using both displays simultaneously.

Wall Display sets the user's reference position to 1m in front of the screen to maximize immersion and match the location of the virtual wall with the physical screen. Since the whole-size screen is observed at close range, the rear-projection tiled display is constructed in an array of 1 (width) x 2 (height) to improve the resolution quality. To reduce the effect of hot spots on the screen by the projector, use a hard-type screen with a gain of about 1.5. The polarization filter for stereoscopic image presentation uses a circular polarization filter that is relatively inexpensive among stereoscopic image presentation filters and has a stable effect of separating left and right channels with respect to head movement.

Next, an embodiment using the wearable display device will be described. The face mounted display (FMD), which is presented as a wearable display device, is a display device capable of presenting a complete immersion space to a user by using a small portable device having high portability when interlocked with the head tracking device. Complementing the wall display with the limitation of the front side-oriented virtual space representation, it has the advantage of supporting work on complex three-dimensional structures in all directions and the excellent mobility of the system. Since the field of view (FOV) of the gas mask used in the ship painting work site is about 110 °, an FMD that presents a viewing angle of about 130 ° formed when wearing general glasses is used.

First, a virtual image of a ship is displayed (S210). At this time, the interface for the user to observe the image is a display device of the above-described type. In addition, the educator paints the interface (S220). Subsequently, according to the painting operation, the virtual image is modified and displayed again (S230).

Specifically, it is as follows. In general, the method of visualizing a three-dimensional object in a virtual environment by applying a texture map image is applied by tinting the surface of the three-dimensional model directly. In this embodiment, a texture map image expressing the thickness is additionally used to measure the thickness of the coating film, and an appropriate spray paint pattern is approximated according to the position and angle of the spray gun to update the color and thickness texture map image. Used to

Real-time spray painting visualization is an important part of evaluating the completeness of a virtual training system when aiming to reproduce the same situation in the field, using physical simulation of particles with Computational Fluid Dynamics / Finite Element Method (CFD / FEM). Spray spraying and additive visualization techniques of paint can be used. In addition, a heuristic approach measures the spray pattern and film thickness under constraints to build an experience database and define an approximation of the stacked model for real-time visualization simulations.

Create profiles for the two types of tip of the spray gun and the two types of properties of the paint, which are the main factors affecting the spray pattern of the paint painted on the ship. Detect collisions and update texture maps in real time (15fps or more). At this time, the size of the texture map should be 128x128pixels allocated to 1m ² area considering the actual size of the structure, the number of polygons tesselated from the CAD data, and an aliasing problem about 1m ahead.

In addition, in order to reflect the above-described numerical value, the training data content and the virtual model DB processing unit cuts the CAD model of the entire vessel (main steel structure) of actual size into a work unit space and converts it into VRML (Virtual Reality Modeling Language). This is necessary. The CAD to VRML model conversion process includes the representation of detailed parameters (thickness information of the steel plate) contained in the CAD data, readjustment of the node hierarchy of the scene graph for real-time visualization, and automatic insertion of texture map coordinate information into tessellation polygons. Increase the efficiency of the work process.

In addition, in order to make the user interface as close as possible to the tools used in actual work, the user interface is presented based on the spray gun used in the actual ship painting shop. By attaching a button to the lever of the spray gun for use as a computer input device, the spray gun can be controlled in the same way as the actual work, and the 3D position tracking device can be used to track the position and posture of the spray gun in 3D space. The spray gun interface can be handled in the same way as in actual work. In addition, in order to reproduce the repulsive force and noise generated during the spraying of the paint, by connecting the compressor to the spray gun to inject compressed air, it presents a repulsive force and sound similar to field work. And, if necessary, mixing (non-toxic) fragrance-like substance with air scent can be presented to the user with a higher sense of presence during the spraying operation.

The display device, which is an interface between the user and the virtual reality, generates and outputs an external large display stereoscopic image by the number of N (row direction) x M (column direction) x 2 (left and right stereoscopic images) or wearable type. It is responsible for the process of generating two left and right images for display, or simultaneously generating all the previous images for presentation of mixed images. According to the application scenario of the virtual training system, a plurality of display devices are integrated to visualize one virtual space, and thus accurate input parameters are required to generate a stereoscopic image for a large display and an FMD. To respond organically to these demand changes, set static calibration parameters by simulating the transformation and relative relationships of multiple virtual cameras.

The data processor 110 separates image information of a user's body part from surrounding image information by using a chroma keying technique, simultaneously synthesizes a virtual model (eg, a ship block) and painting visualization information, and then displays a mixed reality image. Can be generated.

In the above-described embodiment, the user does not simply stay observing the result of visualizing the virtual environment, but the working scenarios by the user's active physical interaction and real-time interaction of the tool (eg, spray gun) are virtually implemented. In addition, it can be used in various modifications in other areas where training scenarios can be implemented.

The present invention is not limited to the above-described embodiments, and such modifications are included in the scope of the present invention even if modifications are possible by those skilled in the art to which the present invention pertains.

1 is a block diagram of one embodiment of a virtual painting training system in accordance with the present invention,

2 is a flowchart of one embodiment of a virtual painting training method according to the present invention.

<Explanation of symbols for the main parts of the drawings>

100: display device 110: data processing unit

113: data creation unit 116: data correction unit

120: operation unit

Claims (10)

A display device for displaying a virtual screen; An operation unit for an educator to respond to the virtual screen; And Virtual painting training system comprising a data processor for processing the response of the educator. The method of claim 1, wherein the virtual screen, A virtual painting training system, characterized by displaying an image for painting a vessel. The display apparatus of claim 1, wherein the display device Virtual painting training system, characterized in that any one of a large display screen, wearable display screen and multiple display screen. The method of claim 1, wherein the data processing unit, And the response of the educator is reflected on the virtual screen and displayed on the display device. The method of claim 2, wherein the data processing unit, A data creating unit which makes the response of the educator into display data; And And a data correction unit for correcting the data created by the data creation unit. The method of claim 5, wherein the data creation unit, Virtual painting training system, characterized in that to make the painter's response to the painting image of the vessel. Displaying a virtual image of a ship; An educator performing a virtual painting on the interface on which the image is displayed; And And modifying and displaying the virtual image according to the virtual painting. The method of claim 7, wherein the displaying of the virtual image comprises: Virtual painting training method, characterized in that made through any one of a large display screen, a wearable display screen and a multi-display screen. The method of claim 7, wherein the virtual painting step, And the educator performs on the interface. The method of claim 7, wherein the correcting of the virtual image, According to the virtual painting, the virtual painting training method, characterized in that made by modifying the painting of the vessel.

Images