KR101917434B1 - Furnace process virtual reality training system - Google Patents

Abstract

The present invention relates to a head mounted display device and a motion recognition device, which are used for a head mounted display device and a motion recognition device, A trainer posture recognizing device for recognizing the posture of the trainee and extracting motion data of the joint of the trainee and photographing the motion of the trainee; A posture virtualization and input calculation device for simulating the posture of the trainee recognized by the trainee posture recognition device and receiving the operation of the trainee's portable blast furnace pillar plant control device and a control device Simulation of blast furnace column plant simulation An image processing apparatus for image processing and outputting visual information of the trainee as a result of the processing by the blast columnar image simulation apparatus; and an image processing apparatus for providing vision information of the trainee to the image processing apparatus, And a video input / output device for displaying an image to the trainee.

Description

{FURNACE PROCESS VIRTUAL REALITY TRAINING SYSTEM}

The present invention relates to a blast furnace process virtual reality education system.

In the manufacturing industry, automation processes have been automated according to the automation trend, but the skill level of the operators still has a great influence on the productivity. In particular, there is no separate measuring instrument for the exit and exit of the charter, ie, the exit and stop of the charter, so that the operator can identify the change occurring during the operation and monitor the operation. It has absolute influence. The operation is controlled by operating the portable pillar facility control device composed of the operation lever and the buttons in accordance with the operation situation and procedures of the operator.

Therefore, the operational skill of the operator of the portable pillar control device is very important. In addition, the wrong control device operation of the operator leads to damage to the company from several tens of millions of won to billions of billions of won, so it is essential to train the operator to increase the skill level of the control device for the portable pillar equipment.

Existing facility operation training was carried out in the field with the actual portable column control equipment. That is, an expert and a trainer paired, and the trainer operates the corresponding control device under the pilot and guidance of an expert to control the facility.

However, due to the nature of the steelworks process, which is operated 24 hours a day, the current training method, which requires actual equipment, is not only time constrained, but also there is a risk of facilities and safety accidents due to inoperability during training. However, there is a disadvantage in that, when a separate training space is provided, the operating device and the facility must be purchased separately.

Because of these problems, the training of virtual reality has emerged as a new training method. Since equipment training using virtual reality manipulates facilities in virtual space rather than actual facilities, there is no risk of equipment purchase, installation site, and safety accidents.

However, virtual reality training, which only displays on a simple screen such as a monitor, has a big problem.

Korean Registered Patent No. 10-1482469

In accordance with an embodiment of the present invention, an actual HMM (Head Mounted Display) device and a motion recognition device, which are head-mounted video devices, A blast furnace process virtual reality education system is provided that can train the air and mud guns to open and close the potholes.

According to an embodiment of the present invention, there is provided a virtual reality learning system for a blast furnace according to an embodiment of the present invention. The virtual reality educational system includes a motion recognition unit for extracting motion data of a joint part of the trainee, A posture virtualization and input computing device for simulating the posture of the trainee recognized by the trainee posture recognizing device and inputting an operation of the trainee's portable borehole posture control device; An image processing apparatus for image processing and outputting visual information of the trainee as a result of the processing of the blast column pillar simulation apparatus; Providing visual information of the trainee to a processing device, It may include a video input and output devices for displaying the images processed from the image processing apparatus to the trainee.

According to the embodiment of the present invention, it is possible to increase the immersion feeling by using the HMD device and to use the actual portable pillar facility control device, so that the training result can be directly applied to the field. It is possible to perform repeated training, and it is easy to install and transfer, and thus it is easy to supply training apparatus.

FIG. 1A is a schematic block diagram of a blast process virtual reality training system according to an embodiment of the present invention, and FIG. 1B is a screen displayed to a trainee by a blast process virtual reality training system according to an embodiment of the present invention.
2 is a schematic block diagram of a blast process virtual reality education system according to an embodiment of the present invention.
3 is a more detailed block diagram of a blast process virtual reality training system in accordance with an embodiment of the present invention.
4 is a diagram illustrating an exemplary computing environment in which one or more embodiments disclosed herein may be implemented.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order that those skilled in the art can easily carry out the present invention.

FIG. 1A is a schematic block diagram of a blast process virtual reality training system according to an embodiment of the present invention, and FIG. 1B is a screen displayed to a trainee by a blast process virtual reality training system according to an embodiment of the present invention.

1A, a blast process virtual reality education system 100 according to an embodiment of the present invention may include a trainee position recognition device 110, signal processing devices 120, 130 and 140, and a video input / output device 150 .

A trainee (A) who is trained through a blast furnace process through a virtual reality wears a video input / output device (150) at his head and wears a portable blast furnace column control device (B) A virtual reality image in response to the operation of the trainer A can be displayed to the trainee A through the input / output device 150 as shown in FIG. 1B.

The signal processing apparatuses 120, 130 and 140 may perform signal processing such as an image and a trainer posture and a virtual reality. The signal processing apparatuses 120, 130 and 140 may include a posture virtualization and input calculation apparatus 120, a blast column phase simulation apparatus 130, And an image processing apparatus 140.

2 is a schematic block diagram of a blast process virtual reality education system according to an embodiment of the present invention.

Referring to FIG. 2, a blast process virtual reality education system 100 according to an embodiment of the present invention includes a trainer posture recognition device 110, a posture virtualization and input calculation device 120, a blast column phase simulation device 130, An image processing apparatus 140, and a video input / output apparatus 150. FIG.

The trainer posture recognizing device 110 may include a motion recognizing device that provides joint image extracting data of a trainee's face, neck, elbow, wrist, etc., and an actual screen image taken together therewith.

The posture virtualization and input calculation device 120 simulates the position and attitude of the trainee in the virtual space using the joint data of the trainee transmitted from the trainee position recognition device 110 and performs depth map filtering ) And preset morphing technique to simulate the interaction of the hand and the portable pillar control device in the virtual space and analyze the operation of the pillar facility by analyzing the interaction between them.

The blast column pseudo-simulator 130 can operate the blast-furnace column equipment such as the open air and the mud gun according to the operation of the trainee, and calculate the scattering and steam generation and the behavior of the charcoal generated by the operation of these facilities.

The image processing apparatus 140 can generate the corresponding image by receiving visual field information such as the field of view of the trainee from the video input / output device 150 in order to display the result calculated by the blast column pacing simulation apparatus 130 on the screen.

The video input / output device 150 may include a head mounted display (HMD) device for providing visual information of the trainee to the video processing device 140 and displaying the created video to the trainee.

3 is a more detailed block diagram of a blast process virtual reality training system in accordance with an embodiment of the present invention.

Referring to FIG. 3, the trainer posture recognizing device 110 recognizes the action taken by the trainer who attaches the portable pillar equipment control device to the body through the motion recognition device 111, and the low- To the posture virtualization and input computing device 120. [

The first virtualization processing unit 121 of the posture virtualization and input calculation apparatus 120 corrects the joint data of low resolution transmitted from the motion recognition apparatus 111 and simulates the posture and position of the trainee in the virtual space. That is, since the trainer attaches a large portable pillar control device to the abdomen, the joint data extracted from the motion recognition device are separated from each other based on the portable pillar control device. Therefore, Interpolation to obtain complete joint data. Then, the position and the position of the trainee are simulated in the virtual space by calculating distance information of the joint data moved from the initial position.

In the meantime, since the motion recognition device 111 sends only a simple shot image and joint data of low resolution, a method of recognizing both hands of a trainee and a portable pillar equipment control device used for operating a pillar facility is required. That is, the second virtualization processing unit 122 applies depth map filtering and preset morphing to the photographed image transmitted from the motion recognition apparatus 111, And the portable pillar facility control device can be recognized and simulated in a virtual space.

The analyzing unit 123 processes the interaction of whether both hands and the portable pillar facility control device derived from the second virtualization processing unit 122 are in contact with each other or whether the trainee has manually pressed the button of the control device . The analyzing unit 123 loads status information on whether or not each button in the portable pillar facility control device is toggled and whether the lever is operated in the database 124 and simulates the loaded state information on the controller of the virtual space, When the trainer's hand interacts with the lever and button of the control unit, information on the change in the state of the lever and the button and the change in the operation of the equipment is extracted. The information thus extracted is transmitted to the blast column column simulation apparatus 130.

The blast column simulation device 130 receives the input of the trainee and operates the open air and the mud gun which are responsible for the outgoing and closing of the main body in accordance with the actual equipment specifications. The discharge of the open air, Water vapor, and charcoal discharge are simulated by physics to simulate the field.

The image processing apparatus 140 receives the visual information such as the viewing angle viewed by the current trainee from the HMD device 151 mounted on the head of the trainer and generates an image by deriving a screen area of the virtual space to be included in the visual field, And is again displayed by the HMD device 151.

That is, a region of the virtual space that the current trainer is looking at is calculated through a head tracking sensor attached to the trainee field-of-view region computing unit 141. Thereafter, the viewing area image generating unit 142 generates a viewing area image including all of the virtual models including the hand model, the portable column equipment control device model, the column equipment, the scattering, the steam, the charcoal, To the screen. At this time, image effects such as anti-aliasing and light source effect can be added.

The HMD device 151 of the video input / output device 150 transmits the field of view information of the trainee to the image processing device 140 and receives the resultant image to display the field of view on both eyes of the trainee.

As described above, according to the present invention, it is possible to increase the immersion feeling by using the HMD device and to use the actual portable pillar facility control device, so that the training results can be directly applied to the field. There is no danger of accident, repetition training is possible, installation and transfer are easy, and training device can be easily supplied.

It is to be understood that the components, devices, and / or parts used in the present embodiment may be implemented by software such as a task, a class, a subroutine, a process, an object, an execution thread, , A field programmable gate array (FPGA), or an application-specific integrated circuit (ASIC), or a combination of the above software and hardware. The above components, 'device' or 'part' may be included in a computer-readable storage medium, or a part thereof may be distributed and distributed to a plurality of computers.

Referring now to FIG. 4, there is shown a diagram of an exemplary computing environment in which one or more embodiments disclosed herein may be implemented, including a computing device 1100 configured to implement one or more embodiments described above RTI ID = 0.0 > 1000 < / RTI > For example, the computing device 1100 may be a personal computer, a server computer, a handheld or laptop device, a mobile device (mobile phone, PDA, media player, etc.), a multiprocessor system, a consumer electronics device, A distributed computing environment including any of the above-described systems or devices, and the like.

The computing device 1100 may include at least one processing unit 1110 and memory 1120. [ The processing unit 1110 may include, for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, an application specific integrated circuit (ASIC), a field programmable gate array And may have a plurality of cores. The memory 1120 can be a volatile memory (e.g., RAM, etc.), a non-volatile memory (e.g., ROM, flash memory, etc.) or a combination thereof.

In addition, the computing device 1100 may include additional storage 1130. Storage 1130 includes, but is not limited to, magnetic storage, optical storage, and the like. The storage 1130 may store computer readable instructions for implementing one or more embodiments as disclosed herein, and other computer readable instructions for implementing an operating system, application programs, and the like. The computer readable instructions stored in storage 1130 may be loaded into memory 1120 for execution by processing unit 1110.

In addition, computing device 1100 may include input device (s) 1140 and output device (s) 1150. Here, input device (s) 1140 may include, for example, a keyboard, a mouse, a pen, a voice input device, a touch input device, an infrared camera, a video input device, or any other input device. Also, output device (s) 1150 can include, for example, one or more displays, speakers, printers, or any other output device. In addition, computing device 1100 may use an input device or output device included in another computing device as input device (s) 1140 or output device (s) 1150. [

The computing device 1100 may also include communication connection (s) 1160 that enable communication with other devices (e.g., computing device 1300) via the network 1200. (S) 1160 may include a modem, a network interface card (NIC), an integrated network interface, a radio frequency transmitter / receiver, an infrared port, a USB connection or other Interface. Also, the communication connection (s) 1160 may include a wired connection or a wireless connection.

Each component of the computing device 1100 described above may be connected by various interconnects (e.g., peripheral component interconnect (PCI), USB, firmware (IEEE 1394), optical bus architecture, etc.) And may be interconnected by a network.

As used herein, terms such as "component,""module,""system,""interface," and the like generally refer to a computer-related entity that is hardware, a combination of hardware and software, software, or software in execution. For example, an element may be, but is not limited to being, a processor, an object, an executable, an executable thread, a program and / or a computer running on a processor. For example, both the application running on the controller and the controller may be components. One or more components may reside within a process and / or thread of execution, and the components may be localized on one computer and distributed among two or more computers.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not intended to limit the invention to the particular forms disclosed. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

100: Blast Furnace Virtual Reality Education System
110: Trainee attitude recognition device
111: motion recognition device
120: Posture virtualization and input computing device
121: first virtualization processor
122: second virtualization processor
123:
124: Database
130: Blast column column simulation device
140: Image processing device
141: Trainee field of view region computing unit
142: field-of-view region image generating unit
150: Video input / output device
151: HMD device

Claims (7)

A trainer posture recognizing device for recognizing the posture of the trainee, extracting motion data of the joint of the trainee, and photographing the motion of the trainee;
A posture virtualization and input calculation device for simulating the posture of the trainee recognized by the trainee posture recognition device and receiving the operation of the trainee's portable borehole column facility control device;
A blast furnace column simulation device for simulating the operation of the blast furnace column plant in accordance with the operation of the portable blast furnace column plant control device of the trainee;
An image processing device for image-processing and outputting visual information of the trainee as a result of processing by the blast columnar simulation device; And
And a video input / output device for providing visual information of the trainee to the image processing apparatus and displaying the image processed by the image processing apparatus to the trainee,
Wherein the trainer posture recognizing device includes a motion recognizing device for extracting motion data of a joint part of the trainee and providing a motion image of the trainee,
Wherein the trainer posture recognizing device further provides motion data of the joint part of the trainee,
The postural virtualization and input calculating device may be configured to calculate the posture of the trainee on the basis of the movement data of the joint of the trainee received from the trainee posture recognizing device, A blast furnace process virtual reality education system that simulates a virtual space and analyzes the operation of the column equipment of the trainee.
delete delete The method according to claim 1,
The posture virtualization and input calculation apparatus includes a blast furnace process virtual reality education system for simulating the hands of the trainee and the control device of the portable blast furnace pillar facility in a virtual space according to a depth map filtering and a preset morphing technique .
The method according to claim 1,
The posture virtualization and input computing device
A first virtualization processor for simulating the posture of the trainee in a virtual space;
A second virtualization processing unit for simulating the hands of the trainee and the control unit of the portable blast furnace pillar facility in a virtual space;
An analysis unit for analyzing an interaction between the hand of the trainee and the control unit of the portable blast furnace plant; And
A database for transmitting status information of the portable stowed columnar equipment control device stored in accordance with the interaction between the hand of the trainee and the portable stowing column equipment control device to the analyzing unit
Virtual reality education system with blast furnace.
The method according to claim 1,
The image processing apparatus
A trainee field of view arithmetic unit for receiving visual information of the trainee from the video input / output device and calculating an area of a virtual space to be included in the field of view of the trainee; And
A field-of-view image generating unit for generating virtual models corresponding to the field of view of the trainee,
Virtual reality education system with blast furnace.
The method according to claim 1,
The video input / output device
A head mounted display (HMD) mounted on the head of the trainee for transmitting visual information of the trainee to the image processing apparatus, receiving the image of the virtual model from the image processing apparatus and displaying the image to the trainee, A blast furnace process virtual reality education system including devices.

Images