KR102011200B1 - Operation and maintainance virtual experience system of 3d equipment model and method thereof - Google Patents

Abstract

The present invention relates to an operation maintenance virtual experience system and method of the 3D facility model, the operation maintenance virtual experience system of the 3D facility model according to an embodiment of the present invention, to perform the operation maintenance virtual experience of the disassembly and assembly process A 3D model generation unit for generating a 3D model group that can be recognized as a VR model by generating a 3D model for each unit from CAD data of a facility; A decomposition / assembly sequence generation unit for defining a sequence for disassembly and assembly according to the maintenance procedure of the facility and corresponding the sequence to a 3D model group; A VR model generation unit for generating a VR model through a VR modeling process by combining the 3D model group and the sequence; A VR library generation unit for generating an operation file of a VR engine for the VR model and registering it in a VR model library; And a platform controller for converting the VR model library according to a platform environment and providing the same to the platform.

Description

Operational experience virtual experience system of 3D facility model and its method {OPERATION AND MAINTAINANCE VIRTUAL EXPERIENCE SYSTEM OF 3D EQUIPMENT MODEL AND METHOD THEREOF}

The present invention relates to an operation maintenance virtual experience system and a method of the 3D facility model, specifically, by creating a 3D model-based VR model library that can be disassembled and assembled for the operation maintenance virtual experience user according to the platform environment The present invention relates to a virtual experience system and a method for maintaining a 3D facility model for providing desired platform functions.

Operation and Maintenance (O & M) is an activity necessary to maintain normal functioning, such as inspecting and maintaining the facility and restoring damaged parts to preserve the function of the completed facility and to promote the convenience and safety of the user. to be.

In particular, in order for the facility to operate reliably and without interruption, 24 hours a day, 365 days a person is required to maintain the operation of the facility. Accordingly, the operation maintenance staff should provide an educational environment for acquiring the professional knowledge, know-how and skills to maintain the operation of the facility.

In the past, the method of training the operation maintenance personnel was mainly utilized using technical document data and various video materials. In this case, educational materials such as 3D contents of the facility, 3D CAD model, drawing data, and video on disassembly / assembly / operation principle were provided.

However, the operation maintenance personnel are only provided with shape-oriented explanation data on the facility through educational materials focused on visual effects, and it is difficult to provide hands-on training on the facility through these educational materials.

At this time, the operation maintenance personnel can be provided only when a separate training (experimental) program is opened offline to receive training (experience) training related to the operation maintenance of the facility. Even in the case of a training program that is opened offline, it may be difficult for remote dispatch personnel (eg, overseas dispatch staff, field dispatch staff, etc.) to provide training for the operation of the facility.

In addition, when the facilities are scattered in several regions, such as power plants, it may be difficult to gather training personnel in one place and to carry out practical training or to set up a training program in each region.

In addition, as an operation maintenance system, an electronic manual system, a facility management system, a history management system, and the like have been provided to operation maintenance personnel. However, these systems are implemented at a level where the operation maintenance personnel can check only the technical specifications or operation maintenance history for operation maintenance. Existing systems for maintaining such operation are not scalable enough to utilize, add, search and search existing technical data by interconnecting each system, and have limited user convenience to directly operate or practice the equipment. to be.

Therefore, operation maintenance personnel need a training environment that can be specifically disassembled, assembled and operated for the facility, and provided without limitation of space and time, and utilizes and adds existing technical data in connection with existing systems. In other words, a system that can search and search is needed.

Korea Registration Utility Model No. 20-0420811 (registered June 29, 2006) Registered Korean Patent No. 10-1480870 (registered on January 5, 2015)

The purpose of the present invention is to create a 3D model-based VR model library capable of disassembling and assembling a facility for operating virtual experience, thereby providing a platform function desired by the user according to the platform environment. It is to provide a system and a method thereof.

The virtual experience system for operating and operating a 3D facility model according to an aspect of the present invention generates a 3D model for each unit from CAD data of a facility for performing an operation maintenance virtual experience of a disassembly and assembly process, and recognizes it as a VR model. 3D model generation unit for forming a 3D model group capable of; A disassembly / assembly sequence generation unit for defining a sequence for disassembling and assembling the parts according to the maintenance procedure of the facility for each unit to correspond to the 3D model group; A VR model generation unit for generating a VR model through a VR modeling process by combining the 3D model group and the sequence; A VR library generation unit for generating an operation file of a VR engine for the VR model and registering it in a VR model library; And a platform controller for converting the VR model library according to a platform environment and providing the platform to the platform, wherein the 3D model generator is configured to assign a name of a 3D model included in the 3D model group to the 3D model group. Change to a unique group key value, and the decomposition / assembly sequence generation unit corresponds to the sequence key assigned to the sequence to the group key assigned to the 3D model group, and arranges all sequences in order according to the sequence number. Generating a list, wherein the decomposition / assembly sequence generation unit associates the technical data or the external system with the technical data or the external system by corresponding to the sequence number of each sequence included in the sequence list. The platform control unit may check the version and registration of the VR model library. Providing VR model library detected by the hour and converted according to the platform environment, when running on the PC platform, the VR model library is automatically converted for the PC platform, and then the VR model library is converted to the quality according to the PC platform specification. And provide a virtual environment by automatically converting the VR model library to the VR platform, and setting a predetermined unique space based on the user who is using the VR platform, when running on the VR platform. When running on a platform, the VR model library is automatically converted to match the AR platform, and a predetermined scan space is set based on a user who is using the AR platform to configure an augmented reality environment, and user requirements for each platform. To create the screen UI and viewer control function according to the registration and register it in the platform UI library The platform control unit further includes a platform function by controlling a platform UI optimization operation according to a platform environment with reference to the platform UI library and generating functions related to the disassembly and assembly of the facility for each platform. A platform function generation unit for registering in the library; The platform control unit, the platform function by controlling the platform function according to the platform environment by referring to the platform function library the function desired by the user in the VR model library, the platform function Using the library to control the disassembly / assembly simulation function, disassembly / assembly education function, external system and technical data link function, VM content section and development view function for the VR model library, and the training result of the disassembly / assembly education function Score, Sequence Execution Result, Sequence Execution History The sequence execution result includes a success count (SUCCESS), a failure count (FAILED), a step pass count (PASS), and a hint check count (HINT) for the entire sequence during the disassembly and assembly of the facility. The number of times of checking the hint is a number of times when the user is difficult to proceed to the next step sequence in the disassembly and assembly process of the facility. GT), boiler feed water pump (BFP), multiple pump (COP) may be any one.

delete

delete

According to one embodiment, the user interface unit for providing a suitable user environment according to the platform environment for performing the operation management virtual experience in cooperation with the platform control unit, the user interface unit, computer-based PC It can provide the platform environment of the platform, VR platform based on VR, AR platform based on AR.

According to an embodiment, the component property information generated by the 3D model generator, the sequence list generated by the decomposition / assembly sequence generator, the VR model library, the platform UI library, and the platform function library are integrated and stored. And an integrated DB for managing, wherein the platform controller may perform a control operation of functions for operating virtual experience according to the platform environment of the user interface unit based on the integrated DB.

delete

delete

The VR model generator may import the 3D model group to perform a VR model lightening operation and texture mapping, and then generate a driving animation of decomposition / assembly according to the sequence of the facility to complete the VR model.

delete

delete

In addition, the virtual experience method of operating the 3D facility model according to an aspect of the present invention, 3D model generation unit, decomposition / assembly sequence generation unit, VR model generation unit including a VR library generation unit, a platform control unit In the operation maintenance virtual experience method of the 3D facility model performed by the operation maintenance virtual experience system, the 3D model generation unit generates a 3D model for each unit from the CAD data of the equipment to perform the operation maintenance virtual experience of the decomposition and assembly process Forming a 3D model group that can be recognized as a VR model; Defining, by the disassembly / assembly sequence generation unit, a sequence representing a disassembly and assembly procedure for each unit according to a maintenance procedure of the facility and corresponding the sequence to a 3D model group; Generating, by the VR model generator, a VR model through a VR modeling process by combining the 3D model group and the sequence; Generating, by the VR library generator, an operation file of a VR engine with respect to the VR model and registering it in a VR model library; And converting, by the platform control unit, the VR model library according to a platform environment and providing the platform to a corresponding platform, wherein the forming of the 3D model includes the name of the 3D model included in the 3D model group. Changing to a unique group key value assigned to a model group, and wherein the corresponding step corresponds to a sequence key assigned to the sequence, wherein the decomposition / assembly sequence generation unit corresponds to a group key value assigned to the 3D model group, Generating a sequence list by ordering according to the sequence number, wherein the corresponding step, the disassembly sequence generation unit corresponding to the sequence number of each sequence included in the sequence list by the technical data or tag information of the external system, Linking the technical data related to the sequence or an external system and providing the The platform control unit detects the version and registration confirmation of the VR model library from time to time to provide a VR model library converted according to a platform environment, and when driven on a PC platform, the VR model library is automatically adapted to the PC platform. After the conversion, the VR model library is provided in the quality converted according to the PC platform specification, and when the VR platform is run on the VR platform, the VR model library is automatically converted for the VR platform, and then the user who is using the VR platform is Configure a virtual environment by setting a predetermined unique space as a reference, and when running on an AR platform, automatically converts the VR model library to suit the AR platform, and then scans based on a user who is using the AR platform. Set up space to configure augmented reality environment, and platform UI generation unit needs Generating a screen UI and a viewer control function according to a matter and registering the same in a platform UI library, wherein the providing step includes the platform control unit optimizing a platform UI according to a platform environment by referring to the platform UI library. And generating a function related to the disassembly and assembly of the facility for each platform and registering the function in a platform function library by the platform function generation unit. Control the platform function according to the platform environment by referring to the platform function library, the platform control unit using the platform function library for the decomposition / assembly simulation function, disassembly / assembly education function for the VR model library, External system and technical data connection Function, VM contents section view and exploded view function, and the training results of the disassembly / assembly training function are displayed with scores, sequence execution results, and sequence execution history, and the sequence execution results show the entire sequence during the disassembly and assembly of the facility. The number of successes (SUCCESS), the number of failures (FAILED), the number of step passes (PASS), and the number of hint checks (HINT) are included for the user. If it is difficult to proceed with the sequence, it is the number of times the hint function has been provided for the next step sequence progress, the equipment is any one of the gas turbine (GT), boiler feed water pump (BFP), multiple pump (COP) Can be.

delete

delete

delete

delete

In the generating step, after the VR model generator imports the 3D model group to perform a VR model lightening operation and texture mapping, the VR model generator generates a driving animation of decomposition / assembly according to the sequence of the facility to complete the VR model. Can be.

delete

The present invention can provide the platform functions desired by the user according to the platform environment by creating a 3D model-based VR model library capable of disassembling and assembling facilities for operating virtual experience.

In addition, the present invention can provide a training environment that can be specifically practiced (experienced) disassembly, assembly and operation principle for the corresponding equipment to the operation maintenance personnel and provided without limitation of time and space.

In particular, the present invention can provide a training program to the personnel in charge of operation even when the equipment is scattered in various areas such as a power plant.

In addition, the present invention can provide a system that can utilize, add, search and search existing technical data in connection with existing systems.

1 is a view of the operation and maintenance virtual experience system of the 3D facility model according to an embodiment of the present invention,
2a to 2c is a view showing a 3D model of a facility for operating virtual experience,
3A to 3C are views for explaining a disassembled state of the VR model library,
3D is a diagram for explaining a state before disassembly of a VR model library;
4A to 4D are diagrams illustrating a disassembly and assembly training process of a VR model library,
5A is a view showing a case where the VR model library is driven by the VR platform;
5B is a view showing a case where the VR model library is driven by the AR platform;
6 is a view for explaining the linkage between the VR model library and the technical data;
7a to 7c are views showing an exploded view of the VR model library,
8 is a view showing the operation maintenance virtual experience start screen,
9 is a view of a virtual experience operation method of operating the 3D facility model according to an embodiment of the present invention.

In order to fully understand the present invention, preferred embodiments of the present invention will be described with reference to the accompanying drawings. Embodiment of the present invention may be modified in various forms, the scope of the invention should not be construed as limited to the embodiments described in detail below. This embodiment is provided to more completely explain the present invention to those skilled in the art. Therefore, the shape of the elements in the drawings and the like may be exaggerated to emphasize a more clear description. It should be noted that the same members in each drawing are sometimes shown with the same reference numerals. Detailed descriptions of well-known functions and configurations that are determined to unnecessarily obscure the subject matter of the present invention are omitted.

1 is a diagram of a virtual experience management system of the 3D facility model according to an embodiment of the present invention.

As shown in FIG. 1, the operation maintenance virtual experience system (hereinafter referred to as “operation maintenance virtual experience system”, 100) of the 3D facility model according to an embodiment of the present invention may be disassembled for the operation maintenance virtual experience. And by creating a 3D model-based VR model library that can be assembled to provide the user's desired platform functions according to the platform environment.

In addition, the operation maintenance virtual experience system 100 may perform external systems (ERP system, maintenance system, facility management system, history management system, electronic manual, etc.) or technical data on parts information of the VR model library for a specific facility. Link.

The operation maintenance virtual experience system 100 is a 3D model generation unit 110, decomposition / assembly sequence generation unit 120, VR model generation unit 130, VR library generation unit 140, platform UI generation unit 150 ), The platform function generating unit 160, the integrated DB 170, the platform control unit 180, the user interface 190.

The 3D model generator 110 generates a 3D model for each unit from CAD data of a facility for performing a virtual operation experience of disassembly and assembly. In this case, the 3D model generator 110 stores the component property information in which the property of each component input when the 3D model is generated in the integrated DB 170.

Here, the facility for the operation maintenance virtual experience may be, for example, a gas turbine (GT), a boiler feedwater pump (BFP), a multiple pump (COndensate Pump (COP)) and the like (FIG. 2A to FIG. 2). 2c).

In addition, the 3D model generator 110 automatically forms a group capable of recognizing one or more 3D models as a VR model. At this time, the 3D model generation unit 110 changes the name of the 3D model included in the group to a 'group key value' which is a unique key value assigned to the group.

The disassembly / assembly sequence generation unit 120 defines a sequence for disassembly and assembly according to the maintenance procedure of the facility. For example, a sequence corresponding to a disassembly or assembly section of 65 steps for a boiler feed pump and 47 steps for a plurality of pumps may be defined.

Here, the sequence is a unit corresponding to the 3D model group generated by the 3D model generation unit 110 for the disassembly and assembly of the facility. That is, one sequence corresponds to one disassembly and assembly section, which may be viewed as a section representing a component unit of a specific facility. The sequence number assigned to one sequence corresponds to the group key value assigned to the 3D model group.

In addition, the decomposition / assembly sequence generation unit 120 generates a sequence list in which all sequences related to disassembly and assembly of the facility are arranged in order according to the sequence number. In this case, the disassembly / assembly sequence generation unit 120 may include technical data related to each sequence of the sequence list (eg, maintenance procedure, operation procedure, drawing, disassembly / assembly / operation principle video, check list, warning list, etc.) or an external system. Link it. Tag information (or specific key values) in technical data or external systems (ie, ERP systems, maintenance systems, etc.) corresponds to the sequence number of the sequence.

In this way, the sequence may comprehensively include all information before, during and after the disassembly and assembly of the facility. The decomposition / assembly sequence generation unit 120 stores the sequence list in the integrated DB 170.

The VR model generator 130 generates a VR model through a VR modeling process by combining the 3D model group generated by the 3D model generator 110 and the sequence generated by the decomposition / assembly sequence generator 120. .

In detail, the VR model generator 130 imports the 3D model group generated by the 3D model generator 110 to automatically align the 3D model group according to the group key value to perform a VR model lightening operation. Here, the lightweighting of the VR model is a task of reducing the capacity of the VR model by removing unnecessary vertices of 3D models of the 3D model group, and is a task for smoothly driving the VR model on each platform. Each platform may be a computer-based PC platform, a VR platform based on virtual reality, an AR (Augmented Reality), an AR platform based on augmented reality, and the like.

In addition, the VR model generator 130 performs texture mapping to realistically express the VR model. This texture mapping is a technique for describing or coloring the detailed textures of the surface materials of the 3D model.

Thereafter, the VR model generator 130 generates a driving animation of decomposition / assembly according to the sequence of the facility to complete the VR model.

Meanwhile, the 3D model generator 110 and the VR model generator 130 may be provided in the form of a plug-in program for supporting some functions. For example, the 3D model generating unit 110 may include a function of automatically generating a group capable of recognizing a 3D model as a VR model, and a function of extracting part property information according to a group key value and storing the information in an integrated DB. have. In addition, the VR model generator 130 may correspond to a VR model lightweight work function.

The VR library generator 140 imports the VR model generated by the VR model generator 130 to generate an operation file of a virtual reality engine, and then registers the VR model library of the integrated DB 170. do.

At this time, the VR library generating unit 140 checks the linkage error of the sequence corresponding to the group key value of the VR model before registering it in the VR model library, and drives the driving animation of disassembly / assembly according to the sequence of the corresponding facility. Check for errors.

The platform UI generation unit 150 generates a screen UI (user interface) and a viewer control function according to platform-specific user requirements and registers them in the platform UI library of the integrated DB 170.

The platform function generation unit 160 may disassemble and assemble related facilities (eg, disassembly / assembly simulation function, disassembly / assembly education function, external system and document data linkage) provided through the operation maintenance virtual experience system 100. Function, development view view function, section view function, etc.) is generated for each platform and registered in the platform function library of the integrated DB 170.

The platform controller 180 performs a control operation of functions for operating virtual experience based on the platform environment of the user interface 190 based on the integrated DB 170.

The platform controller 180 loads a VR model library of a suitable type as each platform is driven. That is, the platform controller 180 provides the VR model library converted according to the platform environment to each platform. This is because the VR model library includes the ability to distinguish each platform on its own.

To this end, the platform control unit 180 performs a unique function according to the platform.

The platform controller 180 detects the version and the registration confirmation of the VR model library generated by the VR library generator 140 from time to time. The platform controller 180 provides a VR model library converted according to a platform environment when the VR model library is newly registered or modified.

Specifically, when driven on a PC platform, the platform control unit 180 automatically converts the VR model library for the PC platform, and then provides the VR model library with the converted quality according to the PC platform specification. That is, a high quality VR model library is run on a high-end PC and a low quality VR model library is run on a low-end PC.

When driven in the VR platform, the platform control unit 180 automatically converts the VR model library to the VR platform, and then sets a predetermined unique space (space of 3 square meters on the basis of the user who is using the VR platform). Configure the virtual environment.

Here, the virtual environment is set as the most suitable virtual space for the facility to operate, it is provided to the user as a virtual space full of realism. For example, when the gas turbine GT is set as a target facility, the virtual space inside the turbine building where the gas turbine is installed is set as a virtual environment.

When driven on an AR platform, the platform control unit 180 automatically converts the VR model library for the AR platform, and then scans a predetermined scan space (scanned space of 5 square meters on the basis of the user using the AR platform). Configure augmented reality environment by setting).

Here, the augmented reality environment can interact with the user and show a 3D virtual image overlaid on the reality background.

In addition, the platform controller 180 refers to the platform UI library of the integrated DB 170 to optimize the platform UI according to the platform environment in order to implement the VR model library converted according to the platform environment in a suitable form through the platform UI. Do this. This is because the resolution and the UI form are different according to the platform environment, and thus, a platform UI optimization task is required.

Accordingly, the platform controller 180 calculates the resolution according to the platform environment with reference to the platform UI library and determines and provides a UI form that varies according to the platform environment.

Here, the platform control unit 180 is a UI form that varies depending on the platform environment, and determines and provides a method of operating a model for each platform.

For example, in the case of a PC platform, the platform controller 180 provides a UI form using a keyboard and a mouse, which are tools mainly used by a user. In the case of the VR platform, the platform controller 180 provides a UI form using a touch controller which is a tool mainly used by a user. In the case of the AR platform, the platform controller 180 provides a UI form that enables the user to rotate the model and / or adjust the size according to the gesture because a tool mainly used by the user operates the gesture by hand.

In addition, the platform controller 180 refers to the platform UI library of the integrated DB 170 to optimize the platform UI according to the platform environment in order to implement the VR model library converted according to the platform environment in a suitable form through the platform UI. Do this.

In addition, the platform control unit 180 implements platform functions according to the platform environment by referring to the platform function library of the integrated DB 170 with the functions desired by the user in the loaded VR model library.

Here, the platform function may include a disassembly / assembly simulation function, a disassembly / assembly education function, an external system and technical data linkage function, a VM content cross section and a development view function, and the like.

In detail, in the case of the disassembly / assembly simulation function, the platform control unit 180 provides a disassembly / assembly simulation function that enables disassembly or assembly of the VR model library using the platform function library. The user can learn the order of disassembly and assembly of the installation regardless of the platform environment.

In the case of the disassembly / assembly education function, the platform control unit 180 provides a disassembly / assembly education function for training and evaluating the disassembly or assembly process of the VR model library. The user selects one equipment from the list of multiple equipment, conducts disassembly or assembly training in the form of question and answer, and finishes all processes and is evaluated.

In the case of an external system and technical data linkage function, the platform control unit 180 provides a function of checking an external system and technical data linked to the VR model library. However, the platform controller 180 does not provide an external system and technical data linkage function in the case of the AR platform.

When a user selects a specific part, the user can interwork with an external system linked to the specific part or view the technical data associated with the specific part.

In the case of the VM content cross section and the developed view view function, the platform control unit 180 provides a function of representing the cross section and the developed view of the VR model library.

The user can select one of the three axes (x, y, z) to display the components of the VM content in a flat view, or select one of the three axes, one of the front, or the rear, to cut the VM content. Can be. The user can specify the degree of cut in the function of the section view.

The user interface 190 provides a user environment suitable for the platform environment in order to perform an operation management virtual experience by interworking with the platform control unit 180. That is, the user interface 190 provides a platform environment of a computer-based PC platform, a VR platform based on VR, and an AR platform based on AR.

The user interface unit 190 is an input device (eg, a keyboard, a mouse, a touch screen, a camera, a cam, various sensors, etc.) for disassembling and assembling the corresponding equipment, and a process of disassembling and assembling the corresponding equipment. It works in conjunction with an output device (eg, display, speaker, etc.) that allows the user to check.

The user interface 190 performs a user authentication procedure of the start stage of the operation maintenance virtual experience system 100.

In addition, the user interface 190 selects a facility and a platform function according to the operation maintenance virtual experience.

2a to 2c is a view showing a 3D model of the facility for the operation maintenance virtual experience.

FIG. 2A shows a 3D model of the gas turbine GT, FIG. 2B shows a 3D model of the boiler feed pump BFP, and FIG. 2C shows a 3D model of the multiple pump COP. These facilities are libraryed by building detailed, 3D models of real-world detail by component unit for disassembly and assembly, based on the contents of the maintenance procedures. That is, the 3D model of the facility may be represented in detail as a set of a plurality of lower parts for one upper part through a hierarchical representation of each part.

As such, since the 3D model of the facility serves as the basis for the VR model library used for the operation maintenance virtual experience, it is preferable to reflect the unit of the actual facility as it is.

However, the operation maintenance virtual experience system 100 is a facility for the operation maintenance virtual experience, which has been described as an example of a gas turbine GT, a boiler feed water pump BP, and a multiple pump COP, but is not limited thereto.

3A to 3C are diagrams illustrating the disassembled state of the VR model library, and FIG. 3D is a diagram illustrating the pre-disassembled state of the VR model library.

FIG. 3A shows the disassembly state of the VR model library of the gas turbine GT, FIG. 3B shows the disassembly state of the VR model library of the boiler feed water pump BFP, and FIG. 3C shows the disassembly state of the multiple model pump COP. Indicates the disassembly state for the VR model library.

Referring to FIGS. 3A to 3C, the screen showing the disassembly state of the VR model library of the facility includes the VR model display windows 10 to 30, the disassembly steps 11 to 31 indicating the disassembled state, and the disassembly of the facility. And sequence flow charts 21 to 32 representing a sequence list as an assembly section, sequence slide bars 13 to 33 for easily confirming movement of a unit sequence included in the sequence list, and disassembling and assembling the corresponding equipment. Sequence animation playback buttons 14 to 34 that can be confirmed by animation are provided. This case represents the case shown in the PC platform.

In particular, the VR model display windows 10 to 30 change and display the color of the parts of the corresponding equipment corresponding to the sequence selected by the user in the sequence flow charts 21 to 32. That is, in the case of FIG. 3A, the parts 10a of the corresponding facility corresponding to the sequence for '054. Special Tool installation, Exhaust Manifold Upper Half disassembly' are displayed in yellow. In the case of Figure 3b '027. The part 20a of the installation corresponding to the sequence for 'barrel cover disassembly' is displayed in yellow. In the case of Figure 3c '13. The parts 30a of the equipment corresponding to the sequence for disassembling the motor and the adjustable bolt are displayed in yellow.

In addition, the sequence flow charts 21 to 32 can view or edit detailed information about the sequence of the facility. Here, the detailed information on the sequence of the facility may be part property information.

In addition, the sequence flow charts 21 to 32 can display a detailed view and a brief view of a sequence of a corresponding facility, as well as a unit object display function that displays only parts corresponding to a specific sequence due to selection of a specific sequence. It is also possible.

Referring to FIG. 3D, a user confirmation item 40 for each step is displayed in a disassembly and assembly process of a corresponding facility on a screen showing a state before disassembly of a VR model library of the corresponding facility.

4A to 4D are diagrams illustrating a disassembly and assembly training process of the VR model library.

4A shows a sequence 51 for 'Top Hat Nozzle, Pilot Nozzle, Main Nozzle Disassembly' during the disassembly and assembly of the gas turbine GT. The sequence 51 corresponds to step 23 of 139 of the entire sequence. The component 52 corresponding to the sequence 51 is displayed in yellow on the VR display window 50. At this time, the component 52 is combined into the lower component 53 configured in detail.

4B shows the sequence 61 for 'Bearing cooling line disassembly' in the disassembly and assembly training of the multiple pump (COP). The sequence 61 corresponds to step 1 of 47 of the entire sequence.

Parts corresponding to the sequence 61 are combined into sub-parts 62, and specific sub-parts 62a can be viewed for detailed information. Detailed information of the specific sub-part 62a includes sequence information (ie, part no, part description, part quantity (Qty), part material), check list, and warning. A warning list is displayed.

4C shows a sequence 71 for 'Special Tool Installation, Compressor 3rd Blade Ring Lower Half Assembly' during disassembly and assembly of the gas turbine GT. The sequence 71 corresponds to step 2 of 139 of the entire sequence.

If it is difficult for the user to proceed to the next step sequence in the sequence 71 of the disassembly and assembly of the gas turbine GT, the hint view 72 may be provided an indication for the next step sequence.

Figure 4d shows the training results of the disassembly and assembly training process of the boiler feed water pump (BFP).

In the training result of FIG. 4D, a score 81, a sequence execution result 82, and a sequence execution history 83 are displayed.

Score 81 displays the progress score as a percentage (%) during the disassembly and assembly training of the boiler feed pump (BFP).

The sequence execution result 82 indicates the number of successes SUCCESS, the number of failures FAILED, the number of step passes PASS, and the number of hint checks HINT for the entire sequence in the disassembly and assembly of the boiler feed pump. Here, in step 65 of the entire sequence, the number of successes 10 times, the number of failures 5 times, the number of step passes 50 times, and the number of hint checks 7 times are shown.

The sequence execution history 83 specifically shows the execution history for each sequence. Here, whether SUCCESS, FAILED, PASS, or HINT is indicated by the sequence number SEQUENCE NO.

FIG. 5A illustrates a case where the VR model library is driven by the VR platform, and FIG. 5B illustrates a case where the VR model library is driven by the AR platform.

Referring to FIG. 5A, when the VR model library is driven by the VR platform, a virtual space that is similar to reality but is not real may be generated to give the user a feeling of actually entering the virtual space.

Users can experience an indirect experience that allows them to simulate virtually difficult or expensive tasks in a virtual space.

In FIG. 5A, the user may experience the inside of the turbine building where the gas turbine GT is actually installed as a virtual space, and thus the user may check the state where the gas turbine GT is installed through the virtual space.

Referring to FIG. 5B, when the VR model library is driven by the AR platform, it is possible to interact with a virtual object based on the real world.

Users can experience the indirect experience of disassembling the actual facility by discussing with others in front of the facility composed of VR models.

In FIG. 5B, the user can experience a realistic disassembly and assembly process while watching the gas turbine GT of the VR model located in the real space.

6 is a view for explaining the linkage between the VR model library and technical data.

FIG. 6 shows a sequence 91 of 'Special Tool Installation, Inlet Casing and Compressor Cylinder Upper H' during the assembly and disassembly of the gas turbine GT. In the details of the sequence 91, '2.IGV, IGV Angle Clearance Check' and '3.Inlet Seal Housing Step Check' in the 'Check List' are displayed. It is. The technical data (93) linked to '3.Inlet Seal Housing Step Check' is the technical document describing the check sheet related to 'Steps of Inlet Seal Housing'.

7A to 7C are exploded views of the VR model library.

FIG. 7A shows a developed view of a component unit of the gas turbine GT, FIG. 7B shows a developed view of a component unit of the boiler feed water pump BFP, and FIG. 7C shows a developed view of a component unit of the multiple pump COP. In addition, the developed view of the facility may be displayed differently at the upper or lower part level for the entire facility, or may be displayed by applying the part level differently for a specific part.

8 is a diagram illustrating an operation maintenance virtual experience start screen.

When the user connects through user authentication of the operation maintenance virtual experience system 100 through the user interface 190, the user selects a facility to proceed with the operation maintenance virtual experience and the corresponding platform function.

Referring to FIG. 8, the operation maintenance virtual experience start screen displays a facility information window 95, a platform function selection menu 96, and a facility selection menu 97.

9 is a view of a virtual experience operation method of operating the 3D facility model according to an embodiment of the present invention.

Referring to FIG. 9, the operation maintenance virtual experience system 100 may generate a 3D model for each unit from CAD data of a facility to perform an operation maintenance virtual experience of a disassembly and assembly process, and may recognize it as a VR model. A 3D model group is formed (S201).

Subsequently, the operation maintenance virtual experience system 100 defines a sequence for disassembly and assembly according to the maintenance procedure of the corresponding facility and corresponds the sequence to the 3D model group (S202). At this time, the operation maintenance virtual experience system 100 changes the name of the 3D model included in the 3D model group to a unique group key value assigned to the 3D model group.

Thereafter, the operation maintenance virtual experience system 100 generates a VR model through a VR modeling process by combining the 3D model group and the sequence (S203). At this time, the operation maintenance virtual experience system 100 imports the 3D model group, performs the VR model lightening work and texture mapping, and then generates a driving animation of decomposition / assembly according to the sequence of facilities to complete the VR model.

In addition, the operating virtual experience system 100 generates a sequence list by matching the group key value assigned to the 3D model group with the sequence number assigned to the sequence and sorting the entire sequences in order according to the sequence number.

The operation virtual experience system 100 associates the technical data or the tag information of the external system with the sequence number of each sequence included in the sequence list, thereby linking the technical data or the external system related to the sequence.

Then, the operation maintenance virtual experience system 100 generates a motion file of the VR engine for the VR model and registers it in the VR model library (S204).

Thereafter, the operation maintenance virtual experience system 100 converts the VR model library according to the platform environment and provides the platform to the corresponding platform (S205).

In this case, the operation maintenance virtual experience system 100 controls the optimization of the platform UI according to the platform environment with reference to the platform UI library. In addition, the operation maintenance virtual experience system 100 controls the platform function according to the platform environment by referring to the platform function library the function desired by the user in the VR model library. In particular, the operation maintenance virtual experience system 100 controls the disassembly / assembly simulation function, disassembly / assembly education function, external system and technical data linkage function, VM content cross section and development view function by using the platform function library. do.

Embodiments of the present invention described above are merely exemplary, and those skilled in the art will appreciate that various modifications and equivalent other embodiments are possible therefrom. Therefore, it will be understood that the present invention is not limited only to the form mentioned in the above detailed description. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims. It is also to be understood that the present invention includes all modifications, equivalents and substitutions within the spirit and scope of the invention as defined by the appended claims.

110: 3D model generation unit 120: decomposition / assembly sequence generation unit
130: VR model generation unit 140: VR library generation unit
150: platform UI generation unit 160: platform function generation unit
170: integrated DB 180: platform control
190: the user interface unit

Claims (17)

A 3D model generator for generating a 3D model group that can be recognized as a VR model by generating a 3D model for each unit from CAD data of a facility for performing a virtual maintenance experience of a disassembly and assembly process;
A disassembly / assembly sequence generation unit for defining a sequence for disassembling and assembling the parts according to the maintenance procedure of the facility for each unit to correspond to the 3D model group;
A VR model generation unit for generating a VR model through a VR modeling process by combining the 3D model group and the sequence;
A VR library generation unit for generating an operation file of a VR engine for the VR model and registering it in a VR model library; And
And a platform controller for converting the VR model library according to a platform environment and providing the same to a platform.
The 3D model generation unit changes the name of the 3D model included in the 3D model group to a unique group key value assigned to the 3D model group,
The decomposition / assembly sequence generation unit generates a sequence list by matching the group key value assigned to the 3D model group to the sequence number assigned to the sequence, and arranging all sequences in order according to the sequence number.
The decomposition / assembly sequence generation unit associates the technical data or the external system related to the sequence by mapping the technical data or the tag information of the external system to the sequence number of each sequence included in the sequence list,
The platform control unit,
While detecting the version and registration confirmation of the VR model library from time to time to provide a VR model library converted according to the platform environment,
When running on a PC platform, the VR model library is automatically converted to match the PC platform, and then the VR model library is provided at a quality converted according to the PC platform specification. After converting automatically to the VR platform, the virtual environment is configured by setting a predetermined unique space based on the user who is using the VR platform, and when running on the AR platform, the VR model library is automatically adapted to the AR platform. After converting to, configure augmented reality environment by setting a predetermined scan space based on the user using the AR platform,
And a platform UI generator for generating a screen UI and a viewer control function according to platform-specific user requirements and registering the same in a platform UI library.
The platform control unit controls the optimization of the platform UI according to the platform environment with reference to the platform UI library,
And a platform function generator for generating functions related to the disassembly and assembly of the facility for each platform and registering the platform function in a platform function library.
The platform control unit controls a platform function according to a platform environment by referring to the platform function library to a function desired by the user in the VR model library, and disassembles / assembles a simulation function of the VR model library using the platform function library. Control of disassembly / assembly training function, external system and technical data connection function, VM content cross section and development view function ,
The training results of the disassembly / assembly training function are displayed scores, sequence performance results, sequence performance history,
The sequence execution result includes a success count (SUCCESS), a failure count (FAILED), a step pass count (PASS), and a hint check count (HINT) for the entire sequence in the disassembly and assembly of the facility.
The number of times the hint check is a number of times when the user is difficult to proceed to the next step sequence in the disassembly and assembly process of the facility, the hint view function is provided an indication for proceeding to the next step sequence,
The facility is a virtual experience system of operation maintenance of the 3D facility model of any one of a gas turbine (GT), a boiler feed water pump (BFP), a plurality of pumps (COP).
delete delete The method of claim 1,
And a user interface unit for providing a suitable user environment according to a platform environment in order to perform an operation management virtual experience in cooperation with the platform control unit.
The user interface unit, a virtual experience system for operating a 3D facility model that provides a platform environment of a computer-based PC platform, VR-based VR platform, AR platform based on augmented reality.
The method of claim 4, wherein
Integrated DB for integrated storage and management of the component property information generated by the 3D model generator, the sequence list generated by the decomposition / assembly sequence generator, the VR model library, the platform UI library, and the platform function library More;
The platform control unit,
Operation maintenance virtual experience system of the 3D facility model for performing a control operation of functions for the operation maintenance virtual experience based on the platform environment of the user interface unit based on the integrated DB.
delete delete The method of claim 1,
The VR model generation unit,
Virtual modeling system for operating a 3D facility model for importing the 3D model group to perform a VR model lightening operation and texture mapping, and then generates a driving animation of decomposition / assembly according to the facility sequence to complete the VR model.
delete delete In the virtual experience method of operating the 3D facility model performed by the virtual experience system for operating and operating the 3D facility model including a 3D model generation unit, decomposition / assembly sequence generation unit, VR model generation unit, VR library generation unit, platform control unit ,
Generating a 3D model group that can be recognized as a VR model by generating a 3D model for each unit from CAD data of a facility to perform an operation maintenance virtual experience of the disassembly and assembly process;
Defining, by the disassembly / assembly sequence generation unit, a sequence representing a disassembly and assembly procedure for each unit according to a maintenance procedure of the facility and corresponding the sequence to a 3D model group;
Generating, by the VR model generator, a VR model through a VR modeling process by combining the 3D model group and the sequence;
Generating, by the VR library generator, an operation file of a VR engine with respect to the VR model and registering it in a VR model library; And
And converting, by the platform control unit, the VR model library according to a platform environment and providing the platform to a corresponding platform.
In the forming step, the model generation unit changes the name of the 3D model included in the 3D model group to a unique group key value assigned to the 3D model group,
In the corresponding step, the decomposition / assembly sequence generation unit corresponds to a sequence key assigned to the sequence to a group key value assigned to the 3D model group, and generates a sequence list by arranging all sequences in order according to the sequence number. ,
In the corresponding step, the decomposition / assembly sequence generation unit associates the technical data or the external system tag information with the sequence number of each sequence included in the sequence list, thereby linking the technical data related to the sequence or the external system,
In the providing step, the platform control unit detects the version and registration confirmation of the VR model library from time to time to provide a VR model library converted according to the platform environment,
When running on a PC platform, the VR model library is automatically converted to match the PC platform, and then the VR model library is provided at a quality converted according to the PC platform specification. After converting automatically to the VR platform, the virtual environment is configured by setting a predetermined unique space based on the user who is using the VR platform, and when running on the AR platform, the VR model library is automatically adapted to the AR platform. After converting to, configure augmented reality environment by setting a predetermined scan space based on the user using the AR platform,
And generating, by the platform UI generation unit, a screen UI and a viewer control function according to platform-specific user requirements, and registering them in the platform UI library.
In the providing step, the platform control unit controls the optimization of the platform UI according to the platform environment with reference to the platform UI library,
And generating, by a platform function generating unit, functions related to disassembling and assembling the facility for each platform, and registering them in a platform function library.
In the providing step, the platform control unit controls a platform function according to a platform environment by referring to the platform function library a function desired by the user in the VR model library, and the platform control unit uses the platform function library to control the VR model. Control the disassembly / assembly simulation function for the library, disassembly / assembly training function, external system and technical data linkage function, and view VM contents section and development view
The training results of the disassembly / assembly training function are displayed scores, sequence performance results, sequence performance history,
The sequence execution result includes a success count (SUCCESS), a failure count (FAILED), a step pass count (PASS), and a hint check count (HINT) for the entire sequence in the disassembly and assembly of the facility.
The number of times the hint check is a number of times when the user is difficult to proceed to the next step sequence in the disassembly and assembly process of the facility, the hint view function is provided an indication for proceeding to the next step sequence,
The facility is a virtual experience method of operation maintenance of the 3D facility model is any one of a gas turbine (GT), a boiler feed water pump (BFP), a plurality of pumps (COP).
delete delete delete delete The method of claim 11,
The generating step,
After the VR model generation unit imports the 3D model group to perform a VR model lightening operation and texture mapping, and generates a driving animation of decomposition / assembly according to the equipment sequence, to operate the 3D facility model to complete the VR model. Maintenance virtual experience method.
delete

Images