CN117351178A

CN117351178A - Maintenance simulation method, system, computer device and storage medium

Info

Publication number: CN117351178A
Application number: CN202311392771.5A
Authority: CN
Inventors: 张俭; 苟立安; 张靖岩
Original assignee: China Nuclear Power Operation Co Ltd
Current assignee: China Nuclear Power Operation Co Ltd
Priority date: 2023-10-25
Filing date: 2023-10-25
Publication date: 2024-01-05

Abstract

The present application relates to a service simulation method, system, computer device, storage medium and computer program product. The method comprises the following steps: responding to the equipment operation instruction, analyzing the equipment operation instruction, and obtaining equipment operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information; determining a target component in the three-dimensional model according to the position information; determining virtual execution actions according to the equipment type and the overhaul guide information; and performing overhaul simulation on the target component in the virtual reality environment according to the virtual execution action. The method can be used for the overhauling staff to simulate and learn the overhauling process, and improves overhauling and learning efficiency.

Description

Maintenance simulation method, system, computer device and storage medium

Technical Field

The present application relates to the field of virtual reality technology, and in particular, to a maintenance simulation method, system, computer device, storage medium, and computer program product.

Background

The pneumatic stop valve of the nuclear power plant is complex in structure, the maintenance process needs to be carried out with spring force release, seal welding cutting, blue oil test of the sealing surfaces of the valve clack and the valve seat, grinding and the like, the requirements on the skills of maintenance work responsible persons are very high, and high radiation protection safety risks exist.

The maintenance training of the traditional nuclear pneumatic stop valve can only be carried out on the overhaul site, and the learning efficiency of maintenance personnel is low. Therefore, in order to improve the overhaul skills of an overhaul worker, an overhaul simulation method capable of simulating an overhaul process is needed, so that the overhaul worker can perform simulation learning on the overhaul process.

Disclosure of Invention

In view of the foregoing, it is desirable to provide an inspection simulation method, system, computer device, computer readable storage medium, and computer program product that can be used for an inspection person to perform simulation learning on an inspection process, thereby improving inspection learning efficiency.

In a first aspect, the present application provides a service simulation method, including:

responding to the equipment operation instruction, analyzing the equipment operation instruction, and obtaining equipment operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information;

determining a target component in the three-dimensional model according to the position information;

determining virtual execution actions according to the equipment types and the overhaul guide information;

and performing overhaul simulation on the target component in the virtual reality environment according to the virtual execution action.

In one embodiment, determining a target component in a three-dimensional model based on the location information includes:

determining a model view type in response to the model view selection instruction;

generating a target view three-dimensional model corresponding to the model view type according to the model view type and the three-dimensional model;

displaying the three-dimensional model of the target view in the virtual reality environment;

and determining the target component in the target view three-dimensional model according to the position information.

In one embodiment, the location information includes first location information indicated by rays emitted by the operating device in the virtual reality environment; the operation device is a device for sending a device operation instruction; determining a target component in the target view three-dimensional model according to the position information, wherein the method comprises the following steps of:

and under the condition that the equipment type is the ray type, taking the part corresponding to the first position information on the three-dimensional model of the target view as a target part in the three-dimensional model of the target view.

In one embodiment, the device type includes a button type or a touch pad type; the determining a virtual execution action according to the equipment type and the overhaul guiding information comprises the following steps:

determining the operation type of the operation device from the device operation information under the condition that the device type is a button type or a touch pad type;

Determining an initial execution action according to the operation type;

and adjusting the initial execution action according to the overhaul guide information to obtain a virtual execution action.

In one embodiment, determining the initial execution action based on the type of operation includes:

under the condition that the operation type is a switching type, acquiring a currently selected component, and determining an initial execution action as a switching mode of the currently selected component to a target component;

in the case that the operation type is the grasp type, determining an initial execution action as grasping the target component;

under the condition that the operation type is a placement type, acquiring a first target position; determining an initial execution action as placing the target part at a first target location;

acquiring a rotation angle under the condition that the operation type is a rotation type; determining an initial execution action as rotating the target member by a corresponding rotation angle;

acquiring a second target position under the condition that the operation type is a throwing type; the initial execution action is determined to be grabbing the target component and placed at a second target location.

In one embodiment, the service simulation method further comprises:

obtaining maintenance sequences of a plurality of target components and maintenance results of the target components, and comparing the maintenance sequences with a reference maintenance sequence to obtain a first assessment result;

Extracting a process result from the overhaul result of the current target component aiming at each target component, and comparing the extracted process result with a reference process result corresponding to the current target component to obtain a second assessment result of the current target component;

for each target component, extracting a quality result from the overhaul result of the current target component, and comparing the extracted quality result with a reference quality result corresponding to the current target component to obtain a second assessment result of the current target component;

and determining an assessment result based on the first assessment result, the second assessment result and the third assessment result which correspond to each target component.

In a second aspect, the present application also provides a service simulation system, including:

the virtual simulation module is used for responding to the equipment operation instruction, analyzing the equipment operation instruction and obtaining equipment operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information;

the image processing module is used for determining a target component in the three-dimensional model according to the position information;

the background management module is used for determining virtual execution actions according to the equipment types and the overhaul guide information; and overhauling the target component in the virtual reality environment according to the virtual execution action.

In a third aspect, the present application also provides a computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:

In a fourth aspect, the present application also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:

In a fifth aspect, the present application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of:

The overhaul simulation method, the system, the computer equipment, the storage medium and the computer program product adopt a virtual reality environment, respond to equipment operation instructions and analyze the equipment operation instructions to obtain equipment operation information, determine target components indicated by the equipment operation information in the virtual reality environment, and combine the equipment operation information with overhaul guide information in the virtual reality environment to obtain virtual execution actions, and overhaul and simulate the target components in the virtual reality environment according to the virtual execution actions. According to the method for carrying out overhaul simulation in the virtual reality environment, as the equipment operation instruction can be initiated by an overhaul worker based on overhaul requirements, the overhaul worker can carry out overhaul simulation on any target component in the object to be overhauled, and therefore the learning efficiency of the overhaul worker is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the related art, the drawings that are required to be used in the embodiments or the related technical descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to the drawings without inventive effort for a person having ordinary skill in the art.

FIG. 1 is an application environment diagram of a service simulation method in one embodiment;

FIG. 2 is a schematic flow diagram of a method of simulation of service in one embodiment;

FIG. 3 is a block diagram of the components of a service simulation system in one embodiment;

FIG. 4 is a schematic flow diagram of a service simulation system setup in one embodiment;

FIG. 5 is a block diagram of a service simulation system in one embodiment;

fig. 6 is an internal structural diagram of a computer device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

The overhaul simulation method provided by the embodiment of the application can be applied to an application environment shown in fig. 1. Wherein the terminal 102 communicates with the server 104 via a network. The data storage system may store data that the server 104 needs to process. The data storage system may be integrated on the server 104 or may be located on a cloud or other network server. The terminal 102 responds to the equipment operation instruction and analyzes the equipment operation instruction to obtain equipment operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information; determining a target component in the three-dimensional model according to the position information; determining virtual execution actions according to the equipment types and the overhaul guide information; and performing overhaul simulation on the target component in the virtual reality environment according to the virtual execution action. The terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, internet of things devices, and portable wearable devices, where the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart vehicle devices, and the like. The portable wearable device may be a smart watch, smart bracelet, headset, or the like. The server 104 may be implemented as a stand-alone server or as a server cluster of multiple servers.

In an exemplary embodiment, as shown in fig. 2, a service simulation method is provided, and the method is applied to the terminal 102 in fig. 1 for illustration, and includes the following steps 202 to 208. Wherein:

step 202, responding to the equipment operation instruction, analyzing the equipment operation instruction, and obtaining equipment operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information.

The device operation instruction refers to an instruction sent by the operation device. And the overhauling personnel performs overhauling simulation on the object to be overhauled by controlling the operation equipment. In some embodiments, the operating device may be of the type of an operating handle or a remote control device. And the terminal receives an equipment operation instruction sent by the operation equipment in the process of controlling the operation equipment by the overhauling personnel. The terminal responds to and analyzes the received equipment operation instruction to obtain equipment operation information. The parsing method is determined according to the protocol followed by the instruction.

The virtual reality environment refers to a simulated virtual environment created by computer-generated images and sounds for an attendant to personally feel scenes and experiences therein.

The object to be overhauled is an object needing overhauling simulation. The object to be overhauled can be provided with different objects according to different overhauling requirements. For example, the maintenance requirement is to perform maintenance simulation on a nuclear-grade pneumatic stop valve of a nuclear power plant, and the object to be maintained is the nuclear-grade pneumatic stop valve of the nuclear power plant.

A three-dimensional model of the object to be serviced may be displayed in the virtual reality environment.

The overhaul guide information refers to virtual guide information preset for each object to be overhauled in the virtual reality environment. The guiding information can exist in the form of text, voice, video or algorithm model and is used for providing virtual guidance for the object to be overhauled, so that the overhauling learning efficiency is improved.

The device type refers to the type of the operation device that transmits the device operation instruction.

The location information is used to characterize the location indicated by the operating device. In some embodiments, a position sensor is disposed in the operation device, and the position sensor may acquire a position of the operation device. In addition, under the condition that the terminal is a virtual reality head-mounted device, the position of the operation device can be converted into a virtual reality environment through a preset registration method, so that the position information can represent the position of the operation device in the virtual reality environment. In other embodiments, the operating device may emit radiation. For example, laser radiation, infrared radiation, or the like. The location information may characterize a location indicated by rays emitted by the operating device in the virtual reality environment.

Step 204, determining the target component in the three-dimensional model according to the position information.

Wherein the object to be inspected comprises at least one component, and the three-dimensional model is composed of a model of the at least one component of the object to be inspected. The position information indicated by the operation device may determine the target component indicated by the operation device in the three-dimensional model. In some embodiments, as the operating device is controlled, the device operating instructions change accordingly, and the operating device can be adjusted to adjust the target component according to the service requirements.

And 206, determining virtual execution actions according to the equipment type and the overhaul guiding information.

The virtual execution actions generated in the virtual reality environment are different by adopting operation devices of different device types. Meanwhile, by combining with overhaul guide information, the virtual execution work can be adjusted, so that the overhaul simulation operation is closer to a real overhaul scene, and the overhaul learning efficiency is improved.

And step 208, performing overhaul simulation on the target component in the virtual reality environment according to the virtual execution action.

In the virtual reality environment, the virtual execution operation is executed, and thus, the overhaul simulation of the target component can be realized. In some embodiments, the virtual execution action may be screwing or unscrewing of the bolt, or adjusting the position of the hand wheel, etc., and in response to the multiple device operation instructions, multiple target components and the virtual execution action may be determined, so as to implement overhaul simulation on the target components.

In the overhaul simulation method, a virtual reality environment is adopted, equipment operation information is obtained by responding to and analyzing equipment operation instructions, a target component indicated by the equipment operation information is determined in the virtual reality environment, the equipment operation information is combined with overhaul guide information in the virtual reality environment to obtain virtual execution actions, and overhaul simulation is carried out on the target component in the virtual reality environment according to the virtual execution work. According to the method for carrying out overhaul simulation in the virtual reality environment, as the equipment operation instruction can be initiated by an overhaul worker based on overhaul requirements, the overhaul worker can carry out overhaul simulation on any target component in the object to be overhauled, and therefore the learning efficiency of the overhaul worker is improved.

In one exemplary embodiment, determining a target component in a three-dimensional model based on location information includes: determining a model view type in response to the model view selection instruction; generating a target view three-dimensional model corresponding to the model view type according to the model view type and the three-dimensional model; displaying the three-dimensional model of the target view in the virtual reality environment; and determining the target component in the target view three-dimensional model according to the position information.

The model view selection instruction may be an instruction sent by the operating device. The virtual reality environment has a model view selection area therein, which in some embodiments includes a first view selection and a second view selection area. And the operator controls the operation equipment so as to determine the target model view selection area in the virtual reality environment.

Each region type corresponds to a model view type. And determining the model view type according to the region type of the target model view selection region. For example, the model view type includes an explosion view type, a section view type, and the like.

And converting the three-dimensional model of the object to be overhauled according to the model view type to obtain a target view three-dimensional model, so that the target view three-dimensional model is displayed in the virtual reality environment.

And the maintenance personnel carry out maintenance simulation on the three-dimensional model of the target view in the virtual reality environment by controlling the operation equipment, and determine the target component in the three-dimensional model of the target view according to the position information obtained by responding to the operation instruction of the equipment.

In this embodiment, by determining the model view type in response to the model view selection instruction, the three-dimensional model of the object to be overhauled may be displayed in a suitable view form in the virtual reality environment according to the overhauling requirement, which is beneficial for the overhauling personnel to learn each component of the object to be overhauled. When the object to be overhauled is displayed in different view forms, different target parts are determined according to the view form of the three-dimensional model and the position information indicated by the operation equipment, so that the overhauling personnel can learn the structure, the installation layout and the like of each part of the overhauling object from different view angles.

In one exemplary embodiment, the location information includes first location information indicated by rays emitted by the operating device in the virtual reality environment; the operation device is a device for sending a device operation instruction; determining a target component in the target view three-dimensional model according to the position information, wherein the method comprises the following steps of: and under the condition that the equipment type is the ray type, taking the part corresponding to the first position information on the three-dimensional model of the target view as a target part in the three-dimensional model of the target view.

Where a radiation emitting module is included in the operating device, the target location may be indicated in the virtual reality environment by emitting radiation. And determining the equipment type according to the equipment operation instruction sent by the operation equipment, and taking the part corresponding to the first position information on the three-dimensional model of the target view as the target part in the three-dimensional model of the target view under the condition that the equipment type is the ray type.

In this embodiment, the operation device may indicate the position indicated by the ray in the virtual reality environment by the emitted ray, so as to determine the indicated target component in the target view three-dimensional model. The maintainer can determine the target component to be overhauled by controlling the rays emitted by the operation equipment, so that flexible control of the object to be overhauled is facilitated, and the learning efficiency is improved.

In one exemplary embodiment, the device type includes a button type or a touch pad type; the determining a virtual execution action according to the equipment type and the overhaul guiding information comprises the following steps: determining the operation type of the operation device from the device operation information under the condition that the device type is a button type or a touch pad type; determining an initial execution action according to the operation type; and adjusting the initial execution action according to the overhaul guide information to obtain a virtual execution action.

The operation device may be a button type or a touch panel type, and the operation device may also be a handle device including a button or a touch panel. And analyzing the equipment operation instruction to determine the equipment type.

Depending on the button function, the buttons may include a ok button, a switch button, a grab button, a put button, a rotate button, a throw button, or the like. Accordingly, the corresponding operation type can be determined from the device operation information by operating different buttons.

The touch panel has different function selection areas thereon, for example, the function selection areas include a determination area, a switching area, a grabbing area, a placement area, a rotation area, a throwing area, or the like. Different equipment operation instructions are generated by touching different function selection areas, and corresponding operation types can be determined by analyzing the obtained equipment operation information.

Each operation type corresponds to different initial execution actions, and the overhaul guide information is used for adjusting the initial execution actions so as to obtain virtual execution actions.

In this embodiment, when the button type or the touch pad type is operated, the operation type is determined, so that the corresponding initial execution action is determined, and then the initial execution action is adjusted according to the overhaul guiding information, so that the control of the operation device is realized, the virtual execution action in the virtual reality environment is obtained, and the overhaul simulation is facilitated for the object to be overhauled, so that the learning efficiency of the overhauler is improved.

In one exemplary embodiment, determining the initial execution action based on the type of operation includes: under the condition that the operation type is a switching type, acquiring a currently selected component, and determining an initial execution action as a switching mode of the currently selected component to a target component; in the case that the operation type is the grasp type, determining an initial execution action as grasping the target component; under the condition that the operation type is a placement type, acquiring a first target position; determining an initial execution action as placing the target part at a first target location; acquiring a rotation angle under the condition that the operation type is a rotation type; determining an initial execution action as rotating the target member by a corresponding rotation angle; acquiring a second target position under the condition that the operation type is a throwing type; the initial execution action is determined to be grabbing the target component and placed at a second target location.

According to maintenance requirements, button types with various functions or functional areas of the touch pad can be set, so that operation types are continuously enriched, and various operations of objects to be maintained are realized.

In other embodiments, the service guide information may also be an angle adjustment interval. For example, when the operation type is a rotation type, the rotation angle is compared with any one of the angles of the angle adjustment section, and if the rotation angle is not in the angle adjustment section, the rotation angle is adjusted, thereby ensuring that the adjusted rotation angle is in the angle adjustment section. The overhaul simulation process is favorably corrected, an overhaul worker can learn a correct overhaul method, and overhaul learning efficiency is improved.

In this embodiment, different initial execution actions are determined under different operation types, which is favorable for flexible operation of the three-dimensional model of the object to be overhauled in the virtual reality environment.

In one exemplary embodiment, the service simulation method further includes: obtaining maintenance sequences of a plurality of target components and maintenance results of the target components, and comparing the maintenance sequences with a reference maintenance sequence to obtain a first assessment result; extracting a process result from the overhaul result of the current target component aiming at each target component, and comparing the extracted process result with a reference process result corresponding to the current target component to obtain a second assessment result of the current target component; for each target component, extracting a quality result from the overhaul result of the current target component, and comparing the extracted quality result with a reference quality result corresponding to the current target component to obtain a second assessment result of the current target component; and determining an assessment result based on the first assessment result, the second assessment result and the third assessment result which correspond to each target component.

Wherein different service tasks may require service of multiple target components. And performing overhaul simulation operation on the plurality of target components according to a certain overhaul sequence, and obtaining overhaul results of the target components.

The overhaul results comprise process results, quality results and the like. The process results are used to characterize the results of the overhaul process level. For example, whether the setting of the valve neutral point is accurate, whether the performance reaches the standard after overhaul, and the like. The instruction results are used to characterize the results of the service quality level. For example, whether the valve is successfully overhauled, whether the blue oil experiment is qualified, and the like.

Comparing the overhaul sequence with the reference overhaul sequence, and determining the first assessment result as a first score under the condition that the overhaul sequence is consistent with the reference overhaul sequence. And under the condition that the overhaul sequence is inconsistent with the reference overhaul sequence, determining the first assessment result as a second score.

Comparing the process result of each target component with the corresponding reference process result of the target component, determining the second assessment result of the target component as a third score under the condition of coincidence, and determining the second assessment result of the target component as a fourth score under the condition of non-coincidence.

And comparing the quality result of each target component with the corresponding reference quality result of the target component, determining the third assessment result of the target component as a fifth score under the condition of coincidence, and determining the third assessment result of the target component as a sixth score under the condition of non-coincidence.

Based on the first assessment result, the second assessment result and the third assessment result corresponding to each target component, a plurality of calculation methods can be adopted to determine a final assessment result. In some embodiments, the three assessment results may be weighted and summed to obtain a final assessment result. In other embodiments, the second test results corresponding to each target component are averaged to obtain a second comprehensive test result, and the third test results corresponding to each target component are averaged to obtain a third comprehensive test result. And then averaging the first, second and third comprehensive assessment results to obtain an assessment result.

In this embodiment, the condition of performing overhaul simulation on a plurality of target components is checked, and a final check result is obtained according to an overhaul sequence, a process result and a quality result. The assessment result can be flexibly adjusted according to actual conditions, so that maintenance staff can conveniently simulate the maintenance and improve the maintenance level. Meanwhile, under the scene of higher radiation in a nuclear power plant and the like, the maintenance and study on site can be avoided, so that the radiation hazard to maintenance personnel is avoided.

In order to describe the overhaul simulation method and effect in detail, the following description will be given with one of the most detailed embodiments:

the overhaul simulation method in the embodiment of the application can be applied to the application scenes such as overhaul, disassembly and assembly of the nuclear-grade pneumatic stop valves with various specifications in the production field and the skill training center of the nuclear power station. Taking an overhaul simulation scene of a pneumatic stop valve in a nuclear power plant as an example for explanation, the object to be overhauled is a nuclear-grade pneumatic stop valve. The overhaul simulation method is applied to an overhaul simulation system. FIG. 3 is a block diagram illustrating the components of a service simulation system in one embodiment. The overhaul simulation system comprises a virtual simulation module, an image processing module, a background management module, a display module, an interaction module and a driving module.

The display module comprises a display, a liquid crystal spliced screen, a projector, a virtual reality head display and the like.

The interaction module comprises a mouse and keyboard interaction unit, a space tracking handle interaction unit and a voice interaction unit.

The driving module comprises a three-dimensional real-time rendering unit, a database unit and a network service unit.

The virtual simulation module comprises a switching functional unit, an equipment integral display unit, an equipment disassembly and assembly demonstration unit, a working principle simulation unit, a medium state simulation unit, a three-dimensional model interaction unit, a component information display unit and a component information editing and updating unit. The virtual simulation module is used for responding to the equipment operation instruction, analyzing the equipment operation instruction and obtaining equipment operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information.

FIG. 4 is a schematic flow diagram illustrating the construction of a service simulation system in one embodiment. The three-dimensional model, the material map, the audio processing unit and the video clipping unit of the object to be overhauled are all connected with the resource library and serve as resource data of an overhauling simulation system, the overhauling simulation system is connected with a hardware system through a data management system, the hardware system comprises operation equipment, a virtual reality helmet and the like, and after the overhauling simulation system is built, release of projects is completed.

The image processing module comprises a device disassembly training unit, a device installation training unit, a structural principle display unit, a device disassembly checking unit, a device installation checking unit, a device fault diagnosis unit and a device fault maintenance unit. And the image processing module is used for responding to the model view selection instruction, determining the model view type, generating a target view three-dimensional model corresponding to the model view type according to the model view type and the three-dimensional model, and displaying the target view three-dimensional model in the virtual reality environment. The position information comprises first position information indicated by rays emitted by the operation device in the virtual reality environment, and the operation device is a device for sending device operation instructions. And under the condition that the equipment type is the ray type, taking the part corresponding to the first position information on the three-dimensional model of the target view as a target part in the three-dimensional model of the target view.

The background management module comprises an instructor information management unit, a student information management unit, a training management unit, a learning progress management unit and an assessment score management unit. The background management module is used for determining the operation type of the operation equipment from the equipment operation information under the condition that the equipment type is a button type or a touch pad type. In the case where the operation type is the switch type, the currently selected part is acquired, and the initial execution action is determined as switching the currently selected part to the target part. In the case where the operation type is the grasp type, the initial execution action is determined as grasping the target member. In the case where the operation type is the placement type, a first target position is acquired, and an initial execution action is determined as placing the target component at the first target position. In the case where the operation type is the rotation type, the rotation angle is acquired, and the initial execution action is determined as rotating the target member by the corresponding rotation angle. Acquiring a second target position under the condition that the operation type is a throwing type; the initial execution action is determined to be grabbing the target component and placed at a second target location. And adjusting the initial execution action according to the overhaul guide information to obtain a virtual execution action, and overhauling the target component in the virtual reality environment according to the virtual execution action.

The background management module is also used for obtaining the overhaul sequence of the plurality of target components and the overhaul result of each target component, and comparing the overhaul sequence with the reference overhaul sequence to obtain a first assessment result. And aiming at each target component, extracting a process result from the overhaul result of the current target component, and comparing the extracted process result with a reference process result corresponding to the current target component to obtain a second assessment result of the current target component. And for each target component, extracting a quality result from the overhaul result of the current target component, comparing the extracted quality result with a reference quality result corresponding to the current target component to obtain a second assessment result of the current target component, and determining an assessment result based on the first assessment result, the second assessment results corresponding to each target component and the corresponding third assessment result.

In some embodiments, the overhaul simulation system can display all parts and complete states of the pneumatic stop valve, can zoom, rotate, stretch and cut out the pneumatic stop valve at will, has voice explanation and text prompt, introduces related information such as names and functions of all parts, and can freely assemble equipment. After explosion display, an operator can touch the component by adopting rays emitted by the operation equipment, the touched component is highlighted and the name is displayed, so that the maintainer can learn each component of the pneumatic stop valve in an immersed mode, and know the specific shape of each component.

In other embodiments, the service simulation system may perform the operations of dismounting and repairing the pneumatic shut-off valve in the virtual reality environment through an operation device such as a handle.

For example, movement and positioning: with the sensors in the handle, the service personnel can freely move and position in the virtual environment. This may be accomplished by the movement and attitude of the handle, for example, by which an attendant may simulate the walking action.

Grabbing and operating: the handle typically has a triggerable button or touch pad that may be used by an attendant to grasp and manipulate objects in the virtual environment. For example, an attendant may grasp, place, rotate, or throw a virtual object by pressing a button or touch pad.

Interaction operation: buttons, rockers, and touchpads on the handle can be used to perform various interactive operations. The learner may select, click, switch, adjust settings, etc. by pressing a button, sliding a rocker, or touch pad.

In still other embodiments, the overhaul simulation system may implement real-time commentary and guidance. The system provides real-time solution and guidance for the virtual trainer, guides the learner to carry out maintenance and disassembly operations according to the correct steps, and ensures safety and accuracy. The system provides a voice prompt function in the operation process of the overhauling personnel, and the voice prompt is a function of providing information, guidance or feedback for the overhauling personnel in an audio mode in a virtual reality environment. The voice command, the prompt or the feedback can be directly transmitted to the maintenance personnel through the built-in loudspeaker of the virtual reality head display.

In some embodiments, for the difficulties in the maintenance and disassembly processes of the nuclear-grade pneumatic stop valve, the system is particularly provided with targeted explanation and demonstration, and related animations are automatically demonstrated by adopting an animation component and other components, so that in the process of executing the animations, an maintainer can analyze the difficulties in an arbitrary moving position and in an omnibearing and multi-angle manner, and meanwhile, the maintainer can view and browse related data, documents or information in the form of images and characters through a virtual reality technology, thereby helping the maintainer overcome the difficulties.

In other embodiments, the service simulation system may also be used for assessment. The system establishes the capability requirement of an maintainer on maintenance of the nuclear-grade pneumatic stop valve, establishes a corresponding assessment standard, assesses the progress of the learning effect of the maintainer, does not give operation prompts and guides, judges whether the operation steps of the maintainer are correct according to the operation positioning and operation position points and the like of the maintainer in the operation process, and simultaneously, presents some operation key points in the form of questions in the operation process to assess the maintainer. And (3) completely recording the check data in the operation process of the overhauling personnel. For the insufficient capacity items, multiple training and examination can be performed, corresponding skills are improved, and training cost is reduced.

According to the overhaul simulation method, the virtual reality environment is adopted, the equipment operation instruction is responded and analyzed, the equipment operation information is obtained, the target component indicated by the equipment operation information is determined in the virtual reality environment, the equipment operation information is combined with overhaul guide information in the virtual reality environment, virtual execution actions are obtained, and overhaul simulation is carried out on the target component in the virtual reality environment according to the virtual execution actions. According to the method for carrying out overhaul simulation in the virtual reality environment, as the equipment operation instruction can be initiated by the overhaul personnel based on the overhaul requirement, the overhaul simulation can be carried out on any target part in the object to be overhauled by the overhaul personnel, so that the learning efficiency of the overhaul personnel is improved, and meanwhile, the large radiation irradiation dose brought to the overhaul personnel can be avoided. Meanwhile, a safe, reliable, practical and efficient learning system is provided for maintenance and skill training of the nuclear-grade pneumatic stop valve, a learner utilizes fragmented time to arrange learning, the limitation of the available time and place of actual equipment is not needed, the learning flexibility and efficiency are improved, and the training resources of a skill center are saved.

It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.

Based on the same inventive concept, the embodiment of the application also provides an overhaul simulation system for realizing the overhaul simulation method. The implementation of the solution provided by the system is similar to the implementation described in the above method, so the specific limitations in one or more embodiments of the overhaul simulation system provided below may be referred to above for the limitations of the overhaul simulation method, and will not be repeated here.

In one exemplary embodiment, as shown in FIG. 5, a service simulation system 100 is provided, comprising: a virtual simulation module 120, an image processing module 140, and a background management module 160, wherein:

the virtual simulation module 120 is configured to parse the device operation instruction in response to the device operation instruction, to obtain device operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information;

an image processing module 140 for determining a target component in the three-dimensional model based on the positional information;

the background management module 160 is configured to determine a virtual execution action according to the equipment type and the overhaul guiding information; and overhauling the target component in the virtual reality environment according to the virtual execution action.

According to the overhaul simulation system, the virtual reality environment is adopted, the equipment operation instruction is responded and analyzed, the equipment operation information is obtained, the target component indicated by the equipment operation information is determined in the virtual reality environment, the equipment operation information is combined with overhaul guide information in the virtual reality environment, virtual execution actions are obtained, and overhaul simulation is carried out on the target component in the virtual reality environment according to the virtual execution actions. According to the method for carrying out overhaul simulation in the virtual reality environment, as the equipment operation instruction can be initiated by the overhaul personnel based on the overhaul requirement, the overhaul simulation can be carried out on any target part in the object to be overhauled by the overhaul personnel, so that the learning efficiency of the overhaul personnel is improved, and meanwhile, the large radiation irradiation dose brought to the overhaul personnel can be avoided.

In one embodiment, the target component in the three-dimensional model is determined based on the location information, and the image processing module 140 is further configured to: determining a model view type in response to the model view selection instruction; generating a target view three-dimensional model corresponding to the model view type according to the model view type and the three-dimensional model; displaying the three-dimensional model of the target view in the virtual reality environment; and determining the target component in the target view three-dimensional model according to the position information.

In one embodiment, the location information includes first location information indicated by rays emitted by the operating device in the virtual reality environment; the operation device is a device for sending a device operation instruction; from the position information, determining the target component in the target view three-dimensional model, the image processing module 140 is further configured to: and under the condition that the equipment type is the ray type, taking the part corresponding to the first position information on the three-dimensional model of the target view as a target part in the three-dimensional model of the target view.

In one embodiment, the device type includes a button type or a touch pad type; the determining virtual execution action according to the equipment type and the overhaul guiding information, the background management module 160 is further configured to: determining the operation type of the operation device from the device operation information under the condition that the device type is a button type or a touch pad type; determining an initial execution action according to the operation type; and adjusting the initial execution action according to the overhaul guide information to obtain a virtual execution action.

In one embodiment, the initial execution action is determined according to the type of operation, and the background management module 160 is further configured to: under the condition that the operation type is a switching type, acquiring a currently selected component, and determining an initial execution action as a switching mode of the currently selected component to a target component; in the case that the operation type is the grasp type, determining an initial execution action as grasping the target component; under the condition that the operation type is a placement type, acquiring a first target position; determining an initial execution action as placing the target part at a first target location; acquiring a rotation angle under the condition that the operation type is a rotation type; determining an initial execution action as rotating the target member by a corresponding rotation angle; acquiring a second target position under the condition that the operation type is a throwing type; the initial execution action is determined to be grabbing the target component and placed at a second target location.

In one embodiment, the background management module 160 is further configured to: obtaining maintenance sequences of a plurality of target components and maintenance results of the target components, and comparing the maintenance sequences with a reference maintenance sequence to obtain a first assessment result; extracting a process result from the overhaul result of the current target component aiming at each target component, and comparing the extracted process result with a reference process result corresponding to the current target component to obtain a second assessment result of the current target component; for each target component, extracting a quality result from the overhaul result of the current target component, and comparing the extracted quality result with a reference quality result corresponding to the current target component to obtain a second assessment result of the current target component; and determining an assessment result based on the first assessment result, the second assessment result and the third assessment result which correspond to each target component.

The various modules in the above-described service simulation system may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In an exemplary embodiment, a computer device, which may be a terminal, is provided, and an internal structure diagram thereof may be as shown in fig. 6. The computer device includes a processor, a memory, an input/output interface, a communication interface, a display unit, and an input means. The processor, the memory and the input/output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input/output interface. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input/output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. The computer program when executed by a processor implements a service simulation method.

It will be appreciated by those skilled in the art that the structure shown in fig. 6 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In one exemplary embodiment, a computer device is provided comprising a memory and a processor, the memory having stored therein a computer program, the processor when executing the computer program performing the steps of:

responding to the equipment operation instruction, analyzing the equipment operation instruction, and obtaining equipment operation information; obtaining overhaul guide information of an object to be overhauled and a three-dimensional model of the object to be overhauled in a virtual reality environment; the device operation information includes device type and location information; determining a target component in the three-dimensional model according to the position information; determining virtual execution actions according to the equipment types and the overhaul guide information; and performing overhaul simulation on the target component in the virtual reality environment according to the virtual execution action.

In one embodiment, the processor when executing the computer program further performs the steps of:

Determining a model view type in response to the model view selection instruction; generating a target view three-dimensional model corresponding to the model view type according to the model view type and the three-dimensional model; displaying the three-dimensional model of the target view in the virtual reality environment; and determining the target component in the target view three-dimensional model according to the position information.

the position information comprises first position information indicated by rays emitted by the operation device in the virtual reality environment; the operation device is a device for sending a device operation instruction; and under the condition that the equipment type is the ray type, taking the part corresponding to the first position information on the three-dimensional model of the target view as a target part in the three-dimensional model of the target view.

the device type includes a button type or a touch pad type; determining the operation type of the operation device from the device operation information under the condition that the device type is a button type or a touch pad type; determining an initial execution action according to the operation type; and adjusting the initial execution action according to the overhaul guide information to obtain a virtual execution action.

under the condition that the operation type is a switching type, acquiring a currently selected component, and determining an initial execution action as a switching mode of the currently selected component to a target component; in the case that the operation type is the grasp type, determining an initial execution action as grasping the target component; under the condition that the operation type is a placement type, acquiring a first target position; determining an initial execution action as placing the target part at a first target location; acquiring a rotation angle under the condition that the operation type is a rotation type; determining an initial execution action as rotating the target member by a corresponding rotation angle; acquiring a second target position under the condition that the operation type is a throwing type; the initial execution action is determined to be grabbing the target component and placed at a second target location.

obtaining maintenance sequences of a plurality of target components and maintenance results of the target components, and comparing the maintenance sequences with a reference maintenance sequence to obtain a first assessment result; extracting a process result from the overhaul result of the current target component aiming at each target component, and comparing the extracted process result with a reference process result corresponding to the current target component to obtain a second assessment result of the current target component; for each target component, extracting a quality result from the overhaul result of the current target component, and comparing the extracted quality result with a reference quality result corresponding to the current target component to obtain a second assessment result of the current target component; and determining an assessment result based on the first assessment result, the second assessment result and the third assessment result which correspond to each target component.

In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:

In one embodiment, the computer program when executed by the processor further performs the steps of:

In one embodiment, a computer program product is provided comprising a computer program which, when executed by a processor, performs the steps of:

It should be noted that, the user information (including, but not limited to, user equipment information, user personal information, etc.) and the data (including, but not limited to, data for analysis, stored data, presented data, etc.) referred to in the present application are information and data authorized by the user or sufficiently authorized by each party, and the collection, use, and processing of the related data are required to meet the related regulations.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the various embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high density embedded nonvolatile Memory, resistive random access Memory (ReRAM), magnetic random access Memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric Memory (Ferroelectric Random Access Memory, FRAM), phase change Memory (Phase Change Memory, PCM), graphene Memory, and the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, and the like. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like. The databases referred to in the various embodiments provided herein may include at least one of relational databases and non-relational databases. The non-relational database may include, but is not limited to, a blockchain-based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic units, quantum computing-based data processing logic units, etc., without being limited thereto.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples only represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the present application. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application shall be subject to the appended claims.

Claims

1. A method of service simulation, the method comprising:

responding to an equipment operation instruction, and analyzing the equipment operation instruction to obtain equipment operation information; obtaining overhaul guide information of an object to be overhauled in a virtual reality environment and a three-dimensional model of the object to be overhauled; the device operation information includes device type and location information;

determining a virtual execution action according to the equipment type and the overhaul guiding information;

2. The method of claim 1, wherein determining the target part in the three-dimensional model from the location information comprises:

displaying the target view three-dimensional model in the virtual reality environment;

3. The method of claim 2, wherein the location information comprises first location information indicated in the virtual reality environment by rays emitted by an operating device; the operation device is a device for sending the device operation instruction; the determining the target component in the target view three-dimensional model according to the position information comprises the following steps:

And taking the component corresponding to the first position information on the three-dimensional model of the target view as a target component in the three-dimensional model of the target view under the condition that the equipment type is a ray type.

4. The method of claim 1, wherein the device type comprises a button type or a touchpad type; the determining a virtual execution action according to the equipment type and the overhaul guiding information comprises the following steps:

determining an initial execution action according to the operation type;

5. The method of claim 4, wherein determining an initial execution action based on the type of operation comprises:

under the condition that the operation type is a switching type, acquiring a currently selected component, and determining an initial execution action as switching the currently selected component into the target component;

determining an initial execution action as grasping the target component in the case that the operation type is a grasping type;

Acquiring a first target position under the condition that the operation type is a placement type; determining an initial execution act as placing the target part at the first target location;

acquiring a rotation angle under the condition that the operation type is a rotation type; determining an initial execution action as rotating the target member by the rotation angle;

acquiring a second target position under the condition that the operation type is a throwing type; and determining the initial execution action as grabbing the target component and placing the target component at the second target position.

6. The method according to claim 1, wherein the method further comprises:

7. A service simulation system, the system comprising:

the virtual simulation module is used for responding to the equipment operation instruction and analyzing the equipment operation instruction to obtain equipment operation information; obtaining overhaul guide information of an object to be overhauled in a virtual reality environment and a three-dimensional model of the object to be overhauled; the device operation information includes device type and location information;

8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.

9. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.

10. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.