CN115082265A - Virtual training management method and device, electronic equipment and readable storage medium - Google Patents
Virtual training management method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN115082265A CN115082265A CN202110276818.6A CN202110276818A CN115082265A CN 115082265 A CN115082265 A CN 115082265A CN 202110276818 A CN202110276818 A CN 202110276818A CN 115082265 A CN115082265 A CN 115082265A
- Authority
- CN
- China
- Prior art keywords
- operation data
- data
- virtual
- target equipment
- running
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 22
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 230000002159 abnormal effect Effects 0.000 claims abstract description 68
- 238000000034 method Methods 0.000 claims abstract description 38
- 230000003238 somatosensory effect Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 5
- 238000010276 construction Methods 0.000 claims description 2
- 238000012549 training Methods 0.000 abstract description 51
- 230000008569 process Effects 0.000 abstract description 16
- 230000000694 effects Effects 0.000 abstract description 8
- 238000005516 engineering process Methods 0.000 description 10
- 230000033001 locomotion Effects 0.000 description 9
- 239000000126 substance Substances 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 3
- 230000000712 assembly Effects 0.000 description 3
- 238000000429 assembly Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 210000003128 head Anatomy 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- VGGSQFUCUMXWEO-UHFFFAOYSA-N Ethene Chemical compound C=C VGGSQFUCUMXWEO-UHFFFAOYSA-N 0.000 description 1
- 239000005977 Ethylene Substances 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000003197 catalytic effect Effects 0.000 description 1
- 230000001364 causal effect Effects 0.000 description 1
- 238000012824 chemical production Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
- G06Q50/2057—Career enhancement or continuing education service
Abstract
The invention provides a virtual training management method and device, electronic equipment and a readable storage medium. The virtual training management method comprises the steps of obtaining operation information of target equipment, wherein the operation information comprises normal operation data of the target equipment and normal operation data corresponding to the normal operation data, and the operation information further comprises abnormal operation data of the target equipment and abnormal operation data corresponding to the abnormal operation data; and associating the operation information with a virtual model corresponding to the target equipment to construct a virtual training system of the target equipment. Therefore, the operation information is associated with the virtual model to establish the virtual training system of the target equipment, and when the target equipment in the virtual training system is operated, the operation data of the target equipment can be determined according to the operation information, so that the working conditions of the equipment under different operations can be reproduced, the consistency between the training process and the actual working condition can be improved, and the training effect can be improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of augmented reality, in particular to a virtual training management method and device, electronic equipment and a readable storage medium.
Background
In industries with certain dangers such as chemical industry and the like, in order to ensure the operation safety, strict training needs to be performed on personnel, however, actual field training is complex, certain dangers are possible, the actual production is possibly affected, theoretical training is separated from actual production requirements to a certain extent, and the training effect is difficult to guarantee, so that the training effect of the existing training mode is poor.
Disclosure of Invention
The embodiment of the invention provides a virtual training management method and device, electronic equipment and a readable storage medium, and aims to solve the problem that the existing training mode is poor in training effect.
In order to solve the problems, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a virtual training management method, including the following steps:
acquiring running information of target equipment, wherein the running information comprises normal operation data of the target equipment and normal running data corresponding to the normal operation data, and the running information further comprises abnormal operation data of the target equipment and abnormal running data corresponding to the abnormal operation data;
and associating the operation information with a virtual model corresponding to the target equipment to construct a virtual training system of the target equipment.
Optionally, the method further includes:
detecting virtual operation data input to the virtual model by using a somatosensory sensor, wherein the somatosensory sensor comprises one or more of a laser locator, a trackball, a data glove and a helmet display;
matching the virtual operation data with the running information to determine target running data corresponding to the virtual operation data;
and adjusting the running state of the virtual model according to the target running data.
Optionally, the adjusting the operation state of the virtual model according to the target operation data includes:
and displaying the abnormal operation data based on the virtual model under the condition that the virtual operation data is matched with the abnormal operation data in the operation information.
Optionally, the obtaining operation information of the target device includes:
collecting operation data of the target equipment and operation data of the target equipment;
determining control logic and interlocking relation among different operation data;
and taking the operation data and the control logic and interlocking relation among different operation data as the operation information of the target equipment.
In a second aspect, an embodiment of the present invention further provides a virtual training management apparatus, including:
the system comprises an operation information acquisition module, a data processing module and a data processing module, wherein the operation information acquisition module is used for acquiring operation information of target equipment, the operation information comprises normal operation data of the target equipment and normal operation data corresponding to the normal operation data, and the operation information further comprises abnormal operation data of the target equipment and abnormal operation data corresponding to the abnormal operation data;
and the construction module is used for associating the operation information with a virtual model corresponding to the target equipment so as to construct a virtual training system of the target equipment.
Optionally, the method further includes: an operation data acquisition module for detecting virtual operation data input to the virtual model by using a motion sensing sensor, wherein the motion sensing sensor comprises one or more of a laser locator, a trackball, a data glove and a helmet display;
the matching module is used for matching the virtual operation data with the running information so as to determine target running data corresponding to the virtual operation data;
and the running state adjusting module is used for adjusting the running state of the virtual model according to the target running data.
Optionally, the running state adjusting module is specifically configured to, when the virtual operation data is matched with abnormal operation data in the running information, display the abnormal running data based on the virtual model.
Optionally, the operation information obtaining module includes:
the acquisition submodule is used for acquiring the operation data of the target equipment and the operation data of the target equipment;
the determining submodule is used for determining control logic and interlocking relation among different operation data;
and the storage submodule is used for taking the operation data and the control logic and the interlocking relation among different operation data as the operation information of the target equipment. .
In a third aspect, an embodiment of the present invention further provides an electronic device, including: a transceiver, a memory, a processor, and a program stored on the memory and executable on the processor; the processor is configured to read the program in the memory to implement the steps of the method according to the first aspect.
In a fourth aspect, the embodiment of the present invention further provides a readable storage medium for storing a program, where the program, when executed by a processor, implements the steps in the method according to the foregoing first aspect.
The method comprises the steps of obtaining running information of target equipment, wherein the running information comprises normal operation data of the target equipment and normal running data corresponding to the normal operation data, and the running information further comprises abnormal operation data of the target equipment and abnormal running data corresponding to the abnormal operation data; and associating the operation information with a virtual model corresponding to the target equipment to construct a virtual training system of the target equipment. Therefore, the operation information is associated with the virtual model to establish the virtual training system of the target equipment, and when the target equipment in the virtual training system is operated, the operation data of the target equipment can be determined according to the operation information, so that the working condition of the equipment under different operations can be reproduced, the consistency between the training process and the actual working condition can be improved, and the training effect can be improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
FIG. 1 is a schematic flow chart of a virtual training management method according to an embodiment of the present invention;
fig. 2 is an architecture diagram between a target device and a virtual device according to an embodiment of the present invention;
fig. 3 is a schematic diagram illustrating a communication principle between a target device and a virtual device according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a virtual training management apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device provided in the implementation of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
The terms "first," "second," and the like in the embodiments of the present invention are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Further, as used herein, "and/or" means at least one of the connected objects, e.g., a and/or B and/or C, means 7 cases including a alone, B alone, C alone, and both a and B present, B and C present, both a and C present, and A, B and C present.
With the development of 5G (5th Generation mobile networks or 5th Generation with less systems, 5th-Generation, fifth Generation mobile communication technology), the technology of internet of things is continuously developed and perfected.
The embodiment of the invention provides a virtual training management method.
As shown in fig. 1, in one embodiment, the virtual training management method includes the following steps:
step 101: and acquiring the running information of the target equipment.
The target device in this embodiment may be a device that needs to be trained and used by a person to be trained, and specifically, may be a device including, but not limited to, a vehicle, a mechanical device, an electronic device, a chemical device, and the like.
In this embodiment, an example of the application to a chemical plant with a high risk is taken as an example for illustration, and it should be understood that, because a field environment of chemical production is complex and various emergencies may occur, for example, safety and reality are ensured, in this embodiment, a person to be trained is trained in a virtual training manner.
In this embodiment, the target device may also be scanned by using a scanning device, then the data obtained by scanning is filtered by using a filtering technique, useful data is extracted, and finally, a three-dimensional reconstruction calculation is performed according to the retained effective data to establish a digital model.
In one embodiment, the established model not only comprises the equipment needing training, but also comprises the scene where the equipment is located, such as a factory building and the like, so that the actual situation can be simulated more accurately.
Exemplary models of chemical plants may include catalytic cracker models, coker models, ethylene cracker models, models of equipment such as external floating roof tanks, internal floating roof tanks, and spherical tanks in storage and transportation tank areas. Furthermore, the equipment can be arranged in the factory building and arranged according to actual conditions, so that trained personnel can know the actual working conditions of the trained personnel personally.
The running information comprises normal operation data of the target equipment and normal running data corresponding to the normal operation data, and the running information further comprises abnormal operation data of the target equipment and abnormal running data corresponding to the abnormal operation data.
As shown in fig. 2, in this embodiment, an internet of things of a target device is implemented by using an intelligent gateway to obtain operation information of the target device, specifically, a corresponding gateway device is set for each operable or workable structure or component of the target device, and each structure is continuously monitored and counted, in this process, operation data for each component needs to be recorded, and operation data corresponding to the target device under an operation based on the operation data needs to be recorded, so that acquisition of device operation data is implemented.
In this embodiment, the acquisition of the operation information may be implemented based on 5G and other data transmission technologies, and during implementation, the correspondence between the gateway and the target device or the structure of the target device may be determined according to information such as a serial number or a Media Access Control Address (MAC Address) of each intelligent gateway device. Furthermore, a corresponding security key management means can be arranged to improve the security of data transmission.
During implementation, firstly, the gateway and the equipment are adapted, specifically, the gateway and the equipment comprise the adaptation of sensor equipment, an industrial protocol, rule application equipment, rule application parameters, an operational expression, a matching value and the like, after configuration is completed, data acquisition frequency is set, rule adaptation is carried out on acquired data, corresponding tasks are executed after adaptation is met, and key authentication is carried out on connection accessed to a data center. And finally, storing the received operation data and the timestamp corresponding to the operation data in a database to form the required operation information of the target equipment.
With reference to fig. 2, after the operation data is collected, the operation data is processed, and since the collected operation data cannot be directly used for the virtual model, the data can be processed by using the virtual device control panel in the virtual data processing layer, then the collected data is matched with the virtual model data through the corresponding relationship according to the preset corresponding relationship between the virtual model data and the real device data, and then the collected data is converted into information for driving the virtual model to operate, and further sent to the virtual device, so that the virtual device operates according to the data.
Because different hardware devices have different PLCs (programmable logic controllers), the communication mode between the hardware devices and the virtual model control panel is different, for example, the communication mode for mitsubishi PLC is MX component, and the communication mode is incompatible with other PLCs.
As shown in fig. 3, in this embodiment, according to the communication mode of the target device, a high-level language interface is used to load a virtual browser and transmit data to the virtual model, so as to convert the real device operation data into the virtual model operation data, thereby triggering the operation of the virtual model. .
In some embodiments, the step 101 specifically includes:
collecting operation data of the target equipment and operation data of the target equipment;
determining control logic and interlocking relation among different operation data;
and taking the operation data and the control logic and interlocking relation among different operation data as the operation information of the target equipment.
In this embodiment, the operation data and the operation data of the target device need to be acquired. In implementation, the worker can perform the relevant operation needing training on the target equipment, and the target equipment is produced and performed under the operation to obtain the corresponding operation result.
Further, control logic and interlocking relation between different operation data need to be determined, it should be understood that certain association relation and causal relation exist between the operation data, in other words, if a certain operation is performed on the target device, a corresponding control result is generated, and further, operation data such as a display interface, a working state, and a position of the target device may be changed.
For example, under a certain operation performed by a worker, certain operation data is generated, and according to the control logic and the interlocking relationship of the data, subsequent operation data are sequentially generated, and the operation data can cause some changes to the virtual model and possibly cause some accidents.
The operations performed by the staff on the target device include normal operations and abnormal operations with certain errors, generally, the normal operations may cause the device to operate normally, and the abnormal operations may cause the target device to operate abnormally.
Data generated under normal operation provides reference standards for correct training guidance, and data generated under abnormal operation provides reference for equipment hazards which may be triggered by illegal operation.
Step 102: and associating the operation information with a virtual model corresponding to the target equipment to construct a virtual training system of the target equipment.
The embodiment is implemented based on an AR (Augmented Reality) technology, the virtual model is presented by the AR technology, and the operation information is associated with the virtual model, so that a person receiving training performs training operation by operating the virtual model in an AR virtual scene.
In the training process, the person receiving the training executes corresponding operation in the AR virtual scene, so that the training of the person using the target equipment is realized.
According to the embodiment of the invention, the operation information is associated with the virtual model to establish the virtual training system of the target equipment, and when the target equipment in the virtual training system is operated, the operation data of the target equipment can be determined according to the operation information, so that the working condition of the equipment under different operations can be reproduced, the consistency of the training process and the actual working condition can be improved, and the training effect can be improved.
In some embodiments, after step 102, the method further includes:
detecting virtual operation data input to the virtual model by using a somatosensory sensor;
matching the virtual operation data with the running information to determine target running data corresponding to the virtual operation data;
and adjusting the running state of the virtual model according to the target running data.
In this embodiment, the somatosensory sensor is used to implement virtual operation data input by a trained person, and when implemented, the person wears the motion sensor, wherein the somatosensory sensor specifically includes one or more of a laser locator, a trackball, a data glove and a helmet display.
The tracking ball is used for tracking the position and the direction of the head and the hands of the trained personnel; the data glove is provided with a stress sensor at the joint part of the finger, so that the relative displacement and the flexion-extension posture of each finger can be obtained, the movement of the whole hand is detected, and the real operation posture of training personnel on a virtual model in a virtual scene can be realized; the data clothes are tactile feedback devices arranged at the joints of the human body, and when training personnel contact and interact with a virtual object, the tactile feedback devices can simulate the force sense and the texture generated when the training personnel contact the real object; the helmet display enables a training person to obtain a three-dimensional stereo image for remote guidance of a training teacher or remote viewing by other training persons.
It will be appreciated that if it is desired to obtain positional movement of the head and hands of the person that a positioner is required, the positioners used in the present invention are laser positioners, the number being at least two. Two laser positioning devices emit infrared laser beams, sensors on a trackball, a data glove and a helmet display receive light emitted by a lighthouse, and the position of the laser positioning device in the space is calculated according to the angle of the light beams, so that the positioning of different parts such as the head, the hands and the like of a person is realized.
When the user moves in the space, the helmet display system refreshes the display picture according to the spatial position of the helmet display system, and provides the current visual field picture for the user. The trackball and data glove have a number of interfaces for determining the spatial position of the trackball and glove, and the buttons on the trackball and data glove provide the user with an interface for interacting with the virtual scene. In order to display and generate stronger stereoscopic impression and immersion in the helmet-mounted display, two views are generated and are respectively displayed on a left screen and a right screen of the helmet-mounted display and projected to the left eye and the right eye, and the two views form visual difference similar to human eyes. In order to realize such parallax, two sets of image capturing assemblies are deployed in the present embodiment, and correspond to the left eye and the right eye of a person respectively, the image capturing assemblies may be cameras, and the two sets of image capturing assemblies are spaced apart laterally by the same distance as the interpupillary distance of the eyes of the person, so that a strong stereoscopic impression and an immersion impression can be given to the person.
Specifically, the person receiving the training can log in the training system through the account number or the identity of the person and further perform the training, illustratively, the operation can be performed based on devices such as a keyboard, a mouse and an operating rod, and can also be performed through a somatosensory sensor. The training process may specifically include different modes such as a learning mode, an operation mode, and an assessment mode.
In the learning mode, the operation mode of the target device can be played, and the operation mode can specifically include a normal operation mode and an abnormal operation mode, so that the trained personnel can know the working mode of the target device.
And in the operation mode and the assessment mode, the interaction with the virtual model of the target equipment in the constructed virtual scene is carried out through the somatosensory sensor. The method comprises the steps of obtaining virtual operation data of a user, determining operation data corresponding to the operation data, further determining which data are sequentially generated and which target equipment is changed according to control logic and interlocking relation corresponding to the operation data, and enabling the changes to pass through a virtual model.
Specifically, a trackball, a data glove, and the like may be used to improve the detection of the movement of the person by the sensor, and determine the interaction of the virtual operation input of the user with the virtual model in the virtual scene according to the positional relationship between the movement and the virtual model.
In order to realize the operation of various virtual models in a scene, an operation interface (UI) can be established for each virtual model, the content of the operation interface is determined by the actual operation function of each device, such as a button, a switch valve, and the like, and an operator realizes the operation of the device through the operation interface.
Illustratively, a Click event may be added to the button, and the corresponding program after clicking the button is written in the On Click () function of the script. And the response program writes the button information into the data cache file according to the clicked state of the button, makes action response in the virtual scene according to the data of the data file and sends a click instruction to the virtual model.
Under the operation mode and the assessment mode, the operation process can be completely recorded for subsequent viewing and problem finding. For example, when abnormal data is generated, operations that do not meet the specifications are tapped to further guide the operations of the trainers. In the examination mode, operation records can be provided, and the operation records can comprise pictures and operation shooting records, and further unconventional operation points of trained personnel can be marked in the pictures. Furthermore, abnormal operation videos in the operation mode and the examination mode can be placed in a knowledge base to be used as abnormal operation teaching materials for other people to watch.
The training personnel may generate some accidents which are not recorded in the operation information database in the operation process, at the moment, the logic relation between the operation step and the accidents can be verified in detail, the data association relation between the operation step and the accidents is found, the cause-and-effect relation between the operation and the accidents is formed, accident data is formed and stored in a knowledge base, the teaching material content of the knowledge base is enriched, the operation of field workers is guided, and the accidents in real scenes are early warned.
In some embodiments, the adjusting the operating state of the virtual model according to the target operating data includes:
and displaying the abnormal operation data based on the virtual model under the condition that the virtual operation data is matched with the abnormal operation data in the operation information.
In this embodiment, the abnormal operation data is associated with the corresponding abnormal operation data change and stored in the database, and is used as a data source for judging whether the operation is standard or not in the virtual model operation flow, and if not, which kind of damage is generated. The accidents caused by different abnormal operations can be of the same type, data which generate the same accident type are optimized into accident data of the same type, and the abnormal data and the accident type are stored in a database.
When the virtual operation data executed by the personnel are matched with the abnormal operation data, the corresponding abnormal operation data are displayed, specifically, the abnormal operation state of the equipment can be directly displayed through the virtual model, so that the result possibly caused by the abnormal operation and the abnormal operation state can be more intuitively known. Accident hazard generated in the real production environment is presented in a virtual mode, so that training personnel can experience accidents personally, operation impression is deepened, and production site loss and personnel body safety injury caused by misoperation are avoided.
The technical solution of the present embodiment is further explained below.
Firstly, establishing a three-dimensional model library of equipment.
In this embodiment, first, three-dimensional data of the acquisition device is established, and a three-dimensional model library of the device components is established, that is, a virtual environment model corresponding to a real scene is established.
And secondly, establishing an operation information database of the equipment.
And then, acquiring real operation data of the chemical field equipment through the intelligent gateway. In this embodiment, the device operation data is divided into two categories: the method comprises the steps that normal data and abnormal data are obtained, danger is possibly caused by data change caused by abnormal operation, data, a timestamp and control logic and interlocking relation among the data are stored in a database, a three-dimensional model base of equipment parts is formed, namely a virtual operation information model corresponding to real equipment is established, and a virtual operation information model corresponding to an actual operation situation is formed.
And thirdly, data conversion.
In this embodiment, by using a specific communication manner and according to a set corresponding relationship between real data and virtual data, the acquired real data is converted into operation information of a virtual model through data matching, that is, by acquiring related data of real devices and determining an association relationship between the data and virtual devices, the acquired real data is converted into the operation information of the virtual model.
And fourthly, classifying data.
After the operation data of the real equipment is collected, the collected data is divided into normal data and abnormal data, the normal data is used as a reference standard for correct operation, the abnormal data is used as a reference for triggering danger of abnormal operation, the abnormal data generating similar accidents is summarized into an accident type and stored in a database, and meanwhile, the incidence relation between the abnormal operation and data change is stored in the database and used as a data source of an abnormal flow in virtual operation.
Therefore, through the four steps, the real equipment production scene can be displayed in the virtual environment, and the experience of being personally on the scene is brought to the staff.
The use of a built virtual scene comprising a virtual model mainly comprises the following aspects.
In a first aspect, a training knowledge base is established.
In the embodiment, basic theories, operation specifications, typical chemical accident cases, theoretical learning, answering, grading and abnormal operation videos are combined to form a knowledge base, the knowledge base is combined with a three-dimensional model base to form a training knowledge base, and in the working process, the formed training knowledge base can be combined to train personnel.
In a second aspect, a virtual scene is constructed.
In the training process, an AR technology can be applied to establish an interaction and display model corresponding to a training knowledge base, the interaction and display model is led into man-machine interface hardware, the spatial position of the hardware is obtained by using methods such as laser positioning and sensor interface, and the operation of a virtual model in a scene is realized.
And in the third aspect, virtual operation is performed.
Training personnel to operate on the virtual model, operating control logic according to real data, and when data are abnormal due to operation errors, generating a real abnormal flow, so that the display of real hazards in a virtual scene is realized.
Fourth, training personnel.
In the working process, training personnel log in the training system, further perform operation training or examination, record abnormal operation through videos and pictures in an operation mode and an examination mode, and form a personnel abnormal operation knowledge base which is used as a knowledge teaching material for the training personnel and field workers to learn.
The technical scheme of the embodiment of the invention can be summarized as collecting three-dimensional data of the equipment, constructing a three-dimensional model according to the three-dimensional data by utilizing an image recognition and matching technology, and establishing an equipment three-dimensional model library suitable for AR. The method comprises the steps of collecting operation information data of the chemical device by using a gateway, storing the operation data and a timestamp, storing control logic and interlocking relation among the data, and corresponding relation between abnormal operation and accident type, and establishing a three-dimensional operation information database.
In the using process, a knowledge base can be formed by combining basic theories, operation specifications, typical chemical accident cases, theoretical learning, answering, grading and abnormal operation teaching materials, and rich experience of domain experts is saved by combining the networking sensor technology, so that the method is applied to safety training of staff.
In the technical scheme of the embodiment, based on rules, algorithms and device equipment data, the AR technology is used for rapid modeling, the actual operation process of the chemical device equipment and the process requirements thereof are visually and clearly displayed, the problems of unclear oral description, incapability of deep subjective understanding of trainees and the like are avoided, and the training quality is ensured and improved.
The operation on the virtual model can enable training personnel to truly experience serious consequences possibly brought by normal operation work and non-normal operation work, the corresponding relation between newly generated abnormal operation and accidents is stored as a video and stored in a knowledge base for guiding the operation specification of field staff, meanwhile, the complex field environment and the running condition are combined, a real virtual environment is created through AR technology, the training personnel can be guided personally on the scene, related risk point warning is given, the possibility of reoccurrence of similar accidents is reduced, the precaution consciousness of real operation is infused in training, and the training quality is improved.
The embodiment of the invention also provides a virtual training management device.
As shown in fig. 4, in one embodiment, the virtual training management apparatus 400 includes:
an operation information obtaining module 401, configured to obtain operation information of a target device, where the operation information includes normal operation data of the target device and normal operation data corresponding to the normal operation data, and the operation information further includes abnormal operation data of the target device and abnormal operation data corresponding to the abnormal operation data;
a building module 402, configured to associate the operation information with a virtual model corresponding to the target device, so as to build a virtual training system of the target device.
Optionally, the method further includes: an operation data acquisition module for detecting virtual operation data input to the virtual model by using a motion sensing sensor, wherein the motion sensing sensor comprises one or more of a laser locator, a trackball, a data glove and a helmet display;
the matching module is used for matching the virtual operation data with the running information so as to determine target running data corresponding to the virtual operation data;
and the running state adjusting module is used for adjusting the running state of the virtual model according to the target running data.
Optionally, the running state adjusting module is specifically configured to, when the virtual operation data is matched with abnormal operation data in the running information, display the abnormal running data based on the virtual model.
Optionally, the operation information obtaining module 401 includes:
the acquisition submodule is used for acquiring the operation data of the target equipment and the operation data of the target equipment;
the determining submodule is used for determining control logic and interlocking relation among different operation data;
and the storage submodule is used for taking the operation data and the control logic and the interlocking relation among different operation data as the operation information of the target equipment.
The virtual training management apparatus 400 of this embodiment can implement the steps of the virtual training management method described above, and can implement substantially the same technical effects, which are not described herein again.
The embodiment of the invention also provides the electronic equipment. Referring to fig. 5, the electronic device may include a processor 501, a memory 502, and a program 5021 stored on the memory 502 and operable on the processor 501.
When the electronic device is a terminal, the program 5021 can implement any steps in the method embodiment corresponding to fig. 1 and achieve the same beneficial effects when being executed by the processor 501, and the details are not repeated here.
In the case that the electronic device is a network-side device, when being executed by the processor 501, the program 5021 may implement any steps in the method embodiment corresponding to fig. 5 and achieve the same beneficial effects, which are not described herein again.
Those skilled in the art will appreciate that all or part of the steps of the method according to the above embodiments may be implemented by hardware associated with program instructions, and the program may be stored in a readable medium.
An embodiment of the present invention further provides a readable storage medium, where a computer program is stored on the readable storage medium, and when the computer program is executed by a processor, any step in the method embodiment corresponding to fig. 1 may be implemented, and the same technical effect may be achieved, and in order to avoid repetition, details are not repeated here.
The storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. A virtual training management method is characterized by comprising the following steps:
acquiring running information of target equipment, wherein the running information comprises normal operation data of the target equipment and normal running data corresponding to the normal operation data, and the running information further comprises abnormal operation data of the target equipment and abnormal running data corresponding to the abnormal operation data;
and associating the operation information with a virtual model corresponding to the target equipment to construct a virtual training system of the target equipment.
2. The method of claim 1, further comprising:
detecting virtual operation data input to the virtual model by using a somatosensory sensor, wherein the somatosensory sensor comprises one or more of a laser locator, a trackball, a data glove and a helmet display;
matching the virtual operation data with the running information to determine target running data corresponding to the virtual operation data;
and adjusting the running state of the virtual model according to the target running data.
3. The method of claim 2, wherein said adjusting the operating state of the virtual model based on the target operating data comprises:
and displaying the abnormal operation data based on the virtual model under the condition that the virtual operation data is matched with the abnormal operation data in the operation information.
4. The method according to any one of claims 1 to 3, wherein the obtaining the operation information of the target device comprises:
collecting operation data of the target equipment and operation data of the target equipment;
determining control logic and interlocking relation among different operation data;
and taking the operation data and the control logic and interlocking relation among different operation data as the operation information of the target equipment.
5. A virtual training management apparatus, comprising:
the system comprises an operation information acquisition module, a data processing module and a data processing module, wherein the operation information acquisition module is used for acquiring operation information of target equipment, the operation information comprises normal operation data of the target equipment and normal operation data corresponding to the normal operation data, and the operation information further comprises abnormal operation data of the target equipment and abnormal operation data corresponding to the abnormal operation data;
and the construction module is used for associating the operation information with a virtual model corresponding to the target equipment so as to construct a virtual training system of the target equipment.
6. The apparatus of claim 5, further comprising:
the operation data acquisition module is used for detecting virtual operation data input to the virtual model by using a somatosensory sensor, and the somatosensory sensor comprises one or more of a laser positioner, a trackball, a data glove and a helmet display;
the matching module is used for matching the virtual operation data with the running information so as to determine target running data corresponding to the virtual operation data;
and the running state adjusting module is used for adjusting the running state of the virtual model according to the target running data.
7. The apparatus of claim 6, wherein the running state adjustment module is specifically configured to, in a case that the virtual operation data matches abnormal operation data in the running information, display the abnormal operation data based on the virtual model.
8. The apparatus according to any one of claims 5 to 7, wherein the operation information acquisition module includes:
the acquisition submodule is used for acquiring the operation data of the target equipment and the operation data of the target equipment;
the determining submodule is used for determining control logic and interlocking relation among different operation data;
and the storage submodule is used for taking the operation data and the control logic and the interlocking relation among different operation data as the operation information of the target equipment.
9. An electronic device, comprising: a transceiver, a memory, a processor, and a program stored on the memory and executable on the processor; the virtual training management method according to any one of claims 1 to 4, wherein the processor is configured to read a program in the memory to implement the steps of the virtual training management method.
10. A readable storage medium storing a program which when executed by a processor performs the steps in the virtual training management method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110276818.6A CN115082265A (en) | 2021-03-15 | 2021-03-15 | Virtual training management method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110276818.6A CN115082265A (en) | 2021-03-15 | 2021-03-15 | Virtual training management method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115082265A true CN115082265A (en) | 2022-09-20 |
Family
ID=83240536
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110276818.6A Pending CN115082265A (en) | 2021-03-15 | 2021-03-15 | Virtual training management method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115082265A (en) |
-
2021
- 2021-03-15 CN CN202110276818.6A patent/CN115082265A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106340217B (en) | Manufacturing equipment intelligence system and its implementation based on augmented reality | |
| CN107730017B (en) | Intelligent metallurgical equipment operation diagnosis system | |
| DE102005061211B4 (en) | Method for creating a human-machine user interface | |
| CN105252532B (en) | The method of the flexible gesture stability of motion capture robot collaboration | |
| Hüttenrauch et al. | Investigating spatial relationships in human-robot interaction | |
| Jankowski et al. | Usability evaluation of vr interface for mobile robot teleoperation | |
| CN110047150B (en) | Complex equipment operation on-site simulation system based on augmented reality | |
| CN109268010B (en) | Remote inspection intervention method for virtual reality mine fully-mechanized coal mining face | |
| Goldberg et al. | Collaborative teleoperation using networked spatial dynamic voting | |
| CN107256652A (en) | Training on electric power Comprehensive Control experience system | |
| Jacobsen et al. | Active personalized construction safety training using run-time data collection in physical and virtual reality work environments | |
| CN110977981A (en) | Robot virtual reality synchronization system and synchronization method | |
| Zhou et al. | Humanlike Inverse kinematics for improved spatial awareness in construction robot teleoperation: Design and experiment | |
| CN115082265A (en) | Virtual training management method and device, electronic equipment and readable storage medium | |
| Lakshantha et al. | A diagrammatic framework for intuitive human robot interaction | |
| De Barros et al. | A survey of user interfaces for robot teleoperation | |
| Franz et al. | Assessment of a user centered interface for teleoperation and 3d environments | |
| Skerlj et al. | Virtual reality-based framework for service robotics: Data monitoring and recording during rehabilitation scenarios | |
| Meng et al. | Virtual Reality Based Robot Teleoperation via Human-Scene Interaction | |
| Mavridis et al. | Steps towards affordable android telepresence | |
| Xie et al. | A VR-based interactive teaching and practice environment for supporting the whole process of mining engineering education | |
| Kanyok et al. | A Novel Metric of Continuous Situational Awareness Monitoring (CSAM) for Multi-telepresence Coordination System | |
| WO2024069997A1 (en) | Virtual three-dimensional space sharing system, virtual three-dimensional space sharing method, and virtual three-dimensional space sharing server | |
| CN116308930A (en) | Virtual simulation method and system based on industrial robot education | |
| Adam | Towards more realism: Improving immersion of a virtual human-robot working cell and discussing the comparability with its real-world representation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |