CN114937393A - Petrochemical enterprise high-altitude operation simulation training system based on augmented reality - Google Patents
Petrochemical enterprise high-altitude operation simulation training system based on augmented reality Download PDFInfo
- Publication number
- CN114937393A CN114937393A CN202210605387.8A CN202210605387A CN114937393A CN 114937393 A CN114937393 A CN 114937393A CN 202210605387 A CN202210605387 A CN 202210605387A CN 114937393 A CN114937393 A CN 114937393A
- Authority
- CN
- China
- Prior art keywords
- altitude operation
- scene
- altitude
- training
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a petrochemical enterprise high-altitude operation simulation training system based on augmented reality, which comprises a high-altitude operation training server, a high-altitude operation simulation training system, an AR visual system, a man-machine interaction system and a high-altitude operation three-dimensional scene positioning device, wherein the high-altitude operation training server is used for operating and storing the simulation training system and a high-altitude operation risk potential three-dimensional database; the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainee; the human-computer interaction system is connected with the AR visual system, and interaction between training personnel and the three-dimensional virtual scene is realized by utilizing the AR handle and the data glove equipment; the three-dimensional scene positioning device is used for positioning and switching the high-altitude operation three-dimensional environment. Its advantage lies in, satisfies enterprise's safety supervision personnel and aerial work personnel and simulate actual operation in real scene, strengthens interactive, the interest of training, greatly promotes operation personnel's safety consciousness and operation level, effectively suppresses the emergence of accident.
Description
Technical Field
The application belongs to a simulation training system for high-altitude operation of petrochemical enterprises, and particularly relates to a simulation training system for high-altitude operation of petrochemical enterprises based on augmented reality.
Background
The petrochemical industry device has the characteristics of large scale, complexity and specialization, and the frequency and the casualty rate of high-altitude falling accidents are very high in the construction processes of new, improved, expanded and constructed devices, detection, maintenance and modification. The high-altitude operation training of the existing petrochemical enterprise mainly carries out training work in modes such as classroom teaching, theoretical training, video teaching, and can meet the training requirements of supervision personnel and operating personnel to a certain extent, but still has the defects that the improvement is not enough and needs to be perfect: (1) trainees in video teaching and classroom teaching can only learn theoretical knowledge, actual operation cannot be carried out, and the training effect is poor; (2) the petrochemical enterprise is complex and changeable on site, and the training content cannot cover all the content; (3) less training in safety awareness; (4) the user experience is not good, the learning is more, the remembering is less, and the form is larger than the content.
Disclosure of Invention
Based on the problems, the invention provides a system for training by combining an entity training model for high-altitude operation based on augmented reality and virtual operation flow information, which effectively improves the safety awareness and the operation level of enterprise supervisors and high-altitude operation personnel and reduces the occurrence of high-altitude operation accidents. The technical scheme is that the method comprises the following steps of,
a petrochemical enterprise high-place operation simulation training system based on augmented reality comprises a high-place operation training server, a high-place operation simulation training system, an AR visual system, a high-place operation entity training model, a man-machine interaction system and a high-place operation three-dimensional scene positioning device, wherein,
the high-altitude operation training server is used for operating and storing the simulation training system and the high-altitude operation three-dimensional database;
the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainee;
the human-computer interaction system is connected with the AR visual system, and interaction between a trainer and a high-altitude operation three-dimensional scene is realized by utilizing the AR handle and the data glove equipment;
the AR vision system provides a visual high-altitude operation three-dimensional scene for the trainee by utilizing a three-dimensional registration technology and a virtual-real fusion display technology, so that the trainee can be immersed in the high-altitude operation scene;
the high-altitude operation entity training model is linked with the high-altitude operation three-dimensional scene, a training environment with a physical entity and a virtual model fused is provided for trained personnel, and the high-altitude operation training server is communicated with the AR visual system, the man-machine interaction system and the high-altitude operation three-dimensional scene positioning device;
the three-dimensional scene positioning device is used for positioning and switching the three-dimensional scene of the high-altitude operation.
Preferably, the high-altitude operation simulation training system comprises a high-altitude operation scene editing module, a high-altitude operation logic editing module, a multi-role multi-mode real-time interaction module and a high-altitude operation examination management module;
the high-altitude operation scene editing module comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station operation three-dimensional scene;
the logic editing module for high-altitude operation carries out the next logic judgment on the operation elements of the operation position, the operation time, the operation type, the use tool, the operator and the guardian in the high-altitude operation process according to the time sequence or the event triggering condition, thereby realizing the whole process design of the high-altitude operation.
Preferably, the high-altitude operation examination management module is used for designing the risk triggered by the accident in the three-dimensional scene according to the typical accident case of the high-altitude operation, and if the risk cannot be identified by an operator in the operation process, the risk is triggered to evolve into the element of the accident, so that the accident evolution process is initiated, and if the risk element of the accident is not triggered, the whole high-altitude operation program is completed according to the normal flow.
Preferably, the multi-role multi-mode real-time interaction module is used for implementing high-altitude operation by needing participation of 7 types of roles, and in order to simulate the characteristics of direct operation and multi-role participation, the system adopts a distributed interaction simulation technology to realize interaction among different roles in a scene, namely for a role without being controlled by training personnel, all tasks of the role, including communication with other people and interaction with the scene, are automatically executed in an artificial intelligence mode, and the operation process is ensured to be smoothly carried out.
Further preferably, the high-altitude job scene editing step includes:
acquiring basic geographical space information of a device and a trained person in a high-altitude operation three-dimensional scene by using an unmanned aerial vehicle photography technology, cutting a three-dimensional model in which the high-altitude operation three-dimensional scene is positioned from a topographic map by using a dynamic monomer method, and directly introducing 3Dmax after cutting to realize three-dimensional restoration of the device and the trained person in the high-altitude operation three-dimensional scene;
the construction of a high-altitude operation three-dimensional scene is realized by utilizing the three-dimensional model data of the bottom layer, and task characteristics in a high-altitude operation process are extracted, wherein the task characteristics comprise operation positions, operation time, operation types, tools, operation risks and risk control measures; dividing the responsibilities of different workers, including an operator, a guardian, a security officer, an operation ticket responsible person, an issuer and a licensor; the virtual trainee, the operation object and the operation content are abstractly described and stored by a single operation task, the action, the device, the environment and the risk of the trainee are described by an independent three-dimensional model, and task serial and parallel combination is carried out on different tasks, different time nodes and different operation objects according to logical relation AND or OR by editing operation process scripts, so that the flexible construction of different task organization structures and training processes is realized; through the high-altitude operation flow editing tool, system management personnel can edit the three-dimensional simulation training course according to the real operation flow and the risk high-incidence point.
Further preferably, the aerial work three-dimensional scene model is constructed by,
the three-dimensional scene rapid building technology based on unmanned aerial vehicle photography is used for rapidly building the surrounding environment of the device, the image matching optimal algorithm ASIFT algorithm is adopted to realize the multi-view stereo matching of mass image data acquired by unmanned aerial vehicle oblique photography, the affine mapping matrix is decomposed according to the formula 1,
wherein λ > 0 is a scale factor representing a multiple of image scaling, ψ is an angle of rotation of an affine camera around its own optical axis,
representing image inclination parameters, theta and phi represent included angles between the optical axis of the camera and the horizontal projection plane and the vertical projection plane respectively, and T t For the inter-image translation transformation matrix, R ψ 、R φ A is an affine mapping result of the texture image of the three-dimensional model;
I’＝A*I (2)
i is the input image and I' is the output image.
Preferably, the AR vision system uses an AR head-mounted display device, and detects the position state of the camera relative to the augmented reality-based high-altitude operation entity training model in real time through an augmented reality three-dimensional registration technology and a virtual-real fusion display technology, determines the position of virtual information to be superimposed in a projection plane, and displays the virtual information at the correct position in a screen in real time, so that the trainee can simulate the supervision of high-altitude operation and the operation process of operation according to the high-altitude operation flow in a three-dimensional virtual environment.
Preferably, the human-computer interaction system comprises the operation of trained personnel on scene operation and the identification of risks and hidden dangers, and the human-computer interaction system performs real-time interaction with equipment and objects in the virtual scene.
Further preferred, aerial work entity training model includes the work platform, prevents the railing, and the bottom universal wheel, work platform are the cuboid steel construction, and the trilateral guardrail that prevents of work platform is equipped with, and the work platform bottom is equipped with 2 groups and takes the brake formula universal wheel, and training personnel simulate on work platform, experience aerial work environment, increase the substitution of training and feel.
Further preferably, the simulation training system for the high-altitude operation of the petrochemical enterprise based on the augmented reality comprises the following operation steps,
(1) in a real scene, a trainee starts a high-altitude operation simulation training system at a server end;
(2) a trainee logs in the aerial work simulation training system, selects a work scene and sends a scene instruction to the scene positioning device;
(3) the trained person wears the AR visual system;
(4) selecting a training mode by a trainee through an AR vision system, and enabling virtual characters of the trainee in a three-dimensional scene to enter an operation scene;
(5) the trainee selects a high-altitude operation task in the virtual scene;
(6) the positioning device captures role actions to realize the operation task of the virtual role in the three-dimensional scene;
(7) if the trainee fails to operate the task due to the operation error, restarting training from the selected model;
(8) and if the trainee successfully finishes the task, taking down the AR vision system, and finishing the training.
Advantageous effects
1. The invention provides a novel method for high-altitude operation training, which improves the safety awareness and the operation level of enterprise supervisors and high-altitude operation personnel by using an augmented reality technology and reduces high-altitude operation accidents.
2. The high-altitude operation training system based on the augmented reality combines the virtual scene with the actual operation, has strong man-machine interaction and immersion, can improve the training interest of students, and can independently edit different scenes to improve the applicability of the system when being developed.
Drawings
FIG. 1 is a diagram of a simulation training system for high-altitude operations of petrochemical enterprises based on augmented reality.
FIG. 2 is a flow chart of an augmented reality-based petrochemical enterprise high-altitude operation simulation training system.
FIG. 3 is an augmented reality based aerial work entity training model.
Detailed Description
The following detailed description is exemplary and is intended to provide further explanation of the disclosure. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present application.
A petrochemical enterprise high-place operation simulation training system based on augmented reality is characterized by comprising a high-place operation training server, a high-place operation simulation training system, an AR visual system, a high-place operation entity training model, a man-machine interaction system and a high-place operation three-dimensional scene positioning device, wherein,
the high-altitude operation training server is used for operating and storing the simulation training system and the high-altitude operation three-dimensional database, and the high-altitude operation three-dimensional database comprises a risk potential database and a high-altitude operation scene three-dimensional database;
the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainee;
the human-computer interaction system is connected with the AR visual system, and interaction between training personnel and the three-dimensional virtual scene is realized by utilizing the AR handle and the data glove equipment;
the AR vision system provides a visual high-altitude operation three-dimensional scene for the trainee by utilizing a three-dimensional registration technology and a virtual-real fusion display technology, so that the trainee can be immersed in the high-altitude operation scene;
the aerial work entity training model is linked with the aerial work three-dimensional scene, a training environment with a physical entity and a virtual model fused together is provided for the trained personnel, and the aerial work training server is communicated with the AR visual system, the man-machine interaction system and the aerial work three-dimensional scene positioning device, so that real-time interaction of the physical environment, the three-dimensional scene, the action of the trained personnel and the action data of the personnel in the virtual space is realized.
The three-dimensional scene positioning device is used for positioning and switching the high-altitude operation three-dimensional environment.
Wherein
The aerial work training server is mainly used for deploying an aerial work simulation training system, storing and managing a three-dimensional model library and editing and rendering a three-dimensional training scene. The three-dimensional scene mainly comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station.
The high-altitude operation simulation training system is a core module of the training system and comprises a high-altitude operation scene editing module, a high-altitude operation logic editing module, a multi-role multi-mode real-time interaction module and a high-altitude operation examination management module;
the high-altitude operation scene editing module comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station operation three-dimensional virtual scene;
the high-altitude operation logic editing module is used for carrying out next logic judgment on operation elements of an operation position, operation time, operation types, a use tool, an operator and a guardian in the high-altitude operation process according to a time sequence or an event triggering condition, so that the whole process design of the high-altitude operation is realized;
the high-place operation examination management module is used for designing accident triggering risks in a three-dimensional scene according to a typical accident case of high-place operation in the past, triggering risk evolution factors into accident factors if an operator cannot identify the risks in the operation process, and triggering an accident evolution process if the risk factors are not triggered;
the multi-role multi-mode real-time interaction module is used for implementing high-place operation and needs participation of 7 types of roles, in order to simulate the characteristic of multi-role participation in direct operation, a distributed interaction simulation technology is adopted in the system to realize interaction among different roles in a scene, namely for roles which are not controlled by training personnel, all tasks of the roles, including communication with other people and interaction with the scene, can be automatically executed in an artificial intelligent mode, and the operation process can be smoothly carried out.
The three-dimensional virtual scene model is as follows,
the three-dimensional scene rapid construction technology based on unmanned aerial vehicle photography is used for rapidly constructing the surrounding environment of the device, the image matching optimal algorithm ASIFT algorithm is adopted to realize the multi-view stereo matching of mass image data acquired by unmanned aerial vehicle oblique photography, the affine mapping matrix is decomposed,
wherein λ > 0 is a scale factor representing a multiple of image scaling, ψ is an angle of rotation of an affine camera around its own optical axis,
and representing the image inclination parameters, wherein theta and phi represent the included angles between the optical axis of the camera and the horizontal projection plane and the vertical projection plane respectively. T is a unit of t For the inter-image translation transformation matrix, R ψ 、R φ A is an affine mapping result of the texture image of the three-dimensional model;
I’＝A*I (2)
i is the input image and I' is the output image.
The high-altitude operation scene editing steps are as follows:
acquiring basic geographical space information of a device and a trained person in a high-altitude operation three-dimensional scene by using an unmanned aerial vehicle photography technology, cutting a three-dimensional model in which the high-altitude operation three-dimensional scene is positioned from a topographic map by using a dynamic monomer method, and directly introducing 3Dmax after cutting to realize three-dimensional restoration of the device and the trained person in the high-altitude operation three-dimensional scene;
the construction of a high-altitude operation three-dimensional scene is realized by utilizing the three-dimensional model data of the bottom layer, and task characteristics in a high-altitude operation process are extracted, wherein the task characteristics comprise operation positions, operation time, operation types, tools, operation risks and risk control measures; dividing the responsibilities of different workers, including an operator, a guardian, a security officer, an operation ticket responsible person, an issuer and a licensor; the virtual trainee, the operation object and the operation content are abstractly described and stored by a single operation task, the action, the device, the environment and the risk of the trainee are described by an independent three-dimensional model, and task serial and parallel combination is carried out on different tasks, different time nodes and different operation objects according to logical relation AND or OR by editing operation process scripts, so that the flexible construction of different task organization structures and training processes is realized; through the high-altitude operation process editing tool, system management personnel can edit the three-dimensional simulation training course according to the real operation process and the high risk starting point.
The invention relates to an AR visual system, which utilizes a three-dimensional registration technology and a virtual-real fusion display technology to detect the position state of a model in real time, ensures that virtual information is displayed at a correct position in a screen in real time, provides a visual three-dimensional scene for a trainee, and enables the trainee to be immersed in a high-altitude operation scene.
The man-machine interaction system comprises the operation of trained personnel on scene operation and the identification of risks and hidden dangers, and can interact with equipment and objects in a virtual scene in real time. Risks in the three-dimensional scene of high-altitude operation depend on the experience knowledge of trained personnel to judge, and common risks such as operation personnel high-altitude falling, article are put and are not standardized and lead to the high-altitude falling object, not wear safety belt safety helmet, safety measure not in place, scaffold puts up incorrect etc..
The aerial work entity training model based on the augmented reality is mainly used for simulating an aerial work environment, and learning interest of trained personnel is increased and a better training effect is realized by combining a three-dimensional virtual scene with the aerial work entity training model based on the augmented reality.
The operation flow of the simulation training system for the high-altitude operation of the petrochemical enterprise based on the augmented reality is shown in fig. 2.
(1) And in a real scene, the trainee starts the aerial work simulation training system at the server side.
(2) The trainee logs in the aerial work simulation training system, selects a work scene and sends a scene instruction to the scene positioning device.
(3) The trained person wears the AR vision system.
(4) The trainee selects a training mode through the AR vision system, and virtual characters of the trainee in the three-dimensional scene enter an operation scene.
(5) The trainee selects a task of high-altitude work in the virtual scene.
(6) The positioning device captures the role action and realizes the operation task of the virtual role in the three-dimensional scene.
(7) The trainee resumes training from the selected model if the operational error results in a task failure.
(8) And if the trainee successfully finishes the task, taking down the AR vision system, and finishing the training.
The implementation case is as follows:
(1) shed cleaning operation of filling station
Firstly, a trainee starts a high-place operation simulation training system at a server side.
Secondly, the trainee logs in the high-altitude operation simulation training system, selects high-altitude operation and sends the selection to the positioning device.
And thirdly, the trainee wears the AR vision system, recognizes the aerial work entity training model based on the augmented reality, and selects a gas station scene.
And fourthly, the trainee enters a high-altitude operation three-dimensional virtual scene of the gas station.
The trainee selects the awning cleaning operation of the gas station.
And sixthly, the trainee carries out on-site inspection, makes a construction scheme and makes an overhead operation ticket.
And seventhly, the trainee moves in a real scene, the leg and hand actions of the trainee are captured by the positioning device, the virtual character is driven to move in a three-dimensional scene, and the gas station awning cleaning operation is carried out through the handle.
Before operation, an operator needs to check whether personal protective articles are intact and wear safety islands and safety helmets which meet the national safety standards; the scaffold is constructed to meet the safety requirements, and is qualified after the acceptance of relevant departments, and a qualified signboard is hung; checking whether the stairs used by the operator up and down are intact.
In the operation process, the safety belt is tied and hung on a fixed structure above an operation position, the safety belt is used in a high-hanging mode and a low-hanging mode, and the safety helmet is tied with a helmet belt; the cross operation cannot be carried out in the uniform falling direction; the tool, materials, sundries and the like are strictly forbidden to be thrown up and down, a safety rope is tied when the tool is used, and the tool is placed into a tool bag when the tool is not used; the operator can not rest at a high place and hold the scaffold with hands; in the operation process, the scaffold is strictly forbidden to move; when the operation is carried out in rainy and snowy days, anti-skid and cold-proof measures can be taken; in the operation engineering, safety guardians need to monitor the safety in real time on the spot.
After the operation is finished, the operator and the guardian should pick up the operation tool and clean the operation site.
And in the process of awning cleaning operation of a gas station, the operator is caused to fall from a high place to die and the task fails due to the fact that the operator is not correctly fastened with the safety belt.
And ninthly, the trainee starts from the second step again.
And (4) completing the awning cleaning operation of the gas station by the person to be trained at the front (R) side, completing the task and finishing the training.
(2) Steel grating laying operation for reactor frame platform of certain device
Firstly, a trainee starts a high-altitude operation simulation training system at a server side.
Secondly, the trainee logs in the high-altitude operation simulation training system, selects high-altitude operation and sends the selection to the positioning device.
And thirdly, the trainee wears the AR vision system, identifies the aerial work entity training model based on the augmented reality, and selects a device scene.
And the trainee enters the three-dimensional virtual scene of the high-altitude operation of the device.
Fifth, the trainee selects the steel grating of the reactor frame platform of a certain device to lay.
And sixthly, the trainee carries out on-site inspection, makes a construction scheme and makes an overhead operation ticket.
And seventhly, the trainee moves in a real scene, the leg and hand actions of the trainee are captured by the positioning device, the virtual character is driven to move in a three-dimensional scene, and the steel grating laying operation of a certain device reactor frame platform is carried out through the handle.
Before operation, a warning area is set, warning signs are placed, and irrelevant people are strictly prohibited from entering the operation area; the personnel shall check whether the personal protective articles are intact and shall wear safety belts and safety helmets which meet the national safety standards; checking whether the scaffold is built according with the safety requirement and whether a qualified signboard is hung; guard rails and foot blocking plates are arranged on the periphery of the operation platform, and guard rails and warning signs or covering measures are arranged on the adjacent edges and the periphery of the opening; checking whether the stairs, the elevators and the cages used by the operators up and down are intact.
In the operation process, the whole belt is tied and hung on a firm construction above an operation position, the height is high, the use is low, and the safety helmet is tied with a helmet belt; the vertical crossing operation cannot be carried out in the same falling direction, and if the vertical crossing operation is required, a safety protection layer is arranged in the middle; in the operation process, tools, materials, sundries and the like are strictly forbidden to be thrown up and down, all materials are stably stacked, a safety warning area is required to be established and a special person is used for nursing, a safety rope is required to be tied when the tool is used, and the tool is required to be placed into a tool bag when not used; when the grid plates are laid at a high place, the grid plates must be laid and fixed at the same time; the operator can not rest at a high place and can not hold an object in the hand to pass through an upper channel and a lower channel; when the operation is carried out in rainy and snowy days, anti-skid and cold-proof measures are taken as much as possible; in the operation engineering, safety monitoring personnel need to monitor the safety of the site in real time.
After the operation is finished, the operator and the guardian should pick up the operation tool and clean the operation site.
And eighthly, in the laying operation process of the steel grating of the reactor frame platform of a certain device, because the steel grating is not stably placed and falls, the operator is dead and the task fails.
And ninthly, the trainee starts from the second step again.
And (4) finishing the laying operation of the steel grating of the reactor frame platform of a certain device by the person to be trained at the red (R) node, finishing the task and finishing the training.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A simulation training system for high-altitude operation of petrochemical enterprises based on augmented reality is characterized by comprising a high-altitude operation training server, a high-altitude operation simulation training system, an AR vision system, a high-altitude operation entity training model, a human-computer interaction system and a high-altitude operation three-dimensional scene positioning device, wherein,
the high-altitude operation training server is used for operating and storing the simulation training system and the high-altitude operation three-dimensional database;
the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainee;
the human-computer interaction system is connected with the AR visual system, and interaction between training personnel and the high-place operation three-dimensional scene is realized by utilizing the AR handle and the data glove equipment;
the AR vision system provides a visual high-altitude operation three-dimensional scene for the trainee by utilizing a three-dimensional registration technology and a virtual-real fusion display technology, so that the trainee can be immersed in the high-altitude operation scene;
the high-altitude operation entity training model is linked with a high-altitude operation three-dimensional scene, a training environment with a physical entity and a virtual model fused together is provided for a trained person, and a high-altitude operation training server is communicated with an AR visual system, a human-computer interaction system and a high-altitude operation three-dimensional scene positioning device;
the three-dimensional scene positioning device is used for positioning and switching the three-dimensional scene of the high-altitude operation.
2. The petrochemical enterprise high-altitude operation simulation training system based on the augmented reality of claim 1, wherein the high-altitude operation simulation training system comprises a high-altitude operation scene editing module, a high-altitude operation logic editing module, a multi-role multi-mode real-time interaction module and a high-altitude operation examination and management module;
the high-altitude operation scene editing module comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station operation three-dimensional scene;
the logic editing module for high-altitude operation carries out the next logic judgment on the operation elements of the operation position, the operation time, the operation type, the use tool, the operator and the guardian in the high-altitude operation process according to the time sequence or the event triggering condition, thereby realizing the whole process design of the high-altitude operation.
3. The system for simulation training of high-altitude operations of petrochemical enterprises based on augmented reality as claimed in claim 2, wherein the high-altitude operation examination management module is used for designing risks triggered by accidents in a three-dimensional scene according to the past typical accident cases of high-altitude operations, triggering the risks to evolve into accident elements if the risks cannot be identified by operators in the operation process, and completing the whole high-altitude operation procedure according to a normal flow if the accident risk elements are not triggered.
4. The simulation training system for the high-altitude operation of the petrochemical enterprise based on the augmented reality as claimed in claim 2, wherein the multi-role multi-mode real-time interaction module is used for realizing the high-altitude operation, 7 types of roles are required to participate, in order to simulate the characteristics of the direct operation and the participation of multiple roles, the system adopts a distributed interaction simulation technology to realize the interaction among different roles in a scene, namely for the role without being controlled by training personnel, all tasks of the role can be automatically executed in an artificial intelligence mode, including the communication with other people and the interaction with the scene, and the smooth operation process is ensured.
5. The augmented reality-based petrochemical enterprise high-altitude operation simulation training system according to claim 1, wherein the high-altitude operation scene editing step comprises the following steps:
acquiring basic geographic space information of a device and a trained person in a high-altitude operation three-dimensional scene by using an unmanned aerial vehicle photography technology, cutting a three-dimensional model in which the high-altitude operation three-dimensional scene is positioned from a topographic map by using a dynamic monomer method, and directly introducing 3Dmax after cutting to realize three-dimensional restoration of the device and the trained person in the high-altitude operation three-dimensional scene;
the construction of a high-altitude operation three-dimensional scene is realized by utilizing the three-dimensional model data of the bottom layer, and task characteristics in a high-altitude operation flow are extracted, wherein the task characteristics comprise an operation position, operation time, operation types, tools, operation risks and risk control measures; dividing the responsibilities of different workers, including an operator, a guardian, a security officer, an operation ticket responsible person, an issuer and a licensor; the virtual trainee, the virtual trainee object and the virtual trainee object are abstractly described and stored by a single operation task, the trainee action, the virtual trainee object and the operation content are described by independent three-dimensional models, and task serial and parallel combination is carried out on different tasks, different time nodes and different operation objects according to logical relation AND or OR by editing operation process scripts, so that different task organizational structures and flexible construction of a training process are realized; through the high-altitude operation process editing tool, system management personnel can edit the three-dimensional simulation training course according to the real operation process and the high risk starting point.
6. The simulation training system for petrochemical enterprise high operation based on augmented reality of claim 2, wherein the high operation three-dimensional scene model is constructed as follows,
the three-dimensional scene rapid construction technology based on unmanned aerial vehicle photography is used for rapidly constructing the surrounding environment of the device, the image matching optimal algorithm ASIFT algorithm is adopted to realize the multi-view stereo matching of mass image data acquired by unmanned aerial vehicle oblique photography, the affine mapping matrix is decomposed according to the formula 1,
where λ > is a scale factor representing the multiple of image scaling, ψ is the angle of rotation of the affine camera around its own optical axis,
representing image inclination parameters, theta and phi represent included angles between the optical axis of the camera and the horizontal projection plane and the vertical projection plane respectively, and T t For the inter-image translation transformation matrix, R ψ 、R φ A is an affine mapping result of the texture image of the three-dimensional model;
I’＝A*I (2)
i is the input image and I' is the output image.
7. The simulation training system for the high-altitude operation of the petrochemical enterprise based on the augmented reality as claimed in claim 1, wherein the AR vision system utilizes an AR head-mounted display device to detect the position state of the camera relative to the training model of the high-altitude operation entity based on the augmented reality in real time through an augmented reality three-dimensional registration technology and a virtual-real fusion display technology, determine the position of virtual information to be superimposed in a projection plane, and display the virtual information at the correct position in a screen in real time, so that the trainee can simulate the supervision of the high-altitude operation and the operation process of the operation in the three-dimensional virtual environment according to the high-altitude operation flow.
8. The simulation training system for petrochemical enterprise high-altitude operations based on augmented reality as claimed in claim 1, wherein the human-computer interaction system comprises the operation of trained personnel on scene operations and the identification of risks and hidden dangers, and performs real-time interaction with equipment and objects in a virtual scene.
9. The simulation training system for the high-altitude operation of the petrochemical enterprise based on the augmented reality as claimed in claim 1, wherein the high-altitude operation entity training model comprises an operation platform, a protection railing, a bottom universal wheel, the operation platform is of a cuboid steel structure, the protection railing is arranged on three sides of the operation platform, 2 groups of brake type universal wheels are arranged at the bottom end of the operation platform, training personnel simulate on the operation platform to experience a high-altitude operation environment, and the substitution sense of training is increased.
10. The augmented reality based petrochemical enterprise high altitude operation simulation training system according to claim 1, wherein the augmented reality based petrochemical enterprise high altitude operation simulation training system is operated by the steps of,
(1) in a real scene, a trainee starts a high-altitude operation simulation training system at a server end;
(2) a trainee logs in the aerial work simulation training system, selects a work scene and sends a scene instruction to the scene positioning device;
(3) the training wears an AR vision system;
(4) the trainee selects a training mode through an AR vision system, and virtual characters of the trainee in the three-dimensional scene enter an operation scene;
(5) the trainee selects a high-altitude operation task in the virtual scene;
(6) the positioning device captures role actions to realize the operation task of the virtual role in the three-dimensional scene;
(7) if the trainee fails to operate the task due to the operation error, restarting training from the selected model;
(8) and if the trainee successfully finishes the task, taking down the AR vision system, and finishing the training.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2022103223044 | 2022-03-30 | ||
| CN202210322304 | 2022-03-30 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114937393A true CN114937393A (en) | 2022-08-23 |
| CN114937393B CN114937393B (en) | 2023-10-13 |
Family
ID=82866317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210605387.8A Active CN114937393B (en) | 2022-03-30 | 2022-05-31 | Petrochemical enterprise high-altitude operation simulation training system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114937393B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102930753A (en) * | 2012-10-17 | 2013-02-13 | 中国石油化工股份有限公司 | Gas station virtual training system and application |
| CA2979217A1 (en) * | 2015-03-09 | 2016-09-15 | Alchemy Systems, L.P. | Augmented reality |
| CN106095105A (en) * | 2016-06-21 | 2016-11-09 | 西南交通大学 | A kind of traction substation operator on duty's virtual immersive Training Simulation System and method |
| CN107331220A (en) * | 2017-09-01 | 2017-11-07 | 国网辽宁省电力有限公司锦州供电公司 | Transformer O＆M simulation training system and method based on augmented reality |
| CN109697909A (en) * | 2019-01-24 | 2019-04-30 | 江苏增强现实智能科技有限公司 | Power distribution network operation simulation training checking system based on VR |
| CN109903621A (en) * | 2017-12-08 | 2019-06-18 | 中国石油化工股份有限公司 | The safe simulation training system of petrochemical sales company |
| CN110135474A (en) * | 2019-04-26 | 2019-08-16 | 武汉市土地利用和城市空间规划研究中心 | A kind of oblique aerial image matching method and system based on deep learning |
| CN111127974A (en) * | 2019-12-16 | 2020-05-08 | 广东电网有限责任公司 | Virtual reality and augmented reality three-dimensional application service platform for transformer substation operation |
| CN111582022A (en) * | 2020-03-26 | 2020-08-25 | 深圳大学 | Fusion method and system of mobile video and geographic scene and electronic equipment |
| CN111696398A (en) * | 2019-03-15 | 2020-09-22 | 中国石油化工股份有限公司 | Immersion type virtual simulation training method for eliminating hidden danger of direct operation link of petrochemical enterprise |
| CN112950773A (en) * | 2021-04-07 | 2021-06-11 | 万翼科技有限公司 | Data processing method and device based on building information model and processing server |
-
2022
- 2022-05-31 CN CN202210605387.8A patent/CN114937393B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102930753A (en) * | 2012-10-17 | 2013-02-13 | 中国石油化工股份有限公司 | Gas station virtual training system and application |
| CA2979217A1 (en) * | 2015-03-09 | 2016-09-15 | Alchemy Systems, L.P. | Augmented reality |
| CN106095105A (en) * | 2016-06-21 | 2016-11-09 | 西南交通大学 | A kind of traction substation operator on duty's virtual immersive Training Simulation System and method |
| CN107331220A (en) * | 2017-09-01 | 2017-11-07 | 国网辽宁省电力有限公司锦州供电公司 | Transformer O＆M simulation training system and method based on augmented reality |
| CN109903621A (en) * | 2017-12-08 | 2019-06-18 | 中国石油化工股份有限公司 | The safe simulation training system of petrochemical sales company |
| CN109697909A (en) * | 2019-01-24 | 2019-04-30 | 江苏增强现实智能科技有限公司 | Power distribution network operation simulation training checking system based on VR |
| CN111696398A (en) * | 2019-03-15 | 2020-09-22 | 中国石油化工股份有限公司 | Immersion type virtual simulation training method for eliminating hidden danger of direct operation link of petrochemical enterprise |
| CN110135474A (en) * | 2019-04-26 | 2019-08-16 | 武汉市土地利用和城市空间规划研究中心 | A kind of oblique aerial image matching method and system based on deep learning |
| CN111127974A (en) * | 2019-12-16 | 2020-05-08 | 广东电网有限责任公司 | Virtual reality and augmented reality three-dimensional application service platform for transformer substation operation |
| CN111582022A (en) * | 2020-03-26 | 2020-08-25 | 深圳大学 | Fusion method and system of mobile video and geographic scene and electronic equipment |
| CN112950773A (en) * | 2021-04-07 | 2021-06-11 | 万翼科技有限公司 | Data processing method and device based on building information model and processing server |
Non-Patent Citations (2)
| Title |
|---|
| 夏麟;董子龙;章国锋;: "基于环境映照自动对齐的高质量虚实融合技术", 计算机辅助设计与图形学学报, vol. 23, no. 10, pages 1641 - 1648 * |
| 毕文婷;: "仿真式培训 身临其境", 劳动保护, no. 10, pages 26 - 29 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114937393B (en) | 2023-10-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Vahdatikhaki et al. | Beyond data visualization: A context-realistic construction equipment training simulators | |
| CN114020185B (en) | Emergency drilling practical training system and construction method thereof | |
| CN111760228B (en) | Intelligent deduction system and method for fire fighting and fire fighting rescue | |
| CN108847081A (en) | A kind of fire-fighting simulated training method based on virtual reality technology | |
| CN105976670A (en) | Three-dimensional emergency drilling virtual system and construction method and use method thereof | |
| CN108268128A (en) | A kind of safety in production emergency preplan 3DVR virtual reality drilling systems | |
| CN108257063A (en) | A kind of fire-fighting war instruction desktop maneuvers man-machine interactive system | |
| CN109903621B (en) | Safety simulation training system for petrochemical marketing enterprises | |
| CN113034311A (en) | Building construction supervision system and method based on BIM | |
| CN111552382B (en) | VR (virtual reality) compressed natural gas tank car accident handling teaching decision method, device and equipment | |
| CN111127974A (en) | Virtual reality and augmented reality three-dimensional application service platform for transformer substation operation | |
| CN112991857A (en) | Electric power emergency rescue training system and method | |
| Mendes et al. | Working safely with drones: A virtual training strategy for workers on heights | |
| CN114694447A (en) | Three-dimensional simulation intelligent application system for emergency drilling | |
| CN113128716A (en) | Operation guidance interaction method and system | |
| CN114937393A (en) | Petrochemical enterprise high-altitude operation simulation training system based on augmented reality | |
| Hossain et al. | Building Indoor Point Cloud Datasets with Object Annotation for Public Safety. | |
| CN115554641A (en) | Big data fire-fighting online exercise system | |
| CN115828620A (en) | Mine disaster emergency simulation method and system based on augmented reality | |
| Congès et al. | Virtual reality to train for crisis management | |
| CN110795859A (en) | Fire safety control generation method and device | |
| CN116884283A (en) | Petrochemical enterprise limited space operation simulation training system based on augmented reality | |
| KR102606532B1 (en) | Disaster training device and disaster training system | |
| CN114611938B (en) | Emergency command method and system based on 3DGIS | |
| Zhang et al. | Development of a dynamic information system for safety management of construction workers based on iot and bim tools |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |