CN114937393B - Petrochemical enterprise high-altitude operation simulation training system based on augmented reality - Google Patents
Petrochemical enterprise high-altitude operation simulation training system based on augmented reality Download PDFInfo
- Publication number
- CN114937393B CN114937393B CN202210605387.8A CN202210605387A CN114937393B CN 114937393 B CN114937393 B CN 114937393B CN 202210605387 A CN202210605387 A CN 202210605387A CN 114937393 B CN114937393 B CN 114937393B
- Authority
- CN
- China
- Prior art keywords
- scene
- training
- altitude operation
- altitude
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application discloses an augmented reality-based high-altitude operation simulation training system for petrochemical enterprises, which comprises a high-altitude operation training server, a high-altitude operation simulation training system, an AR vision system, a man-machine interaction system and a high-altitude operation three-dimensional scene positioning device, wherein the high-altitude operation training server is used for running and storing the simulation training system and a high-altitude operation risk hidden danger three-dimensional database; the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainer; the human-computer interaction system is connected with the AR vision system, and interaction between training personnel and the three-dimensional virtual scene is realized by using an AR handle and data glove equipment; the three-dimensional scene positioning device is used for positioning and switching the three-dimensional environment of the overhead operation. The intelligent training system has the advantages that the simulation actual operation of enterprise safety supervision personnel and high-altitude operators in a real scene is met, the interactivity and the interestingness of training are enhanced, the safety consciousness and the operation level of the operators are greatly improved, and accidents are effectively restrained.
Description
Technical Field
The application belongs to a petrochemical enterprise high-altitude operation simulation training system, and particularly relates to a petrochemical enterprise high-altitude operation simulation training system based on augmented reality.
Background
The petrochemical industry device has the characteristics of large-scale, complicated and specialized, and the frequency and the casualty rate of high falling accidents are very high in the construction process of new, improved and expanded devices and inspection, maintenance and improvement. The existing high-place operation training of petrochemical enterprises mainly develops training work through classroom teaching, theoretical training, video teaching and other modes, and although the training requirements of supervision personnel and operation personnel can be met to a certain extent, the existing high-place operation training is still insufficient and needs improvement and perfection: (1) The trainees of video teaching and classroom teaching can only learn theoretical knowledge, can not actually operate, and have poor training effect; (2) The petrochemical enterprises are complex and changeable in site, and training contents cannot cover the whole content; (3) less training in terms of safety awareness; (4) The user experience is poor, the learning is more, the remembering is less, and the form is larger than the content.
Disclosure of Invention
Based on the problems, the application provides a system for training by combining the high-altitude operation entity training model based on augmented reality and virtual operation flow information, which effectively improves the safety consciousness and the operation level of enterprise supervision personnel and high-altitude operation personnel and reduces the occurrence of high-altitude operation accidents. The technical proposal is that,
an augmented reality-based high-altitude operation simulation training system for petrochemical enterprises comprises a high-altitude operation training server, a high-altitude operation simulation training system, an AR vision system, a high-altitude operation entity training model, a man-machine interaction system and a high-altitude operation three-dimensional scene positioning device, wherein,
the high-altitude operation training server is used for running and storing a simulation training system and a high-altitude operation three-dimensional database;
the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainer;
the man-machine interaction system is connected with the AR vision system, and interaction between a training person and a high-place operation three-dimensional scene is realized by using an AR handle and data glove equipment;
the AR vision system provides a visual high-altitude operation three-dimensional scene for the trainee by utilizing a three-dimensional registration technology and a virtual-real fusion display technology, so that the trainee can be immersed in the high-altitude operation scene;
the high-altitude operation entity training model is linked with the high-altitude operation three-dimensional scene, a training environment in which a physical entity and a virtual model are fused is provided for trained personnel, and the high-altitude operation training server is communicated with the AR vision system, the man-machine interaction system and the high-altitude operation three-dimensional scene positioning device;
the three-dimensional scene positioning device is used for positioning and switching the three-dimensional scene of the overhead operation.
Further preferably, the high-altitude operation simulation training system comprises a high-altitude operation scene editing module, a high-altitude operation logic editing module, a multi-role multi-mode real-time interaction module and a high-altitude operation assessment management module;
the overhead operation scene editing module comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station operation three-dimensional scene construction;
the overhead operation logic editing module is used for carrying out logic judgment of the next step on operation positions, operation time, operation types, using tools, operators and guardianship operation elements in the overhead operation process according to time sequence or event triggering conditions, so that the whole process design of the overhead operation is realized.
Further preferably, the overhead operation assessment management module designs accident triggering risks in a three-dimensional scene according to the conventional typical accident case of overhead operation, if the risks cannot be identified in the operation process of an operator, the triggering risks are changed into accident elements, the accident evolution process is initiated, and if the accident risk elements are not triggered, the whole overhead operation procedure is completed according to a normal flow.
Further preferably, the multi-role multi-mode real-time interaction module is used for implementing high-altitude operation, 7 roles are needed to participate, in order to simulate the characteristic of direct operation multi-role participation, the system adopts a distributed interaction simulation technology to realize interaction among different roles in a scene, namely, for the roles which are not controlled by training personnel, all tasks of the roles can be automatically executed in an artificial intelligence mode, including communication with other people and interaction with the scene, and the smooth operation flow is ensured.
Further preferably, the step of editing the high-altitude job scene is as follows:
the method comprises the steps of obtaining basic ground management space information of a device and trained personnel in a three-dimensional scene of high-altitude operation by using an unmanned aerial vehicle photographing technology, cutting a three-dimensional model of the three-dimensional scene of high-altitude operation from a topographic map by using a dynamic singulation method, and directly importing 3Dmax after cutting to realize three-dimensional restoration of the device and trained personnel in the three-dimensional scene of high-altitude operation;
constructing a three-dimensional scene of high-altitude operation by utilizing three-dimensional model data of a bottom layer, and extracting task characteristics in a high-altitude operation flow, wherein the task characteristics comprise operation positions, operation time, operation types, use tools, operation risks and risk control measures; dividing responsibilities of different staff, including operators, guardians, security officers, job ticket responsible persons, issuers and licensees; abstract description and storage are carried out on virtual trained personnel, operation objects and operation contents by a single operation task, the actions, devices, environments and risks of the trained personnel are described by independent three-dimensional models, and tasks are serially and parallelly combined with different tasks, different time nodes and different operation objects according to logical relations by editing operation flow scripts, so that flexible construction of different task organization structures and training flows is realized; through the overhead operation flow editing tool, system management personnel can edit three-dimensional simulation training courses according to the real operation flow and the high risk point according to requirements.
Further preferably, the overhead working three-dimensional scene model is constructed as follows,
the three-dimensional scene rapid construction technology based on unmanned aerial vehicle photography is used for rapidly constructing the surrounding environment of the device, the multi-view stereo matching of mass image data acquired by unmanned aerial vehicle oblique photography is realized by adopting an image matching optimal algorithm ASIFT algorithm, an affine mapping matrix is decomposed, the affine mapping matrix can be decomposed according to a formula 1,
wherein lambda > 0 is a scale factor representing a multiple of image scaling, psi is the angle by which the affine camera rotates about its own optical axis,representing the inclination parameters of the image, wherein theta and phi represent the included angles between the optical axis of the camera and the horizontal projection plane and the vertical projection plane respectively, T t R is a translation transformation matrix between images ψ 、R φ A is affine mapping result of texture image of three-dimensional model;
I’＝A*I (2)
i is the input image, and I' is the output image.
Further preferably, the AR vision system utilizes an AR head-mounted display device, and through an augmented reality three-dimensional registration technology and a virtual-real fusion display technology, the position state of a camera relative to a high-altitude operation entity training model based on augmented reality is detected in real time, the position of virtual information required to be overlapped in a projection plane is determined, and the virtual information is displayed in a correct position in a screen in real time, so that a trainee can simulate the supervision of high-altitude operation and the operation process of the operation according to the high-altitude operation flow in a three-dimensional virtual environment.
Further preferably, the man-machine interaction system comprises the operation of trained personnel on scene operation, the identification of risks and hidden dangers, and the real-time interaction with equipment and objects in the virtual scene.
Further preferably, the high-altitude operation entity training model comprises an operation platform, a protection railing and bottom universal wheels, wherein the operation platform is of a cuboid steel structure, the protection railing is arranged on three sides of the operation platform, 2 groups of universal wheels with brakes are arranged at the bottom end of the operation platform, training staff simulate the operation environment at a high altitude on the operation platform, and the substitution sense of training is increased.
Further preferably, the operation steps of the high-rise operation simulation training system of the petrochemical enterprise based on augmented reality are that,
(1) In a real scene, a trainee starts an overhead operation simulation training system at a server side;
(2) The trainee logs in the high-altitude operation simulation training system, selects an operation scene and sends a scene instruction to the scene positioning device;
(3) Wearing an AR vision system under training;
(4) The trainee selects a training mode through the AR vision system, and virtual roles of the trainee enter an operation scene in the three-dimensional scene;
(5) The trainee selects a high-altitude operation task in the virtual scene;
(6) The positioning device captures role actions and realizes the task of the virtual role in the three-dimensional scene;
(7) The trainee resumes training from the selection model if the task fails due to an operation error;
(8) And if the trainee successfully completes the task, the AR vision system is taken down, and the training is finished.
Advantageous effects
1. The application provides a novel method for high-altitude operation training, which utilizes the technology based on augmented reality to improve the safety awareness and the operation level of enterprise supervisory personnel and high-altitude operators and reduce the occurrence of high-altitude operation accidents.
2. The high-altitude operation training system based on augmented reality, provided by the application, combines the virtual scene with the actual operation, has strong man-machine interaction and immersion, can improve training interest of students, and can automatically edit different scenes to improve the applicability of the system.
Drawings
FIG. 1 is a block diagram of a petrochemical enterprise overhead operation simulation training system based on augmented reality.
FIG. 2 is a flow chart of an augmented reality-based petrochemical enterprise high-rise job simulation training system.
FIG. 3 is an augmented reality based high-rise job entity training model.
Detailed Description
The following detailed description is exemplary and is intended to provide further explanation of the application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the present application.
The utility model is characterized by comprising an overhead operation training server, an overhead operation simulation training system, an AR vision system, an overhead operation entity training model, a man-machine interaction system and an overhead operation three-dimensional scene positioning device,
the high-altitude operation training server is used for running and storing a simulation training system and a high-altitude operation three-dimensional database, wherein the high-altitude operation three-dimensional database comprises a risk hidden danger database and a high-altitude operation scene three-dimensional database;
the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainer;
the human-computer interaction system is connected with the AR vision system, and interaction between training personnel and the three-dimensional virtual scene is realized by using an AR handle and data glove equipment;
the AR vision system provides a visual high-altitude operation three-dimensional scene for the trainee by utilizing a three-dimensional registration technology and a virtual-real fusion display technology, so that the trainee can be immersed in the high-altitude operation scene;
the high-altitude operation entity training model is linked with the high-altitude operation three-dimensional scene, a training environment in which physical entities and virtual models are fused is provided for trained personnel, and the high-altitude operation training server is communicated with the AR vision system, the man-machine interaction system and the high-altitude operation three-dimensional scene positioning device, so that real-time interaction of physical environment, three-dimensional scene, trained personnel action and virtual space personnel action data is realized.
The three-dimensional scene positioning device is used for positioning and switching the three-dimensional environment of the overhead operation.
Wherein the method comprises the steps of
The high-altitude operation training server is mainly used for deployment of a high-altitude operation simulation training system, storage and management of a three-dimensional model library, and editing and rendering of a three-dimensional training scene. The three-dimensional scene mainly comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station.
The high-altitude operation simulation training system is a core module of the training system and comprises a high-altitude operation scene editing module, a high-altitude operation logic editing module, a multi-role multi-mode real-time interaction module and a high-altitude operation assessment management module;
the overhead operation scene editing module comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station operation three-dimensional virtual scene construction;
the overhead operation logic editing module is used for carrying out logic judgment of the next step on operation positions, operation time, operation types, using tools, operators and guardianship operation elements in the overhead operation process according to time sequences or event triggering conditions, so that the whole process design of the overhead operation is realized;
the overhead operation assessment management module is used for designing accident triggering risks in a three-dimensional scene according to the conventional typical accident cases of overhead operation, triggering the risks to be changed into accident elements in the operation process if the risks cannot be identified by operators, triggering the accident evolution process, and completing the whole overhead operation program according to a normal flow if the accident risk elements are not triggered;
the multi-role multi-mode real-time interaction module is used for implementing high-altitude operation, 7 types of roles are needed to participate, in order to simulate the characteristics of direct operation multi-role participation, the system adopts a distributed interaction simulation technology to realize interaction among different roles in a scene, namely, for the roles without training personnel control, all tasks of the roles can be automatically executed in an artificial intelligence mode, including communication with other people and interaction with the scene, and the smooth operation flow is ensured.
The three-dimensional virtual scene model is that,
the three-dimensional scene rapid construction technology based on unmanned aerial vehicle photography is used for rapidly constructing the surrounding environment of the device, the multi-view stereo matching of mass image data acquired by unmanned aerial vehicle oblique photography is realized by adopting an image matching optimal algorithm ASIFT algorithm, an affine mapping matrix is decomposed,
wherein lambda > 0 is a scale factor representing a multiple of image scaling, psi is the angle by which the affine camera rotates about its own optical axis,and the image inclination parameters are represented, and theta and phi represent angles between the optical axis of the camera and the horizontal projection plane and the vertical projection plane respectively. T (T) t R is a translation transformation matrix between images ψ 、R φ A is affine mapping result of texture image of three-dimensional model;
I’＝A*I (2)
i is the input image, and I' is the output image.
The high-altitude operation scene editing steps are as follows:
the method comprises the steps of obtaining basic ground management space information of a device and trained personnel in a three-dimensional scene of high-altitude operation by using an unmanned aerial vehicle photographing technology, cutting a three-dimensional model of the three-dimensional scene of high-altitude operation from a topographic map by using a dynamic singulation method, and directly importing 3Dmax after cutting to realize three-dimensional restoration of the device and trained personnel in the three-dimensional scene of high-altitude operation;
constructing a three-dimensional scene of high-altitude operation by utilizing three-dimensional model data of a bottom layer, and extracting task characteristics in a high-altitude operation flow, wherein the task characteristics comprise operation positions, operation time, operation types, use tools, operation risks and risk control measures; dividing responsibilities of different staff, including operators, guardians, security officers, job ticket responsible persons, issuers and licensees; abstract description and storage are carried out on virtual trained personnel, operation objects and operation contents by a single operation task, the actions, devices, environments and risks of the trained personnel are described by independent three-dimensional models, and tasks are serially and parallelly combined with different tasks, different time nodes and different operation objects according to logical relations by editing operation flow scripts, so that flexible construction of different task organization structures and training flows is realized; through the overhead operation flow editing tool, system management personnel can edit three-dimensional simulation training courses according to the real operation flow and the high risk point according to requirements.
The AR vision system utilizes a three-dimensional registration technology and a virtual-real fusion display technology to detect the position state of a model in real time, ensures that virtual information is displayed at the correct position in a screen in real time, provides a visual three-dimensional scene for a trainee, and enables the trainee to be immersed in a high-altitude operation scene.
The man-machine interaction system comprises the operation of trained personnel on scene operation, and the identification of risks and hidden dangers, and can interact with equipment and objects in a virtual scene in real time. Risk in the three-dimensional scene of overhead operation relies on trained personnel's experience knowledge to judge, and common risk is like that the operating personnel eminence falls, article put out and not standardize and lead to the overhead to drop the thing, not wear the safety belt safety helmet, the safety measure is not in place, scaffold builds incorrectly etc..
The high-altitude operation entity training model based on augmented reality is mainly used for simulating a high-altitude operation environment, and through combination of a three-dimensional virtual scene and a high-altitude operation entity training model based on augmented reality, the learning interest of trained personnel is increased, and a better training effect is achieved.
The operation flow of the petrochemical enterprise high-altitude operation simulation training system based on augmented reality is shown in fig. 2.
(1) In a real scene, a trainee starts an overhead operation simulation training system at a server side.
(2) The trainee logs in the high-altitude operation simulation training system, selects an operation scene and sends a scene instruction to the scene positioning device.
(3) The AR vision system is worn after training.
(4) The trainee selects a training mode through the AR vision system, and virtual roles of the trainee in the three-dimensional scene enter the operation scene.
(5) The trainee selects an overhead job task in the virtual scene.
(6) The positioning device captures role actions and realizes the task of the virtual role in the three-dimensional scene.
(7) The trainee resumes training from the selection model if the task fails due to an operating error.
(8) And if the trainee successfully completes the task, the AR vision system is taken down, and the training is finished.
Implementation case:
(1) Cleaning operation of awning of gas station
(1) The trainee starts the high-altitude operation simulation training system at the server side.
(2) The trainee logs in to the high-altitude operation simulation training system, selects high-altitude operation, and sends the selection to the positioning device.
(3) The trainee wears the AR vision system, identifies the training model of the high-altitude operation entity based on augmented reality, and selects a gas station scene.
(4) The trainee enters a three-dimensional virtual scene of the operation at the high position of the gas station.
(5) The trainee selects a gas station awning cleaning operation.
(6) The trainee performs field check, formulates a construction scheme and starts a working ticket at the high place.
(7) The trainee moves in the real scene, the positioning device captures the actions of the legs and hands of the trainee, the virtual character is driven to move in the three-dimensional scene, and the awning cleaning operation of the gas station is carried out through the handle.
Before operation, operators should check whether personal protection articles are good or not, and should wear safety islands and safety helmets conforming to national safety standards; the scaffold is built to meet the safety requirement, and is accepted by related departments, and a qualified signboard is hung; checking and checking whether the stairs used up and down by the operators are good.
In the operation process, the safety belt is hung on a fixed structure above the operation place, the safety belt is hung at a high position for low use, and the safety helmet is tied with the cap belt; the cross operation cannot be performed in the uniform falling direction; tightly forbidding up and down throwing tools, materials, sundries and the like, tying safety ropes when the tools are used, and putting the tools into a tool bag when the tools are not used; the operator cannot rest at a high place and cannot hold objects in hands to climb the scaffold; in the operation process, the movable scaffold is forbidden; during the operation in rainy and snowy days, anti-skid and cold-proof measures can be adopted; in the operation engineering, the safety guardian needs to carry out safety guardianship on the site in real time.
After the operation is finished, the operation personnel and guardians should pick up the operation tools and clean the operation site.
(8) In the cleaning operation process of the awning of the gas station, the worker falls off and dies at the high position due to incorrect fastening of the safety belt of the worker, and the task fails.
(9) The trainee starts again from the second step.
The trainee finishes the awning cleaning operation of the gas station, the task is completed, and the training is finished.
(2) Steel grating laying operation for reactor frame platform of certain device
(1) The trainee starts the high-altitude operation simulation training system at the server side.
(2) The trainee logs in to the high-altitude operation simulation training system, selects high-altitude operation, and sends the selection to the positioning device.
(3) The trainee wears the AR vision system, identifies the training model of the high-altitude operation entity based on augmented reality, and selects the device scene.
(4) The trainee enters a three-dimensional virtual scene of the device overhead operation.
(5) The trainee selects a certain device reactor frame platform steel grid laying operation.
(6) The trainee performs field check, formulates a construction scheme and starts a working ticket at the high place.
(7) The trainee moves in a real scene, the positioning device captures the actions of the legs and hands of the trainee, the virtual character is driven to move in a three-dimensional scene, and the steel grating laying operation of the reactor frame platform of a certain device is carried out through the handle.
Before operation, setting a warning area, placing a warning sign, and strictly forbidding irrelevant personnel to enter the operation area; operators should check whether the personal protective articles are intact or not, and should wear safety belts and safety caps which meet national safety standards; checking whether the scaffold is built to meet the safety requirement or not, and whether a qualified signboard is hung or not; the fourth Zhou Ying working platform is provided with a guard rail and a foot blocking plate, and a guard rail, a warning sign or a covering measure is arranged around the edge and the opening; checking whether stairs, elevators and cages used up and down by operators are good.
In the operation process, the whole belt is tied and hung on a firm construction above an operation place, the high hanging is low, and the safety helmet is tied with the hat belt; the upper and lower cross operation cannot be performed in the same falling direction, and if the cross operation is required, a safety protection layer is arranged in the middle; in the operation process, the upper and lower throwing tools, materials, sundries and the like are forbidden, all materials should be piled stably, a safety guard area should be set up and a special person nurses, a safety rope should be tied when the tools are used, and the tools should be put into the tool bags when the tools are not used; when the grid plate is paved at the high position, the grid plate must be paved and fixed at the same time; the operator cannot rest at a high place and cannot hold objects up and down in the hand; during the operation in rainy and snowy days, anti-skid and cold-proof measures are adopted as much as possible; in the operation engineering, the safety guardian needs to carry out safety guardianship on site in real time.
After the operation is finished, the operation personnel and guardians should pick up the operation tools and clean the operation site.
(8) In the laying operation process of the steel grating of the reactor frame platform of a certain device, the steel grating is placed unstably and falls, so that operators die, and the task fails.
(9) The trainee starts again from the second step.
The trainee finishes the laying operation of the steel grating of the reactor frame platform of a certain device, the task is finished, and the training is finished.
The above description is only of the preferred embodiments of the present application and is not intended to limit the present application, but various modifications and variations can be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (8)
1. The utility model is characterized by comprising an overhead operation training server, an overhead operation simulation training system, an AR vision system, an overhead operation entity training model, a man-machine interaction system and an overhead operation three-dimensional scene positioning device,
the high-altitude operation training server is used for running and storing a simulation training system and a high-altitude operation three-dimensional database;
the AR vision system presents high-altitude operation flow, risk and hidden danger operation data for the trainer;
the man-machine interaction system is connected with the AR vision system, and interaction between training personnel and a three-dimensional scene of high-altitude operation is realized by using an AR handle and data glove equipment;
the AR vision system provides a visual high-altitude operation three-dimensional scene for the trainee by utilizing a three-dimensional registration technology and a virtual-real fusion display technology, so that the trainee can be immersed in the high-altitude operation scene;
the high-altitude operation entity training model is linked with the high-altitude operation three-dimensional scene, a training environment in which a physical entity and a virtual model are fused is provided for trained personnel, and the high-altitude operation training server is communicated with the AR vision system, the man-machine interaction system and the high-altitude operation three-dimensional scene positioning device;
the high-altitude operation scene editing steps are as follows:
obtaining basic geospatial information of a device and trained personnel in a three-dimensional scene of high-altitude operation by using an unmanned aerial vehicle photographing technology, cutting a three-dimensional model of the three-dimensional scene of high-altitude operation from a topographic map by using a dynamic singulation method, and directly importing 3Dmax after cutting to realize three-dimensional restoration of the device and trained personnel in the three-dimensional scene of high-altitude operation;
constructing a three-dimensional scene of the overhead operation by utilizing three-dimensional model data of the bottom layer, and extracting task characteristics in an overhead operation flow, wherein the task characteristics comprise an operation position, operation time, operation types, using tools, operation risks and risk control measures; dividing responsibilities of different staff, including operators, guardians, security officers, job ticket responsible persons, issuers and licensees; abstract description and storage are carried out on virtual trained personnel, operation objects and operation contents by a single operation task, the actions, devices, environments and risks of the trained personnel are described by independent three-dimensional models, and task series connection and parallel connection combination are carried out on different tasks, different time nodes and different operation objects according to logical relations by editing operation flow scripts, so that flexible construction of different task organization structures and training flows is realized; through a high-altitude operation flow editing tool, a system manager can edit three-dimensional simulation training courses according to the real operation flow and the high risk point according to requirements;
the three-dimensional scene model of the overhead operation is constructed as follows,
the three-dimensional scene rapid construction technology based on unmanned aerial vehicle photography is used for rapidly constructing the surrounding environment of the device, the multi-view stereo matching of mass image data acquired by unmanned aerial vehicle oblique photography is realized by adopting an image matching optimal algorithm ASIFT algorithm, an affine mapping matrix is decomposed, the affine mapping matrix can be decomposed according to a formula 1,
wherein lambda > 0 is a scale factor representing a multiple of image scaling, psi is the angle by which the affine camera rotates about its own optical axis,representing the inclination parameters of the image, wherein theta and phi represent the included angles between the optical axis of the camera and the horizontal projection plane and the vertical projection plane respectively, T t R is a translation transformation matrix between images ψ 、R φ A is affine mapping result of texture image of three-dimensional model;
I’＝A*I (2)
i is an input image, and I' is an output image;
the three-dimensional scene positioning device is used for positioning and switching the three-dimensional scene of the overhead operation.
2. The augmented reality-based high-altitude operation simulation training system for the petrochemical enterprises, according to claim 1, is characterized in that the high-altitude operation simulation training system comprises a high-altitude operation scene editing module, a high-altitude operation logic editing module, a multi-role multi-mode real-time interaction module and a high-altitude operation assessment management module;
the overhead operation scene editing module comprises a chemical device, an oil refining device, a tank field, an oil depot and a gas station operation three-dimensional scene construction;
the overhead operation logic editing module is used for carrying out logic judgment of the next step on operation positions, operation time, operation types, using tools, operators and guardianship operation elements in the overhead operation process according to time sequence or event triggering conditions, so that the whole process design of the overhead operation is realized.
3. The augmented reality-based high-rise operation simulation training system for petrochemical enterprises according to claim 2 is characterized in that the high-rise operation assessment management module designs accident triggering risks in a three-dimensional scene according to typical accident cases of high-rise operation, and if risks cannot be identified in the operation process of operators, the triggering risks become accident elements, the accident evolution process is initiated, and if the accident risk elements are not triggered, the whole high-rise operation procedure is completed according to a normal flow.
4. The augmented reality-based high-altitude operation simulation training system for the petrochemical enterprises is characterized in that the multi-role multi-mode real-time interaction module is used for implementing high-altitude operation, 7 types of roles are involved, in order to simulate the characteristics of direct operation multi-role participation, the system adopts a distributed interaction simulation technology to realize interaction among different roles in a scene, namely, for the roles which are not controlled by training staff, all tasks of the roles are automatically executed in an artificial intelligence mode, including communication with other people and interaction with the scene, and smooth operation flow is ensured.
5. The augmented reality-based high-altitude operation simulation training system for the petrochemical enterprises is characterized in that an AR vision system utilizes AR head-mounted display equipment to detect the position state of a camera relative to a high-altitude operation entity training model based on augmented reality in real time through an augmented reality three-dimensional registration technology and a virtual-real fusion display technology, determines the position of virtual information required to be overlapped in a projection plane, and displays the virtual information in the correct position in a screen in real time, so that a trainee can simulate the supervision of high-altitude operation and the operation process of the operation in a three-dimensional virtual environment according to the high-altitude operation flow.
6. The augmented reality-based simulation training system for high-rise operations of petrochemical enterprises according to claim 1, wherein the human-computer interaction system comprises the operation of trained personnel on scene operations and the identification of risks and hidden dangers, and performs real-time interaction with equipment and objects in a virtual scene.
7. The augmented reality-based high-altitude operation simulation training system for the petrochemical enterprises is characterized in that the high-altitude operation entity training model comprises an operation platform, a protection railing and bottom universal wheels, wherein the operation platform is of a cuboid steel structure, the protection railing is arranged on three sides of the operation platform, 2 groups of universal wheels with brakes are arranged at the bottom end of the operation platform, training staff simulate the operation environment on the operation platform, and substitution feeling of training is increased.
8. The augmented reality-based high-altitude operation simulation training system for petrochemical enterprises according to claim 1, wherein the augmented reality-based high-altitude operation simulation training system for petrochemical enterprises comprises the following operation steps of,
(1) In a real scene, a trainee starts an overhead operation simulation training system at a server side;
(2) The trainee logs in the high-altitude operation simulation training system, selects an operation scene and sends a scene instruction to the scene positioning device;
(3) Wearing an AR vision system under training;
(4) The trainee selects a training mode through the AR vision system, and virtual roles of the trainee enter an operation scene in a three-dimensional scene;
(5) The trainee selects a high-altitude operation task in the virtual scene;
(6) The positioning device captures role actions and realizes the task of the virtual role in the three-dimensional scene;
(7) The trainee resumes training from the selection model if the task fails due to an operation error;
(8) And if the trainee successfully completes the task, the AR vision system is taken down, and the training is finished.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210322304 | 2022-03-30 | ||
| CN2022103223044 | 2022-03-30 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114937393A CN114937393A (en) | 2022-08-23 |
| CN114937393B true CN114937393B (en) | 2023-10-13 |
Family
ID=82866317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210605387.8A Active CN114937393B (en) | 2022-03-30 | 2022-05-31 | Petrochemical enterprise high-altitude operation simulation training system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114937393B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102930753A (en) * | 2012-10-17 | 2013-02-13 | 中国石油化工股份有限公司 | Gas station virtual training system and application |
| CA2979217A1 (en) * | 2015-03-09 | 2016-09-15 | Alchemy Systems, L.P. | Augmented reality |
| CN106095105A (en) * | 2016-06-21 | 2016-11-09 | 西南交通大学 | A kind of traction substation operator on duty's virtual immersive Training Simulation System and method |
| CN107331220A (en) * | 2017-09-01 | 2017-11-07 | 国网辽宁省电力有限公司锦州供电公司 | Transformer O＆M simulation training system and method based on augmented reality |
| CN109697909A (en) * | 2019-01-24 | 2019-04-30 | 江苏增强现实智能科技有限公司 | Power distribution network operation simulation training checking system based on VR |
| CN109903621A (en) * | 2017-12-08 | 2019-06-18 | 中国石油化工股份有限公司 | The safe simulation training system of petrochemical sales company |
| CN110135474A (en) * | 2019-04-26 | 2019-08-16 | 武汉市土地利用和城市空间规划研究中心 | A kind of oblique aerial image matching method and system based on deep learning |
| CN111127974A (en) * | 2019-12-16 | 2020-05-08 | 广东电网有限责任公司 | Virtual reality and augmented reality three-dimensional application service platform for transformer substation operation |
| CN111582022A (en) * | 2020-03-26 | 2020-08-25 | 深圳大学 | Fusion method and system of mobile video and geographic scene and electronic equipment |
| CN111696398A (en) * | 2019-03-15 | 2020-09-22 | 中国石油化工股份有限公司 | Immersion type virtual simulation training method for eliminating hidden danger of direct operation link of petrochemical enterprise |
| CN112950773A (en) * | 2021-04-07 | 2021-06-11 | 万翼科技有限公司 | Data processing method and device based on building information model and processing server |
-
2022
- 2022-05-31 CN CN202210605387.8A patent/CN114937393B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102930753A (en) * | 2012-10-17 | 2013-02-13 | 中国石油化工股份有限公司 | Gas station virtual training system and application |
| CA2979217A1 (en) * | 2015-03-09 | 2016-09-15 | Alchemy Systems, L.P. | Augmented reality |
| CN106095105A (en) * | 2016-06-21 | 2016-11-09 | 西南交通大学 | A kind of traction substation operator on duty's virtual immersive Training Simulation System and method |
| CN107331220A (en) * | 2017-09-01 | 2017-11-07 | 国网辽宁省电力有限公司锦州供电公司 | Transformer O＆M simulation training system and method based on augmented reality |
| CN109903621A (en) * | 2017-12-08 | 2019-06-18 | 中国石油化工股份有限公司 | The safe simulation training system of petrochemical sales company |
| CN109697909A (en) * | 2019-01-24 | 2019-04-30 | 江苏增强现实智能科技有限公司 | Power distribution network operation simulation training checking system based on VR |
| CN111696398A (en) * | 2019-03-15 | 2020-09-22 | 中国石油化工股份有限公司 | Immersion type virtual simulation training method for eliminating hidden danger of direct operation link of petrochemical enterprise |
| CN110135474A (en) * | 2019-04-26 | 2019-08-16 | 武汉市土地利用和城市空间规划研究中心 | A kind of oblique aerial image matching method and system based on deep learning |
| CN111127974A (en) * | 2019-12-16 | 2020-05-08 | 广东电网有限责任公司 | Virtual reality and augmented reality three-dimensional application service platform for transformer substation operation |
| CN111582022A (en) * | 2020-03-26 | 2020-08-25 | 深圳大学 | Fusion method and system of mobile video and geographic scene and electronic equipment |
| CN112950773A (en) * | 2021-04-07 | 2021-06-11 | 万翼科技有限公司 | Data processing method and device based on building information model and processing server |
Non-Patent Citations (2)
| Title |
|---|
| 仿真式培训 身临其境;毕文婷;;劳动保护(10);第26-29页 * |
| 基于环境映照自动对齐的高质量虚实融合技术;夏麟;董子龙;章国锋;;计算机辅助设计与图形学学报;23(10);第1641-1648页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114937393A (en) | 2022-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Vahdatikhaki et al. | Beyond data visualization: A context-realistic construction equipment training simulators | |
| Filigenzi et al. | Virtual reality for mine safety training | |
| CN114020185B (en) | Emergency drilling practical training system and construction method thereof | |
| CN104317637A (en) | Multi-agent-based virtual miner safety behavior modeling and emergency simulation system | |
| CN107993389A (en) | A kind of construction site safe early warning method and system based on BIM models | |
| CN112488483B (en) | EHS transparent management system and management method based on AI technology | |
| CN108268128A (en) | A kind of safety in production emergency preplan 3DVR virtual reality drilling systems | |
| CN108257063A (en) | A kind of fire-fighting war instruction desktop maneuvers man-machine interactive system | |
| Golovina et al. | Using serious games in virtual reality for automated close call and contact collision analysis in construction safety | |
| CN111552382B (en) | VR (virtual reality) compressed natural gas tank car accident handling teaching decision method, device and equipment | |
| CN109448487A (en) | A kind of virtual emergency drilling method and system of coal mine gas from explosion disaster | |
| CN111127974A (en) | Virtual reality and augmented reality three-dimensional application service platform for transformer substation operation | |
| CN109947258A (en) | A kind of safe experiential method in construction site based on BIM+VR technology | |
| WO2003060830A1 (en) | Method and system to display both visible and invisible hazards and hazard information | |
| CN108831237A (en) | The improper driving training examination system of the engine drivers in locomotive depot of immersive VR | |
| Fang et al. | A multi-user virtual 3D training environment to advance collaboration among crane operator and ground personnel in blind lifts | |
| Grant et al. | Realizing the vision of smart fire fighting | |
| Laciok et al. | Experimental implementation of new technology into the area of teaching occupational safety for Industry 4.0 | |
| CN116957484A (en) | Fire rescue plan method and system based on digital twinning | |
| CN114937393B (en) | Petrochemical enterprise high-altitude operation simulation training system based on augmented reality | |
| Mendes et al. | Working safely with drones: A virtual training strategy for workers on heights | |
| CN108230202A (en) | A kind of fire-fighting simulative training system and method | |
| CN114781924A (en) | Dangerous chemical storage operation safety skill VR training system | |
| CN111696399A (en) | VR simulation experience training method for handling dangerous chemical transport tank car collision accident | |
| CN116312116A (en) | Exercise method and system for handling physical protection emergency |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |