CN112419799A - Intelligent sensing virtual-real interaction practical training system and method for assembly type building - Google Patents

Intelligent sensing virtual-real interaction practical training system and method for assembly type building Download PDF

Info

Publication number
CN112419799A
CN112419799A CN202011567304.8A CN202011567304A CN112419799A CN 112419799 A CN112419799 A CN 112419799A CN 202011567304 A CN202011567304 A CN 202011567304A CN 112419799 A CN112419799 A CN 112419799A
Authority
CN
China
Prior art keywords
practical training
assembly type
component
type building
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011567304.8A
Other languages
Chinese (zh)
Other versions
CN112419799B (en
Inventor
李帅
王光炎
许林林
石高峰
李昌辉
彭森茂
袁泉
张正
李豪
孙延德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Yingxian Information Technology Co ltd
Original Assignee
Shandong Yingxian Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Yingxian Information Technology Co ltd filed Critical Shandong Yingxian Information Technology Co ltd
Priority to CN202011567304.8A priority Critical patent/CN112419799B/en
Publication of CN112419799A publication Critical patent/CN112419799A/en
Application granted granted Critical
Publication of CN112419799B publication Critical patent/CN112419799B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D21/00—Measuring or testing not otherwise provided for
    • G01D21/02—Measuring two or more variables by means not covered by a single other subclass
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device
    • G06K17/0029—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device the arrangement being specially adapted for wireless interrogation of grouped or bundled articles tagged with wireless record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Architecture (AREA)
  • Computer Hardware Design (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an intelligent sensing virtual-real interaction training system and method for an assembly type building, which are used for the field of assembly type building professional talent training. The system comprises a special assembly type building practical training component, a tool, a special practical training hoisting device, a sensing detection module, a virtual reality communication module and a three-dimensional digital virtual reality system. Based on a digital twin concept, by means of a UNITY 3D platform and by means of the Internet of things technology, the Internet technology, big data, cloud services and the like, a physical entity scene for assembly type building construction practical training is synchronously mapped and interacted with a three-dimensional digital virtual scene in real time, real-time synchronous intelligent sensing, detection and feedback are carried out on the practical training process, teaching, practical training and evaluation are integrated, practical training participants synchronously carry out theoretical learning and practice in the virtual scene and the real scene, and teaching, practical training and evaluation are intelligently, low-cost, risk-free, economical and efficient.

Description

Intelligent sensing virtual-real interaction practical training system and method for assembly type building
Technical Field
The invention relates to an intelligent sensing virtual-real interaction practical training system for an assembly type building, in particular to an intelligent sensing virtual-real interaction practical training system and method for the assembly type building.
Background
Compared with the traditional building production organization mode, the assembly type building has the advantages that the cast-in-place operation is greatly reduced, a large number of building component parts are produced in a workshop, the labor force is saved, and the engineering progress is less influenced by weather; secondly, adopting building and decoration integrated design and construction; thirdly, the design standardization and the management informatization are realized, the production efficiency is high, and the cost is low; fourthly, the method meets the requirements of green buildings, consumes less resources, and is energy-saving and environment-friendly. The development of the fabricated building is a deep revolution in the building history, the fabricated building under the new situation provides higher standards for the building construction technology, the fabricated building is vigorously developed, the culture of assembly building construction professional talents needs to be increased at first, and the conversion from agricultural workers to industrial workers is realized.
At present, there are two training modes for training professional talents for assembly type building construction in colleges and universities and training institutions in China, wherein one mode is to build a real site of an assembly type building and adopt real components and tools. The weight of parts is large, potential safety hazards of practical training exist, the operation difficulty of practical training students is large, and the utilization rate of practical training sites is low; when some students participate in the practical training, other students can only wait, the combination of theoretical learning and practice is not tight, and the practical training efficiency is low; the teacher has a large evaluation difficulty, and if the training trainees really operate according to the standard, the teacher cannot perform comprehensive, detailed and accurate evaluation, and the training trainees have defects and poor effect. The other is a pure virtual environment training system. The practical training trainees can not actually operate in a complete virtual environment and can only perceptually recognize the practical operation, so that the practical operation capability is limited, the practical training trainees can not completely master the complex construction technology and the required key and can not directly and actually carry out construction operation, and the purposes of learning and practical training can not be completely achieved. The two training modes are seriously insufficient and have disadvantages in the aspects of interactivity, practicality, intellectualization, comprehensiveness, high efficiency and the like, and cannot adapt to and meet the requirements of the assembly type building on high-level professional talents.
Disclosure of Invention
The invention aims to overcome the defects and shortcomings of the assembly type building practical training mode and provide an assembly type building virtual-real interactive intelligent perception practical training system and method.
In order to achieve the purpose, the invention adopts the following technical scheme:
1. the utility model provides an interactive real standard system of fabricated building intelligent perception virtuality and reality which characterized in that includes:
(1) physical entity scenario R:
firstly, a special assembly type building training component A: the device is characterized by replacing a collection of various common components in the field of assembly type buildings, adopting light-weight high-strength materials for manufacturing, designing a cavity structure, and being used for carrying out assembly type building construction operation and practical training in a physical entity scene, wherein various components are internally provided with a plurality of sensing detection devices;
training a special hoisting device B: the assembly type building practical training special component A is made of lightweight high-strength materials, various sensing detection devices are arranged in the assembly type building practical training special component A, and the assembly type building practical training special component A is hoisted and transported to an assembly area from a placement area and participates in assembly work of the assembly type building practical training special component A in the assembly area;
③ training a special tool C: the assembly type steel bar gauge is characterized by comprising a plurality of tools and instruments which are commonly used for assembly type building construction, wherein the tools and instruments comprise a flat shovel, an air blower, a steel brush, a hammer, a chisel, a measuring tape, an ink fountain, a steel bar positioning plate, a steel bar wrench, a level gauge, a running rule, a sealing strip, a traction rope and the like;
fourthly, a sensing detection module D: the system consists of all sensing detection equipment which is arranged in a fabricated building practical training special component A, practical training special hoisting equipment B and a practical training special tool C, is used for synchronously sensing, detecting and judging the states of the fabricated building practical training special component A, the practical training special hoisting equipment B and the practical training special tool C in real time, and the like, forms dynamic data and sends the dynamic data to a virtual reality communication module E in real time;
virtual reality communication module E: the system is used for realizing data processing and transmission between the sensing detection module D and the three-dimensional digital virtual reality system F, and is divided into two parts, namely, intranet communication is realized, an intranet server (W) is established, the intranet server is respectively connected with a host (M) of the three-dimensional digital virtual reality system F, the sensing detection module D and external network interface equipment, and the data processing and transmission of the whole system are realized in a wireless transmission mode; the internal network server is connected to the Internet cloud service (Y) through external network interface equipment to form an external network environment, the internal network can be accessed by the PC end and the mobile terminal through the Internet, and the intelligent sensing virtual-real interaction practical training system for the assembly type building can be remotely used, managed, maintained and monitored;
sixthly, physical entity scene R layout condition: the system is provided with a placing area, an assembling area and an auxiliary area, wherein the assembly building training special component A is orderly placed in the placing area, the foundation of the assembly building is built in the assembling area, the training special hoisting equipment B is arranged, and the auxiliary area is provided with a training special tool C, a large screen S for displaying a virtual scene V, personal protective articles and the like;
(2) a virtual scene V:
a three-dimensional digital virtual reality system F: the practical training system software G is characterized in that a practical training participant performs class selection, role distribution, component selection, cognitive learning and safe intersection in sequence through login software, then performs practical building construction practical training in a physical entity scene R, and in the practical training process, the practical training system software G synchronously interacts with the physical entity scene R in real time, plays teaching videos for construction processes currently in progress and prompts safety information through real-time popup windows, and also builds 3D models for all elements in the physical entity scenes R such as a practical training special component A, a practical training special hoisting device B and a practical tool C based on a UNITY 3D platform design and shows the practical training scene H as one-to-one corresponding practical component model VA in the practical training scene H, Virtual models of all elements in all physical entity scenes R such as a practical training special hoisting equipment model VB and a practical training special tool model VC enable a virtual-real interaction scene H to be mapped to the physical entity scene R;
the three-dimensional digital virtual reality system F acquires the state information of the assembly building practical training special component A, the practical training special hoisting equipment B and the practical training special tool C according to the data sent by the virtual reality communication module E, finishes capturing the state information of the distance, the displacement, the action and the like of the solid parts in the physical solid scene R, and enables the assembly building practical training special component model VA, the practical training special hoisting equipment model VB, the practical training special tool model VC and other virtual model parts in the virtual-real interactive scene H to dynamically map the state change of the elements in the simulated physical solid scene R in real time, thereby realizing digital twinning.
Further, the sensing detection module D in the physical entity scene R comprises a gyroscope (CG 1), a tilt sensor (CG 2), an ultrasonic ranging sensor (CG 3), a laser ranging sensor (CG 4), an RFID tag (CG 5) and an infrared proximity sensor (CG 6);
gyroscope (CG 1): the real-time dynamic angle data of the assembly type building practical training special component A in three axes in the direction X, Y, Z are sensed, detected and generated at the middle part in the assembly type building practical training special component A, and are averaged with the angle dynamic data generated by the tilt sensor (CG 2) after calculation, so that the accuracy of the angle dynamic data is ensured, and the angle dynamic data can be used for real-time interaction of a three-dimensional digital virtual reality system F;
tilt sensor (CG 2): the device is deployed in the middle or upper half part of the assembly type building practical training special component A and used for sensing, detecting and generating angle dynamic data of the assembly type building practical training special component A, and the angle dynamic data and dynamic angle data generated by a gyroscope (CG 1) are averaged after calculation so as to ensure the accuracy of the angle dynamic data and provide for a three-dimensional digital virtual reality system F to interact and use in real time;
③ ultrasonic ranging sensor (CG 3): the height dynamic data of the assembly type building practical training special component A is sensed, detected, monitored and generated at the bottom of the assembly type building practical training special component A and is used by a three-dimensional digital virtual reality system F;
(iv) laser ranging sensor (CG 4): the device is installed on the top of a practical training special hoisting device B, the whole moving distance of the practical training special hoisting device B is measured and calculated by taking a certain fixed wall as a reference object through laser reflection, and dynamic displacement data of the practical training special hoisting device B are generated; the two sets of dynamic displacement data reflect the real-time movement conditions of the practical training special hoisting equipment B in the transverse direction and the longitudinal direction;
RFID tag (CG 5): the assembly type building practical training special component A is internally provided with four paths of RFID tag identification antennas, wherein two paths of RFID tag identification antennas are positioned at the left side and the right side of the vertical height 50CM of the assembly type building practical training special component A, one path of RFID tag identification antennas is positioned at the bottom of the assembly type building practical training special component A, and the last path of RFID tag identification antennas is positioned at the middle part of the assembly type building practical training special component A;
sixthly, infrared proximity sensor (CG 6): the device is arranged at the bottom of an assembly type building practical training special component A, the inside of a hoisting point bolt, a traction rope bolt, a support rod bolt and the like, can sense, detect and judge whether the assembly type building practical training special component A is positioned on a base of a physical entity scene R placing area or is separated from the base, can sense, detect and judge whether each bolt is placed and screwed, and can sense, detect and judge whether a sleeve at the bottom of the assembly type building practical training special component A is in hole alignment with an embedded steel bar, the generated dynamic data is used by a three-dimensional digital virtual reality system F, and mapping and interaction are carried out in a virtual-real interaction scene H.
The intelligent sensing virtual-real interaction practical training method for the fabricated building corresponding to the system comprises the following steps:
(1) initialization of the system: logging in software of an intelligent practical training system G of the prefabricated building, selecting a component to be subjected to practical training in a list, selecting a special component A of the practical training system of the prefabricated building corresponding to the selected component in a placing area in a physical entity scene R, checking the safety and quality of the special component A of the practical training system of the prefabricated building and the presence or absence of abnormity of sensing detection equipment at the end G of the software of the intelligent practical training system of the prefabricated building according to data fed back by a sensing detection module D, and performing the practical training operation of the next step in the physical entity scene R after a practical training person correctly wears protective articles;
(2) clearing, paying off, correcting and adjusting the elevation of the steel bar and pasting a sealing strip: in a physical entity scene R placing area, a practical training person needs to respectively carry out the working procedures of cleaning, paying off, reinforcing steel bar correction, sealing strip pasting and the like on a selected assembly type building practical training special component A, in a physical entity scene R assembling area, the practical training person needs to carry out the working procedures of adjusting the elevation of the foundation of the assembly type building, cleaning the joint surface, pasting the sealing strip and the like, and can use the flat shovel, the blower, the steel wire brush, the hammer, the hair clasp, the measuring tape, the reinforcing steel bar positioning plate, the reinforcing steel bar wrench and other tools in the practical training special tool C, when the practical training person uses a specific practical training special tool C to operate, the selected assembly type building practical training special component A and sensing detection equipment built in a specific practical training special tool C can detect the specific working procedures carried out by the practical training person at present, and synchronously send the sensed dynamic data to a three-dimensional digital virtual reality system F in, a corresponding specific practical training special tool and appliance model VC in the virtual-real interaction scene H synchronously performs the same operation process at a corresponding position of a corresponding assembly type building practical training special component model VA in real time, and meanwhile, a practical training special tool and appliance C triggers sensing detection equipment of a sensing detection module D due to operation, drives a teaching video of a working procedure performed under the condition of real-time synchronous cycle playing of software of an assembly type building intelligent practical training system G and pops out a safety prompt information window to inform safety matters needing attention of the working procedure;
(3) couple and set up the haulage rope: when a practical training person installs a lifting point bolt of an assembly type building practical training special component A and sets a traction rope, a sensing detection module D can sense the installation condition of the bolt in real time and sends dynamic data to a three-dimensional digital virtual reality system F through a virtual reality communication module E, the lifting point on an assembly type building practical training special component model VA and the bolt hanging the traction rope in a virtual reality interaction scene H can synchronously map the operation process of the practical training person in real time, the bolt model also performs corresponding screwing actions, meanwhile, the assembly type building intelligent practical training system software G synchronously and circularly plays a teaching video of the installation bolt in real time, simultaneously pops out a safety prompt information window, reminds safety matters which need to be noticed in the middle working procedure in progress, and sensing detection equipment can sense whether the bolt is fastened and in place and issue early warning information in real time;
(4) hoisting and horizontally moving: the hook of the practical training special hoisting equipment B is hung in a hoisting point bolt of the practical training special component A of the fabricated building, the component is vertically hoisted to a position of 50CM, the component is determined to be hoisted to a height of more than 1M without error, then the component is horizontally moved to an assembly area of a physical entity scene R and reaches the upper part of a basic installation part of the fabricated building, aiming at the stage of operation and operation process, a sensing detection module D can sense and detect dynamic data of the height, height change, horizontal movement and movement distance of the practical training special component A and the practical training special hoisting equipment B, the dynamic data is sent to a three-dimensional digital virtual reality system F in real time through a virtual reality communication module E, software of a fabricated building intelligent system G in a virtual scene V is triggered to synchronously play a hoisting operation teaching video in real time, meanwhile, a popup window prompts safety matter, the assembly type building practical training special component model VA and the practical training special hoisting equipment model VB in the virtual-real interactive scene H synchronously perform corresponding operation in real time along with the assembly type building practical training special component A and the practical training special hoisting equipment B in the physical entity scene R, and the visual angle of the virtual-real interactive scene H changes along with the actual component;
(5) guiding of component hoisting: the assembly building practical training special component A is hoisted to the upper part of a basic installation part of an assembly building to land, and when the distance between the component A and the basic installation part is 1.8M, the sensing detection equipment is triggered for the first time in the step, which is the height that a practical training person can touch and hold a traction rope; when the mobile terminal vertically lands to a height of 50CM from a basic installation part of an assembly type building, the sensing detection equipment is triggered for the second time in the step, the height is that a practical training person can hold the height of a guide component, dynamic data generated by triggering the sensing detection equipment for the second time is sequentially sent to a three-dimensional digital virtual reality system F, the assembly type building intelligent practical training system software G in a corresponding virtual scene V synchronously plays a teaching video for component guide operation in real time, meanwhile, a popup window prompts safety matters to pay attention to, meanwhile, an assembly type building practical training special component model VA and a practical training special hoisting equipment model VB in a virtual-real interactive scene H are synchronously mapped to a real-time operation process that an assembly type building practical training special component A and a practical training special hoisting equipment B in a physical scene R are guided, and the visual angle of the virtual-real interactive scene H changes along with the actual component;
(6) viewing the wells and adjusting the position: when a practical training person holds and guides the assembly type building practical training special component A to the position with the height of 20CM at the top of the embedded steel bar, on one hand, the practical training person utilizes a reflector to observe the hole aligning and test whether the steel bar and the sleeve are in place or not, can adjust the position of the component from the side surface of the component by a crowbar or an S hook and slowly descends after determining no fault, on the other hand, sensing and detecting equipment senses the action of observing the hole aligning and adjusting the position in real time and sends dynamic data to a three-dimensional digital virtual reality system F, so that the assembly type building intelligent training system software G synchronously plays teaching videos of a next procedure in real time, meanwhile, a practical training special tool VC model in a virtual-real interactive scene H synchronously maps the real-time running condition of a special tool C used by the practical training person in a physical scene R in real-time, and the view;
(7) mounting support, component adjustment and position detection: after the embedded steel bars are inserted into sleeves of the assembly type building practical training special component A, an inclined support is installed for the assembly type building practical training special component A, the inclined support is adjusted according to the verticality of the component to keep the component vertical and horizontal, the verticality and levelness detection is carried out by using a practical training special tool C guiding rule, the assembly type building practical training special component A is finely adjusted according to the detection condition until the component is kept horizontal and vertical in the X direction and the Y direction, the three links of installation support, component adjustment and position detection are carried out, a sensing detection device senses in real time and forms dynamic data to be sent to a three-dimensional digital virtual reality system F, corresponding teaching video and popup window prompt safety information are synchronously played in real time in a virtual scene V, a virtual-real interactive scene H synchronously maps the operation process of the three operation links in real time, wherein the sensing detection device can sense the levelness and the verticality of the assembly type building special component A in the X direction and the Y direction, sensing the positioning condition of a support point bolt in real time, synchronously displaying real-time dynamic data of levelness and verticality on a large screen S by the assembly type building practical training special component A along with component adjustment, wherein the visual angle of the whole virtual-real interactive scene H changes along with the physical entity scene R;
(8) supporting locking, retesting precision and unhooking: the sensing detection equipment can sense the states of whether an upper bolt and a lower bolt of a support rod of the assembly type building practical training special component A are screwed down, whether a positioning pin of a middle adjusting area is fixed, whether the angle of a support system is correct, whether the support system conflicts with adjacent support and the like, and displays all dynamic data on a large screen S in real time;
(9) clearing the finished materials and finishing the practical training: restoring the initial state of the physical entity scene R, dismounting and returning the physical component parts such as the assembly type building practical training special component A, the practical training special hoisting equipment B, the practical training special tool C and the like, and detecting whether the state of the sensing detection module D is normal or not through the three-dimensional digital virtual reality system F, thereby finishing the initialization of the physical entity scene R and the virtual scene V.
Further, when the practical training person carries out practical training operation in the physical entity scene R, the three-dimensional digital virtual reality system F in the virtual scene V can acquire various dynamic data of the practical training operation in real time, carries out listing recording on the data, and carries out intelligent comprehensive analysis on the system to form a practical training result report, so that a teacher can investigate and evaluate the actual operation level and the theoretical knowledge mastering condition of the practical training person, and the goal of practical training, teaching and evaluation is achieved.
The invention has the beneficial effects that:
based on a digital twin concept, by means of a UNITY 3D platform and by comprehensively utilizing intelligent means such as an internet of things technology, an internet technology, big data, cloud service and the like, the invention realizes real-time mapping and interaction between a physical entity scene of assembly type building construction practical training and a three-dimensional digital virtual scene, realizes virtual-real fusion interaction, and assembles abundant assembly type building teaching resources, so that practical training participants can intelligently interact to perform theoretical learning and practical activities in the virtual scene and the real scene, and the purposes of teaching, practical training and evaluation can be intelligently, economically and efficiently completed with low cost and no risk;
the method is based on a digital twin concept, virtual and real can be fused and interacted, virtual and real interactivity and intellectualization in the training process are realized, and training, teaching and evaluation are integrated;
by means of the UNITY 3D platform, the change process and the state of the three-dimensional digital virtual scene and the change process and the state of the physical entity scene and parts of each part are the same, and a practical training person and other field trainees combine the actual scene with the on-site large-screen teaching video and the virtual-real interactive scene, so that the theory learning is intuitive, the practice can be comprehensive, and the synchronization, the high efficiency and the system learning of the theory connection reality are realized;
the solid component part is designed to be light and hollow, can be used repeatedly, and ensures no safety risk and low cost of practical training.
Drawings
FIG. 1 is a schematic diagram of the system workflow and scenario of the present invention;
FIG. 2 is a diagram of the architecture of a sensing module D and a virtual reality communication module E in a physical entity scene R of the system of the present invention;
fig. 3 is a flow chart of a training method of the present invention.
The specific implementation mode is as follows:
the present invention will be further described with reference to the accompanying drawings and specific embodiments, and it should be noted that the following description is only for the purpose of explaining the present invention and does not limit the contents thereof.
As shown in fig. 1 and 2, an intelligent sensing virtual-real interaction training system for an assembly type building includes:
(1) physical entity scenario R:
firstly, a special assembly type building training component A: the device is characterized by replacing a collection of various common components in the field of assembly type buildings, adopting light-weight high-strength materials for manufacturing, designing a cavity structure, and being used for carrying out assembly type building construction operation and practical training in a physical entity scene, wherein various components are internally provided with a plurality of sensing detection devices;
training a special hoisting device B: the assembly type building practical training special component A is made of lightweight high-strength materials, various sensing detection devices are arranged in the assembly type building practical training special component A, and the assembly type building practical training special component A is hoisted and transported to an assembly area from a placement area and participates in assembly work of the assembly type building practical training special component A in the assembly area;
③ training a special tool C: the assembly type steel bar gauge is characterized by comprising a plurality of tools and instruments which are commonly used for assembly type building construction, wherein the tools and instruments comprise a flat shovel, an air blower, a steel brush, a hammer, a chisel, a measuring tape, an ink fountain, a steel bar positioning plate, a steel bar wrench, a level gauge, a running rule, a sealing strip, a traction rope and the like;
fourthly, a sensing detection module D: the system consists of all sensing detection equipment which is arranged in a fabricated building practical training special component A, practical training special hoisting equipment B and a practical training special tool C, is used for synchronously sensing, detecting and judging the states of the fabricated building practical training special component A, the practical training special hoisting equipment B and the practical training special tool C in real time, and the like, forms dynamic data and sends the dynamic data to a virtual reality communication module E in real time;
virtual reality communication module E: the system is used for realizing data processing and transmission between the sensing detection module D and the three-dimensional digital virtual reality system F, and is divided into two parts, namely, intranet communication is realized, an intranet server (W) is established, the intranet server is respectively connected with a host (M) of the three-dimensional digital virtual reality system F, the sensing detection module D and external network interface equipment, and the data processing and transmission of the whole system are realized in a wireless transmission mode; the internal network server is connected to the Internet cloud service (Y) through external network interface equipment to form an external network environment, the internal network can be accessed by the PC end and the mobile terminal through the Internet, and the intelligent sensing virtual-real interaction practical training system for the assembly type building can be remotely used, managed, maintained and monitored;
sixthly, physical entity scene R layout condition: the system is provided with a placing area, an assembling area and an auxiliary area, wherein the assembly building training special component A is orderly placed in the placing area, the foundation of the assembly building is built in the assembling area, the training special hoisting equipment B is arranged, and the auxiliary area is provided with a training special tool C, a large screen S for displaying a virtual scene V, personal protective articles and the like;
(2) a virtual scene V:
a three-dimensional digital virtual reality system F: the practical training system software G is characterized in that a practical training participant performs class selection, role distribution, component selection, cognitive learning and safe intersection in sequence through login software, then performs practical building construction practical training in a physical entity scene R, and in the practical training process, the practical training system software G synchronously interacts with the physical entity scene R in real time, plays teaching videos for construction processes currently in progress and prompts safety information through real-time popup windows, and also builds 3D models for all elements in the physical entity scenes R such as a practical training special component A, a practical training special hoisting device B and a practical tool C based on a UNITY 3D platform design and shows the practical training scene H as one-to-one corresponding practical component model VA in the practical training scene H, Virtual models of all elements in all physical entity scenes R such as a practical training special hoisting equipment model VB and a practical training special tool model VC enable a virtual-real interaction scene H to be mapped to the physical entity scene R;
the three-dimensional digital virtual reality system F acquires the state information of the assembly building practical training special component A, the practical training special hoisting equipment B and the practical training special tool C according to the data sent by the virtual reality communication module E, finishes capturing the state information of the distance, the displacement, the action and the like of the solid parts in the physical solid scene R, and enables the assembly building practical training special component model VA, the practical training special hoisting equipment model VB, the practical training special tool model VC and other virtual model parts in the virtual-real interactive scene H to dynamically map the state change of the elements in the simulated physical solid scene R in real time, thereby realizing digital twinning.
As shown in fig. 2, the sensing detection module D in the physical entity scene R includes a gyroscope (CG 1), a tilt sensor (CG 2), an ultrasonic ranging sensor (CG 3), a laser ranging sensor (CG 4), an RFID tag (CG 5), and an infrared proximity sensor (CG 6);
gyroscope (CG 1): the real-time dynamic angle data of the assembly type building practical training special component A in three axes in the direction X, Y, Z are sensed, detected and generated at the middle part in the assembly type building practical training special component A, and are averaged with the angle dynamic data generated by the tilt sensor (CG 2) after calculation, so that the accuracy of the angle dynamic data is ensured, and the angle dynamic data can be used for real-time interaction of a three-dimensional digital virtual reality system F;
tilt sensor (CG 2): the device is deployed in the middle or upper half part of the assembly type building practical training special component A and used for sensing, detecting and generating angle dynamic data of the assembly type building practical training special component A, and the angle dynamic data and dynamic angle data generated by a gyroscope (CG 1) are averaged after calculation so as to ensure the accuracy of the angle dynamic data and provide for a three-dimensional digital virtual reality system F to interact and use in real time;
③ ultrasonic ranging sensor (CG 3): the height dynamic data of the assembly type building practical training special component A is sensed, detected, monitored and generated at the bottom of the assembly type building practical training special component A and is used by a three-dimensional digital virtual reality system F;
(iv) laser ranging sensor (CG 4): the device is installed on the top of a practical training special hoisting device B, the whole moving distance of the practical training special hoisting device B is measured and calculated by taking a certain fixed wall as a reference object through laser reflection, and dynamic displacement data of the practical training special hoisting device B are generated; the two sets of dynamic displacement data reflect the real-time movement conditions of the practical training special hoisting equipment B in the transverse direction and the longitudinal direction;
RFID tag (CG 5): the assembly type building practical training special component A is internally provided with four paths of RFID tag identification antennas, wherein two paths of RFID tag identification antennas are positioned at the left side and the right side of the vertical height 50CM of the assembly type building practical training special component A, one path of RFID tag identification antennas is positioned at the bottom of the assembly type building practical training special component A, and the last path of RFID tag identification antennas is positioned at the middle part of the assembly type building practical training special component A;
sixthly, infrared proximity sensor (CG 6): the device is arranged at the bottom of an assembly type building practical training special component A, the inside of a hoisting point bolt, a traction rope bolt, a support rod bolt and the like, can sense, detect and judge whether the assembly type building practical training special component A is positioned on a base of a physical entity scene R placing area or is separated from the base, can sense, detect and judge whether each bolt is placed and screwed, and can sense, detect and judge whether a sleeve at the bottom of the assembly type building practical training special component A is in hole alignment with an embedded steel bar, the generated dynamic data is used by a three-dimensional digital virtual reality system F, and mapping and interaction are carried out in a virtual-real interaction scene H.
As shown in fig. 3, the intelligent sensing virtual-real interaction practical training method for the fabricated building corresponding to the system includes the following steps:
(1) initialization of the system: logging in software of an intelligent practical training system G of the prefabricated building, selecting a component to be subjected to practical training in a list, selecting a special component A of the practical training system of the prefabricated building corresponding to the selected component in a placing area in a physical entity scene R, checking the safety and quality of the special component A of the practical training system of the prefabricated building and the presence or absence of abnormity of sensing detection equipment at the end G of the software of the intelligent practical training system of the prefabricated building according to data fed back by a sensing detection module D, and performing the practical training operation of the next step in the physical entity scene R after a practical training person correctly wears protective articles;
(2) clearing, paying off, correcting and adjusting the elevation of the steel bar and pasting a sealing strip: in a physical entity scene R placing area, a practical training person needs to respectively carry out the working procedures of cleaning, paying off, reinforcing steel bar correction, sealing strip pasting and the like on a selected assembly type building practical training special component A, in a physical entity scene R assembling area, the practical training person needs to carry out the working procedures of adjusting the elevation of the foundation of the assembly type building, cleaning the joint surface, pasting the sealing strip and the like, and can use the flat shovel, the blower, the steel wire brush, the hammer, the hair clasp, the measuring tape, the reinforcing steel bar positioning plate, the reinforcing steel bar wrench and other tools in the practical training special tool C, when the practical training person uses a specific practical training special tool C to operate, the selected assembly type building practical training special component A and sensing detection equipment built in a specific practical training special tool C can detect the specific working procedures carried out by the practical training person at present, and synchronously send the sensed dynamic data to a three-dimensional digital virtual reality system F in, a corresponding specific practical training special tool and appliance model VC in the virtual-real interaction scene H synchronously performs the same operation process at a corresponding position of a corresponding assembly type building practical training special component model VA in real time, and meanwhile, a practical training special tool and appliance C triggers sensing detection equipment of a sensing detection module D due to operation, drives a teaching video of a working procedure performed under the condition of real-time synchronous cycle playing of software of an assembly type building intelligent practical training system G and pops out a safety prompt information window to inform safety matters needing attention of the working procedure;
(3) couple and set up the haulage rope: when a practical training person installs a lifting point bolt of an assembly type building practical training special component A and sets a traction rope, a sensing detection module D can sense the installation condition of the bolt in real time and sends dynamic data to a three-dimensional digital virtual reality system F through a virtual reality communication module E, the lifting point on an assembly type building practical training special component model VA and the bolt hanging the traction rope in a virtual reality interaction scene H can synchronously map the operation process of the practical training person in real time, the bolt model also performs corresponding screwing actions, meanwhile, the assembly type building intelligent practical training system software G synchronously and circularly plays a teaching video of the installation bolt in real time, simultaneously pops out a safety prompt information window, reminds safety matters which need to be noticed in the middle working procedure in progress, and sensing detection equipment can sense whether the bolt is fastened and in place and issue early warning information in real time;
(4) hoisting and horizontally moving: the hook of the practical training special hoisting equipment B is hung in a hoisting point bolt of the practical training special component A of the fabricated building, the component is vertically hoisted to a position of 50CM, the component is determined to be hoisted to a height of more than 1M without error, then the component is horizontally moved to an assembly area of a physical entity scene R and reaches the upper part of a basic installation part of the fabricated building, aiming at the stage of operation and operation process, a sensing detection module D can sense and detect dynamic data of the height, height change, horizontal movement and movement distance of the practical training special component A and the practical training special hoisting equipment B, the dynamic data is sent to a three-dimensional digital virtual reality system F in real time through a virtual reality communication module E, software of a fabricated building intelligent system G in a virtual scene V is triggered to synchronously play a hoisting operation teaching video in real time, meanwhile, a popup window prompts safety matter, the assembly type building practical training special component model VA and the practical training special hoisting equipment model VB in the virtual-real interactive scene H synchronously perform corresponding operation in real time along with the assembly type building practical training special component A and the practical training special hoisting equipment B in the physical entity scene R, and the visual angle of the virtual-real interactive scene H changes along with the actual component;
(5) guiding of component hoisting: the assembly building practical training special component A is hoisted to the upper part of a basic installation part of an assembly building to land, and when the distance between the component A and the basic installation part is 1.8M, the sensing detection equipment is triggered for the first time in the step, which is the height that a practical training person can touch and hold a traction rope; when the mobile terminal vertically lands to a height of 50CM from a basic installation part of an assembly type building, the sensing detection equipment is triggered for the second time in the step, the height is that a practical training person can hold the height of a guide component, dynamic data generated by triggering the sensing detection equipment for the second time is sequentially sent to a three-dimensional digital virtual reality system F, the assembly type building intelligent practical training system software G in a corresponding virtual scene V synchronously plays a teaching video for component guide operation in real time, meanwhile, a popup window prompts safety matters to pay attention to, meanwhile, an assembly type building practical training special component model VA and a practical training special hoisting equipment model VB in a virtual-real interactive scene H are synchronously mapped to a real-time operation process that an assembly type building practical training special component A and a practical training special hoisting equipment B in a physical scene R are guided, and the visual angle of the virtual-real interactive scene H changes along with the actual component;
(6) viewing the wells and adjusting the position: when a practical training person holds and guides the assembly type building practical training special component A to the position with the height of 20CM at the top of the embedded steel bar, on one hand, the practical training person utilizes a reflector to observe the hole aligning and test whether the steel bar and the sleeve are in place or not, can adjust the position of the component from the side surface of the component by a crowbar or an S hook and slowly descends after determining no fault, on the other hand, sensing and detecting equipment senses the action of observing the hole aligning and adjusting the position in real time and sends dynamic data to a three-dimensional digital virtual reality system F, so that the assembly type building intelligent training system software G synchronously plays teaching videos of a next procedure in real time, meanwhile, a practical training special tool VC model in a virtual-real interactive scene H synchronously maps the real-time running condition of a special tool C used by the practical training person in a physical scene R in real-time, and the view;
(7) mounting support, component adjustment and position detection: after the embedded steel bars are inserted into sleeves of the assembly type building practical training special component A, an inclined support is installed for the assembly type building practical training special component A, the inclined support is adjusted according to the verticality of the component to keep the component vertical and horizontal, the verticality and levelness detection is carried out by using a practical training special tool C guiding rule, the assembly type building practical training special component A is finely adjusted according to the detection condition until the component is kept horizontal and vertical in the X direction and the Y direction, the three links of installation support, component adjustment and position detection are carried out, a sensing detection device senses in real time and forms dynamic data to be sent to a three-dimensional digital virtual reality system F, corresponding teaching video and popup window prompt safety information are synchronously played in real time in a virtual scene V, a virtual-real interactive scene H synchronously maps the operation process of the three operation links in real time, wherein the sensing detection device can sense the levelness and the verticality of the assembly type building special component A in the X direction and the Y direction, sensing the positioning condition of a support point bolt in real time, synchronously displaying real-time dynamic data of levelness and verticality on a large screen S by the assembly type building practical training special component A along with component adjustment, wherein the visual angle of the whole virtual-real interactive scene H changes along with the physical entity scene R;
(8) supporting locking, retesting precision and unhooking: the sensing detection equipment can sense the states of whether an upper bolt and a lower bolt of a support rod of the assembly type building practical training special component A are screwed down, whether a positioning pin of a middle adjusting area is fixed, whether the angle of a support system is correct, whether the support system conflicts with adjacent support and the like, and displays all dynamic data on a large screen S in real time;
(9) clearing the finished materials and finishing the practical training: restoring the initial state of the physical entity scene R, dismounting and returning the physical component parts such as the assembly type building practical training special component A, the practical training special hoisting equipment B, the practical training special tool C and the like, and detecting whether the state of the sensing detection module D is normal or not through the three-dimensional digital virtual reality system F, thereby finishing the initialization of the physical entity scene R and the virtual scene V.
When a practical training person carries out practical training operation in the physical entity scene R, the three-dimensional digital virtual reality system F in the virtual scene V can acquire various dynamic data of the practical training operation in real time, carries out listing recording on the data, carries out intelligent comprehensive analysis on the system and forms a practical training result report, so that teachers can investigate and evaluate the actual operation level and the theoretical knowledge mastering condition of the practical training person, and the goal of practical training, teaching and appraisal is achieved.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, the scope of the present invention is not limited thereto, and various modifications and variations which do not require inventive efforts and which are made by those skilled in the art are within the scope of the present invention.

Claims (4)

1. The utility model provides an interactive real standard system of fabricated building intelligent perception virtuality and reality which characterized in that includes:
(1) physical entity scenario R:
firstly, a special assembly type building training component A: the device is characterized by replacing a collection of various common components in the field of assembly type buildings, adopting light-weight high-strength materials for manufacturing, designing a cavity structure, and being used for carrying out assembly type building construction operation and practical training in a physical entity scene, wherein various components are internally provided with a plurality of sensing detection devices;
training a special hoisting device B: the assembly type building practical training special component A is made of lightweight high-strength materials, various sensing detection devices are arranged in the assembly type building practical training special component A, and the assembly type building practical training special component A is hoisted and transported to an assembly area from a placement area and participates in assembly work of the assembly type building practical training special component A in the assembly area;
③ training a special tool C: the assembly type steel bar gauge is characterized by comprising a plurality of tools and instruments which are commonly used for assembly type building construction, wherein the tools and instruments comprise a flat shovel, an air blower, a steel brush, a hammer, a chisel, a measuring tape, an ink fountain, a steel bar positioning plate, a steel bar wrench, a level gauge, a running rule, a sealing strip, a traction rope and the like;
fourthly, a sensing detection module D: the system consists of all sensing detection equipment which is arranged in a fabricated building practical training special component A, practical training special hoisting equipment B and a practical training special tool C, is used for synchronously sensing, detecting and judging the states of the fabricated building practical training special component A, the practical training special hoisting equipment B and the practical training special tool C in real time, and the like, forms dynamic data and sends the dynamic data to a virtual reality communication module E in real time;
virtual reality communication module E: the system is used for realizing data processing and transmission between the sensing detection module D and the three-dimensional digital virtual reality system F, and is divided into two parts, namely, intranet communication is realized, an intranet server (W) is established, the intranet server is respectively connected with a host (M) of the three-dimensional digital virtual reality system F, the sensing detection module D and external network interface equipment, and the data processing and transmission of the whole system are realized in a wireless transmission mode; the internal network server is connected to the Internet cloud service (Y) through external network interface equipment to form an external network environment, the internal network can be accessed by the PC end and the mobile terminal through the Internet, and the intelligent sensing virtual-real interaction practical training system for the assembly type building can be remotely used, managed, maintained and monitored;
sixthly, physical entity scene R layout condition: the system is provided with a placing area, an assembling area and an auxiliary area, wherein the assembly building training special component A is orderly placed in the placing area, the foundation of the assembly building is built in the assembling area, the training special hoisting equipment B is arranged, and the auxiliary area is provided with a training special tool C, a large screen S for displaying a virtual scene V, personal protective articles and the like;
(2) a virtual scene V:
a three-dimensional digital virtual reality system F: the practical training system software G is characterized in that a practical training participant performs class selection, role distribution, component selection, cognitive learning and safe intersection in sequence through login software, then performs practical building construction practical training in a physical entity scene R, and in the practical training process, the practical training system software G synchronously interacts with the physical entity scene R in real time, plays teaching videos for construction processes currently in progress and prompts safety information through real-time popup windows, and also builds 3D models for all elements in the physical entity scenes R such as a practical training special component A, a practical training special hoisting device B and a practical tool C based on a UNITY 3D platform design and shows the practical training scene H as one-to-one corresponding practical component model VA in the practical training scene H, Virtual models of all elements in all physical entity scenes R such as a practical training special hoisting equipment model VB and a practical training special tool model VC enable a virtual-real interaction scene H to be mapped to the physical entity scene R;
the three-dimensional digital virtual reality system F acquires the state information of the assembly building practical training special component A, the practical training special hoisting equipment B and the practical training special tool C according to the data sent by the virtual reality communication module E, finishes capturing the state information of the distance, the displacement, the action and the like of the solid parts in the physical solid scene R, and enables the assembly building practical training special component model VA, the practical training special hoisting equipment model VB, the practical training special tool model VC and other virtual model parts in the virtual-real interactive scene H to dynamically map the state change of the elements in the simulated physical solid scene R in real time, thereby realizing digital twinning.
2. The assembly type building intelligent perception virtual-real interaction practical training system according to claim 1, characterized in that: the sensing detection module D in the physical entity scene R comprises a gyroscope (CG 1), a tilt sensor (CG 2), an ultrasonic ranging sensor (CG 3), a laser ranging sensor (CG 4), an RFID tag (CG 5) and an infrared proximity sensor (CG 6);
gyroscope (CG 1): the real-time dynamic angle data of the assembly type building practical training special component A in three axes in the direction X, Y, Z are sensed, detected and generated at the middle part in the assembly type building practical training special component A, and are averaged with the angle dynamic data generated by the tilt sensor (CG 2) after calculation, so that the accuracy of the angle dynamic data is ensured, and the angle dynamic data can be used for real-time interaction of a three-dimensional digital virtual reality system F;
tilt sensor (CG 2): the device is deployed in the middle or upper half part of the assembly type building practical training special component A and used for sensing, detecting and generating angle dynamic data of the assembly type building practical training special component A, and the angle dynamic data and dynamic angle data generated by a gyroscope (CG 1) are averaged after calculation so as to ensure the accuracy of the angle dynamic data and provide for a three-dimensional digital virtual reality system F to interact and use in real time;
③ ultrasonic ranging sensor (CG 3): the height dynamic data of the assembly type building practical training special component A is sensed, detected, monitored and generated at the bottom of the assembly type building practical training special component A and is used by a three-dimensional digital virtual reality system F;
(iv) laser ranging sensor (CG 4): the device is installed on the top of a practical training special hoisting device B, the whole moving distance of the practical training special hoisting device B is measured and calculated by taking a certain fixed wall as a reference object through laser reflection, and dynamic displacement data of the practical training special hoisting device B are generated; the two sets of dynamic displacement data reflect the real-time movement conditions of the practical training special hoisting equipment B in the transverse direction and the longitudinal direction;
RFID tag (CG 5): the assembly type building practical training special component A is internally provided with four paths of RFID tag identification antennas, wherein two paths of RFID tag identification antennas are positioned at the left side and the right side of the vertical height 50CM of the assembly type building practical training special component A, one path of RFID tag identification antennas is positioned at the bottom of the assembly type building practical training special component A, and the last path of RFID tag identification antennas is positioned at the middle part of the assembly type building practical training special component A;
sixthly, infrared proximity sensor (CG 6): the device is arranged at the bottom of an assembly type building practical training special component A, the inside of a hoisting point bolt, a traction rope bolt, a support rod bolt and the like, can sense, detect and judge whether the assembly type building practical training special component A is positioned on a base of a physical entity scene R placing area or is separated from the base, can sense, detect and judge whether each bolt is placed and screwed, and can sense, detect and judge whether a sleeve at the bottom of the assembly type building practical training special component A is in hole alignment with an embedded steel bar, the generated dynamic data is used by a three-dimensional digital virtual reality system F, and mapping and interaction are carried out in a virtual-real interaction scene H.
3. The system of claim 1 corresponds to an intelligent sensing virtual-real interaction practical training method for the fabricated building, and is characterized by comprising the following steps:
(1) initialization of the system: logging in software of an intelligent practical training system G of the prefabricated building, selecting a component to be subjected to practical training in a list, selecting a special component A of the practical training system of the prefabricated building corresponding to the selected component in a placing area in a physical entity scene R, checking the safety and quality of the special component A of the practical training system of the prefabricated building and the presence or absence of abnormity of sensing detection equipment at the end G of the software of the intelligent practical training system of the prefabricated building according to data fed back by a sensing detection module D, and performing the practical training operation of the next step in the physical entity scene R after a practical training person correctly wears protective articles;
(2) clearing, paying off, correcting and adjusting the elevation of the steel bar and pasting a sealing strip: in a physical entity scene R placing area, a practical training person needs to respectively carry out the working procedures of cleaning, paying off, reinforcing steel bar correction, sealing strip pasting and the like on a selected assembly type building practical training special component A, in a physical entity scene R assembling area, the practical training person needs to carry out the working procedures of adjusting the elevation of the foundation of the assembly type building, cleaning the joint surface, pasting the sealing strip and the like, and can use the flat shovel, the blower, the steel wire brush, the hammer, the hair clasp, the measuring tape, the reinforcing steel bar positioning plate, the reinforcing steel bar wrench and other tools in the practical training special tool C, when the practical training person uses a specific practical training special tool C to operate, the selected assembly type building practical training special component A and sensing detection equipment built in a specific practical training special tool C can detect the specific working procedures carried out by the practical training person at present, and synchronously send the sensed dynamic data to a three-dimensional digital virtual reality system F in, a corresponding specific practical training special tool and appliance model VC in the virtual-real interaction scene H synchronously performs the same operation process at a corresponding position of a corresponding assembly type building practical training special component model VA in real time, and meanwhile, a practical training special tool and appliance C triggers sensing detection equipment of a sensing detection module D due to operation, drives a teaching video of a working procedure performed under the condition of real-time synchronous cycle playing of software of an assembly type building intelligent practical training system G and pops out a safety prompt information window to inform safety matters needing attention of the working procedure;
(3) couple and set up the haulage rope: when a practical training person installs a lifting point bolt of an assembly type building practical training special component A and sets a traction rope, a sensing detection module D can sense the installation condition of the bolt in real time and sends dynamic data to a three-dimensional digital virtual reality system F through a virtual reality communication module E, the lifting point on an assembly type building practical training special component model VA and the bolt hanging the traction rope in a virtual reality interaction scene H can synchronously map the operation process of the practical training person in real time, the bolt model also performs corresponding screwing actions, meanwhile, the assembly type building intelligent practical training system software G synchronously and circularly plays a teaching video of the installation bolt in real time, simultaneously pops out a safety prompt information window, reminds safety matters which need to be noticed in the middle working procedure in progress, and sensing detection equipment can sense whether the bolt is fastened and in place and issue early warning information in real time;
(4) hoisting and horizontally moving: the hook of the practical training special hoisting equipment B is hung in a hoisting point bolt of the practical training special component A of the fabricated building, the component is vertically hoisted to a position of 50CM, the component is determined to be hoisted to a height of more than 1M without error, then the component is horizontally moved to an assembly area of a physical entity scene R and reaches the upper part of a basic installation part of the fabricated building, aiming at the stage of operation and operation process, a sensing detection module D can sense and detect dynamic data of the height, height change, horizontal movement and movement distance of the practical training special component A and the practical training special hoisting equipment B, the dynamic data is sent to a three-dimensional digital virtual reality system F in real time through a virtual reality communication module E, software of a fabricated building intelligent system G in a virtual scene V is triggered to synchronously play a hoisting operation teaching video in real time, meanwhile, a popup window prompts safety matter, the assembly type building practical training special component model VA and the practical training special hoisting equipment model VB in the virtual-real interactive scene H synchronously perform corresponding operation in real time along with the assembly type building practical training special component A and the practical training special hoisting equipment B in the physical entity scene R, and the visual angle of the virtual-real interactive scene H changes along with the actual component;
(5) guiding of component hoisting: the assembly building practical training special component A is hoisted to the upper part of a basic installation part of an assembly building to land, and when the distance between the component A and the basic installation part is 1.8M, the sensing detection equipment is triggered for the first time in the step, which is the height that a practical training person can touch and hold a traction rope; when the mobile terminal vertically lands to a height of 50CM from a basic installation part of an assembly type building, the sensing detection equipment is triggered for the second time in the step, the height is that a practical training person can hold the height of a guide component, dynamic data generated by triggering the sensing detection equipment for the second time is sequentially sent to a three-dimensional digital virtual reality system F, the assembly type building intelligent practical training system software G in a corresponding virtual scene V synchronously plays a teaching video for component guide operation in real time, meanwhile, a popup window prompts safety matters to pay attention to, meanwhile, an assembly type building practical training special component model VA and a practical training special hoisting equipment model VB in a virtual-real interactive scene H are synchronously mapped to a real-time operation process that an assembly type building practical training special component A and a practical training special hoisting equipment B in a physical scene R are guided, and the visual angle of the virtual-real interactive scene H changes along with the actual component;
(6) viewing the wells and adjusting the position: when a practical training person holds and guides the assembly type building practical training special component A to the position with the height of 20CM at the top of the embedded steel bar, on one hand, the practical training person utilizes a reflector to observe the hole aligning and test whether the steel bar and the sleeve are in place or not, can adjust the position of the component from the side surface of the component by a crowbar or an S hook and slowly descends after determining no fault, on the other hand, sensing and detecting equipment senses the action of observing the hole aligning and adjusting the position in real time and sends dynamic data to a three-dimensional digital virtual reality system F, so that the assembly type building intelligent training system software G synchronously plays teaching videos of a next procedure in real time, meanwhile, a practical training special tool VC model in a virtual-real interactive scene H synchronously maps the real-time running condition of a special tool C used by the practical training person in a physical scene R in real-time, and the view;
(7) mounting support, component adjustment and position detection: after the embedded steel bars are inserted into sleeves of the assembly type building practical training special component A, an inclined support is installed for the assembly type building practical training special component A, the inclined support is adjusted according to the verticality of the component to keep the component vertical and horizontal, the verticality and levelness detection is carried out by using a practical training special tool C guiding rule, the assembly type building practical training special component A is finely adjusted according to the detection condition until the component is kept horizontal and vertical in the X direction and the Y direction, the three links of installation support, component adjustment and position detection are carried out, a sensing detection device senses in real time and forms dynamic data to be sent to a three-dimensional digital virtual reality system F, corresponding teaching video and popup window prompt safety information are synchronously played in real time in a virtual scene V, a virtual-real interactive scene H synchronously maps the operation process of the three operation links in real time, wherein the sensing detection device can sense the levelness and the verticality of the assembly type building special component A in the X direction and the Y direction, sensing the positioning condition of a support point bolt in real time, synchronously displaying real-time dynamic data of levelness and verticality on a large screen S by the assembly type building practical training special component A along with component adjustment, wherein the visual angle of the whole virtual-real interactive scene H changes along with the physical entity scene R;
(8) supporting locking, retesting precision and unhooking: the sensing detection equipment can sense the states of whether an upper bolt and a lower bolt of a support rod of the assembly type building practical training special component A are screwed down, whether a positioning pin of a middle adjusting area is fixed, whether the angle of a support system is correct, whether the support system conflicts with adjacent support and the like, and displays all dynamic data on a large screen S in real time;
(9) clearing the finished materials and finishing the practical training: restoring the initial state of the physical entity scene R, dismounting and returning the physical component parts such as the assembly type building practical training special component A, the practical training special hoisting equipment B, the practical training special tool C and the like, and detecting whether the state of the sensing detection module D is normal or not through the three-dimensional digital virtual reality system F, thereby finishing the initialization of the physical entity scene R and the virtual scene V.
4. The assembly type building intelligent perception virtual-real interaction practical training system according to claim 1, characterized in that: when the practical training person carries out practical training operation in the physical entity scene R, the three-dimensional digital virtual reality system F in the virtual scene V can acquire and summarize various dynamic data of the practical training operation in real time, carries out tabulated recording on the data, and carries out intelligent comprehensive analysis on the system to form a practical training result report, so that a teacher can investigate and evaluate the actual operation level and the mastering condition of theoretical knowledge of the practical training person, and the aim of practical training, teaching and appraisal is fulfilled.
CN202011567304.8A 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building Active CN112419799B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011567304.8A CN112419799B (en) 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011567304.8A CN112419799B (en) 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building

Publications (2)

Publication Number Publication Date
CN112419799A true CN112419799A (en) 2021-02-26
CN112419799B CN112419799B (en) 2023-05-23

Family

ID=74782697

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011567304.8A Active CN112419799B (en) 2020-12-25 2020-12-25 Intelligent perception virtual-real interaction practical training system and method for assembled building

Country Status (1)

Country Link
CN (1) CN112419799B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113205607A (en) * 2021-05-08 2021-08-03 山西晓雯文化艺术发展有限公司 Immersive virtual reality interactive teaching system for building assembly and using method
CN113534279A (en) * 2021-09-16 2021-10-22 武汉恒新动力科技有限公司 Intelligent hook-entering detection method for universal hook
CN113538997A (en) * 2021-07-14 2021-10-22 重庆电子工程职业学院 Equipment predictive maintenance learning system
CN113538993A (en) * 2021-06-02 2021-10-22 上海贽匠智能科技有限公司 Training all-in-one machine based on digital twin technology
CN113947967A (en) * 2021-12-01 2022-01-18 浙江太学科技集团有限公司 Installation training system for assembly type building components

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180010676A (en) * 2016-07-22 2018-01-31 남서울대학교 산학협력단 Portable Interactive 3D Education Device for Construction Engineering
CN108447335A (en) * 2018-05-02 2018-08-24 徐州工业职业技术学院 A kind of assembled architecture AR imagings simulation training tutoring system
CN108510866A (en) * 2018-04-04 2018-09-07 广东机电职业技术学院 A kind of integrated practice tutoring system of intelligent Manufacturing Technology
CN108665245A (en) * 2018-05-23 2018-10-16 华北水利水电大学 A kind of prefabricated component information fusion management system and method based on DT-BIM
US20190163215A1 (en) * 2017-11-27 2019-05-30 General Electric Company Building energy modeling tool systems and methods
CN111176245A (en) * 2019-10-29 2020-05-19 中国电子科技集团公司第三十八研究所 Multi-terminal industrial equipment inspection monitoring system and method based on digital twin technology
GB202010042D0 (en) * 2020-07-01 2020-08-12 Vrco Ltd Airspace simulator
US20200265535A1 (en) * 2017-11-08 2020-08-20 Kabushiki Kaisha Toshiba Skill platform system, skill modeling device, and skill dissemination method
CN111899630A (en) * 2020-08-10 2020-11-06 天津博诺智创机器人技术有限公司 Industrial robot system operator training and examining platform
CN112002172A (en) * 2020-09-11 2020-11-27 北京金控数据技术股份有限公司 Three-dimensional simulation system of sewage treatment plant
CN112084550A (en) * 2020-06-24 2020-12-15 北京工业大学 Digital twinning modeling method for intelligent hoisting process of prefabricated parts of fabricated building

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180010676A (en) * 2016-07-22 2018-01-31 남서울대학교 산학협력단 Portable Interactive 3D Education Device for Construction Engineering
US20200265535A1 (en) * 2017-11-08 2020-08-20 Kabushiki Kaisha Toshiba Skill platform system, skill modeling device, and skill dissemination method
US20190163215A1 (en) * 2017-11-27 2019-05-30 General Electric Company Building energy modeling tool systems and methods
CN108510866A (en) * 2018-04-04 2018-09-07 广东机电职业技术学院 A kind of integrated practice tutoring system of intelligent Manufacturing Technology
CN108447335A (en) * 2018-05-02 2018-08-24 徐州工业职业技术学院 A kind of assembled architecture AR imagings simulation training tutoring system
CN108665245A (en) * 2018-05-23 2018-10-16 华北水利水电大学 A kind of prefabricated component information fusion management system and method based on DT-BIM
CN111176245A (en) * 2019-10-29 2020-05-19 中国电子科技集团公司第三十八研究所 Multi-terminal industrial equipment inspection monitoring system and method based on digital twin technology
CN112084550A (en) * 2020-06-24 2020-12-15 北京工业大学 Digital twinning modeling method for intelligent hoisting process of prefabricated parts of fabricated building
GB202010042D0 (en) * 2020-07-01 2020-08-12 Vrco Ltd Airspace simulator
CN111899630A (en) * 2020-08-10 2020-11-06 天津博诺智创机器人技术有限公司 Industrial robot system operator training and examining platform
CN112002172A (en) * 2020-09-11 2020-11-27 北京金控数据技术股份有限公司 Three-dimensional simulation system of sewage treatment plant

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113205607A (en) * 2021-05-08 2021-08-03 山西晓雯文化艺术发展有限公司 Immersive virtual reality interactive teaching system for building assembly and using method
CN113538993A (en) * 2021-06-02 2021-10-22 上海贽匠智能科技有限公司 Training all-in-one machine based on digital twin technology
CN113538997A (en) * 2021-07-14 2021-10-22 重庆电子工程职业学院 Equipment predictive maintenance learning system
CN113534279A (en) * 2021-09-16 2021-10-22 武汉恒新动力科技有限公司 Intelligent hook-entering detection method for universal hook
CN113534279B (en) * 2021-09-16 2021-12-14 武汉恒新动力科技有限公司 Intelligent hook-entering detection method for universal hook
CN113947967A (en) * 2021-12-01 2022-01-18 浙江太学科技集团有限公司 Installation training system for assembly type building components
CN113947967B (en) * 2021-12-01 2024-04-26 浙江太学科技集团有限公司 Real standard system of assembled building element installation

Also Published As

Publication number Publication date
CN112419799B (en) 2023-05-23

Similar Documents

Publication Publication Date Title
CN112419799B (en) Intelligent perception virtual-real interaction practical training system and method for assembled building
CN110847963B (en) Data interaction system for railway tunnel construction
CN108717808B (en) Tunnel construction virtual teaching system and method based on three-dimensional laser scanning modeling
CN108447335B (en) AR real-scene simulation practical training teaching system for fabricated building
CN110992197B (en) Early warning method and system for irregular convergence deformation of coal mine tunnel
CN111597709A (en) Total station virtual simulation teaching system
CN104933943A (en) Land drilling rig installation operation simulation system and operation method thereof
CN113124797A (en) Hydraulic support group pose simulation system based on adjustable bottom plate
CN112347540A (en) Building intelligent detection modeling system
CN204808639U (en) Land rig virtual assembly system
CN112710352B (en) Intelligent monitoring system for pushing process of frame bridges and culverts
RU81830U1 (en) INTERACTIVE REMOTE AUTOMATED LEARNING SYSTEM
CN101710466B (en) Method for simulating gas expansion for drilling simulator
CN111597618B (en) Bridge monitoring system based on BIM-GIS
CN112267906B (en) Method for determining working state of two-column hydraulic support
CN104933942A (en) Ring screen projection system of land drilling rig installation operation simulation system, and image processing method thereof
CN206972220U (en) A kind of system that tunnel boring is carried out using travel engineering robot
CN109557284A (en) A kind of tunnel surrounding rank intelligent quickly decision-making system and method
CN104599543A (en) Virtual assembly system for land drilling rig and operation method thereof
CN204965893U (en) Rig model of land rig installation operation simulation system
CN104851353B (en) A kind of ring curtain projection display system of land rig installation operation simulation system
CN204965889U (en) Circular screen projection display system of land rig installation operation simulation system
CN204965892U (en) Land rig installation operation simulation system
Sun et al. Virtual Reality Interactive Training System of Prefabricated Building Based on Internet of Things Technology
CN114234901A (en) Information monitoring method and system for dismantling and modifying super high-rise building

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: A prefabricated building intelligent perception virtual real interaction training system and method

Granted publication date: 20230523

Pledgee: China Construction Bank Corporation Zibo Xicheng sub branch

Pledgor: Shandong Yingxian Information Technology Co.,Ltd.

Registration number: Y2024980019842

PE01 Entry into force of the registration of the contract for pledge of patent right