CN112396718A - On-site construction safety and quality supervision research system based on AR technology - Google Patents
On-site construction safety and quality supervision research system based on AR technology Download PDFInfo
- Publication number
- CN112396718A CN112396718A CN202011075473.XA CN202011075473A CN112396718A CN 112396718 A CN112396718 A CN 112396718A CN 202011075473 A CN202011075473 A CN 202011075473A CN 112396718 A CN112396718 A CN 112396718A
- Authority
- CN
- China
- Prior art keywords
- module
- inspection
- glasses
- acquisition terminal
- technology
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 24
- 238000010276 construction Methods 0.000 title claims abstract description 20
- 238000011160 research Methods 0.000 title claims abstract description 16
- 239000011521 glass Substances 0.000 claims abstract description 61
- 238000007689 inspection Methods 0.000 claims abstract description 56
- 238000000034 method Methods 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 11
- 238000003860 storage Methods 0.000 claims description 11
- 210000000988 bone and bone Anatomy 0.000 claims description 9
- 230000009467 reduction Effects 0.000 claims description 6
- 239000013589 supplement Substances 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 4
- 230000001502 supplementing effect Effects 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 2
- 230000001976 improved effect Effects 0.000 abstract description 7
- 238000012544 monitoring process Methods 0.000 abstract description 2
- 238000007726 management method Methods 0.000 description 24
- 238000012423 maintenance Methods 0.000 description 11
- 238000005457 optimization Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 7
- 238000009826 distribution Methods 0.000 description 6
- 238000009434 installation Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000002159 abnormal effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000007639 printing Methods 0.000 description 4
- 238000004088 simulation Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 4
- 230000003190 augmentative effect Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 210000003027 ear inner Anatomy 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 210000000860 cochlear nerve Anatomy 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007794 irritation Effects 0.000 description 1
- 210000004880 lymph fluid Anatomy 0.000 description 1
- 230000005389 magnetism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 210000002985 organ of corti Anatomy 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 210000003625 skull Anatomy 0.000 description 1
- 230000008093 supporting effect Effects 0.000 description 1
- 210000003454 tympanic membrane Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C3/00—Registering or indicating the condition or the working of machines or other apparatus, other than vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C9/00—Measuring inclination, e.g. by clinometers, by levels
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J1/00—Photometry, e.g. photographic exposure meter
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C3/00—Registering or indicating the condition or the working of machines or other apparatus, other than vehicles
- G07C3/14—Quality control systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Abstract
The invention relates to the field of construction monitoring systems, in particular to an AR technology-based on-site construction safety and quality supervision and research system. The inspection personnel set an inspection task at the background management end and then wear the glasses acquisition terminal to inspect on site, the glasses acquisition terminal automatically identifies the state of the equipment and displays the identification result in the field of view of the display module through the projection module; and comparing the recognition state with the prefabricated data of the background management end, automatically judging whether the inspection result is normal or not, and displaying the result on the display module through the projection module. Therefore, for traditional multi-person inspection, inspection of a plurality of devices can be achieved only by one person. If the inspection personnel encounters the problem or question which can not be solved independently, the inspection personnel can remotely guide the experts remotely connected with the service end to help solve the difficult problem in the inspection so as to smoothly complete the inspection work; various operation instruction books and operation manuals are not needed, and the inspection efficiency can be greatly improved.
Description
Technical Field
The invention relates to the field of construction monitoring systems, in particular to an AR technology-based on-site construction safety and quality supervision and research system.
Background
The inspection of the traditional power transformation equipment mainly takes manual inspection as a main point. In current transformer substation patrols and examines, the personnel of patrolling and examining still adopt traditional simple manpower to patrol and examine, cause following four problems: one person can copy the ticket, and one person can patrol and check, so that more manpower is wasted in patrol and check; a large number of power transformation protection devices are arranged in each transformer substation, and the number of pressure plate switches, remote local switches, air switches and handle switches on each protection device is large, so that the inspection time is long; the inspection flow has high repeatability, and the inspection personnel can easily miss, miss or not inspect due to large quantity; the paper operation ticket adopted during inspection is inconvenient for inspection recording and filing of the inspected materials; historical data of the equipment during each inspection, such as characters, pictures, videos and other materials, are stored in the background, and when the inspection is needed, the equipment needs to run back to the background to obtain the data.
The operation of complex devices, such as UPS switching, difficult training of novice, needing the assistance of old hands for guiding, and the difficulty in inquiring the operation specifications of various operation instruction books and operation manuals when the old hands operate, can not obtain the assistance and the guidance at the first time.
Real-time data of equipment in an SCADA system, an asset management system and a comprehensive data platform, such as basic information of the equipment, defects of an equipment platform, real-time load data, interval real-time abnormal information, main transformer oil temperature and ring temperature, bus voltage and line voltage and the like which need to be checked in the maintenance process, cannot be acquired in real time in the maintenance site.
Disclosure of Invention
In order to solve the problems, the invention provides an AR technology-based field construction safety and quality supervision and research system, which adopts the installation and maintenance of main power equipment of a transformer substation to carry out three-dimensional modeling and dismounting operation simulation by adopting an augmented reality technology (AR) and a three-dimensional simulation technology. The relevant technical specifications, safety specifications and professional knowledge of equipment installation and maintenance operation are converted into video and three-dimensional visual display forms, relevant personnel only need to scan two-dimensional codes or equipment appearance in front of relevant equipment of the transformer substation, equipment installation and maintenance worker training can be achieved, and the business knowledge level and the safe production skill of maintenance workers are efficiently and rapidly improved.
In order to achieve the purpose, the invention adopts the technical scheme that: on-spot construction safety and quality supervision research system based on AR technique, its characterized in that: the glasses management system comprises a glasses acquisition terminal and a background management terminal; the background management terminal establishes specifically executed task information and pushes the task information to the glasses acquisition terminal, the glasses acquisition terminal selects to execute a corresponding module task, and the glasses acquisition terminal uploads all information recorded in the polling process to the background management terminal;
the glasses acquisition terminal comprises a camera module for acquiring an inspection scene image, a sound receiving module for acquiring inspection scene sound data, a storage module for storing inspection total data, a sensing module for detecting scene environment light and the distance between field devices, an operation module for processing data, a display module for displaying background data, a projection module for projecting the background data to the display module, a sound playing module for playing the background sound data, a first wireless module for receiving and sending data, and a battery module for supplying power to each module in the glasses acquisition terminal;
the camera module, the sound receiving module, the storage module, the sensing module, the projection module, the sound playing module, the first wireless module and the battery module are all electrically connected with the operation module.
As a further optimization of this application scheme, glasses collection terminal is still including the light filling lamp that is used for supplementing light, wherein this light filling lamp and operation module electric connection.
As the further optimization of this application scheme, the sensing module includes ambient light sensor, TOF range unit, and wherein ambient light sensor, TOF range unit all with operation module electric connection.
As the further optimization of this application scheme, wherein display module includes LCOS curved surface filter lens, wherein glasses collection terminal is provided with the assembly mouth of mutual symmetry, and every assembly mouth can dismantle the dress with LCOS curved surface filter lens.
As a further optimization of the scheme, a first magnetic block is arranged in each assembling opening, a second magnetic block is arranged on each LCOS curved filter lens, and the second magnetic block of each LCOS curved filter lens and the first magnetic block in the assembling opening are mutually magnetically attracted.
As the further optimization of this application scheme, receive the acoustic module and for falling the microphone of making an uproar, wherein fall that the microphone of making an uproar embeds there is the chip of making an uproar.
As the further optimization of this application scheme, broadcast the sound module and be bone conduction earphone.
As the further optimization of the scheme, the operation module is provided with a timer, and when the task is executed, each step of the task starts the timer to be automatically triggered, and the operation time of the current step is recorded.
As the further optimization of the scheme, the background management end sends the equipment state judgment result to the operation module of the glasses acquisition terminal according to the equipment state, and the operation module controls the projection of the equipment state judgment result to the display module through the projection module.
The invention has the beneficial effects that:
1) can discern high-low voltage distribution cabinet equipment state: the inspection personnel set an inspection task at the background management end and then wear the glasses acquisition terminal to inspect on site, the glasses acquisition terminal automatically identifies the equipment state (including a pointer, a number, a switch valve and the like) through the camera module, and the identification result is displayed in the field of view of the display module through the projection module; comparing background prefabricated data: and comparing the recognition state with the prefabricated data of the background management end, automatically judging whether the inspection result is normal or not, and displaying the result in the field of view of the display module through the projection module. The inspection personnel can choose to disconnect the equipment valve (the client side has remote disconnection software) or call historical data (text or pictures or videos); therefore, for traditional multi-person inspection, inspection of a plurality of devices can be achieved only by one person.
2) Visual remote guidance: if the inspection personnel encounters the problem or question which can not be solved independently, the inspection personnel can remotely guide the experts remotely connected with the service end to help solve the difficult problem in the inspection so as to smoothly complete the inspection work; various operation instruction books and operation manuals are not needed, and the inspection efficiency can be greatly improved.
3) And (3) printing and storing the polling work ticket: automatically generating a polling work ticket, recording related polling parameters (polling items, polling persons, time, errors and the like), storing and submitting the polling work ticket to a background management end, and printing the polling work ticket in a background.
Drawings
Fig. 1 is a schematic structural diagram of a glasses collection terminal.
Fig. 2 is a schematic structural diagram of a noise reduction chip.
Fig. 3 is an overall system framework diagram in the embodiment of the invention.
Fig. 4 is a technical architecture diagram in an embodiment of the invention.
The reference numbers illustrate: 11. a sound broadcasting module; 12. a sound receiving module; 13. a camera module; 14. a sensing module; 15. a light supplement lamp; 16. a display module; 17. a projection module.
Detailed Description
Referring to fig. 1-4, the present invention relates to an AR technology-based field construction safety and quality supervision and research system, which is characterized in that: the glasses management system comprises a glasses acquisition terminal and a background management terminal; the background management terminal establishes specifically executed task information and pushes the task information to the glasses acquisition terminal, the glasses acquisition terminal selects to execute a corresponding module task, and the glasses acquisition terminal uploads all information recorded in the polling process to the background management terminal;
the glasses acquisition terminal comprises a camera module 13 for acquiring an inspection scene image, a sound receiving module 12 for acquiring inspection scene sound data, a storage module for storing inspection total data, a sensing module 14 for detecting scene environment light and field equipment distance, an operation module for processing data, a display module 16 for displaying background data, a projection module 17 for projecting the background data to the display module 16, a sound playing module 11 for playing the background sound data, a first wireless module for receiving and sending data, and a battery module for supplying power to each module in the glasses acquisition terminal;
wherein the camera module 13, the sound receiving module 12, the storage module, the sensing module 14, the projection module 17, the sound playing module 11, the first wireless module and the battery module are all electrically connected with the operation module.
The glasses acquisition terminal is used for acquiring, comparing and returning state information of field data; the background management terminal is used for integrating the data acquired by the glasses acquisition terminal, assisting in management and guiding the routing inspection process, recording and summarizing inspection result information and generating a corresponding supervision work sheet. In the working process, the data storage glasses acquisition terminal can be uploaded to the background management terminal through a wired mode or in an environment supporting 4G and wifi.
The glasses acquisition terminal can identify all background management terminal task devices, such as a high-voltage power distribution cabinet, a low-voltage power distribution cabinet, a transformer, an isolating switch and the like. The glasses collecting terminal further comprises a light supplement lamp 15 used for supplementing light, wherein the light supplement lamp 15 is electrically connected with the operation module. Sensing module 14 includes ambient light sensor, TOF range unit, 3 gyroscopes, 3 accelerometers, 3 geomagnetism appearance, and wherein ambient light sensor, TOF range unit, 3 gyroscopes, 3 accelerometers, 3 geomagnetism appearance all with operation module electric connection. The glasses acquisition terminal is provided with symmetrical assembly ports, and each assembly port is detachably assembled with an LCOS curved surface filter lens. A first magnetic block is arranged in each assembling opening, a second magnetic block is arranged on each LCOS curved filter lens, and the second magnetic block of each LCOS curved filter lens and the first magnetic block in the assembling opening are mutually magnetically attracted. The LCOS curved surface filter lens that adopts in this application is for magnetism to inhale the dress with the assembly opening, so convenient loading and unloading.
The glasses collection terminal can be used all weather, and can still perform recognition work by applying an ambient light sensor and a light supplement lamp 15 accessory when light is insufficient; when the sunlight is too glaring, the glasses are also provided with the LCOS curved surface filter lens, so that the glasses of a user are protected from dazzling. Data that glasses collection terminal gathered have network condition (4G/WIFI) down can pass back backstage management end at any time immediately, and data storage does not need to worry about data loss at no network environment promptly at the storage module of glasses collection terminal simultaneously. And TOF range unit can make glasses gather the terminal and know the relative position with equipment, and 3 axle gyroscopes, 3 axle accelerometers, 3 axle geomagnetism appearance then can make user's glasses gather the terminal and know current accurate position.
In this application, glasses collection terminal is based on AR engine algorithm, utilize wearable ergonomic design, module 13 of making a video recording that will be used for gathering the scene image of patrolling and examining, a collection sound module 12 for gathering the scene sound data of patrolling and examining, a storage module for storing and examining total data, a sensing module 14 for detecting site environment light and field device distance, an operation module for handling data, a display module 16 for showing backstage data, a broadcast sound module 11 for playing backstage sound data, a first wireless module for receiving and sending data, a wearable equipment that the battery module that is used for gathering the inside each module power supply of terminal for glasses is integrated together.
In the present application, the glasses acquisition terminal (split machine) is required to implement, and the technical parameters are as follows: the weight requirement of the glasses acquisition terminal is as follows: the weight is not more than 65 grams. The operation requirement is as follows: the Intel CPU host is adopted to be an X86 framework, so that the operation is very smooth in industrial severe application. The endurance requirement is as follows: the portable mobile power supply can be used for about 10 hours under the condition of full electric quantity, and can ensure long-time operation.
In this application, the glasses acquisition terminal has the following specific functions:
1. information acquisition: reading/obtaining current inspection task information, and obtaining characteristic point information of the identified equipment;
2. human-computer interaction: the inspection personnel wear the glasses, and operate and record information in a voice instruction mode in the inspection process;
3. automatic timing: starting automatic triggering of a glasses timer in each step, and recording the operation time of the current step;
4. visualization: the device state judgment result is superimposed on the identified object through an augmented reality technology (the background management terminal sends the device state judgment result to the glasses acquisition terminal, and the glasses acquisition terminal projects the information to the display module 16, namely the LCOS curved surface filter lens);
5. and (4) photographing and recording: the real-time calling of the camera module 13 is supported to record the field information, and the camera module 13 adopts 800 ten thousand pixel heads in the application;
6. local saving: the data collected by the glasses collecting end is stored in the storage module;
7. and (3) real-time transmission: and wired connection PC end transmission and real-time transmission of information acquired by the glasses end in a wireless environment are supported.
In this embodiment, the sound playing module 11 in the glasses collecting terminal is a bone conduction earphone, and bone conduction is a sound conduction mode, that is, sound is converted into mechanical vibration with different frequencies, and sound waves are transmitted through the skull, the bone labyrinth, the lymph fluid transmission of the inner ear, the spiral organ, the auditory nerve and the auditory center of a person. Compared with a classical sound conduction mode of generating sound waves through a vibrating diaphragm, the bone conduction mode omits a plurality of sound wave transmission steps, can realize clear sound restoration in a noisy environment, and does not influence other people due to the fact that the sound waves are diffused in the air. Wherein in this application, adopt bone conduction earphone as broadcasting acoustic module 11, then have following advantage: 1. comfort, because earplugs or earmuffs are not needed any more, namely, the ears are not needed to be plugged any more, the ears are greatly liberated; 2. the music box is safer, and has the most prominent advantages that the user can still keep normal hearing when listening to music and can keep the surrounding environment alert; 3. bone conduction earphones are beneficial to hearing protection, and greatly reduce irritation to the tympanic membrane due to open wearing; 4. the interference of noisy sound of the surrounding environment is reduced, and the tone quality and the definition are improved.
Simultaneously in this application, the receipts voice module 12 in the glasses collection terminal is for falling the microphone of making an uproar, and it has the chip of making an uproar to fall the microphone built-in of making an uproar wherein, falls the chip of making an uproar and is the advanced audio frequency noise reduction system who adopts HUSH circuit production: HUSH combines a dynamic filter with a downward expander, and is therefore highly efficient and free of the noise that is common to systems; furthermore, the adaptive threshold circuit can detect the nominal signal level and can dynamically adjust the two thresholds, thereby providing the optimal result regardless of the signal source; HUSH may be used with virtually any sound source, including audio and video tapes, radio and television broadcasts, and other noisy sound sources; can be used together with a coding signal source to produce good effect; one of the main features of the circuit is that it can be directly connected to the voltage controlled amplifier port, and can realize functions such as DC amplitude control, automatic level adjustment and compression with minimum foreign circuit.
Through the processing of the noise reduction chip, more than 90% of noise can be filtered, the communication quality of remote communication is ensured, and the interference of noisy field environment is avoided when field constructors and remote experts guide the operation process; and the accuracy of speech recognition can be greatly improved.
The intelligent risk pre-control system is a novel informatization means which is established on the basis of high informatization, and has the advantages of comprehensive perception of people and objects, comprehensive intelligence of construction technology, interconnection and intercommunication of objects, information collaborative sharing and intelligent risk pre-control.
Perception: real-time interaction, intelligent sensing and data acquisition are carried out through terminal equipment such as the camera module 13 and the background management end of the glasses acquisition terminal, so that real controllable on-site control is realized.
And (3) networking: the data collected by the background management end layer is convenient for project participants to acquire the data and work cooperatively.
Intelligentization: the intelligent algorithm comprises bone conduction and other intelligent algorithms, can be notified and processed in time, and improves the work cooperation efficiency.
And (4) infrastructure visualization, namely, the abnormal conditions of the water level, the environment temperature and humidity, SF6 gas, the entrance guard and each execution object are checked in a linkage manner by utilizing equipment, and an air conditioner, a fan, a water pump and the like are regulated and controlled in time to prevent abnormal events.
Flexible multiplexing: modular management is provided, and hardware devices and platforms can be reused.
Remote assistance: the expert side can initiate assistance and can also respond to an assistance request initiated by the operation side, and the system supports two-way real-time video communication and is efficient in cooperation.
And the simulation of three-dimensional modeling and dismounting operation is carried out by adopting the installation and maintenance of the main power equipment of the transformer substation based on augmented reality technology (AR) and three-dimensional simulation technology.
The relevant technical specifications, safety specifications and professional knowledge of equipment installation and maintenance operation are converted into video and three-dimensional visual display forms, relevant personnel only need to scan two-dimensional codes or equipment appearance in front of relevant equipment of the transformer substation, equipment installation and maintenance worker training can be achieved, and the business knowledge level and the safe production skill of maintenance workers are efficiently and rapidly improved.
Specific use examples of the present application are discussed in detail below:
1) AR discerns high-low voltage distribution cabinet equipment state: the inspection personnel set an inspection task at the background and then wear the glasses acquisition terminal to inspect on site, the glasses acquisition terminal automatically identifies the state of the equipment (including a pointer, a number, a switch valve and the like) and displays the identification result in the field of view;
2) comparing background prefabricated data: and comparing the recognition state with the background prefabricated data, automatically judging whether the inspection result is normal or not, and displaying the result in the field of view. The inspection personnel can choose to disconnect the equipment valve (the client side has remote disconnection software) or call historical data (text or pictures or videos);
3) visual remote guidance: if the inspection personnel encounters the problem or question which can not be solved independently, the inspection personnel can remotely guide the experts remotely connected with the service end to help solve the difficult problem in the inspection so as to smoothly complete the inspection work;
4) equipment linkage: the method mainly checks the water level, the environment temperature and humidity, SF6 gas, entrance guard and abnormal conditions of each execution object, and timely regulates and controls an air conditioner, a fan, a water pump and the like;
5) and (3) printing and storing the polling work ticket: automatically generating a polling work ticket, recording related polling parameters (polling items, polling persons, time, errors and the like), storing and submitting the polling work ticket to a server, and printing the polling work ticket in a background;
6) routing inspection voice delivery: filling a power grid standard form by voice in the whole process;
7) the automatic doorplate recognition is carried out in the inspection process, so that the distribution network management efficiency and quality are improved;
8) reading routing inspection automation data: the data are jointly dispatched with the DTU data of the dispatching system, and the AR automatically reads the operation data of the corresponding power distribution cabinet;
9) and (5) other power grid service inspection projects.
The remote expert guidance assistance function is discussed in detail below
In the process of field construction or operation and maintenance, an expert guidance assistance function can be applied to the background:
1) assistance initiation/response: the expert side can initiate assistance and also can respond to an assistance request initiated by the operation side, and the system supports two-way real-time video communication;
2) and (3) an online user: the expert side can see online real-time online users and comprises an expert side and an operation side;
3) and session management: the operation side and the expert side form a session after communication connection, and a third person can be invited to join the session to form a multi-person session;
4) basic communication functions: the method has the advantages that the real-time pushing of rich styles (pictures and characters) is realized, and various interactive interaction modes such as video, voice, audio recording, video recording and video pushing are supported;
5) data security architecture: the data transmission channel is encrypted by using an HTTPS technology to ensure the safety of data transmission, and the data local storage is encrypted by using a 128-bit encryption technology to ensure the safety of the data local storage;
6) an electronic whiteboard: the electronic whiteboard supports various hand-drawn guides, including ellipses, wire frames, arrows and the like;
7) AR technology: the system supports the AR technology, supports 3D presentation, has rich and diverse AR guidance, and really enables field operators to feel that remote experts have the guidance of hands in their own experience;
8) policy definition: defining product-related strategies, mainly including a communication strategy, an electronic whiteboard strategy and the like, such as size control and duration control of each time of pushing a video; word number control of text information; controlling the display duration of the hand-drawn shape of the electronic whiteboard;
the above embodiments are merely illustrative of the preferred embodiments of the present invention, and not restrictive, and various changes and modifications to the technical solutions of the present invention may be made by those skilled in the art without departing from the spirit of the present invention, and the technical solutions of the present invention are intended to fall within the scope of the present invention defined by the appended claims.
Claims (9)
1. On-spot construction safety and quality supervision research system based on AR technique, its characterized in that: the glasses management system comprises a glasses acquisition terminal and a background management terminal; the background management terminal establishes specifically executed task information and pushes the task information to the glasses acquisition terminal, the glasses acquisition terminal selects to execute a corresponding module task, and the glasses acquisition terminal uploads all information recorded in the polling process to the background management terminal;
the glasses acquisition terminal comprises a camera module for acquiring an inspection scene image, a sound receiving module for acquiring inspection scene sound data, a storage module for storing inspection total data, a sensing module for detecting scene environment light and the distance between field devices, an operation module for processing data, a display module for displaying background data, a projection module for projecting the background data to the display module, a sound playing module for playing the background sound data, a first wireless module for receiving and sending data, and a battery module for supplying power to each module in the glasses acquisition terminal;
the camera module, the sound receiving module, the storage module, the sensing module, the projection module, the sound playing module, the first wireless module and the battery module are all electrically connected with the operation module.
2. The AR technology-based on-site construction safety and quality supervision and research system as claimed in claim 1, wherein: the glasses collection terminal further comprises a light supplement lamp for supplementing light, wherein the light supplement lamp is electrically connected with the operation module.
3. The AR technology-based on-site construction safety and quality supervision research system according to claim 1 or 2, characterized in that: the sensing module comprises an ambient light sensor and a TOF ranging unit, wherein the ambient light sensor and the TOF ranging unit are electrically connected with the operation module.
4. The AR technology-based on-site construction safety and quality supervision and research system as claimed in claim 1, wherein: the display module comprises LCOS curved surface filter lenses, wherein the glasses acquisition terminal is provided with mutually symmetrical assembly ports, and each assembly port is detachably assembled with the LCOS curved surface filter lenses.
5. The AR technology-based on-site construction safety and quality supervision research system according to claim 4, wherein: a first magnetic block is arranged in each assembling opening, a second magnetic block is arranged on each LCOS curved filter lens, and the second magnetic block of each LCOS curved filter lens and the first magnetic block in the assembling opening are mutually magnetically attracted.
6. The AR technology-based on-site construction safety and quality supervision and research system as claimed in claim 1, wherein: the sound receiving module is a noise reduction microphone, wherein a noise reduction chip is arranged in the noise reduction microphone.
7. The AR technology-based on-site construction safety and quality supervision and research system as claimed in claim 1, wherein: the sound broadcasting module is a bone conduction earphone.
8. The AR technology-based on-site construction safety and quality supervision and research system as claimed in claim 1, wherein: the operation module is provided with a timer, and when the task is executed, each step of the task starts the timer to be automatically triggered, and the operation time of the current step is recorded.
9. The AR technology-based on-site construction safety and quality supervision and research system as claimed in claim 1, wherein: the background management end sends the equipment state judgment result to the operation module of the glasses acquisition terminal according to the equipment state, and the operation module controls the equipment state judgment result to be projected onto the display module through the projection module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011075473.XA CN112396718A (en) | 2020-10-09 | 2020-10-09 | On-site construction safety and quality supervision research system based on AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011075473.XA CN112396718A (en) | 2020-10-09 | 2020-10-09 | On-site construction safety and quality supervision research system based on AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112396718A true CN112396718A (en) | 2021-02-23 |
Family
ID=74595830
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011075473.XA Pending CN112396718A (en) | 2020-10-09 | 2020-10-09 | On-site construction safety and quality supervision research system based on AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112396718A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113284271A (en) * | 2021-04-28 | 2021-08-20 | 中国工商银行股份有限公司 | Machine room inspection method and device, electronic equipment and computer readable storage medium |
| CN114304798A (en) * | 2021-11-13 | 2022-04-12 | 国网辽宁省电力有限公司电力科学研究院 | Power inspection operation system and inspection process integrating intelligent wearing equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108021241A (en) * | 2017-12-01 | 2018-05-11 | 西安枭龙科技有限公司 | A kind of method for realizing AR glasses virtual reality fusions |
| CN108227203A (en) * | 2018-01-09 | 2018-06-29 | 歌尔科技有限公司 | AR display methods, equipment and device |
| CN108319019A (en) * | 2018-02-12 | 2018-07-24 | 杭州太若科技有限公司 | AR display devices and wearable AR equipment |
| CN110211254A (en) * | 2019-06-20 | 2019-09-06 | 中冶京诚工程技术有限公司 | Pipe gallery inspection monitoring method, platform and computer storage medium |
| CN110400388A (en) * | 2019-07-02 | 2019-11-01 | 上海德衡数据科技有限公司 | A kind of intelligent inspection system based on augmented reality |
| CN111612933A (en) * | 2020-05-18 | 2020-09-01 | 上海齐网网络科技有限公司 | Augmented reality intelligent inspection system based on edge cloud server |
| CN111708040A (en) * | 2020-06-02 | 2020-09-25 | Oppo广东移动通信有限公司 | Distance measuring device, distance measuring method and electronic equipment |
-
2020
- 2020-10-09 CN CN202011075473.XA patent/CN112396718A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108021241A (en) * | 2017-12-01 | 2018-05-11 | 西安枭龙科技有限公司 | A kind of method for realizing AR glasses virtual reality fusions |
| CN108227203A (en) * | 2018-01-09 | 2018-06-29 | 歌尔科技有限公司 | AR display methods, equipment and device |
| CN108319019A (en) * | 2018-02-12 | 2018-07-24 | 杭州太若科技有限公司 | AR display devices and wearable AR equipment |
| CN110211254A (en) * | 2019-06-20 | 2019-09-06 | 中冶京诚工程技术有限公司 | Pipe gallery inspection monitoring method, platform and computer storage medium |
| CN110400388A (en) * | 2019-07-02 | 2019-11-01 | 上海德衡数据科技有限公司 | A kind of intelligent inspection system based on augmented reality |
| CN111612933A (en) * | 2020-05-18 | 2020-09-01 | 上海齐网网络科技有限公司 | Augmented reality intelligent inspection system based on edge cloud server |
| CN111708040A (en) * | 2020-06-02 | 2020-09-25 | Oppo广东移动通信有限公司 | Distance measuring device, distance measuring method and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113284271A (en) * | 2021-04-28 | 2021-08-20 | 中国工商银行股份有限公司 | Machine room inspection method and device, electronic equipment and computer readable storage medium |
| CN114304798A (en) * | 2021-11-13 | 2022-04-12 | 国网辽宁省电力有限公司电力科学研究院 | Power inspection operation system and inspection process integrating intelligent wearing equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107862760A (en) | Wearable equipment and its application process for substation equipment maintenance and repair movement inspection operation | |
| CN105024894A (en) | Spectrum sensing-based 3D intelligent home system | |
| CN112396718A (en) | On-site construction safety and quality supervision research system based on AR technology | |
| CN109068090B (en) | Wireless video conference system | |
| CN110958537A (en) | Intelligent sound box and use method thereof | |
| CN108156033A (en) | The wearable maintenance support of unmanned plane supports system | |
| WO2021259008A1 (en) | Electric operation order individual soldier intelligent monitoring system and method | |
| CN109285088A (en) | A kind of intelligent inspection system and its method applied to power plant | |
| CN204733292U (en) | Nuclear power station remote monitoring, diagnosis, safeguard integral system | |
| CN112578906A (en) | Remote family perception and virtual presentation method based on natural interaction | |
| CN114666454A (en) | Intelligent conference system | |
| CN107888934A (en) | A kind of power transformation technical ability live broadcast system based on AR technologies | |
| WO2019119022A1 (en) | Augmented visual assistance system for assisting a person working at a remote workplace, method and headwear for use therewith | |
| CN211608330U (en) | Wearable device | |
| CN214480998U (en) | Indoor audio-visual monitoring system | |
| CN109348164A (en) | A kind of self-service guarantee control system of teleconference | |
| CN112966552B (en) | Routine inspection method and system based on intelligent identification | |
| CN211906347U (en) | Remote after-sale system | |
| CN111050137B (en) | Portable life search and rescue command box and system | |
| CN208722262U (en) | A kind of intelligent inspection system applied to power plant | |
| CN108818554B (en) | Multimedia intelligent robot | |
| CN113934148A (en) | Stage acousto-optic coordinated operation system based on 5G technology | |
| CN202009460U (en) | Electronic network invigilating and supervising system | |
| CN206921109U (en) | A kind of behavior analysis system | |
| CN205912162U (en) | A monitoring device for it is indoor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210422 Address after: 529599 110 Mojiang Road, Yangjiang City, Guangdong Province Applicant after: YANGJIANG POWER SUPPLY BUREAU OF GUANGDONG POWER GRID Corp. Address before: 529599 110 Mojiang Road, Yangjiang City, Guangdong Province Applicant before: YANGJIANG POWER SUPPLY BUREAU OF GUANGDONG POWER GRID Corp. Applicant before: Guangzhou Magic Power Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| CB03 | Change of inventor or designer information |
Inventor after: Liu Chengfeng Inventor after: Wu Rongji Inventor after: Xu Zhixian Inventor after: Wu Zhongxiao Inventor after: Zheng Qi Inventor before: Liu Chengfeng Inventor before: Wu Rongji Inventor before: Xu Zhixian Inventor before: Wu Zhongxiao Inventor before: Zheng Qi Inventor before: Shi Haixia Inventor before: Li Kang |
|
| CB03 | Change of inventor or designer information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210223 |
|
| RJ01 | Rejection of invention patent application after publication |