CN113518123A - National network digital converter station operation and maintenance system based on augmented reality technology - Google Patents
National network digital converter station operation and maintenance system based on augmented reality technology Download PDFInfo
- Publication number
- CN113518123A CN113518123A CN202110706915.4A CN202110706915A CN113518123A CN 113518123 A CN113518123 A CN 113518123A CN 202110706915 A CN202110706915 A CN 202110706915A CN 113518123 A CN113518123 A CN 113518123A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- maintenance
- equipment
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 110
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 34
- 238000005516 engineering process Methods 0.000 title claims abstract description 31
- 238000007726 management method Methods 0.000 claims description 57
- 239000011521 glass Substances 0.000 claims description 47
- 238000000034 method Methods 0.000 claims description 21
- 238000004891 communication Methods 0.000 claims description 17
- 238000003825 pressing Methods 0.000 claims description 17
- 230000008569 process Effects 0.000 claims description 16
- 238000009529 body temperature measurement Methods 0.000 claims description 14
- 230000003993 interaction Effects 0.000 claims description 14
- 230000006870 function Effects 0.000 claims description 12
- 238000005259 measurement Methods 0.000 claims description 7
- 230000009467 reduction Effects 0.000 claims description 7
- 230000006978 adaptation Effects 0.000 claims description 6
- 238000013499 data model Methods 0.000 claims description 6
- 238000007689 inspection Methods 0.000 claims description 6
- 238000002372 labelling Methods 0.000 claims description 6
- 238000001931 thermography Methods 0.000 claims description 6
- 230000007547 defect Effects 0.000 claims description 5
- 238000013461 design Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 4
- 230000008520 organization Effects 0.000 claims description 4
- 238000012795 verification Methods 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 claims description 4
- 238000009960 carding Methods 0.000 claims description 3
- 230000009977 dual effect Effects 0.000 claims description 3
- 238000011156 evaluation Methods 0.000 claims description 3
- 238000012946 outsourcing Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000009877 rendering Methods 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 2
- 238000003908 quality control method Methods 0.000 description 10
- 238000011161 development Methods 0.000 description 8
- 238000012549 training Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000033228 biological regulation Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004445 quantitative analysis Methods 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 239000002689 soil Substances 0.000 description 1
- 238000010977 unit operation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a national network digital converter station operation and maintenance system based on augmented reality technology, which comprises a server system and a mobile terminal equipment system, wherein the server system comprises an application server, a database server, a management server and a data server, the application server, the database server and the management server are privatized and deployed in a national network intranet, corresponding operation and maintenance data are obtained from the data server through a gatekeeper, and finally the corresponding operation and maintenance data are connected with the Internet through equipment such as an authentication server, an encryption gateway and a firewall.
Description
Technical Field
The invention relates to the technical field of national grid operation and maintenance, in particular to a national grid digital converter station operation and maintenance system based on an augmented reality technology.
Background
With the gradual falling of a large number of technologies representing advanced productivity, such as a large data platform, artificial intelligence, an industrial robot and the like, larger-scale capital construction and digital capital construction are developed, and traditional equipment and systems in the operation and maintenance site of the national network are gradually replaced. On the one hand, the ability of prior art workman's self-study receives the huge impact that the science and technology wave tide brought, and the advanced technical equipment has also hidden inherent complicacy when bringing the facility for production work for industrial enterprise more relies on the technical service that the equipment provider provided, and self technical staff presents weak trend to production system's support. On the other hand, the number of field devices, sensor networks and intelligent platforms is increasing year by year, and front-line operation and maintenance personnel are faced with the current situation that the number of platform systems is increasing year by year. The quantity of middle and high-grade technicians kept by the enterprise cannot keep pace with the development of the platform system, and huge enterprise burden is generated by excessively keeping human resources, so that cost reduction and efficiency improvement are increasingly difficult.
With the train installation of new equipment, the development of a maintenance theory and the promotion of maintenance management informatization, the operation and maintenance quality control work of the power grid has larger development opportunities and spaces, and simultaneously, the power grid has huge challenges.
The measurement index of the operation and maintenance personnel is the operation and maintenance efficiency, namely, the operation and maintenance work of how many devices can be covered by each person in unit time. According to the current development trend, the capacity of some newly-added stations and old stations is expanded every year, and the annual growth rate is close to 10%. And the basic operation and maintenance needs a more comprehensive knowledge coverage and a detection means with higher efficiency. The operation and maintenance work line of the converter station has the following problems:
1. the background operation and maintenance data are difficult to read on site;
2. the remote assistance efficiency is low;
3. the plate pressing checking efficiency is low;
4. the on-site operation and maintenance personnel are complicated to obtain a standard operation demonstration flow;
5. the process of acquiring information of equipment spare parts on site is complicated;
6. the efficiency of on-site retrieval of the operation and maintenance steps of the equipment and the information of the equipment is low;
7. the operation of temperature measurement and evidence retention in the operation and maintenance process is complex;
8. the vehicle admission process of the field check non-operating personnel is complicated;
9. the state judgment efficiency of the equipment and the device indicator lamp is low.
At present, new technical equipment is necessary to be introduced to correct the long-term existence of 'old habits' and 'soil methods' in the operation and maintenance work of the power grid, strictly adhere to the regulation and regulation system, and improve the normalized level of quality control work. In order to adapt to the development of new equipment, a scientific maintenance management mode is actively carried out, augmented reality technical equipment is introduced, card reading inspection modes are enriched in an operation, maintenance and quality control link, the execution efficiency of card-based operation is improved, the operation requirement of card-based operation is standardized, the whole process monitoring is carried out on maintenance training, and the method is especially necessary.
Augmented reality technology has emerged across the corners of the industry. Through a space positioning technology, a machine vision technology and the like, the change of working modes and the improvement of efficiency are brought to the point inspection work and the skill training work of an industrial field. Through space labeling, field workers can quickly understand the work content and the work requirement in the current work area, and for special operation requirements, the operation key is displayed in a mode of hanging animation in space. In the actual practice training stage, the remote guidance efficiency can be greatly improved by utilizing various tools such as bidirectional audio and video, space marking, drawing hanging, remote desktop and the like provided by the augmented reality technology through the remote assistance system. In the post research and judgment link, objective judgment is carried out on the practice training effect through the first visual angle audio/video record, and an improvement plan is made. Through a series of scientific and technological means, industrial field training and operation and maintenance work has a new weather which changes the head and the face, and is worthy of learning and reference.
The introduction of the augmented reality technology is a new innovative and advanced means for quality control management. The standardized quality control quality can be cultured in a planned way at the source of the operation and maintenance link. The operation and maintenance informatization construction of the power grid is a future development trend, and a new technical means is provided for the quality control work by introducing augmented reality equipment. In daily work, three capabilities of quality control work, namely quantitative analysis, accurate planning and forecast prediction capabilities, are improved. Through quantitative analysis, a quantitative decision basis is provided for operation and maintenance of the power grid; the operation and maintenance efficiency of the power grid is improved through an accurate plan; through scientific forecast and prediction, the pertinence of the operation and maintenance of the power grid is improved.
Based on the above, the invention designs a national network digital converter station operation and maintenance system based on the augmented reality technology, introduces the augmented reality technology, and has very positive effects on further enriching quality control management means, improving quality control management level and exciting whole-member quality control consciousness so as to solve the above mentioned problems.
Disclosure of Invention
The invention aims to provide a national network digital converter station operation and maintenance system based on an augmented reality technology, which is characterized in that a set of intelligent operation and maintenance system is researched and developed by combining a machine vision technology, a deep learning technology, a space positioning technology and an intelligent interaction technology through intelligent glasses, so that operation and maintenance personnel can be assisted to quickly retrieve operation and maintenance manuals, safety regulations, historical operation and maintenance data, pressing plate standard state graphic data and the like on a working site, the established operation and maintenance work can be completed more accurately, and the working efficiency is improved; the thermal imaging technology and the space labeling technology are integrated, and a set of efficient operation and maintenance temperature measuring equipment is researched. The field temperature measurement process is simplified, abnormal data are rapidly recorded, and operation and maintenance evidence keeping work is strengthened; by identifying the states of the indicating lamps of the field equipment and the device and comparing background data, the working states of the field equipment and the device are verified quickly, and the operation and maintenance efficiency is improved; a set of portable operation and maintenance equipment is researched, the identity information flow of the inspectors and the engineering vehicles is simplified on the operation and maintenance site through a face recognition technology and a license plate recognition technology, and the safety accident occurrence probability is reduced; a set of brand-new platform system is researched, a more friendly working platform is provided for operation and maintenance remote assistance through audio and video interaction, AR labels, desktop sharing and the like, and remote assistance efficiency is improved.
In order to achieve the purpose, the invention provides the following technical scheme: a national network digital converter station operation and maintenance system based on an augmented reality technology comprises a server system and a mobile terminal equipment system, wherein the server system comprises an application server, a database server, a management server and a data server, the application server, the database server and the management server are deployed in a national network in a privatization mode, then corresponding operation and maintenance data are obtained from the data server through a network gate, and finally the mobile terminal equipment system is connected with the internet through equipment such as an authentication server, an encryption gateway and a firewall, and is in data interconnection and intercommunication with all servers of the national network and the intranet through access authentication.
Preferably, in the above system for operation and maintenance of a national network digital converter station based on augmented reality technology, the server includes
The soft bus platform is used for transmitting various types of data of the system in real time in a wide area network or a proprietary network;
the system uplink module is used for realizing the interconnection with the protocol layers of other application systems;
the hardware adaptation module is used for realizing the adaptation function of a driver and a communication protocol required by the expansion board card;
the Web service module is used for providing access service based on a browser for the application client;
the database is used for bearing the functions of storing, adding, deleting, modifying and searching all data of the system;
the device management module is used for providing the system to manage each access hardware device;
the resource management module is used for managing the memory and the hard disk use state of the system;
the audio/video module is used for providing a uniform audio/video interaction channel for the system and recording and managing data generated in the audio/video interaction process;
the equipment scene management module is used for managing scattered space information scanned and modeled by the intelligent glasses;
the identification service module is used for providing identification algorithm service for various objects provided by the application program;
the face recognition module is used for carrying out cloud management and synchronization on personnel information and alarm information generated in the face recognition process;
the label management module is used for providing a text label, a video label, a table label, a graphic label and a model label standard access interface for the application program, and providing label editing, label adding, deleting, modifying and searching functions for the application program;
the model management module is used for managing each data model accessed by the system to enable the data model to be in a standard data format and performing classified management;
the personnel management application module is used for finishing the carding of the organization architecture of the target unit personnel;
the work order management application module is used for setting a maintenance work plan and a detail flow according to the work flow and the specific requirements of a target unit and providing support for work order implementation and subsequent additional statistics;
the equipment management application module is used for registering equipment attribution conditions according to system setting, monitoring the running state of the equipment in real time and recording equipment use information;
the remote cooperative application module is used for providing service application for a plurality of front-end devices, accessing a plurality of users through an audio and video interactive platform, and utilizing augmented reality labeling, animation demonstration and desktop sharing of videos at a first visual angle;
the AR operation and maintenance module is used for determining a working target, a working process and a working requirement in the form of an augmented reality label; displaying an operation video for field workers in the form of a video tag; providing tool book data retrieval service for field workers in a document tag form; displaying real-time operation and maintenance data for field workers in a dynamic table label mode; thermal imaging temperature measurement; comparing the states of the pressing plates; offline face recognition and license plate recognition; equipment and device indicator lamp state identification;
and the report management module is used for generating reports in corresponding formats according to user requirements on operation and maintenance personnel, equipment, operation and maintenance records and data generated by instruments and meters.
Preferably, in the above operation and maintenance system for a national network digital converter station based on the augmented reality technology, the mobile terminal device system includes a mobile terminal device and an AR operation and maintenance application unit, the mobile terminal device is an intelligent glasses, a computer, a PAD, or a mobile phone device, and the AR operation and maintenance application unit includes
The real-time operation and maintenance data module is used for checking current equipment information, operation parameters, historical defect records and differences between current instrument data and background data in real time through intelligent glasses;
the system comprises an enhancement operation module, a display module and a display module, wherein the enhancement operation module is used for checking operation and maintenance need, operation and maintenance rules and historical operation and maintenance information through a two-dimensional code on intelligent glasses scanning equipment or a device, and the information is hung around the equipment in the form of a text augmented reality label;
the multi-party remote assistance module is used for integrating field inspection personnel, remote experts and outsourcing experts on a platform to work, and performing remote assistance in various modes of marking, displaying drawings, white board discussion and sharing a desktop;
the pressing plate state comparison module is used for scanning the two-dimensional code of the pressing plate cabinet through the worn intelligent glasses, the application program can display the correct state of the switch of the pressing plate cabinet, and the operation and maintenance personnel can complete the checking of the pressing plate cabinet by comparing the standard graph with the pressing plate state;
the secondary equipment temperature measurement module is used for carrying out real-time infrared temperature measurement on secondary equipment machine room equipment through the intelligent glasses, automatically recording video information exceeding a threshold value by a system, giving out sound alarm and facilitating operation and maintenance personnel to read alarm sound and video data afterwards;
a personnel vehicle verification module; the intelligent glasses are used for rapidly verifying the identity of vehicles and personnel on the working site and recording alarm information through the intelligent glasses, so that the vehicles and the personnel can be conveniently called afterwards;
check pilot lamp state module, through wearing intelligent glasses, scan rack two-dimensional code, on the one hand, retrieve this equipment pilot lamp state data, on the other hand discerns current equipment pilot lamp state through machine vision mode, through comparing with backstage data, gives current equipment operating condition evaluation.
Preferably, in the above operation and maintenance system of the national network digital converter station based on the augmented reality technology, the intelligent glasses mainly comprise a main control module, a communication module, a positioning module, an IMU, other sensors, a display module, an image acquisition module and an MIC/SPK module;
the main control module is used for completing data acquisition, graphic rendering, audio and video coding and decoding, man-machine interaction command processing, power management and data intercommunication among the modules;
the communication module is used for completing the access of the intelligent glasses to the network;
the display module is connected with the main control module through an LVDS bus;
the image acquisition module is used for completing visible light and infrared image acquisition;
the MIC/SPK module adopts a microphone array noise reduction design, and the SPK module supports background noise reduction;
the positioning module supports a GPS and Beidou dual mode;
the IMU module is an augmented reality application core module and mainly comprises a triaxial angular velocity meter and a triaxial accelerometer;
the other sensor modules comprise a distance measuring sensor, a light sensor and a temperature sensor, and the distance measuring sensor provides data support for constructing a space measurement algorithm; the light sensor measures the real-time environment brightness and is matched with the system to adjust the brightness of the near-to-eye display module; the temperature sensor measures the ambient temperature in real time and adjusts and measures the ambient parameters in cooperation with temperature measurement application;
the battery module provides continuous stable electric power for intelligent glasses, cooperates external adapter to charge for the battery, cooperates with the power management unit of main control module, provides corresponding operating voltage for each functional module of intelligent glasses, possesses data communication module simultaneously, reports real-time electric quantity, temperature, the relevant data of charge-discharge number of times to the system.
Compared with the prior art, the invention has the beneficial effects that:
1. and pulling through the foreground and background data, capturing general information, real-time operation parameters and historical defect information of the field equipment from the background, and displaying the general information, the real-time operation parameters and the historical defect information to field operation and maintenance personnel in an augmented reality label mode, so that the field decision of the working personnel is facilitated. And simultaneously, the working state of the field equipment is sensed and data is recorded.
2. Standardize the fortune dimension flow, fortune dimension maintainer is through wearing intelligent glasses, after getting into the workspace, through the camera quick scanning rack sign that intelligent glasses carried, demonstrates this safety need of fortune dimension, technological key and fortune dimension historical record in the rack relevant position. Through the learning of the operation and maintenance personnel on the information, standard operation is standardized, working habits are strengthened, and operation and maintenance historical information is known.
3. The field tool data support is realized, the operation and maintenance personnel trigger animation demonstration through voice commands, and the operation and maintenance personnel are matched with voice explanation to introduce operation requirements and technical requirements in detail; necessary tool documents are displayed in a document tag mode, so that on-site personnel can conveniently read the documents; displaying related information such as storage position, quantity and the like of the current equipment spare parts in a text label form; and displaying information such as historical operation and maintenance records, fault records and the like of the current equipment in a text label form.
4. The clamp plate is compared, and at the electric wire netting fortune dimension in-process, each on-off state of clamp plate cabinet is relatively fixed, needs the fortune dimension personnel of patrolling and examining to compare one by one with actual on-off state through reading on-off state description file usually, and is inefficient. Attempts have also been made to automatically interpret the switch status by machine vision, but due to limitations in industrial field light, angle, distance, the recognition rate is up to 95%. And under the condition that the machine vision cannot reach 100%, the application scene has no use value. Therefore, the standard graph comparison mode is adopted, the labor intensity is reduced for on-site operation and maintenance, and the comparison efficiency is improved.
5. And multi-party remote assistance is realized, and the field operation and maintenance maintainers receive the technical guidance of remote experts through a remote assistance system. The remote experts communicate with field personnel in various ways such as real-time enhanced tag labeling, voice talkback, white board, screen freezing, video hanging, desktop sharing and the like, and can introduce a third party and a fourth party for remote consultation if necessary. Through various communication means, the remote assistance efficiency is improved, and the recording and the evidence keeping are enhanced.
6. Safety control, in the actual job site, it is comparatively loaded down with trivial details to external personnel and vehicle identity check hand flow. Through the intelligent glasses that on-spot fortune dimension maintainer wore, carry out quick discernment to operation region personnel and vehicle and verify, stop the hidden danger that external personnel vehicle brought the safety in production.
7. Thermal imaging screening, at secondary equipment computer lab, to all equipment, instrument, the device that eyesight reaches carry out thermal imaging screening, the automatic record high temperature point, the evidence is stayed to the video, promotes fortune dimension efficiency.
8. The device pilot lamp discerns, patrols and examines the fortune dimension scene, through intelligent glasses to rack, the bright state identification that goes out of device pilot lamp, compares backstage data, gives the judged result, supplementary fortune dimension personnel promote work efficiency.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of the framework of the system of the present invention;
FIG. 2 is a schematic diagram of a server framework according to the present invention;
FIG. 3 is a schematic diagram of the framework structure of the AR operation and maintenance application unit of the present invention;
fig. 4 is a schematic structural diagram of an intelligent glasses frame according to the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an embodiment of the present invention: a national network digital converter station operation and maintenance system based on an augmented reality technology comprises a server system and a mobile terminal equipment system, wherein the server system comprises an application server, a database server, a management server and a data server, the application server, the database server and the management server are deployed in a national network in a privatization mode, then corresponding operation and maintenance data are obtained from the data server through a network gate, and finally the mobile terminal equipment system is connected with the internet through equipment such as an authentication server, an encryption gateway and a firewall, and is in data interconnection and intercommunication with all servers of the national network and the intranet through access authentication.
Please refer to fig. 2 in the drawings of the specification: the server comprises
The system soft bus is mainly responsible for transmitting various types of data of the system in real time (according to the characteristics of the existing physical transmission medium, the transmission is carried out as far as possible) in a wide area network or a proprietary network. The system soft bus abstractly classifies various data, encapsulates a network retransmission mechanism, QOS, various devices and common transmission protocols, facilitates the rapid access of a subsequent system through a standard interface, and realizes the interconnection and intercommunication of the data.
The system uplink module mainly realizes the protocol layer interconnection of the system and other application systems. The method realizes a plurality of third-party protocols and industry universal protocols for subsequent system function expansion, and is convenient for data interaction with other application systems.
The hardware adaptation module mainly realizes adaptation functions such as a driver, a communication protocol and the like required by the expansion board card. On one hand, when the server expands and unknown hardware equipment is newly added, corresponding drivers and communication protocols need to be developed. On the other hand, when the intelligent glasses side needs to be interconnected and communicated with newly added instruments, instruments and functional modules, corresponding driving programs and communication protocols can be downloaded from the server side.
Web services provide browser-based access services for application clients.
Database services are common general modules of systems. The system mainly has the functions of storing, increasing, deleting, changing, searching and the like of all data of the system. This module is the basis for other services and applications. The standard unified database service is beneficial to the rapid development of system application and the stable operation of the system.
The device management service mainly provides management of each access hardware device by the system. And synchronizing the working state, capacity access, alarm management and other functions of each hardware device in real time. Good equipment management is the key of the coordinated operation of the system and belongs to the basic service of the system.
The resource management service mainly manages the memory and hard disk use states of the system. In order to prevent the slow operation of the system caused by resource fragmentation, the resource management module manages the memory in sections and provides functional interfaces for application, release and the like in a unified manner. Meanwhile, system storage service is managed, system data, business data, model data, application data and the like are managed in a classified mode, and a disaster backup function is achieved.
The audio and video service provides a uniform audio and video interaction channel for the system, ensures the smoothness of audio and video in various network states, provides point-to-point, point-to-multipoint and multipoint-to-multipoint audio and video interaction services for application programs, and records and manages data generated in the audio and video interaction process. The method is provided with a call quality management interface, and channels of different levels are provided with different preemption strategies and discarding strategies.
The device scene management module mainly manages scattered space information scanned and modeled by the intelligent glasses. The device scene module associates identification information in a scene, such as characters, two-dimensional codes, bar codes, feature points, and the like, and also associates tag information in the device scene. And for the label information, hierarchical management is performed, and a uniform data interface is provided for the application. And classifying and storing the scene data of the equipment, and providing an adding, deleting, modifying and searching interface for the application program.
The identification service is an identification algorithm service of various objects provided by the system to the application program. The application program can call a corresponding algorithm model, convert a real object into data information, and cooperate with application logic to quickly generate the application program.
The face recognition service is divided into two parts, face detection and face recognition. The service provides a uniform face detection and face recognition interface for the application program, and meets the development requirements of various applications. And carrying out cloud management and synchronization on personnel information and alarm information generated in the face identification process.
The label management service module mainly provides standard access interfaces such as text labels, video labels, table labels, graphic labels and model labels for the application program, and provides functions such as label editing, label adding, deleting, changing and searching for the application program.
The model management service mainly completes the management of each data model accessed to the system, so that the data model becomes a standard data format and is managed in a classified mode. And a uniform access interface is provided for the application program, and operation interfaces such as addition, deletion, modification, check and the like are provided for the management background.
The personnel management application is a system background application and mainly finishes the carding of the organization architecture of the target unit personnel. And finishing the input and the arrangement of the personnel information and the organization relationship information of each team. And according to the unit operation and maintenance flow and the authority setting, providing authority configuration for the user.
The work order management application is a system background application. And setting a maintenance work plan and a detail flow according to the work flow and the specific requirements of the target unit, and providing support for the implementation of the work order and the follow-up statistics.
The device management application is a system background application. According to system setting, registering equipment attribution condition, monitoring equipment running state in real time, recording equipment use information and the like.
The remote cooperative application is a service application provided by the system background for a plurality of front-end devices. A plurality of users are accessed through an audio and video interaction platform, and the remote assistance efficiency is improved by utilizing augmented reality labeling, animation demonstration and desktop sharing of videos at a first visual angle.
The AR operation and maintenance module is used for determining a working target, a working process and a working requirement in the form of an augmented reality label according to the description of the operation process card; displaying an operation video for field workers in the form of a video tag; providing tool book data retrieval service for field workers in a document tag form; displaying real-time operation and maintenance data for field workers in a dynamic table label mode; thermal imaging temperature measurement; comparing the states of the pressing plates; offline face recognition and license plate recognition; and identifying the states of equipment and device indicator lamps.
And the report management module generates data by operation and maintenance personnel, equipment, operation and maintenance records, instruments and meters and the like in the using process of the system, generates reports in corresponding formats according to user requirements, and facilitates printing, archiving and historical query of users.
Please refer to fig. 3 in the drawings of the specification: the mobile terminal equipment system comprises mobile terminal equipment and an AR operation and maintenance application unit, wherein the mobile terminal equipment is intelligent glasses, a computer, a PAD or mobile phone equipment, and the AR operation and maintenance application unit comprises
And the real-time operation and maintenance data module is used for enabling operation and maintenance personnel to check current equipment information, operation parameters, historical defect records and current instrument data and background data difference in real time through intelligent glasses.
And the operation module is enhanced, and operation and maintenance inspection personnel check operation and maintenance needs, operation and maintenance rules, historical operation and maintenance information and the like through the two-dimensional codes on the intelligent glasses scanning equipment or device. This information is suspended around the device in the form of a textual augmented reality tag.
And the multi-party remote assistance module integrates the field inspection personnel, the remote experts and the outsourcing experts on one platform to work through a remote assistance system. By means of various modes such as marking, drawing displaying, whiteboard discussing and desktop sharing, remote assistance efficiency is improved, and maintenance cost is reduced.
The clamp plate state contrast module, on-the-spot fortune dimension personnel scan clamp plate cabinet two-dimensional code through the intelligent glasses of wearing, and application can show this clamp plate cabinet switch's correct state. And the operation and maintenance personnel finish the checking of the pressing plate cabinet by comparing the standard graph with the pressing plate state.
And the secondary equipment temperature measurement module is used for carrying out real-time infrared temperature measurement on secondary equipment machine room equipment by wearing intelligent glasses by operation and maintenance personnel. The system automatically records video information exceeding a threshold value and gives an audible alarm. And the operation and maintenance personnel can conveniently read the warning audio and video data afterwards.
A personnel vehicle verification module; the on-site operation and maintenance personnel can perform rapid identity verification and record alarm information on vehicles and personnel on the working site through the intelligent glasses, and the convenience is brought to the retrieval after the fact.
The check indicator lamp state module, on-the-spot fortune dimension personnel are through wearing intelligent glasses, scanning rack two-dimensional code. On one hand, the state data of the indicating lamp of the equipment is retrieved, on the other hand, the state of the indicating lamp of the equipment is identified in a machine vision mode, and the working state evaluation of the equipment is given out by comparing the state data with background data.
Please refer to fig. 4 in the drawings of the specification: the system special hardware is mainly intelligent glasses which mainly comprise a main control module, a communication module, a positioning module, an IMU (inertial measurement Unit), other sensors, a display module, an image acquisition module and an MIC/SPK (many integrated core/short circuit link) module;
the main control module is used for completing data acquisition, graphic rendering, audio and video coding and decoding, man-machine interaction command processing, power management and data intercommunication among the modules;
the communication module is mainly used for completing the access of the intelligent glasses to the network and communicating other application software and a database. The communication module supports two local area communication modes of WiFi and Bluetooth, and supports modes of 4G or 5G public networks, 4G or 5G private networks, ad hoc networks and the like.
The display module is connected with the main control module through the LVDS bus, is a 'display' of the intelligent glasses, has the characteristics of resolution ratio not lower than 800X600, field angle not smaller than 20 degrees multiplied by 30 degrees, high contrast, high brightness and the like, and meets the normal use requirements under sunlight.
The image acquisition module finishes visible light and infrared image acquisition and is the 'eyes' of the intelligent glasses. The pixel is not less than 1300 ten thousand, and the maximum sampling rate is not less than 30 frames.
The MIC/SPK module is an ear of the intelligent glasses, a microphone array noise reduction design is adopted, and the SPK module supports background noise reduction.
The positioning module supports a GPS and Beidou dual mode, and the positioning precision is within 10 meters.
The IMU module is an augmented reality application core module and mainly comprises a triaxial angular velocity meter and a triaxial accelerometer. And data support is provided for spatial repositioning, spatial scanning and spatial measurement.
Other sensor modules include ranging sensors, light sensors, temperature sensors, and the like. The ranging sensor provides data support for constructing a space measurement algorithm. The light sensor measures the real-time environment brightness and is matched with the system to adjust the brightness of the near-eye display module. The temperature sensor measures the ambient temperature in real time and adjusts and measures the ambient parameters in cooperation with temperature measurement application.
The battery module provides continuous stable power for the smart glasses. The external adapter is matched to charge the battery, and the external adapter is matched with the power management unit of the main control module to provide corresponding working voltage for each functional module of the intelligent glasses. The system has data communication capacity, and reports related data such as real-time electric quantity, temperature, charging and discharging times and the like to the system.
In the description herein, references to the description of "one embodiment," "an example," "a specific example" or the like are intended to mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (4)
1. A national network digital convertor station operation and maintenance system based on augmented reality technology is characterized in that: the system comprises a server system and a mobile terminal equipment system, wherein the server system comprises an application server, a database server, a management server and a data server, the application server, the database server and the management server are privatized and deployed in a national network intranet, then corresponding operation and maintenance data are obtained from the data server through a gatekeeper, and finally the data are connected with the internet through equipment such as an authentication server, an encryption gateway and a firewall, and the mobile terminal equipment system is interconnected and intercommunicated with the data of each server of the national network intranet through access authentication.
2. The operation and maintenance system of the national grid digital converter station based on the augmented reality technology according to claim 1, characterized in that: the server comprises
The soft bus platform is used for transmitting various types of data of the system in real time in a wide area network or a proprietary network;
the system uplink module is used for realizing the interconnection with the protocol layers of other application systems;
the hardware adaptation module is used for realizing the adaptation function of a driver and a communication protocol required by the expansion board card;
the Web service module is used for providing access service based on a browser for the application client;
the database is used for bearing the functions of storing, adding, deleting, modifying and searching all data of the system;
the device management module is used for providing the system to manage each access hardware device;
the resource management module is used for managing the memory and the hard disk use state of the system;
the audio/video module is used for providing a uniform audio/video interaction channel for the system and recording and managing data generated in the audio/video interaction process;
the equipment scene management module is used for managing scattered space information scanned and modeled by the intelligent glasses;
the identification service module is used for providing identification algorithm service for various objects provided by the application program;
the face recognition module is used for carrying out cloud management and synchronization on personnel information and alarm information generated in the face recognition process;
the label management module is used for providing a text label, a video label, a table label, a graphic label and a model label standard access interface for the application program, and providing label editing, label adding, deleting, modifying and searching functions for the application program;
the model management module is used for managing each data model accessed by the system to enable the data model to be in a standard data format and performing classified management;
the personnel management application module is used for finishing the carding of the organization architecture of the target unit personnel;
the work order management application module is used for setting a maintenance work plan and a detail flow according to the work flow and the specific requirements of a target unit and providing support for work order implementation and subsequent additional statistics;
the equipment management application module is used for registering equipment attribution conditions according to system setting, monitoring the running state of the equipment in real time and recording equipment use information;
the remote cooperative application module is used for providing service application for a plurality of front-end devices, accessing a plurality of users through an audio and video interactive platform, and utilizing augmented reality labeling, animation demonstration and desktop sharing of videos at a first visual angle;
the AR operation and maintenance module is used for determining a working target, a working process and a working requirement in the form of an augmented reality label; displaying an operation video for field workers in the form of a video tag; providing tool book data retrieval service for field workers in a document tag form; displaying real-time operation and maintenance data for field workers in a dynamic table label mode; thermal imaging temperature measurement; comparing the states of the pressing plates; offline face recognition and license plate recognition; equipment and device indicator lamp state identification;
and the report management module is used for generating reports in corresponding formats according to user requirements on operation and maintenance personnel, equipment, operation and maintenance records and data generated by instruments and meters.
3. The operation and maintenance system of the national grid digital converter station based on the augmented reality technology according to claim 1, characterized in that: the mobile terminal equipment system comprises mobile terminal equipment and an AR operation and maintenance application unit, wherein the mobile terminal equipment is intelligent glasses, a computer, a PAD or mobile phone equipment, and the AR operation and maintenance application unit comprises
The real-time operation and maintenance data module is used for checking current equipment information, operation parameters, historical defect records and differences between current instrument data and background data in real time through intelligent glasses;
the system comprises an enhancement operation module, a display module and a display module, wherein the enhancement operation module is used for checking operation and maintenance need, operation and maintenance rules and historical operation and maintenance information through a two-dimensional code on intelligent glasses scanning equipment or a device, and the information is hung around the equipment in the form of a text augmented reality label;
the multi-party remote assistance module is used for integrating field inspection personnel, remote experts and outsourcing experts on a platform to work, and performing remote assistance in various modes of marking, displaying drawings, white board discussion and sharing a desktop;
the pressing plate state comparison module is used for scanning the two-dimensional code of the pressing plate cabinet through the worn intelligent glasses, the application program can display the correct state of the switch of the pressing plate cabinet, and the operation and maintenance personnel can complete the checking of the pressing plate cabinet by comparing the standard graph with the pressing plate state;
the secondary equipment temperature measurement module is used for carrying out real-time infrared temperature measurement on secondary equipment machine room equipment through the intelligent glasses, automatically recording video information exceeding a threshold value by a system, giving out sound alarm and facilitating operation and maintenance personnel to read alarm sound and video data afterwards;
a personnel vehicle verification module; the intelligent glasses are used for rapidly verifying the identity of vehicles and personnel on the working site and recording alarm information through the intelligent glasses, so that the vehicles and the personnel can be conveniently called afterwards;
check pilot lamp state module, through wearing intelligent glasses, scan rack two-dimensional code, on the one hand, retrieve this equipment pilot lamp state data, on the other hand discerns current equipment pilot lamp state through machine vision mode, through comparing with backstage data, gives current equipment operating condition evaluation.
4. The operation and maintenance system of the national grid digital converter station based on the augmented reality technology according to claim 1, characterized in that: the intelligent glasses mainly comprise a main control module, a communication module, a positioning module, an IMU (inertial measurement Unit), other sensors, a display module, an image acquisition module and an MIC/SPK (many integrated core/short-range link) module;
the main control module is used for completing data acquisition, graphic rendering, audio and video coding and decoding, man-machine interaction command processing, power management and data intercommunication among the modules;
the communication module is used for completing the access of the intelligent glasses to the network;
the display module is connected with the main control module through an LVDS bus;
the image acquisition module is used for completing visible light and infrared image acquisition;
the MIC/SPK module adopts a microphone array noise reduction design, and the SPK module supports background noise reduction;
the positioning module supports a GPS and Beidou dual mode;
the IMU module is an augmented reality application core module and mainly comprises a triaxial angular velocity meter and a triaxial accelerometer;
the other sensor modules comprise a distance measuring sensor, a light sensor and a temperature sensor, and the distance measuring sensor provides data support for constructing a space measurement algorithm; the light sensor measures the real-time environment brightness and is matched with the system to adjust the brightness of the near-to-eye display module; the temperature sensor measures the ambient temperature in real time and adjusts and measures the ambient parameters in cooperation with temperature measurement application;
the battery module provides continuous stable electric power for intelligent glasses, cooperates external adapter to charge for the battery, cooperates with the power management unit of main control module, provides corresponding operating voltage for each functional module of intelligent glasses, possesses data communication module simultaneously, reports real-time electric quantity, temperature, the relevant data of charge-discharge number of times to the system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110706915.4A CN113518123A (en) | 2021-06-24 | 2021-06-24 | National network digital converter station operation and maintenance system based on augmented reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110706915.4A CN113518123A (en) | 2021-06-24 | 2021-06-24 | National network digital converter station operation and maintenance system based on augmented reality technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113518123A true CN113518123A (en) | 2021-10-19 |
Family
ID=78066298
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110706915.4A Pending CN113518123A (en) | 2021-06-24 | 2021-06-24 | National network digital converter station operation and maintenance system based on augmented reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113518123A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114153315A (en) * | 2021-12-02 | 2022-03-08 | 浙江科顿科技有限公司 | Augmented reality distributed server intelligent glasses system and control method |
| CN114466121A (en) * | 2022-01-21 | 2022-05-10 | 中国船舶重工集团公司第七0九研究所 | Air-ground visualization command system based on AR and working method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107167246A (en) * | 2017-05-16 | 2017-09-15 | 上海欧忆能源科技有限公司 | Scene perceives intelligent helmet, live cognitive method, device and storage medium |
| CN110782138A (en) * | 2019-10-10 | 2020-02-11 | 福建京力信息科技有限公司 | Engineering quality general illness treatment platform based on mobile internet AR technology |
| CN112365623A (en) * | 2020-12-03 | 2021-02-12 | 国网信息通信产业集团有限公司 | Electric power inspection system |
-
2021
- 2021-06-24 CN CN202110706915.4A patent/CN113518123A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107167246A (en) * | 2017-05-16 | 2017-09-15 | 上海欧忆能源科技有限公司 | Scene perceives intelligent helmet, live cognitive method, device and storage medium |
| CN110782138A (en) * | 2019-10-10 | 2020-02-11 | 福建京力信息科技有限公司 | Engineering quality general illness treatment platform based on mobile internet AR technology |
| CN112365623A (en) * | 2020-12-03 | 2021-02-12 | 国网信息通信产业集团有限公司 | Electric power inspection system |
Non-Patent Citations (2)
| Title |
|---|
| 彭博: "AR技术在变电动态运维关键技术中的应用", 《科技创新导报》 * |
| 李大勇等: "基于AR技术的变电站智能巡检系统设计与实现", 《微型电脑应用》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114153315A (en) * | 2021-12-02 | 2022-03-08 | 浙江科顿科技有限公司 | Augmented reality distributed server intelligent glasses system and control method |
| CN114466121A (en) * | 2022-01-21 | 2022-05-10 | 中国船舶重工集团公司第七0九研究所 | Air-ground visualization command system based on AR and working method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109978409B (en) | Multi-engineering enterprise-level intelligent construction site block chain management method | |
| CN109413188A (en) | A kind of industrial equipment management system for internet of things and method | |
| CN110865917A (en) | AR technology-based electric power machine room inspection operation method, system and application | |
| CN105574593B (en) | Track state static detection and control system and method based on cloud computing and big data | |
| CN113518123A (en) | National network digital converter station operation and maintenance system based on augmented reality technology | |
| CN111062504A (en) | AR technology-based intelligent power distribution station operation and maintenance system and method | |
| CN106251240A (en) | Power transmission network method for early warning based on big data | |
| CN111792487A (en) | Elevator intelligent management system and management method based on big data platform | |
| CN105491102A (en) | Intelligent monitoring system based on cloud computing technology and device thereof | |
| CN109142978B (en) | Active monitoring method for running state of railway contact net | |
| CN111369220A (en) | Teacher's cloud platform is built to wisdom | |
| CN109460939A (en) | A kind of Municipal Engineering Construction safety control system and method based on 3DGIS+BIM technology | |
| CN114399265A (en) | Electric power engineering construction project overall process management and control system | |
| CN111738595A (en) | Intelligent engineering monitoring management system based on big data | |
| CN115052129A (en) | Construction site visual supervision system and supervision method thereof | |
| CN108960603A (en) | Railway intelligent information management system | |
| CN115567563B (en) | Comprehensive transportation hub monitoring and early warning system based on end edge cloud and control method thereof | |
| CN115689277B (en) | Chemical industry garden risk early warning system under cloud edge cooperation technology | |
| CN109754160B (en) | Shield construction supervision system | |
| CN116797412A (en) | Scenic spot digital twin visual display and early warning system based on knowledge graph | |
| CN114023134B (en) | Digital information electric power simulation training system | |
| CN113779125A (en) | Construction safety information management method and system | |
| CN112907415A (en) | Laboratory safety inspection system and method for multi-person patrol | |
| CN116151771B (en) | Construction project management and control method and system under multi-configuration heterogeneous Internet of things | |
| CN118053216B (en) | Personnel attendance intelligent management system based on electronic fence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211019 |
|
| RJ01 | Rejection of invention patent application after publication |