CN113783305A - AR-based power station integrated management method, system and server - Google Patents
AR-based power station integrated management method, system and server Download PDFInfo
- Publication number
- CN113783305A CN113783305A CN202111134860.0A CN202111134860A CN113783305A CN 113783305 A CN113783305 A CN 113783305A CN 202111134860 A CN202111134860 A CN 202111134860A CN 113783305 A CN113783305 A CN 113783305A
- Authority
- CN
- China
- Prior art keywords
- data
- communication
- power station
- real
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00001—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by the display of information or by user interaction, e.g. supervisory control and data acquisition systems [SCADA] or graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00002—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by monitoring
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
- H02J13/00022—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment using wireless data transmission
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B90/00—Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
- Y02B90/20—Smart grids as enabling technology in buildings sector
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S40/00—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them
- Y04S40/12—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them characterised by data transport means between the monitoring, controlling or managing units and monitored, controlled or operated electrical equipment
- Y04S40/126—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them characterised by data transport means between the monitoring, controlling or managing units and monitored, controlled or operated electrical equipment using wireless data transmission
Landscapes
- Engineering & Computer Science (AREA)
- Power Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention provides an AR-based power station integrated management method, system and server, wherein an AR intelligent device end is used for acquiring a real-time video of a first visual angle of a power station site, and the real-time video is remotely cooperated with a remote user end, so that multi-party remote conference and real-time interaction between site operation personnel and service experts and safety supervision personnel in various fields of a power system in the emergency and emergency repair operation processes of a power plant are realized, problems are diagnosed by technical means such as AR labeling, and the site operation personnel are guided to investigate potential fault points, remotely supervise safety operation and the like; and a wireless network group is constructed according to the field network environment condition of the power station, so that the wireless network coverage of the power station is realized, and a reliable and stable high-quality wireless network transmission environment is provided for AR intelligent operation and maintenance and remote cooperation.
Description
Technical Field
The invention relates to the technical field of communication, in particular to an AR-based power station integrated management method, system and server.
Background
At present, the problems of wide distribution area, long distance, complicated equipment, insufficient professional level of personnel, difficult field operation and maintenance management and low efficiency exist in the field operation and maintenance management polling working process of a power station, and the problems of insufficient supervision, negative polling, incapability of timely and accurately mastering the field equipment operation condition and difficult defect handling of managers and the like exist in the traditional polling mode.
Disclosure of Invention
In order to overcome the technical defects, the invention aims to provide a high-efficiency and high-accuracy AR-based power station integrated management method, system and server for remote cooperative guidance.
The invention discloses an AR-based power station integrated management method, which comprises the following steps: the AR intelligent device collects field data of the power station, identifies the field data, judges a corresponding device number and acquires the state information of the current device; tracking the target object through the field data, and starting target detection to recover the tracking when the tracking fails; carry out holographic communication between AR smart machine, cloud platform and one or more clients, holographic communication includes: compressing data to be transmitted into different types of multimedia data formats; the AR intelligent equipment acquires and displays the operation data of the power station equipment through the cloud platform; the AR intelligent equipment sends the collected field data to the cloud platform and the user side; the user end carries out AR labeling on the data acquired in the holographic communication process, and sends the data after the AR labeling to the AR intelligent equipment and the cloud platform, wherein the data acquired in the holographic communication process comprises the field data; carrying out a virtual-real fusion process on the holographic communication data; encryption management is adopted in the holographic communication process, and the encryption management comprises local area network address filtering, equipment white list limitation, temporary equipment account password access, service set identification management, wired equivalent privacy protocol encryption, advanced encryption standard encryption, temporary key integrity protocol, authority division according to user names and communication flow abnormity monitoring; performing cross-site scripting attack prevention and server injection attack prevention on the AR intelligent device, the cloud platform and one or more user sides; the cross-site scripting attack prevention method comprises the following steps: establishing a unique hypertext transfer protocol identifier on data stored locally at a user terminal; using content security policies and nonce attributes; filtering input data, encoding output data, and performing targeted encoding according to the context of the data; the server prevents injection attacks and comprises the following steps: error display of a web server in a production environment is not started; checking, filtering and escaping all variable inputs from the outside; forbidding to use a pure computer language and using a computer language with precompiled bound variables; and setting the management authority of the database account, and not using a root user to connect the database.
Preferably, the multimedia data format includes a video format, an audio format, a multimedia format, and an interactive instruction format.
Preferably, the identifying the field data includes: shooting to obtain a real-time picture of the field power station equipment; matching the real-time picture with a plurality of contrast pictures in a preset contrast picture set, wherein the contrast picture with the largest matching rate is defined as a target picture in the identification process; acquiring the equipment number and the equipment state information associated with the target picture; or extracting key information from the real-time picture, matching the key information with a plurality of pieces of comparison information in a preset comparison information set, and defining the piece of comparison information with the maximum matching rate as the target information of the identification process; the destination information includes the device number and the state information of the device.
Preferably, the process of fusing the holographic data includes: setting a virtual data packet, wherein the virtual data packet comprises preset contents of a plurality of communication images and videos; acquiring shot real data through AR intelligent equipment and a user side; and geometrically transforming the virtual data and the real data to realize the mutual alignment of the virtual data and the real data, and finally obtaining the fused enhanced image and the enhanced video.
Preferably, the tracking of the target object by the field data includes: shooting to obtain a real-time picture of the field power station equipment; extracting feature point information of the real-time picture; and calculating the space attitude according to the characteristic point information, wherein the space attitude comprises a multi-image attitude, an anti-shielding attitude, a large-dip-angle attitude, a long-distance attitude, a motion fuzzy attitude and a light ray change attitude.
Preferably, the holographic communication between the AR smart device, the cloud platform, and one or more user terminals includes: when only two communication main bodies exist, the communication data is directly transmitted between the two devices where the communication main bodies are located through TCP/IP; and when the number of the communication main bodies is more than two, performing calculation processing on the communication process through the cloud server.
Preferably, the performing, by the user end, AR labeling on the data acquired in the holographic communication process, and sending the data after AR labeling to the AR intelligent device and the cloud platform includes: in the process of communicating a plurality of communication main bodies, the communication main bodies at the administrator level in the plurality of communication main bodies carry out picture interception on a real-time playing video and simultaneously transmit the image to other communication main bodies; in the process of communication of the communication main bodies, the communication main body at the administrator level in the communication main bodies selects one of a plurality of videos being transmitted to transmit in a first preset resolution format, and the other videos are transmitted in a second preset resolution format, wherein the first preset resolution is larger than the second preset resolution; in the communication process of the communication main bodies, the communication main bodies at the administrator level in the communication main bodies control the shooting parameters of the AR intelligent equipment terminal, and the shooting parameters comprise shooting angles, focusing and zooming.
Preferably, the holographic communication between the AR smart device, the cloud platform, and one or more user terminals further includes: and creating a real-time conversation room, and entering the real-time conversation room through the communication subject verified by the account number to perform holographic communication.
The invention also discloses an AR-based power station integrated management system, which comprises an AR intelligent device end, a user end and a cloud platform management end which are connected with each other; the user side comprises a mobile phone, a tablet and a computer; the AR intelligent device collects field data of the power station, identifies the field data, judges a corresponding device number and acquires the state information of the current device; tracking the target object through the field data, and starting target detection to recover the tracking when the tracking fails; the AR smart device, cloud platform management end and one or more carry out holographic communication between the user side, holographic communication includes: compressing data to be transmitted into different types of multimedia data formats, wherein the multimedia data formats comprise a video format, an audio format, a multimedia format and an interactive instruction format; the AR intelligent equipment acquires and displays the operation data of the power station equipment through the cloud platform management end; the AR intelligent device sends the collected field data to the cloud platform management end and the user end; the user end carries out AR labeling on the data acquired in the holographic communication process, and sends the data after the AR labeling to the AR intelligent equipment and the cloud platform management end, wherein the data acquired in the holographic communication process comprises the field data; carrying out a virtual-real fusion process on the holographic communication data; encryption management is adopted in the holographic communication process, and the encryption management comprises local area network address filtering, equipment white list limitation, temporary equipment account password access, service set identification management, wired equivalent privacy protocol encryption, advanced encryption standard encryption, temporary key integrity protocol, authority division according to user names and communication flow abnormity monitoring; performing cross-site scripting attack prevention and server injection attack prevention on the AR intelligent device, the cloud platform management end and one or more user ends; the cross-site scripting attack prevention method comprises the following steps: establishing a unique hypertext transfer protocol identifier on data stored locally at the user terminal; using content security policies and nonce attributes; filtering input data, encoding output data, and performing targeted encoding according to the context of the data; the server prevents injection attacks and comprises the following steps: error display of a web server in a production environment is not started; checking, filtering and escaping all variable inputs from the outside; forbidding to use a pure computer language and using a computer language with precompiled bound variables; and setting the management authority of the database account, and not using a root user to connect the database.
The invention also discloses a server, which is used for the AR-based power station integrated management method and comprises a node service module, a message service module, a file service module, an account service module, an AR intelligent device service module, a background service module, an application service module, a database service module, a process manager module, a cache service module and a programming service module.
After the technical scheme is adopted, compared with the prior art, the method has the following beneficial effects:
1. the method comprises the steps that an AR intelligent device end is used for obtaining a real-time video of a first visual angle of a power station site, the real-time video and a remote user end are in remote cooperation, multi-party remote conferences and real-time interaction of site operation personnel, service experts and safety supervision personnel in various fields of a power system in the emergency and emergency repair operation processes of the power plant are achieved, problems are diagnosed through technical means such as AR labeling, and the site operation personnel are guided to investigate potential fault points, remote safety operation supervision and the like;
2. according to the field network environment condition of the power station, a wireless network group is constructed, wireless network coverage of the power station is realized, and a reliable and stable high-quality wireless network transmission environment is provided for AR intelligent operation and maintenance and remote cooperation;
3. the operation and maintenance processes of the power station are integrated into the AR glasses, the operation and maintenance processes of the inspection personnel are standardized through the AR glasses, the inspection personnel can efficiently complete operation and maintenance operation according to the operation and maintenance steps displayed in the glasses, the problems of missed inspection and false inspection caused by human negligence or subjective intention are effectively avoided, and the inspection working quality is improved;
4. the method takes the requirements of information security into full consideration, achieves the security management requirements in the aspects of access control, attack prevention, virus prevention, security audit and the like in the aspects of an operating system, a database system, network application and the like, and ensures that the system has high security in the whole from the aspects of user authentication, authorization and the like, and data security such as backup, disaster tolerance and the like.
Drawings
FIG. 1 is a flow chart of an AR-based integrated management method for a power station provided by the present invention;
fig. 2 is a block diagram of an implementation of the AR-based integrated management method for a power station according to the present invention.
Detailed Description
The advantages of the invention are further illustrated in the following description of specific embodiments in conjunction with the accompanying drawings.
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
In the description of the present invention, it is to be understood that the terms "longitudinal", "lateral", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like, indicate orientations or positional relationships based on those shown in the drawings, and are used merely for convenience of description and for simplicity of description, and do not indicate or imply that the referenced devices or elements must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, are not to be construed as limiting the present invention.
In the description of the present invention, unless otherwise specified and limited, it is to be noted that the terms "mounted," "connected," and "connected" are to be interpreted broadly, and may be, for example, a mechanical connection or an electrical connection, a communication between two elements, a direct connection, or an indirect connection via an intermediate medium, and specific meanings of the terms may be understood by those skilled in the art according to specific situations.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
Referring to fig. 1-2, the present invention discloses an AR-based integrated management method for a power station, in which an AR smart device collects field data of the power station, identifies the field data, determines a device number corresponding to the field data, and obtains status information of a current device. AR smart devices are typically AR glasses.
Specifically, the field data includes routing inspection information, equipment status, inspection steps, maintenance records, and the like. The identification processing is carried out on the data, and the method mainly comprises the following steps: two-dimensional image recognition and OCR recognition. The identification is to identify the pictures existing in the power station operation and maintenance and overhaul application scene in an image feature point matching mode.
The two-dimensional image recognition includes device image recognition and identification code recognition. And the two-dimensional image recognition application confirms the identity of the target equipment through a preset recognition image by a two-dimensional recognition algorithm. The identification process comprises the steps of uploading an identification chart, associating equipment with information and displaying the information. The identification graph uploading and the equipment and information association are completed through the AR cloud platform, and the associated information data are displayed through AR glasses.
For the environment which is complex and inconvenient for identity confirmation in an image recognition mode, the invention recognizes the target equipment in a two-dimensional code or bar code or other identification code mode. The identification process includes identification code making, device-to-information association, information display, etc., and is similar to device image identification and is not described herein again.
The OCR recognition technology is mainly used for recognizing equipment parts such as a power station operation and maintenance and field equipment nameplate, character labels and the like. And identifying the number corresponding to the equipment in real time through the AR glasses, and calling the relevant information in the background to the AR glasses for display through the number. The information association is carried out through an AR cloud platform, the operation and maintenance personnel wear AR glasses to collect images of OCR recognition objects of the front-end unit equipment, recognition is carried out through an OCR algorithm, and then association information display is carried out according to recognition results.
And tracking the target object through the field data, specifically, calculating the spatial attitude according to the characteristic point information of the identification picture. The spatial gestures include multi-image gestures, anti-occlusion gestures, large-dip-angle gestures, remote gestures, motion-blur gestures, and light-change gestures.
In addition, in the actual process, stable identification and tracking of a specific 3D object need to be realized, and the target tracking difficulty is high due to the fact that a scene is complex. Therefore, the invention is provided with a restarting and protecting mechanism after the target tracking fails, and the tracking can be recovered from the failure in real time by combining the target detection. In particular, a preferred embodiment combines a hybrid tracking strategy of visual and inertial sensors to achieve stable 3D object tracking.
According to the equipment identification result, the AR glasses display the running state data of the equipment through the AR cloud platform in an AR mode, so that the running state of the power station can be remotely visualized.
And moreover, in the inspection process, the records of photographing, recording and the like of the inspection process can be realized through AR glasses operation or voice instructions, the generated pictures and video files can be stored in the local storage space of the AR glasses and also can be transmitted back to the background storage space through a network to form a process record file, the recording and backtracking of the inspection operation can be realized, and an inspection knowledge base is formed.
The method comprises the steps that holographic communication is conducted among AR intelligent equipment, a cloud platform and one or more user sides, a holographic communication module is responsible for information sharing and remote interaction when multiple users cooperate, and a universal and flexible heterogeneous multi-terminal platform (such as AR glasses, head displays, mobile phones, flat panels, PCs and the like) is constructed so as to achieve seamless holographic communication among multiple different terminals.
Holographic communication information integration and information transmission.
The aim of information integration is to reasonably and automatically arrange various information involved in the cooperative remote maintenance guidance process of multiple persons into parts required by each terminal and compress the information into a format suitable for network transmission. These formats include both raw video and audio information (e.g., video of a factory site and calls between multiple terminals), multimedia material information related to tasks (e.g., material transmitted by experts to workers and related to maintenance instructions), interactive instruction information between multiple persons (e.g., expert's pointing to key parts in a scene), and related knowledge generated by the context understanding module. For multimedia information, mature multimedia coding and decoding technology is adopted; for other semantic or geometric information, the vectorization technology is adopted to perform lossless compression on the semantic or geometric information, and the compression efficiency is continuously optimized through a dictionary learning method.
The aim of information transmission is to transmit the AR information among all terminals in real time, so that seamless interaction among users participating in remote places is achieved.
And the user terminal performs AR labeling on the data acquired in the holographic communication process and sends the AR labeled data to the AR intelligent equipment and the cloud platform.
And performing a virtual-real fusion process on the data of the holographic communication, and presenting the output to a user in a terminal in a multimedia mode, so that AR information transmitted between the terminals is displayed on different terminals in real time. The device mainly comprises a software part and a hardware part. The key to the virtual-real fusion software part is the registration (also called alignment) between the virtual and real, with the purpose of establishing a geometric transformation between the virtual information and the real information (the real world as observed by the camera or through the lens in the AR glasses). The hardware part depends on the terminal equipment, and for most mature terminal forms such as mobile phones, PCs and tablets, due to the fact that the AR display mode of video perspective is adopted, the virtual-real fusion can be realized by the software part. For another part of the AR device, a natural optical perspective is used.
In order to ensure the wireless safe access, the invention adopts the following safety scheme, including:
1) local area network address filtering, which limits terminals with certain type of MAC address characteristics to enter the network;
2) the white list of the equipment is limited, the white list of the equipment which is allowed to be accessed is set through the white list of the equipment, and the equipment in the white list can be accessed to the network;
3) the temporary equipment account password is accessed, and equipment which is temporarily accessed to the network can be accessed in an account password login mode;
4) service set identification management, namely performing a logical identification on a network, requiring the management of the SSID service set identification on the messages sent by the terminal, and if the SSID identification does not exist, the network cannot be accessed;
5) the wired equivalent privacy protocol encryption is a static encryption mechanism, two communication parties have a common key, and an air interface information message sent by a terminal must be encrypted by using the common key;
6) advanced encryption standard encryption, a dynamic key management mechanism, and key generation based on an asymmetric key mechanism, and key management is also updated regularly, the time of an entity is set by a system, and is generally set to about 5 minutes, so that an illegal user needs to acquire enough messages within 5 minutes to match the messages to obtain a key, and the wireless air interface is basically impossible in view of the flow of wireless air interfaces;
8) the authority is divided according to the user name, namely the authority of the same user is kept consistent when the same user accesses the wireless network at different places; the key setting may be combined according to the SSID information and the user information, that is, the key generation of different users under different SSIDs may be different, so that the problem of serial numbers between users is guaranteed to a certain extent, thereby protecting investment and achieving operation and maintenance balance;
9) and monitoring communication flow abnormity, and realizing monitoring of flow abnormity and message abnormity, thereby protecting the further safety of the network.
Meanwhile, the method can be combined with authentication, preferably, a Radius charging authentication server is adopted, and the security of wireless access is integrally guaranteed.
Since a client is easy to generate Cross-site scripting (XSS), the method can be used for attacks such as privacy stealing, phishing and cheating, password stealing, malicious code spreading and the like. Malicious attackers put codes harmful to the user side on the server as webpage content, so that when other website users watch the webpage, the codes are injected into the browser of the user to be executed, and the user is attacked. Generally, with a cross-site scripting attack, an attacker can steal session COOKIE to steal the privacy of the website user, including passwords. The XSS attack mainly uses HTML and Javascript, and also comprises VBscript, Actionscript and the like. Although XSS attack has no direct harm to a WEB server, the XSS attack is spread by means of a website, so that a user using the website is attacked, the account number of the user of the website is stolen, and the website is seriously harmed.
The invention carries out cross-site scripting attack prevention on AR intelligent equipment, a cloud platform and one or more user sides, and comprises the following steps:
1) establishing a unique hypertext transfer protocol identifier (HTTP-OnlyCookie) on data stored locally at a user end, and combining the HTTP-OnlyCookie with other technologies for use;
2) using CSP content security policy and nonce attributes;
3) filtering the input data, encoding the output data, and performing targeted encoding for the context of the data, one preferred:
a) HTML coding in HTML label or label attribute value-;
b) in the HTML tag link attribute value- > URL coding;
c) in the HTML label event attribute value- > JavaScript escape + HTML coding;
d) in Script tag- > JavaScript escape;
e) in JSON data- > JavaScript escape + HTML coding;
f) callback Callback function name- > Callback escape;
g) others- > forbidden.
SQL injection attacks, i.e., attackers, execute unauthorized arbitrary query procedures by spoofing a database server. The SQL injection attack is essentially based on the syntax of SQL, which aims at the vulnerability of an application program developer in the programming process, and occurs when the attacker can operate data and insert some SQL sentences into the application program. In fact, the SQL injection attack is an attacker that spoofs the database server to execute an unauthorized arbitrary query by adding an extra SQL statement element to the end of a predefined query statement in an application. SQL injection vulnerabilities are currently the most common and very widely-affected vulnerabilities of the internet.
Therefore, the invention implements server injection attack prevention on AR intelligent equipment, a cloud platform and one or more user sides, and comprises the following steps: error display of a web server in a production environment is not started; checking, filtering and escaping all variable inputs from the outside; the method comprises the following steps of prohibiting using a plain SQL (structured query language) pure computer language and using an SQL (structured query language) computer language with precompiled binding variables; and setting the management authority of the database account, and connecting the root of the root user with the database without using the root, and the like.
Preferably, when the information transmission only has two communication bodies, the communication data is directly transmitted between the devices where the two communication bodies are located through the TCP/IP; and when the number of the communication main bodies is more than two, performing calculation processing on the communication process through the cloud server.
Specifically, double cooperation: when the system has only two users, e.g. a single worker and a single expert, a simple but efficient connection scheme will be used to transfer data directly between the two devices over TCP/IP.
Multi-person cooperation: when the system has more than two users, such as one worker and a plurality of experts, which are jointly maintained remotely, the cloud service is used for heavy computing work, such as target tracking and migration to a cloud server, the system not only ensures higher system efficiency, but also provides safer data transmission, and simultaneously supports many-to-many interactive cooperation (such as opinion exchange among experts), and the input and output equipment can be a desktop computer, a notebook computer, a mobile phone, a tablet, AR/VR glasses, a projector and the like.
Preferably, in the process of communication of the communication main bodies, the communication main body at the administrator level in the communication main bodies performs picture interception on the real-time playing video and simultaneously transmits the picture to the communication main bodies, so that the very fast screen freezing technology is realized, all video participants can acquire video images intercepted by the administrator at a speed close to real time, and the annotation information of the administrator on the screenshot can be obtained in real time.
In the process of communication of the communication main bodies, the communication main body at the administrator level in the communication main bodies selects one of a plurality of videos being transmitted to transmit in a first preset resolution format, and the other videos are transmitted in a second preset resolution format, wherein the first preset resolution is larger than the second preset resolution; in the process of communication of the communication main bodies, the communication main bodies at the administrator level in the communication main bodies control the shooting parameters of the AR intelligent equipment end, and the shooting parameters comprise shooting angles, focusing and zooming.
For example, when there are multiple parties in a room for a call and there are multiple video senders, in order to maintain high-definition transmission and reduce bandwidth requirements, only one video source transmits high-definition video at a time, the other video sources transmit low-definition video, and the video source selected for high-definition transmission is controlled by an administrator in the call process. In the remote assistance process, besides audio-video assistance, other assistance schemes are required.
Preferably, the holographic communication further comprises creating a real-time conversation room, and the communication subject authenticated by the account enters the real-time conversation room to perform holographic communication.
According to the invention, the AR glasses are used for quickly identifying the inspection equipment, and the equipment state information is quickly and accurately displayed through the butt joint with the power system of the power plant, so that inspection personnel can deal with problems at the first time, and the inspection work efficiency is improved; and the first visual angle picture on site is transmitted to a remote expert and a safety supervision worker in real time, the AR glasses are used for replacing relevant workers to 'arrive' at the operation and maintenance site, the problem of remote accurate positioning is assisted, and accurate guidance is provided for front-end operators.
The invention also discloses an AR-based power station integrated management system, which comprises an AR intelligent device end, a user end and a cloud platform management end which are connected with each other; the user side comprises a mobile phone, a tablet and a computer.
The AR intelligent device end comprises a user module and a task module, wherein the user module is used for realizing functions of user login, login state keep-alive, password modification, user logout and the like. The task module is used for realizing the functions of task list, task details, equipment information acquisition and display, job video shooting and uploading and the like.
The cloud platform management end comprises a user module, a role management module, a background user management module, a task management module, a log management module and a data interface module. The user module is used for realizing functions of user login, password modification, user logout and the like. The role management module is used for realizing functions of adding roles (creating different system roles according to needs and distributing the authority of the roles), editing roles (editing roles, including role names and authority modification), role list (listing all roles of the system), role state setting (state including activation and deactivation, after one role is deactivated, a user belonging to the role cannot log in the system), role deletion and the like. The background user management module is used for realizing functions of adding users, editing user information, user lists, setting user states, deleting users and the like. The task management module is used for realizing the functions of creating tasks, editing tasks, canceling tasks, deleting tasks, checking task pictures, deleting pictures, checking job videos, deleting job videos and the like. The log management module is used for realizing functions of operation log recording, log lists and the like. The data interface module is used for realizing a login interface, a keep-alive interface, a logout interface, a task list interface, a task detail interface, a picture uploading interface, a video uploading interface and an equipment information interface.
Specifically, the AR intelligent device collects field data of the power station, identifies the field data, judges a corresponding device number and acquires state information of the current device, tracks a target object through the field data, and starts target detection to recover tracking when tracking fails.
Carry out holographic communication between AR smart machine, cloud platform management end and one or more user side, holographic communication includes: compressing data to be transmitted into different types of multimedia data formats, wherein the multimedia data formats comprise a video format, an audio format, a multimedia format and an interactive instruction format; the AR intelligent equipment acquires and displays the operation data of the power station equipment through the cloud platform management terminal; the AR intelligent equipment sends the collected field data to a cloud platform management end and a user end; the user terminal performs AR labeling on data acquired in the holographic communication process and sends the AR labeled data to the AR intelligent equipment and the cloud platform management terminal; and carrying out a virtual-real fusion process on the data of the holographic communication.
The holographic communication system also comprises a wireless network module, wherein encryption management is adopted in the holographic communication process and comprises local area network address filtering, equipment white list limitation, temporary equipment account password access, service set identification management, wired equivalent privacy protocol encryption, advanced encryption standard encryption, temporary key integrity protocol, authority division according to a user name and communication flow abnormity monitoring.
And the anti-cross-site scripting attack and the server anti-injection attack are also carried out on the AR intelligent equipment, the cloud platform management end and one or more user ends.
The cross-site scripting attack prevention method comprises the following steps: establishing a unique hypertext transfer protocol identifier on data stored locally at a user terminal; using content security policies and nonce attributes; the input data is filtered, the output data is encoded, and the context of the data is specifically encoded.
The server prevents the injection attack and comprises the following steps: error display of a web server in a production environment is not started; checking, filtering and escaping all variable inputs from the outside; forbidding to use a pure computer language and using a computer language with precompiled bound variables; and setting the management authority of the database account, and not using a root user to connect the database.
The invention also discloses a server, which is used for the AR-based power station integrated management method and comprises the following steps:
the node service module comprises an imgate service and an MCUServer service, wherein the imgate service is responsible for a gateway of an access layer and handles long connection between a user side and a server;
and the message service module comprises several services of roomsvr, msgsvr, statussvr, msgdbg, mculogsvr, pyimquerysvr and pyimdependsvr. The Roomsvr service is responsible for room service, and provides session management logic, temporary sessions and the like before audio and video real-time streams; the msgsvr service is responsible for point-to-point private chat service; the statussvr service is responsible for a user state server and caches the route of the user; the msgdbg service is responsible for the storage gateway service of the message logic; the mculogsvr is responsible for storage gateway service of audio and video communication; the pyimquerysvr service is responsible for querying the status of im; the pyimdependsvr service is responsible for relieving dependencies;
the file service module is used for transmitting files and freezing screen functions between the user terminals, the user terminals upload local files to the fileserver through a Post mode, correct file downloading urls are obtained after uploading is successful, the user terminals distribute the downloading urls to other user terminals, and the other user terminals can download the files to the local through the urls;
the account service module is used for providing services of user management and user information verification, running an AR intelligent equipment service module as basic service of the whole system, and providing API access of basic service for a user side, such as services of obtaining user information, obtaining a contact list, managing (adding, deleting and modifying) contacts, modifying passwords, registering users and the like;
and the background service module comprises the functions of enterprise management, user management, role management, system logs, statistical information and the like.
The system also comprises a service module based on a Linux operating system: the system comprises a nginx application service module, a mysql and mongodb database service module, a FastCGI process manager module, a redis cache service module and a java and python programming service module.
It should be noted that the embodiments of the present invention have been described in terms of preferred embodiments, and not by way of limitation, and that those skilled in the art can make modifications and variations of the embodiments described above without departing from the spirit of the invention.
Claims (10)
1. An AR-based power station integrated management method is characterized by comprising the following steps:
the AR intelligent device collects field data of the power station, identifies the field data, judges a corresponding device number and acquires the state information of the current device; tracking the target object through the field data, and starting target detection to recover the tracking when the tracking fails;
carry out holographic communication between AR smart machine, cloud platform and one or more clients, holographic communication includes: compressing data to be transmitted into different types of multimedia data formats; the AR intelligent equipment acquires and displays the operation data of the power station equipment through the cloud platform; the AR intelligent equipment sends the collected field data to the cloud platform and the user side; the user end carries out AR labeling on the data acquired in the holographic communication process, and sends the data after the AR labeling to the AR intelligent equipment and the cloud platform, wherein the data acquired in the holographic communication process comprises the field data;
carrying out a virtual-real fusion process on the holographic communication data;
encryption management is adopted in the holographic communication process, and the encryption management comprises local area network address filtering, equipment white list limitation, temporary equipment account password access, service set identification management, wired equivalent privacy protocol encryption, advanced encryption standard encryption, temporary key integrity protocol, authority division according to user names and communication flow abnormity monitoring;
performing cross-site scripting attack prevention and server injection attack prevention on the AR intelligent device, the cloud platform and one or more user sides;
the cross-site scripting attack prevention method comprises the following steps: establishing a unique hypertext transfer protocol identifier on data stored locally at a user terminal; using content security policies and nonce attributes; filtering input data, encoding output data, and performing targeted encoding according to the context of the data;
the server prevents injection attacks and comprises the following steps: error display of a web server in a production environment is not started; checking, filtering and escaping all variable inputs from the outside; forbidding to use a pure computer language and using a computer language with precompiled bound variables; and setting the management authority of the database account, and not using a root user to connect the database.
2. The power plant integrated management method of claim 1, wherein the multimedia data formats comprise video formats, audio formats, multimedia formats, interactive command formats.
3. The power plant integrated management method of claim 1, wherein the identifying the field data comprises:
shooting to obtain a real-time picture of the field power station equipment;
matching the real-time picture with a plurality of contrast pictures in a preset contrast picture set, wherein the contrast picture with the largest matching rate is defined as a target picture in the identification process; acquiring the equipment number and the equipment state information associated with the target picture;
or extracting key information from the real-time picture, matching the key information with a plurality of pieces of comparison information in a preset comparison information set, and defining the piece of comparison information with the maximum matching rate as the target information of the identification process; the destination information includes the device number and the state information of the device.
4. The power station integrated management method according to claim 1, wherein the virtual-real fusion process of the holography data comprises:
setting a virtual data packet, wherein the virtual data packet comprises preset contents of a plurality of communication images and videos;
acquiring shot real data through AR intelligent equipment and a user side;
and geometrically transforming the virtual data and the real data to realize the mutual alignment of the virtual data and the real data, and finally obtaining the fused enhanced image and the enhanced video.
5. The power station integrated management method according to claim 1, wherein the tracking of the target object by the field data comprises:
shooting to obtain a real-time picture of the field power station equipment;
extracting feature point information of the real-time picture;
and calculating the space attitude according to the characteristic point information, wherein the space attitude comprises a multi-image attitude, an anti-shielding attitude, a large-dip-angle attitude, a long-distance attitude, a motion fuzzy attitude and a light ray change attitude.
6. The power station integrated management method of claim 1, wherein the performing holographic communications between the AR smart device, the cloud platform, and one or more clients comprises:
when only two communication main bodies exist, the communication data is directly transmitted between the two devices where the communication main bodies are located through TCP/IP;
and when the number of the communication main bodies is more than two, performing calculation processing on the communication process through the cloud server.
7. The power station integrated management method of claim 1, wherein the performing, by the user end, AR labeling on the data acquired in the holographic communication process, and sending the data after AR labeling to the AR smart device and the cloud platform comprises:
in the process of communicating a plurality of communication main bodies, the communication main bodies at the administrator level in the plurality of communication main bodies carry out picture interception on a real-time playing video and simultaneously transmit the image to other communication main bodies;
in the process of communication of the communication main bodies, the communication main body at the administrator level in the communication main bodies selects one of a plurality of videos being transmitted to transmit in a first preset resolution format, and the other videos are transmitted in a second preset resolution format, wherein the first preset resolution is larger than the second preset resolution;
in the communication process of the communication main bodies, the communication main bodies at the administrator level in the communication main bodies control the shooting parameters of the AR intelligent equipment terminal, and the shooting parameters comprise shooting angles, focusing and zooming.
8. The power station integrated management method of claim 1, wherein the performing holographic communications between the AR smart device, the cloud platform, and one or more clients further comprises:
and creating a real-time conversation room, and entering the real-time conversation room through the communication subject verified by the account number to perform holographic communication.
9. An AR-based power station integrated management system is characterized by comprising an AR intelligent device end, a user end and a cloud platform management end which are connected with each other; the user side comprises a mobile phone, a tablet and a computer;
the AR intelligent device collects field data of the power station, identifies the field data, judges a corresponding device number and acquires the state information of the current device; tracking the target object through the field data, and starting target detection to recover the tracking when the tracking fails;
the AR smart device, cloud platform management end and one or more carry out holographic communication between the user side, holographic communication includes: compressing data to be transmitted into different types of multimedia data formats, wherein the multimedia data formats comprise a video format, an audio format, a multimedia format and an interactive instruction format; the AR intelligent equipment acquires and displays the operation data of the power station equipment through the cloud platform management end; the AR intelligent device sends the collected field data to the cloud platform management end and the user end; the user end carries out AR labeling on the data acquired in the holographic communication process, and sends the data after the AR labeling to the AR intelligent equipment and the cloud platform management end, wherein the data acquired in the holographic communication process comprises the field data;
carrying out a virtual-real fusion process on the holographic communication data;
encryption management is adopted in the holographic communication process, and the encryption management comprises local area network address filtering, equipment white list limitation, temporary equipment account password access, service set identification management, wired equivalent privacy protocol encryption, advanced encryption standard encryption, temporary key integrity protocol, authority division according to user names and communication flow abnormity monitoring;
performing cross-site scripting attack prevention and server injection attack prevention on the AR intelligent device, the cloud platform management end and one or more user ends;
the cross-site scripting attack prevention method comprises the following steps: establishing a unique hypertext transfer protocol identifier on data stored locally at the user terminal; using content security policies and nonce attributes; filtering input data, encoding output data, and performing targeted encoding according to the context of the data;
the server prevents injection attacks and comprises the following steps: error display of a web server in a production environment is not started; checking, filtering and escaping all variable inputs from the outside; forbidding to use a pure computer language and using a computer language with precompiled bound variables; and setting the management authority of the database account, and not using a root user to connect the database.
10. A server, characterized in that, the AR-based integrated management method for power stations in any one of the above claims 1 to 8 includes a node service module, a message service module, a file service module, an account service module, an AR smart device service module, a background service module, an application service module, a database service module, a process manager module, a cache service module, and a programming service module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111134860.0A CN113783305B (en) | 2021-09-27 | 2021-09-27 | AR-based power station integrated management method, system and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111134860.0A CN113783305B (en) | 2021-09-27 | 2021-09-27 | AR-based power station integrated management method, system and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113783305A true CN113783305A (en) | 2021-12-10 |
| CN113783305B CN113783305B (en) | 2023-10-20 |
Family
ID=78853670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111134860.0A Active CN113783305B (en) | 2021-09-27 | 2021-09-27 | AR-based power station integrated management method, system and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113783305B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117676072A (en) * | 2024-01-31 | 2024-03-08 | 国网湖北省电力有限公司信息通信公司 | AR-based multi-person complex interactive conference method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111146865A (en) * | 2019-12-25 | 2020-05-12 | 上海电力大学 | Intelligent monitoring system for operation and maintenance state of power equipment |
| CN111679740A (en) * | 2020-06-06 | 2020-09-18 | 西安热工研究院有限公司 | Method for carrying out remote intelligent diagnosis on power station equipment by using Augmented Reality (AR) technology |
| CN111738459A (en) * | 2020-05-30 | 2020-10-02 | 国网河北省电力有限公司石家庄供电分公司 | Holographic expert system is examined in communication dispatch operation based on AR technique |
| CN112399072A (en) * | 2020-09-15 | 2021-02-23 | 国网浙江省电力有限公司湖州供电公司 | VR live-action system for monitoring switch station data of power distribution room in real time |
| CN113096477A (en) * | 2021-04-09 | 2021-07-09 | 国核电力规划设计研究院有限公司 | Visual operation and maintenance work platform of virtual power station |
-
2021
- 2021-09-27 CN CN202111134860.0A patent/CN113783305B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111146865A (en) * | 2019-12-25 | 2020-05-12 | 上海电力大学 | Intelligent monitoring system for operation and maintenance state of power equipment |
| CN111738459A (en) * | 2020-05-30 | 2020-10-02 | 国网河北省电力有限公司石家庄供电分公司 | Holographic expert system is examined in communication dispatch operation based on AR technique |
| CN111679740A (en) * | 2020-06-06 | 2020-09-18 | 西安热工研究院有限公司 | Method for carrying out remote intelligent diagnosis on power station equipment by using Augmented Reality (AR) technology |
| CN112399072A (en) * | 2020-09-15 | 2021-02-23 | 国网浙江省电力有限公司湖州供电公司 | VR live-action system for monitoring switch station data of power distribution room in real time |
| CN113096477A (en) * | 2021-04-09 | 2021-07-09 | 国核电力规划设计研究院有限公司 | Visual operation and maintenance work platform of virtual power station |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117676072A (en) * | 2024-01-31 | 2024-03-08 | 国网湖北省电力有限公司信息通信公司 | AR-based multi-person complex interactive conference method and device |
| CN117676072B (en) * | 2024-01-31 | 2024-04-09 | 国网湖北省电力有限公司信息通信公司 | AR-based multi-person complex interactive conference method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113783305B (en) | 2023-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105069880B (en) | A kind of method and system of the mobile terminal access control based on converged communication | |
| CN104639624B (en) | A kind of method and apparatus for realizing mobile terminal remote access control | |
| CN105959618A (en) | Method of robot remote control | |
| CN105827624B (en) | A kind of authentication system | |
| CN107770137A (en) | A kind of information processing method and device | |
| CN111953656B (en) | Method, device, equipment and medium for monitoring video encryption transmission | |
| CN110012322B (en) | Method and system for initiating video networking service | |
| CN106982355A (en) | The video monitoring system and anti-leak server of a kind of anti-image leakage | |
| CN113783305B (en) | AR-based power station integrated management method, system and server | |
| CN102811369B (en) | Security authentication method during video sharing and handheld equipment | |
| CN114079971A (en) | Service flow management and control method, system, DPI node and storage medium | |
| CN104113547A (en) | SIP (session initiation protocol) security protection video monitoring network access control system | |
| CN111200762B (en) | Watermarking and tracing system and method based on real-time online video sharing and browsing | |
| CN108712369A (en) | A kind of more attribute constraint access control decision system and method for industrial control network | |
| CN104717127B (en) | Method, terminal and the system of contact person's triggering are realized based on image recognition | |
| CN103475491A (en) | Remote maintenance system which is logged in to safely without code and achieving method | |
| CN108235111A (en) | Information sharing method and Intelligent set top box | |
| CN117715048A (en) | Telecommunication fraud recognition method, device, electronic equipment and storage medium | |
| CN117319596A (en) | Information security system and method for video conference based on face recognition | |
| CN108184091A (en) | A kind of video monitoring equipment dispositions method and device | |
| CN105992206A (en) | Enterprise safety management method, equipment and system | |
| CN105430345A (en) | Method for remote monitoring of comprehensive video training platform | |
| CN110312101B (en) | Implementation method of portable real-time mobile portrait deployment and control system | |
| CN112272181B (en) | Live broadcast method based on block chain, electronic equipment and computer readable storage medium | |
| CN114640487B (en) | GB35114 standard real-time detection system and method for avoiding interruption of operation of video monitoring equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |