CN116016659A - Power data processing method, device, system and storage medium - Google Patents
Power data processing method, device, system and storage medium Download PDFInfo
- Publication number
- CN116016659A CN116016659A CN202211409830.0A CN202211409830A CN116016659A CN 116016659 A CN116016659 A CN 116016659A CN 202211409830 A CN202211409830 A CN 202211409830A CN 116016659 A CN116016659 A CN 116016659A
- Authority
- CN
- China
- Prior art keywords
- data
- calculation result
- power
- power data
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000003672 processing method Methods 0.000 title claims description 13
- 238000004364 calculation method Methods 0.000 claims abstract description 74
- 238000012545 processing Methods 0.000 claims abstract description 49
- 238000000034 method Methods 0.000 claims abstract description 13
- 238000012795 verification Methods 0.000 claims description 10
- 238000013500 data storage Methods 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 abstract description 12
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 241000700605 Viruses Species 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a method, a device, a system and a storage medium for processing electric power data, and belongs to the technical field of data processing. The method comprises the following steps: receiving power data from a terminal device; judging whether a data processing program corresponding to the power data exists or not; if the data processing program corresponding to the power data does not exist, acquiring the data processing program corresponding to the power data from the central node; processing unstructured data in the power data into structured data; processing the structured data based on the data processing program to obtain a data calculation result; and storing the data calculation result. The method of the invention reduces the data transmission pressure between the central node and the edge node.
Description
Technical Field
The invention belongs to the technical field of data processing, and particularly relates to a method, a device, a system and a storage medium for processing electric power data.
Background
In the traditional scheme, collected power data are generally uniformly transmitted to a data center for processing, however, the data size of the power data is large, the transmission cost for uniformly transmitting the power data to the rear end for processing is high, and meanwhile, the problems of blockage of a transmission channel, data loss and the like are easily caused by transmitting a large amount of data.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a power data processing method, a device, a system and a storage medium.
The aim of the invention is realized by the following technical scheme:
according to a first aspect of the present invention, a power data processing method includes:
receiving power data from a terminal device;
judging whether a data processing program corresponding to the power data exists or not;
if the data processing program corresponding to the power data does not exist, acquiring the data processing program corresponding to the power data from the central node;
processing unstructured data in the power data into structured data;
processing the structured data based on the data processing program to obtain a data calculation result;
and storing the data calculation result.
Further, receiving power data from the device terminal, comprising:
judging whether the terminal equipment is registered or not;
and if the terminal equipment is registered, the power data is accepted, otherwise, the power data is refused.
Further, receiving the power data from the terminal device, further includes:
and verifying the safety of the power data, and rejecting the power data if the safety verification is not passed.
Further, storing the data calculation result includes:
judging whether the data calculation result meets a preset condition or not;
if the data calculation result meets the preset condition, the data calculation result is sent to a central node;
and if the data calculation result does not meet the preset condition, storing the data calculation result locally.
Further, when the data calculation result is sent to the central node, the data calculation result is backed up locally.
Further, sending the data calculation result to a central node, including:
combining the data calculation result with a preset identity to form a data packet;
encrypting the data packet;
and sending the encrypted data packet to a central node.
According to a second aspect of the present invention, a power data processing apparatus includes:
a data receiving module for receiving power data from the terminal device;
the algorithm calling module is used for judging whether a data processing program corresponding to the power data exists or not, and acquiring the data processing program corresponding to the power data from a central node when the data processing program corresponding to the power data does not exist;
the data processing module is used for processing unstructured data in the power data into structured data and processing the structured data based on the data processing program to obtain a data calculation result;
and the data storage module is used for storing the data calculation result.
Further, the data storage module is specifically configured to determine whether the data calculation result meets a preset condition, send the data calculation result to a central node when the data calculation result meets the preset condition, and store the data calculation result locally when the data calculation result does not meet the preset condition.
According to a third aspect of the invention, a power data processing system comprises:
an edge node for receiving power data from a terminal device; judging whether a data processing program corresponding to the power data exists or not; if the data processing program corresponding to the power data does not exist, acquiring the data processing program corresponding to the power data from the central node; processing unstructured data in the power data into structured data; processing the structured data based on the data processing program to obtain a data calculation result; storing the data calculation result;
and the central node is used for receiving the request from the edge node and sending a corresponding data processing program to the edge node according to the request.
According to a fourth aspect of the present invention, a storage medium includes a storage program, wherein the program, when executed, controls a device in which the storage medium is located to perform a power data processing method according to the first aspect of the present invention.
The beneficial effects of the invention are as follows: in the invention, the central node transmits the data processing algorithm to the edge computing node, the edge technology node provides computing power to process the local power data, and the data is not required to be transmitted back to the central node for unified processing, thereby reducing the data transmission pressure between the central node and the edge node.
Drawings
FIG. 1 is a flowchart of an embodiment of a power data processing method in the present embodiment;
FIG. 2 is a block diagram showing an embodiment of a power data processing apparatus in the present embodiment;
FIG. 3 is a block diagram of one embodiment of a power data processing system in this embodiment.
Detailed Description
The technical solutions of the present invention will be clearly and completely described below with reference to the embodiments, and it is apparent that the described embodiments are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by a person skilled in the art without any inventive effort, are intended to be within the scope of the present invention, based on the embodiments of the present invention.
Referring to fig. 1-3, the present embodiment provides a method, an apparatus, a system, and a storage medium for processing electric power data:
one embodiment of a power data processing method provided by the invention comprises the following steps: as shown in fig. 1, a power data processing method includes:
s100, the edge node receives power data from the terminal equipment.
In one embodiment, receiving power data from a device terminal includes:
s110, judging whether the terminal equipment is registered.
For example, whether the terminal equipment is in a preset registration list is judged, only the data sent by the terminal equipment in the registration list can be accepted, the reception of the power data sent by unregistered terminal equipment is avoided, and the safety is improved.
S120, if the terminal equipment is registered, the power data is accepted, otherwise, the power data is refused.
In one embodiment, for the power data which is not registered by the terminal device, after rejecting the power data, alarm information is sent to the central node so as to facilitate the investigation of related personnel, and the safety of the whole system is further improved.
In one embodiment, receiving power data from a terminal device further comprises: and verifying the safety of the power data, and rejecting the power data if the safety verification is not passed. For example, virus scanning is performed on the power data, the power data is rejected when the power data which fails the security verification is encountered, and alarm information is sent to a central node. Generally, security verification is performed on the received power data, and whether the terminal device is registered or not is judged after the security verification is passed.
S200, the edge node judges whether a data processing program corresponding to the power data exists locally, and if the data processing program corresponding to the power data does not exist, S300 is executed.
In general, if there is a data processing program corresponding to the power data, S400 is executed.
S300, the edge node acquires a data processing program corresponding to the power data from the central node.
In this embodiment, the central node issues the data processing algorithm (program) to the edge computing node, and the edge technology node provides computing power to process local data, so that the data does not need to be transmitted back to the central node for unified processing, the data transmission pressure between the central node and the edge node is reduced, the transmission channel can be prevented from being blocked, and the possibility of data loss is reduced.
S400, the edge node processes unstructured data in the power data into structured data.
For example, processing unstructured data in the power data into structured data includes: the edge node selects a corresponding model according to the type of unstructured data to extract key information, wherein the key information comprises names, storage paths and the like of the unstructured data, the algorithm model is a deep neural model or an LDA theme model and the like, and then the key information is converted into the structured data by utilizing a preset rule, so that the unstructured data can be managed by utilizing the converted key information.
S500, the edge node processes the structured data based on the data processing program to obtain a data calculation result.
S600, the edge node stores the data calculation result.
In one embodiment, storing the data calculation results includes: the edge node judges whether the data calculation result meets a preset condition or not; if the data calculation result meets the preset condition, the data calculation result is sent to a central node; and if the data calculation result does not meet the preset condition, storing the data calculation result locally. In this embodiment, only the selected calculation results (for example, calculation results corresponding to some selected power data) need to be transmitted to the central node, and all calculation results need not to be transmitted to the central node, so that the data transmission amount between the edge node and the central node is reduced.
Typically, the edge node locally backs up the data computation results while sending them to the central node. In the implementation, the calculation result transmitted to the central node is backed up locally, and even if data loss occurs in the transmission process, the backup data at the edge node can be used for retransmission, so that the reliability and the safety of the data are improved.
In one embodiment, sending the data calculation result to a central node includes: the edge node combines the data calculation result with a preset identity to form a data packet; encrypting the data packet; and sending the encrypted data packet to a central node. In the embodiment, the data packet is encrypted, so that the safety in the data transmission process is improved.
In general, the edge node combines the data calculation result with its own identity to form a data packet, and after receiving the data packet, the central node verifies the source of the data packet by using the identity in the data packet, and if the edge node sending the data packet is not in the white list of the central node, the central node refuses to receive the data packet. The central node verifies the source of the data packet, so that the safety is improved.
One embodiment of the present invention provides a power data processing apparatus including: as shown in fig. 2, a power data processing apparatus includes a data receiving module, an algorithm calling module, a data processing module, and a data storage module.
The data receiving module is used for receiving power data from the terminal equipment. In one embodiment, the data receiving module performs security verification on the received circuit data, and if the security verification is not passed, the power data is rejected. For example, operations such as virus scanning and source verification are performed on the power data, the power data is refused when the power data which fails the security verification is encountered, and alarm information is sent to the central node.
The algorithm calling module is used for judging whether a data processing program corresponding to the power data exists or not, and acquiring the data processing program corresponding to the power data from a central node when the data processing program corresponding to the power data does not exist. In this embodiment, the central node issues the data processing algorithm (program) to the edge computing node, and the edge technology node provides computing power to process local data, so that the data does not need to be transmitted back to the central node for unified processing, the data transmission pressure between the central node and the edge node is reduced, the transmission channel can be prevented from being blocked, and the possibility of data loss is reduced.
The data processing module is used for processing unstructured data in the electric power data into structured data, and processing the structured data based on the data processing program to obtain a data calculation result.
The data storage module is used for storing the data calculation result. In one embodiment, the data storage module determines whether the data calculation result meets a preset condition; if the data calculation result meets the preset condition, the data calculation result is sent to a central node; and if the data calculation result does not meet the preset condition, storing the data calculation result locally. In this embodiment, only the selected calculation results (for example, calculation results corresponding to some selected power data) need to be transmitted to the central node, and all calculation results need not to be transmitted to the central node, so that the data transmission amount between the edge node and the central node is reduced. Generally, the data storage module locally backs up the data calculation result while sending the data calculation result to the central node.
One embodiment of a power data processing system provided by the invention comprises: as shown in fig. 3, a power data processing system includes a central node and a plurality of edge nodes, the central node and the edge nodes being communicatively coupled.
The edge node is used for receiving power data from the terminal equipment; judging whether a data processing program corresponding to the power data exists or not; if the data processing program corresponding to the power data does not exist, acquiring the data processing program corresponding to the power data from the central node; processing unstructured data in the power data into structured data; processing the structured data based on the data processing program to obtain a data calculation result; and storing the data calculation result.
The central node is used for receiving the request from the edge node and sending a corresponding data processing program to the edge node according to the request. In one embodiment, the edge node combines the data calculation result with the own identity to form a data packet, and sends the data packet to the central node; and after receiving the data packet, the central node verifies the source of the data packet by using the identity mark in the data packet, and if the edge node for transmitting the data packet is not in the white list of the central node, the central node refuses to receive the data packet. The central node verifies the source of the data packet, so that the safety is improved.
One embodiment of a storage medium provided by the present invention includes: the storage medium includes a storage program, wherein the program, when executed, controls a device in which the storage medium is located to execute a power data processing method according to any one of the above embodiments.
The foregoing is merely a preferred embodiment of the invention, and it is to be understood that the invention is not limited to the form disclosed herein but is not to be construed as excluding other embodiments, but is capable of numerous other combinations, modifications and environments and is capable of modifications within the scope of the inventive concept, either as taught or as a matter of routine skill or knowledge in the relevant art. And that modifications and variations which do not depart from the spirit and scope of the invention are intended to be within the scope of the appended claims.
Claims (10)
1. A method of power data processing, comprising:
receiving power data from a terminal device;
judging whether a data processing program corresponding to the power data exists or not;
if the data processing program corresponding to the power data does not exist, acquiring the data processing program corresponding to the power data from the central node;
processing unstructured data in the power data into structured data;
processing the structured data based on the data processing program to obtain a data calculation result;
and storing the data calculation result.
2. The method of power data processing according to claim 1, wherein receiving power data from the device terminal comprises:
judging whether the terminal equipment is registered or not;
and if the terminal equipment is registered, the power data is accepted, otherwise, the power data is refused.
3. The power data processing method according to claim 2, wherein receiving the power data from the terminal device, further comprises:
and verifying the safety of the power data, and rejecting the power data if the safety verification is not passed.
4. A power data processing method according to claim 1, wherein storing the data calculation result includes:
judging whether the data calculation result meets a preset condition or not;
if the data calculation result meets the preset condition, the data calculation result is sent to a central node;
and if the data calculation result does not meet the preset condition, storing the data calculation result locally.
5. The power data processing method according to claim 4, wherein the data calculation result is backed up locally when the data calculation result is transmitted to a center node.
6. The method of claim 4, wherein transmitting the data calculation result to a central node comprises:
combining the data calculation result with a preset identity to form a data packet;
encrypting the data packet;
and sending the encrypted data packet to a central node.
7. A power data processing apparatus, comprising:
a data receiving module for receiving power data from the terminal device;
the algorithm calling module is used for judging whether a data processing program corresponding to the power data exists or not, and acquiring the data processing program corresponding to the power data from a central node when the data processing program corresponding to the power data does not exist;
the data processing module is used for processing unstructured data in the power data into structured data and processing the structured data based on the data processing program to obtain a data calculation result;
and the data storage module is used for storing the data calculation result.
8. The power data processing device according to claim 7, wherein the data storage module is specifically configured to determine whether the data calculation result satisfies a preset condition, send the data calculation result to a central node when the data calculation result satisfies the preset condition, and store the data calculation result locally when the data calculation result does not satisfy the preset condition.
9. A power data processing system, comprising:
an edge node for receiving power data from a terminal device; judging whether a data processing program corresponding to the power data exists or not; if the data processing program corresponding to the power data does not exist, acquiring the data processing program corresponding to the power data from the central node; processing unstructured data in the power data into structured data; processing the structured data based on the data processing program to obtain a data calculation result; storing the data calculation result;
and the central node is used for receiving the request from the edge node and sending a corresponding data processing program to the edge node according to the request.
10. A storage medium comprising a stored program, wherein the program, when run, controls a device in which the storage medium is located to perform a power data processing method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211409830.0A CN116016659A (en) | 2022-11-11 | 2022-11-11 | Power data processing method, device, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211409830.0A CN116016659A (en) | 2022-11-11 | 2022-11-11 | Power data processing method, device, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116016659A true CN116016659A (en) | 2023-04-25 |
Family
ID=86028644
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211409830.0A Withdrawn CN116016659A (en) | 2022-11-11 | 2022-11-11 | Power data processing method, device, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116016659A (en) |
-
2022
- 2022-11-11 CN CN202211409830.0A patent/CN116016659A/en not_active Withdrawn
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101966626B1 (en) | Method and apparatus for updating software of electronic devices in a vehicle | |
| CN105991412B (en) | Information push method and device | |
| EP2611226B1 (en) | Processing method and system for over-the-air bootstrap | |
| CN105825409B (en) | Electronic invoice message pushing system and method | |
| WO2018040877A1 (en) | Recovery method and system for password keyboard usb communication abnormality | |
| CN111277963A (en) | Method, equipment and system for establishing connection | |
| CN109729000B (en) | Instant messaging method and device | |
| CN113708993A (en) | Abnormal state testing method and device, terminal equipment and storage medium | |
| CN112087475B (en) | Message pushing method and device for cloud platform component application and message server | |
| CN101790155A (en) | Method, device and system for updating security algorithm of mobile terminal | |
| CN107172112B (en) | Computer file transmission method and device | |
| CN116016659A (en) | Power data processing method, device, system and storage medium | |
| CN101026889A (en) | Method, system and base station for locking illegal copy mobile terminal | |
| CN111371801A (en) | Block chain node scanning method, equipment and storage medium | |
| CN114500237B (en) | Communication method and system | |
| CN113645103B (en) | Method and device for detecting communication link abnormity between video monitoring platform and front-end equipment | |
| CN100450018C (en) | Method for raising Diameter internodal communication reliability | |
| JP2003069581A (en) | Unjust packet prevention method and preventing apparatus of radio multi-hop network | |
| EP3562194B1 (en) | Method for identifying at least one network slice configuration of a mobile network, communication system, and automation system | |
| CN110460586B (en) | In-vehicle node communication method, device, equipment and storage medium | |
| CN115396402B (en) | Address conflict processing method and device in Internet of vehicles and user equipment | |
| CN113242549B (en) | Data processing method, mobile device, UICC (Universal Integrated Circuit card) and terminal | |
| CN113297569B (en) | Attack processing method, equipment and storage medium based on Hash diagram | |
| CN114501442B (en) | Message tamper detection method, auxiliary method, device, medium and terminal | |
| CN114362986A (en) | System and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20230425 |