CN113726841A - Multisource heterogeneous energy data collection system - Google Patents
Multisource heterogeneous energy data collection system Download PDFInfo
- Publication number
- CN113726841A CN113726841A CN202110771235.0A CN202110771235A CN113726841A CN 113726841 A CN113726841 A CN 113726841A CN 202110771235 A CN202110771235 A CN 202110771235A CN 113726841 A CN113726841 A CN 113726841A
- Authority
- CN
- China
- Prior art keywords
- data
- energy
- codes
- floating point
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013480 data collection Methods 0.000 title claims abstract description 14
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 10
- 238000007667 floating Methods 0.000 claims description 26
- 230000005540 biological transmission Effects 0.000 abstract description 3
- 238000000605 extraction Methods 0.000 abstract description 3
- 210000001503 joint Anatomy 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000007789 sealing Methods 0.000 description 2
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to the technical field of data processing, in particular to a multisource heterogeneous energy data collection system.A gateway unit completes the butt joint of an external network and a scheduling system intranet, receives transmission data of various energy equipment from the external network, adopts a key information extraction mode to reconstruct the data due to different equipment types and various data formats, firstly acquires identity information in initial data, converts the identity information into energy data codes in a standard format which can be directly used in a scheduling system, then splices and merges the energy data codes with time sequence information and digital information containing dimensions, and transmits the acquired data to the scheduling system through the gateway unit to assist scheduling work; because the method of scanning one by one and directly extracting the key information is adopted, the influence of various formats of the initial data is avoided, and the data with the uniform format is obtained after the initial data is processed uniformly, so that the method is convenient to call and use.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a multi-source heterogeneous energy data collection system.
Background
Under the background of the explosive development of the internet, big data and data fusion technologies are ubiquitous, but the big data technologies are utilized very slowly in the energy field, and the main obstacles are the heterogeneity of data among various energy devices and the sealing performance among different networks.
One of the systems is embodied in a power dispatching system and isolated from the internet in order to ensure the safety of the dispatching system, but with the arrival of the internet era, more and more power devices are connected to the internet, and due to the sealing performance of the power dispatching system, the dispatching system cannot directly use the internet of things to sense the power devices.
Disclosure of Invention
In view of this, the present invention provides a multi-source heterogeneous energy data aggregation system, which is capable of aggregating and fusing data of an electric power device in the internet of things and data in an electric power scheduling system, so as to perform electric power scheduling by using the data of the electric power device in the internet of things.
The invention discloses a multi-source heterogeneous energy data collection system which comprises a gateway unit, a dispatching system and a control unit, wherein the gateway unit is used for receiving data from energy equipment and sending the processed data to the dispatching system;
the storage unit is divided into a temporary storage area and a fixed storage area, the temporary storage area is used for performing list storage on the data received by the exchange unit according to a receiving time sequence, and the fixed storage area stores the identity data of all energy equipment and the processed energy data;
the processing unit is used for processing the data in the list according to a standard format, and the processing process is as follows:
(1) according to the time sequence in the list, reading out the identity information in the data by comparing the identity data in the storage unit, wherein the identity information is the identity information of the corresponding energy equipment and is replaced by the energy equipment code in the standard format;
(2) extracting floating point numbers and non-floating point numbers in the data, and reserving the dimension of the floating point numbers and the non-floating point numbers;
(3) splicing the time sequence information, the energy equipment codes, the floating point numbers, the non-floating point numbers and the dimensions of the data;
(4) and sending the processed data to a storage unit, and storing the data according to a time sequence.
Further, the data in the temporary storage area of the storage unit are deleted one by one after being processed.
Further, the storage unit stores a dimension symbol set in the energy system, and the step of digitally extracting the data includes:
(3-1) scanning the data in a reverse order, and searching and marking the dimension symbols in the data one by one in a dimension symbol set;
(3-2) if the dimension symbol is preceded by a number, proposing a floating point number or a non-floating point number before the dimension symbol;
(3-3) if the dimension symbol is preceded by other characters or text, ignoring.
Further, the energy equipment codes comprise equipment type standard codes and identity codes, and the energy equipment codes in the system are unique codes.
Further, when the energy device sends data to the gateway unit for the first time, the energy device needs to send a device MAC for identification, and the system automatically registers and obtains a unique identity code and a corresponding energy device code according to the device MAC and stores the unique identity code and the corresponding energy device code in the storage unit.
Further, the processed data is stored in blocks according to the energy device codes, and each block only contains one energy device code.
The invention has the beneficial effects that: according to the multisource heterogeneous energy data collection system, the external network is in butt joint with the internal network of the dispatching system through the gateway unit, the gateway unit receives transmission data of various energy devices from the external network, due to different device types and various data formats, the processing unit reconstructs data in a key information extraction mode, the processing unit firstly obtains identity information in initial data, converts the identity information into energy data codes in a standard format which can be directly used in the dispatching system, then splices and merges the energy data codes with time sequence information and digital information containing dimensions, and the obtained processed data are sent to the dispatching system through the gateway unit to assist in dispatching; because the method of scanning one by one and directly extracting the key information is adopted, the influence of various formats of the initial data is avoided, and the data with the uniform format is obtained after the initial data is processed uniformly, so that the method is convenient to call and use.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that for a person skilled in the art, other relevant drawings can be obtained from the drawings without inventive effort:
FIG. 1 is a schematic diagram of the system of the present invention;
FIG. 2 is a schematic diagram of the system operation of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
As shown in fig. 1-2: the multi-source heterogeneous energy data collection system of the embodiment comprises
The gateway unit is used for receiving data from the energy equipment and sending the processed data to the scheduling system, the gateway unit can directly adopt the existing gateway equipment, and the network environment where the energy equipment is located needs to be considered for selection of the gateway equipment.
The memory cell, the memory cell divide into scratch pad and fixed storage area, and scratch pad is used for carrying out the tabulation storage with the data that exchange unit received according to receiving the chronogenesis, carries out the subregion once more in the fixed storage area, wherein:
the area A stores identity data of all energy equipment;
the area B is used for storing the processed data with the label format, and the list is stored in blocks;
and the C area is used for storing all dimension symbols encountered in the energy system to form a dimension symbol set.
The processing unit, i.e. the computing device, is adapted to process the data in the list according to a standard format.
Specifically, the working principle of the system is as follows:
s1, after the system is built, all energy devices need to be registered, when the energy devices send data to the gateway unit for the first time, the energy devices need to send device MAC for identification, the MAC of each device is unique and contains device type information, the system automatically registers according to the device MAC and obtains a unique identity code and a corresponding energy device code and stores the unique identity code and the corresponding energy device code in the storage unit, the identity code is consistent with the identity code of the energy devices in the dispatching system, so that the dispatching system can be directly used, and when the energy devices send data to the gateway unit again, the processing unit can directly read and identify the identity information of the energy devices.
And S2, the processing unit reads the identity information in the data by comparing the identity data in the storage unit according to the time sequence in the list, the identity information is the identity information of the corresponding energy equipment, the identity information comprises equipment types and is replaced by energy equipment codes in a standard format, the energy equipment codes comprise equipment type standard codes and identity codes, the energy equipment codes in the system are unique codes, and the dispatching system can acquire the position information of the corresponding equipment, the affiliated power distribution station, the information of maintenance personnel and the like through the unique energy equipment codes.
S3, extracting floating point numbers and non-floating point numbers in the data, and keeping the dimension of the floating point numbers and the non-floating point numbers, wherein the extracting process comprises the following steps:
s31, the processing unit scans the data in reverse order and character by character, the dimension symbols in the data are searched and marked one by one in the dimension symbol set, and the front of the marked dimension symbols indicates that key numbers may appear;
s31, if the digits are in front of the dimension symbols, floating point digits or non-floating point digits in front of the dimension symbols are provided, the non-floating point digits can contain decimal points, the floating point digits are integers, the dimension of the digits is reserved while the digits are extracted, and the digits are provided for a dispatcher to serve as a judgment basis;
and S31, if the dimension symbol is preceded by other characters or texts, ignoring.
S4, splicing the time sequence information, the energy equipment codes, the floating point numbers, the non-floating point numbers and the dimensions of the data, wherein the spliced data are processed data, and the presentation data in the temporary storage area of the storage unit are directly deleted after being processed;
and S5, sending the processed data to a storage unit, storing the processed data according to a time sequence, and storing the processed data in blocks according to the energy equipment codes, wherein each block only comprises one energy equipment code.
The specific embodiment is as follows:
(1) the gateway unit receives initial data from the energy device X and the energy device Y, and the initial data respectively comprise:
312384763-192.168.46.1-bdhssnc112.55A
1100V-dehnjhn-192.168.162.78-idddsklmj21467353YYK
the two formats are different greatly, and the information in the two formats is difficult to directly acquire.
(2) The processing unit obtains X and Y as a current transformer X and a voltage transformer Y through MAC identification, so that the identity codes of the current transformer X and the voltage transformer Y are 20201170481 and 20130763423 obtained from the dispatching system through MAC inquiry, the signs TA and TV of the standard current transformer and voltage transformer are obtained, the energy equipment codes of the standard current transformer and voltage transformer are TA20201170481 and TV20130763423 respectively are obtained, and the energy equipment codes are stored in the A area of the memory.
(3) The processing unit finds dimensions a (amperes) and V (volts) by scanning and extracts key numbers 112.55 and 1100, and corresponding key parameters 112.55a and 1100V of the current transformer X and the voltage transformer Y can be obtained.
(4) And adding time sequence information, so that the processed data is as follows:
2020061121-TA20201170481-112.55A
2020061104-TV20130763423-1100V
in the above data storage and forwarding to the dispatching system, the dispatcher can learn that the data collected by the current transformer and the voltage transformer with identities TA20201170481 and TV20130763423 are 112.55a and 1100V respectively at 21 of 6/11/2020 and 4 of 6/11/2020 respectively according to a fixed format, and the data are provided to the dispatcher as a reference to assist the dispatcher in dispatching.
According to the multisource heterogeneous energy data collection system, the external network is in butt joint with the internal network of the dispatching system through the gateway unit, the gateway unit receives transmission data of various energy devices from the external network, due to different device types and various data formats, the processing unit reconstructs data in a key information extraction mode, the processing unit firstly obtains identity information in initial data, converts the identity information into energy data codes in a standard format which can be directly used in the dispatching system, then splices and merges the energy data codes with time sequence information and digital information containing dimensions, and the obtained processed data are sent to the dispatching system through the gateway unit to assist in dispatching; because the method of scanning one by one and directly extracting the key information is adopted, the influence of various formats of the initial data is avoided, and the data with the uniform format is obtained after the initial data is processed uniformly, so that the method is convenient to call and use.
Finally, the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all of them should be covered in the claims of the present invention.
Claims (6)
1. A multisource heterogeneous energy data collection system which characterized in that: comprises that
The gateway unit is used for receiving data from the energy equipment and sending the processed data to the dispatching system;
the storage unit is divided into a temporary storage area and a fixed storage area, the temporary storage area is used for performing list storage on the data received by the exchange unit according to a receiving time sequence, and the fixed storage area stores the identity data of all energy equipment and the processed energy data;
the processing unit is used for processing the data in the list according to a standard format, and the processing process is as follows:
(1) according to the time sequence in the list, reading out the identity information in the data by comparing the identity data in the storage unit, wherein the identity information is the identity information of the corresponding energy equipment and is replaced by the energy equipment code in the standard format;
(2) extracting floating point numbers and non-floating point numbers in the data, and reserving the dimension of the floating point numbers and the non-floating point numbers;
(3) splicing the time sequence information, the energy equipment codes, the floating point numbers, the non-floating point numbers and the dimensions of the data;
(4) and sending the processed data to a storage unit, and storing the data according to a time sequence.
2. The multi-source heterogeneous energy data collection system of claim 1, wherein: and deleting the data in the temporary storage area of the storage unit one by one after processing.
3. The multi-source heterogeneous energy data collection system of claim 1, wherein: the storage unit stores a dimension symbol set in an energy system, and the step of digitally extracting data comprises the following steps:
(3-1) scanning the data in a reverse order, and searching and marking the dimension symbols in the data one by one in a dimension symbol set;
(3-2) if the dimension symbol is preceded by a number, proposing a floating point number or a non-floating point number before the dimension symbol;
(3-3) if the dimension symbol is preceded by other characters or text, ignoring.
4. The multi-source heterogeneous energy data collection system of claim 1, wherein: the energy equipment codes comprise equipment type standard codes and identity codes, and the energy equipment codes in the system are unique codes.
5. The multi-source heterogeneous energy data collection system of claim 4, wherein: when the energy equipment sends data to the gateway unit for the first time, the equipment MAC needs to be sent for identification, and the system automatically registers and obtains a unique identity code and a corresponding energy equipment code according to the equipment MAC and stores the unique identity code and the corresponding energy equipment code in the storage unit.
6. The multi-source heterogeneous energy data collection system of claim 1, wherein: and the processed data is stored in blocks according to the energy equipment codes, and each block only comprises one energy equipment code.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110771235.0A CN113726841A (en) | 2021-07-08 | 2021-07-08 | Multisource heterogeneous energy data collection system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110771235.0A CN113726841A (en) | 2021-07-08 | 2021-07-08 | Multisource heterogeneous energy data collection system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113726841A true CN113726841A (en) | 2021-11-30 |
Family
ID=78673116
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110771235.0A Pending CN113726841A (en) | 2021-07-08 | 2021-07-08 | Multisource heterogeneous energy data collection system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113726841A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412956A (en) * | 2013-08-30 | 2013-11-27 | 北京中科江南软件有限公司 | Data processing method and system for heterogeneous data sources |
| CN108769109A (en) * | 2018-04-13 | 2018-11-06 | 西安电子科技大学 | Method and system are uniformly processed in a kind of Internet of Things heterogeneous device data |
| KR20190109621A (en) * | 2018-02-27 | 2019-09-26 | (주)에스엔 | IoT-Based system integrating various measuring instruments |
| CN111680021A (en) * | 2020-05-11 | 2020-09-18 | 北京邮电大学 | Multi-source heterogeneous disaster situation data processing and presenting method and device |
-
2021
- 2021-07-08 CN CN202110771235.0A patent/CN113726841A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412956A (en) * | 2013-08-30 | 2013-11-27 | 北京中科江南软件有限公司 | Data processing method and system for heterogeneous data sources |
| KR20190109621A (en) * | 2018-02-27 | 2019-09-26 | (주)에스엔 | IoT-Based system integrating various measuring instruments |
| CN108769109A (en) * | 2018-04-13 | 2018-11-06 | 西安电子科技大学 | Method and system are uniformly processed in a kind of Internet of Things heterogeneous device data |
| CN111680021A (en) * | 2020-05-11 | 2020-09-18 | 北京邮电大学 | Multi-source heterogeneous disaster situation data processing and presenting method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103501486A (en) | Message pushing method and pushing server | |
| CN104077341A (en) | Keyword auto-response mapping relation generation method and device in instant messaging | |
| CN104104778A (en) | Mobile terminal short message processing method and device | |
| CN109379764B (en) | Message sending method and device | |
| CN110083722A (en) | A kind of electronic drawing lookup method, device, equipment and readable storage medium storing program for executing | |
| JP5788047B2 (en) | Encoder for encoding text into matrix code symbols and decoder for decoding matrix code symbols | |
| CN111935789A (en) | Uu interface signaling association method, device and storage medium | |
| CN106603502A (en) | XML-based IEC 60870-5-104 and GOOSE conversion method | |
| CN104077593A (en) | Image processing method and image processing device | |
| CN104090983A (en) | Scanning data processing method | |
| CN105915434A (en) | Email processing method and equipment | |
| CN104346337A (en) | Method and device for intercepting junk information | |
| CN113726841A (en) | Multisource heterogeneous energy data collection system | |
| CN107734180B (en) | Information processing method | |
| CN109002455A (en) | A kind of cross-platform power distribution network line chart Mobile Online checks and equipment localization method | |
| CN110932393B (en) | Substation information protection master station system and data initialization method thereof | |
| CN111723205A (en) | Conference summary processing method and device and conference summary processing equipment | |
| CN108228778B (en) | BPA power flow data separation equivalent conversion method based on MATLAB platform | |
| CN115359505A (en) | Electric power drawing detection and extraction method and system | |
| CN106102027A (en) | Note based on MapReduce batch submits method to | |
| CN115879880A (en) | RPA (resilient packet Access) acquisition method and system for power industry expansion data | |
| CN102281516B (en) | Short message processing method and short message processing terminal | |
| CN105120045A (en) | Method and device for creating address book according to note information of new contact name | |
| CN110597933B (en) | Matching method of power grid topological data | |
| CN113872963A (en) | Message protocol rapid analysis method and system based on free label splicing technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |