CN107506448A - A kind of method and system of intelligent grid time scale measurement data interchange format - Google Patents
A kind of method and system of intelligent grid time scale measurement data interchange format Download PDFInfo
- Publication number
- CN107506448A CN107506448A CN201710744540.4A CN201710744540A CN107506448A CN 107506448 A CN107506448 A CN 107506448A CN 201710744540 A CN201710744540 A CN 201710744540A CN 107506448 A CN107506448 A CN 107506448A
- Authority
- CN
- China
- Prior art keywords
- data
- format
- intelligent grid
- time scale
- scale measurement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of method and system of data interchange format in power network, more particularly to the DIF of time scale measurement data in intelligent grid.The form that the present invention designs has been abstracted data format caused by monitoring device all in intelligent grid, the data extracted again from multiple source servers are established into E files to carry out data sharing and exchange with brand-new naming rule, so as to which specification and unified each system carry out data sharing and the form exchanged, the complexity of each system data docking is reduced.
Description
Technical field
The present invention relates to data interchange format in a kind of power network, more particularly to the friendship of time scale measurement data in intelligent grid
Change form.
Technical background
E files are by the file of E language generations.The name of E language come from Easy (simple), Efficiency (efficient),
3 English prefixes of Electric-power (electric power), it is by the data describing mode of the traditional facing relation of power system and face
It is combined to the CIM of object, has both remained the high efficiency of facing relation method, inherit its long-term achievement in research, is absorbed again
The advantages of object-oriented method (inheritance of such as class), there is the characteristics of succinct, efficiently and suitable for power system.E languages
Speech is a kind of markup language, has the basic characteristics and advantage of markup language, its instance data formed is a kind of marking
Plain text data.E language succinctly can efficiently describe the various letters of power system by a small amount of label symbol and description grammer
Single and complex data model, the more big then efficiency of data volume is higher, and E language more meets the natural custom that people use than XML,
Computer disposal is also simpler.E language as one man follows CIM fundamental objects classes with XML, the power system described with E language
Model with the electric power system model of XML language description with that can carry out bi-directional conversion.
Intelligent grid time scale measurement data are highly important data in power grid application, as the big data class of intelligent grid four
The important component of type, it is the important foundation of intelligent grid equipment condition monitoring, decision Analysis, big data excavation etc..
At present, sensor is numerous in intelligent grid, belongs to different equipment vendors, and in business scope, belong to different business again
Department, this just carries out data sharing to cross-system and brings problem.Form is numerous during existing system progress data docking, can not shape
Into unified docking mode.
The content of the invention
A kind of method and system of intelligent grid time scale measurement data interchange format of the present invention propose one kind and are based on E files
Intelligent grid time scale measurement data interchange format, time scale measurement data can be shared with unified standard cross-system/platform data
Form, the complexity of data integration when data sharing is greatly reduced, improve data transmission efficiency.
Technical scheme：A kind of method and system of intelligent grid time scale measurement data interchange format of the present invention are adopted including data
Collection, data format are exchanged, data export 3 system modules, and data are arranged by data collecting module collected, further, collection
Reduced data carries out format exchange by data format Switching Module, further, by data export module by format exchange
Data export afterwards.
Step 1：Data acquisition module, data need to be verified and sieved when extracting from multiple source servers
Choosing, information, data value and data type saved to the net of data and judged, filter out effective data, and it is wrong to existing
The data of false information are recorded.
Step 2：Data format Switching Module, the code for generating file are java applet, can be by data collecting module collected
Data be converted into file stream, constantly write file in；Program is entitled according to the newly-built E files of E file designations rule, file：Net
M- system code-random number of number of data lines-8-source table name .txt when saving information-data acquisition date-file generated.
Further, wherein net, which saves the net that code is two, saves upper-case first letters, if Jiangsu is JS, Zhejiang ZJ；Data
The collection date is correct time caused by data；The file production time is the newly-built correct time of file；Number of data lines represents
How many row in this E file, maximum are no more than 500,000 rows, minimum a line；Random number is elimination duplication of name file possibility
The random digit of addition, its practical significance are once file number caused by extraction.
Further, program writes the data classified in newly-built E files in sequence again, and file content is " five
Tuple ", including：Measuring point name, time, data type, value and data description；These data are all from source database, wherein
Data description can be sky；When finding that data content is undesirable, such as data type loss, data largely lack (such as one
It is secondary extract 100 numerical value but only 50) etc. mistake, then abandon this useless data and current data error reporting remembered
Record.
Step 3：Data export module, data are constantly extracted from data source, while data are verified, meet requirement
Data can be written into E files, and E files reach line number limitation, and program can continue to write to data by newly-built E files automatically, until all
Data write-in finishes.
Further, E files are parsed by unified parsing interface, then incoming destination server is stored, this
Sample just completes the operation that data are transferred to target database from source database.
Brief description of the drawings：A kind of method and system of intelligent grid time scale measurement data interchange format of Fig. 1
Specific implementation method：
A kind of method and system of intelligent grid time scale measurement data interchange format of the present invention, following say is carried out with reference to accompanying drawing
It is bright：
Present invention is generally directed to cross-system time scale measurement Data share-and-exchange, scalar during its object is to solve cross-system
That surveys data shares data format, file format standard problem during with exchanging.
Step 1, data acquisition module, data need to be verified and sieved when extracting from multiple source servers
Choosing, information, data value and data type saved to the net of data and judged, filter out effective data, and it is wrong to existing
The data of false information are recorded；
Step 2, data format Switching Module, the code for generating file are java applet, can be by data collecting module collected
Data be converted into file stream, constantly write file in；Program is entitled according to the newly-built E files of E file designations rule, file：Net
M- system code-random number of number of data lines-8-source table name .txt when saving information-data acquisition date-file generated.
Further, wherein net, which saves the net that code is two, saves upper-case first letters, if Jiangsu is JS, Zhejiang ZJ；Data
The collection date is correct time caused by data；The file production time is the newly-built correct time of file；Number of data lines represents
How many row in this E file, maximum are no more than 500,000 rows, minimum a line；Random number is elimination duplication of name file possibility
The random digit of addition, its practical significance are once file number caused by extraction.
Further, program writes the data classified in newly-built E files in sequence again, and file content is " five
Tuple ", including：Measuring point name, time, data type, value and data description；These data are all from source database, wherein
Data description can be sky；When finding that data content is undesirable, such as data type loss, data largely lack (such as one
It is secondary extract 100 numerical value but only 50) etc. mistake, then abandon this useless data and current data error reporting remembered
Record；
The specific generation process of " five-tuple " is：
(1) using SQL statement inquiry database, districts and cities' code, device numbering, data time, data type, data are obtained
Five essential informations of value and these assembled information；
(2) measuring point name：Measuring point name=net saves abbreviation+districts and cities' code+data source systems code+device id
(3) time：The data time of time=specific format is (during year-month-day：Point：Second)；
(4) data type：Data type is presented as numeral, it is necessary to by a mapping table in source database, incites somebody to action
Numeral is converted into letter, such as：1 represents voltage, and it is exactly " U " to be converted into data type；2 represent electric current, are converted into data type just
It is " I "；
(5) value：Value is the precise number directly extracted from database, without any change
(6) describe：Part system is more special, and the data that Chinese can be inquired when SQL statement inquires about database are retouched
State, then the description write these information in E files；In addition, when can not inquire about data and describe, the information of description with
Measuring point name information is consistent, is that net saves abbreviation+districts and cities' code+data source systems code+device id；
(7) take separator to be separated between " five-tuple ", separator can with self-defined, as single quotation marks " ' ", so,
Every a line in E files is shown as：Measuring point name ' time ' data type ' value ' data description, i.e. five kinds of data, four points
Every symbol.Example in particular content such as following table：
Step 3：Data export module, data are constantly extracted from data source, while data are verified, meet requirement
Data can be written into E files, and E files reach line number limitation, and program can continue to write to data by newly-built E files automatically, until all
Data write-in finishes；
Further, E files are parsed by unified parsing interface, then incoming destination server is stored, this
Sample just completes the operation that data are transferred to target database from source database.
Beneficial effect：A kind of method and system of intelligent grid time scale measurement data interchange format of the present invention will be from multiple sources
The data that extraction is thought highly of in service establish E files to carry out data sharing and exchange with brand-new naming rule, so as to specification and system
One each system carries out data sharing and the form exchanged, reduces the complexity of each system data docking.
Claims (5)
1. a kind of system of intelligent grid time scale measurement data interchange format, it is characterised in that the system includes data acquisition, number
3 system modules are exported according to format exchange, data, data are arranged by data collecting module collected, further, after collection arranges
Data format exchange is carried out by data format Switching Module, further, by data export module by the number after format exchange
According to export.
2. according to claim 1, a kind of method and system of intelligent grid time scale measurement data interchange format, its feature
It is, data are needed to be verified and sieved by data acquisition module when extracting from multiple source servers in the system
Choosing, information, data value and data type saved to the net of data and judged, filter out effective data, and it is wrong to existing
The data of false information are recorded.
3. according to claim 1, a kind of method and system of intelligent grid time scale measurement data interchange format, its feature
It is, the data of data collecting module collected are converted into file stream by data format Switching Module in the system, constantly write-in text
In part；Program is entitled according to the newly-built E files of E file designations rule, file：When net saves information-data acquisition date-file generated
M- system code-the random number of number of data lines-8-source table name .txt.
4. according to claim 1, a kind of method and system of intelligent grid time scale measurement data interchange format, its feature
It is, data export module data are constantly extracted from data source in the system, while data are verified, meet the number of requirement
According to that can be written into E files, E files reach line number limitation, and program can continue to write to data by newly-built E files automatically, until whole numbers
Finished according to write-in；E files are parsed by unified parsing interface, then incoming destination server is stored, thus complete
The operation of target database is transferred into data from source database.
A kind of 5. method of intelligent grid time scale measurement data interchange format, it is characterised in that this method is based in claim 1
A kind of system of described intelligent grid time scale measurement data interchange format, data are arranged by data collecting module collected, entered
One step, collection reduced data carries out format exchange by data format Switching Module, further, by data export module
Data after format exchange are exported.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710744540.4A CN107506448A (en) | 2017-08-25 | 2017-08-25 | A kind of method and system of intelligent grid time scale measurement data interchange format |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710744540.4A CN107506448A (en) | 2017-08-25 | 2017-08-25 | A kind of method and system of intelligent grid time scale measurement data interchange format |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107506448A true CN107506448A (en) | 2017-12-22 |
Family
ID=60693780
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710744540.4A Pending CN107506448A (en) | 2017-08-25 | 2017-08-25 | A kind of method and system of intelligent grid time scale measurement data interchange format |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107506448A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112231277A (en) * | 2020-10-27 | 2021-01-15 | 杭州冒险元素网络技术有限公司 | Resume batch archiving method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063563A (en) * | 2010-12-14 | 2011-05-18 | 中国电力科学研究院 | Network-province-local integrative bus load predicting method |
| CN104318481A (en) * | 2014-05-04 | 2015-01-28 | 国家电网公司 | Power-grid-operation-oriented holographic time scale measurement data extraction conversion method |
| CN105807658A (en) * | 2016-03-16 | 2016-07-27 | 国网四川省电力公司 | Method for graph-model information sharing of intelligent substation and dispatching master station |
-
2017
- 2017-08-25 CN CN201710744540.4A patent/CN107506448A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063563A (en) * | 2010-12-14 | 2011-05-18 | 中国电力科学研究院 | Network-province-local integrative bus load predicting method |
| CN104318481A (en) * | 2014-05-04 | 2015-01-28 | 国家电网公司 | Power-grid-operation-oriented holographic time scale measurement data extraction conversion method |
| CN105807658A (en) * | 2016-03-16 | 2016-07-27 | 国网四川省电力公司 | Method for graph-model information sharing of intelligent substation and dispatching master station |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112231277A (en) * | 2020-10-27 | 2021-01-15 | 杭州冒险元素网络技术有限公司 | Resume batch archiving method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107402976B (en) | Power grid multi-source data fusion method and system based on multi-element heterogeneous model | |
| CN106777644B (en) | Automatic generation method and device for power plant identification system code | |
| CN112347071B (en) | Power distribution network cloud platform data fusion method and power distribution network cloud platform | |
| CN102207946B (en) | Knowledge network semi-automatic generation method | |
| CN104899314A (en) | Pedigree analysis method and device of data warehouse | |
| CN103902269B (en) | System and method for generating MIB files through XML files | |
| CN101859303A (en) | Metadata management method and management system | |
| CN104573024A (en) | Self-adaptive extracting method and system for heterogeneous security log information under complex network system | |
| CN106126528A (en) | A kind of moonlet based on platform model test Back ground Information generates method | |
| CN103606032B (en) | A kind of method in two dimension power grid GIS data set | |
| CN109033322A (en) | A kind of test method and device of multidimensional data | |
| CN114186533A (en) | Model training method and device, knowledge extraction method and device, equipment and medium | |
| CN111177323B (en) | Power failure plan unstructured data extraction and identification method based on artificial intelligence | |
| CN117312531A (en) | Power distribution network fault attribution analysis method based on large language model with enhanced knowledge graph | |
| CN112905642B (en) | Method for storing IEC61850 report data into relational database based on CSV mapping file | |
| CN107506448A (en) | A kind of method and system of intelligent grid time scale measurement data interchange format | |
| CN113570345A (en) | Power failure range automatic identification system based on construction project circuit diagram | |
| CN104750812A (en) | Automatic data collecting method based on webpage label analysis | |
| CN113515515B (en) | Method, device, equipment and medium for fusing customer data and power grid equipment data | |
| CN115827885A (en) | Operation and maintenance knowledge graph construction method and device and electronic equipment | |
| CN115222058A (en) | Method and device for establishing operating state analysis model of regulation and control system, medium and equipment | |
| CN111198879A (en) | Intelligent community-based business data storage method and system | |
| CN112417844A (en) | Parallel CIM/E file structured analysis method | |
| Uslar et al. | Building the semantic utility with standards and semantic web services | |
| CN111143296A (en) | Substation SCD file classification method and device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171222 |