CN107341608A - One kind production basic data index analysis method - Google Patents
One kind production basic data index analysis method Download PDFInfo
- Publication number
- CN107341608A CN107341608A CN201710539090.5A CN201710539090A CN107341608A CN 107341608 A CN107341608 A CN 107341608A CN 201710539090 A CN201710539090 A CN 201710539090A CN 107341608 A CN107341608 A CN 107341608A
- Authority
- CN
- China
- Prior art keywords
- data
- basic data
- analysis
- analysis method
- layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 46
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 27
- 238000000034 method Methods 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 12
- 238000012544 monitoring process Methods 0.000 claims abstract description 8
- 230000008569 process Effects 0.000 claims abstract description 4
- 238000012546 transfer Methods 0.000 claims abstract description 4
- 238000007726 management method Methods 0.000 claims description 21
- 230000002950 deficient Effects 0.000 claims description 9
- 230000007547 defect Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000013523 data management Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000008859 change Effects 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000032683 aging Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000000869 mutational effect Effects 0.000 description 1
- 238000005498 polishing Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2216/00—Indexing scheme relating to additional aspects of information retrieval not explicitly covered by G06F16/00 and subgroups
- G06F2216/03—Data mining
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Economics (AREA)
- Computational Linguistics (AREA)
- Strategic Management (AREA)
- Probability & Statistics with Applications (AREA)
- Entrepreneurship & Innovation (AREA)
- Fuzzy Systems (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- Health & Medical Sciences (AREA)
- General Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Tourism & Hospitality (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Mathematical Physics (AREA)
- Public Health (AREA)
- General Factory Administration (AREA)
- Operations Research (AREA)
- General Health & Medical Sciences (AREA)
- Water Supply & Treatment (AREA)
- Primary Health Care (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Game Theory and Decision Science (AREA)
Abstract
The invention provides one kind to produce basic data index analysis method, comprises the following steps：（1）Data Layer obtains associated traffic data and handled from production and professional monitoring system；（2）Data transfer after step 1 is handled is into the subject data base of data Layer；（3）Operation layer analyzes and processes to the data in subject data base, generates analyze data；（4）The analysis processing result of step 3 is shown by represent layer.Foundation can be provided for the decision-making of equipment control department using the method for the present invention, guide numerous producers to change from " experience dependence " to " data dependence ", so as to be to ensure that enterprise safety operation stably provides strong support.
Description
Technical field
The invention belongs to data analysis technique field, and in particular to one kind production basic data index analysis method.
Background technology
With power network scale rapid growth, internal and external environment is increasingly complicated, and power supply regulatory requirements are increasingly strict, public to power network
Department's production safety management level proposes requirements at the higher level.At the same time, in information technology of the information age using big data as representative
Just with unprecedented range, depth and power network production run and management rapid fusion, more and more important effect is played, into
For the boost motor of new period power network production management lean transition.The core of big data is to excavate caused mass data
And analysis, so as to rapidly obtain valuable information, it is converted into knowledge and carries out decision-making and anticipation.But also to see, produce number
It is very huge according to measuring, and each information system is dispersed in, isolate each other, fail to be effectively integrated and share；Data integrity,
The quality problems such as accuracy, uniformity are still present；The effective rate of utilization of data is relatively low, and data value can not embody；Data are driven
The theory of dynamic management is not yet formed, and all levels of management personnel does not know what track data can bring, and does not also know how to utilize grasp
Data are analyzed, judged, decision-making.In face of these problems, it is necessary to production basic data management method and mechanism are established, to open
Creation data analysis and research are opened up, the scientific and ageing of decision-making of production management is lifted and lays the foundation.
The content of the invention
To overcome deficiency of the prior art, the present invention proposes a kind of production basic data index analysis method, the party
The technical scheme that method uses for：
One kind production basic data index analysis method, based on producing basic data index analysing system, the system bag
Data Layer, operation layer and represent layer are included, the described method comprises the following steps：
S1：Data Layer obtains associated traffic data and handled from production and professional monitoring system；
S2：By the data transfer after step S1 processing into the subject data base of data Layer；
S3：Operation layer analyzes and processes to the data in subject data base, generates analyze data；
S4：Step S3 analysis processing result is shown by represent layer.
Preferably, the processing in the step S1 includes data cleansing, interface protocol conversion and data pick-up service.
Preferably, the subject data base in the step S2 include account data storehouse, experimental data base, defect database and
Monitor database.
Preferably, the analyzing and processing in the step S3 includes basic data synchronization configuration management, basic data synchronization matter
Amount analysis and quality index statistics.
Preferably, it is same to include data access management, data access monitoring and data for the basic data synchronization configuration management
Step management.
Preferably, the basic data synchronizing quality analysis includes Data integrality analysis, data validity analysis, data
Real time analysis, data validity analysis and the out-of-limit analysis of data.
Preferably, the quality index statistics includes base values statistics, defective data excavates and multidimensional visualizes.
Preferably, mode shown in the step S4 includes form, pie chart, column diagram, line chart.
Preferably, content shown in the step S4 include Data Quality Analysis result, defective data Result and
Main KPI indexs.
Benefit of the invention is that using this method foundation can be provided for the decision-making of equipment control department, guide
Numerous producers change from " experience dependence " to " data dependence ", so as to provide strong branch to ensure that enterprise safety operation is stable
Support.
Brief description of the drawings
Fig. 1 is the flow chart of the present invention.
Embodiment
One kind production basic data index analysis method, based on producing basic data index analysing system, the system bag
Data Layer, operation layer and represent layer are included, as shown in figure 1, the described method comprises the following steps：
S1：Data Layer obtains associated traffic data and handled from production and professional monitoring system, and it is clear mainly to include data
Wash, interface protocol conversion and data pick-up service, and screen model whether unify.
S2：By the data transfer after step S1 processing into the subject data base of data Layer, the subject data base includes
Account data storehouse, experimental data base, defect database and monitor database and other databases.
S3：Operation layer analyzes and processes to the data in subject data base, generates analyze data.Operation layer is used for function
Build, the analyzing and processing includes basic data synchronization configuration management, the analysis of basic data synchronizing quality and quality index statistics.
Wherein：
Basic data synchronization configuration management includes data access management, data access monitoring and data management by synchronization.Due to defeated change
Electric equipment status monitoring centring system accesses all kinds of production business datums, the class of these business datums from production management system
Type, all differences such as cycle, synchronisation requirement are produced, therefore, power transmission and transformation equipment state is mainly responsible in basic data synchronization configuration management
Monitoring center's system and the unified management of the synchronization parameter of all kinds of business datums.Major function includes：The increase of synchronous task, delete
The function such as remove, change, inquiring about.Increase function sets what is communicated with production management system when being used to increase synchronizing traffic data task
Parameter, the parameter mainly include communication protocol, communication mode, port address etc.；Function is deleted then to be used to delete business datum
Synchronous task；Modification function is used to change synchronizing traffic data configuration parameter；Query function is used for query traffic data and synchronously appointed
Business.
The analysis of basic data synchronizing quality mainly serves for ensuring authenticity of the data of system when being used by other application
And intelligibility, guarantee data can be corresponding with reality and understood by data consumer.Concrete function includes data integrity point
Analysis, data validity analysis, real-time property analysis, data validity analysis and the out-of-limit analysis of data.Wherein：
Data integrality analysis：The main situation for determining whether to lose data.For the data point of loss, data are notified first
AM access module carries out data amended record, and for that can not complete amended record, Data-parallel language is carried out using corresponding computational algorithm.For logical
The data for calculating polishing are crossed, quality identification is changed, is set to calculating.
Data validity is analyzed：According to attributes such as the effective range of data, mutational ranges, the validity of data is judged.It is right
In invalid data, quality identification is changed, it is invalid to be set to.
Real-time property is analyzed：Check whether data exceed the time restriction of configuration and do not update.For more than configuration
Time limit and without renewal data, change quality identification, be set to legacy data.
Data validity is analyzed：According to configuration rule, operation of power networks state identification is carried out, finds suspicious data.For
Suspicious data, quality identification is changed, is set to suspicious.
The out-of-limit analysis of data：It is whether out-of-limit according to measuring point limit value configuration determination real time data, and determine out-of-limit rank.It is right
In out-of-limit data, out-of-limit mark is set；Out-of-limit mark is removed when returning to normal condition.
Quality index statistics includes base values statistics, defective data excavates and multidimensional visualizes.Quality index is united
Meter is on the basis of basic data quality analysis is produced, and statistical analysis is carried out simultaneously to the creation data quality index of each power supply administration
Export statistical result.In addition, being based on data platform, carry out the application study of grid company equipment deficiency data visualization and build work
Make, all kinds of problems existing for solution defective data, higher-quality defective data is provided for types of applications；Simultaneously, there is provided abundant
Visualization means, disclose defective data inside and its relation with external data, improve defect management business.
S4：Step S3 analysis processing result is shown by represent layer.According to power supply administration, data type, voltage class
Quality index statistics is carried out etc. multi-angle, various dimensions exhibition is carried out in a manner of form, pie chart, column diagram, line chart etc. are visual
Show, the content shown includes Data Quality Analysis result, defective data Result and main KPI indexs.
Claims (9)
1. one kind production basic data index analysis method, based on producing basic data index analysing system, the system
Including data Layer, operation layer and represent layer, it is characterised in that the described method comprises the following steps：
S1：Data Layer obtains associated traffic data and handled from production and professional monitoring system；
S2：By the data transfer after step S1 processing into the subject data base of data Layer；
S3：Operation layer analyzes and processes to the data in subject data base, generates analyze data；
S4：Step S3 analysis processing result is shown by represent layer.
2. a kind of production basic data index analysis method according to claim 1, it is characterised in that in the step S1
Processing include data cleansing, interface protocol conversion and data pick-up service.
3. a kind of production basic data index analysis method according to claim 1, it is characterised in that in the step S2
Subject data base include account data storehouse, experimental data base, defect database and monitor database.
4. a kind of production basic data index analysis method according to claim 1, it is characterised in that in the step S3
Analyzing and processing include basic data synchronization configuration management, basic data synchronizing quality analysis and quality index statistics.
A kind of 5. production basic data index analysis method according to claim 4, it is characterised in that the basic data
Synchronous configuration management includes data access management, data access monitoring and data management by synchronization.
A kind of 6. production basic data index analysis method according to claim 4, it is characterised in that the basic data
Synchronizing quality analysis includes Data integrality analysis, data validity analysis, real-time property analysis, data validity analyze and
The out-of-limit analysis of data.
A kind of 7. production basic data index analysis method according to claim 4, it is characterised in that the quality index
Statistics includes base values statistics, defective data excavates and multidimensional visualizes.
8. a kind of production basic data index analysis method according to claim 1, it is characterised in that in the step S4
The mode of displaying includes form, pie chart, column diagram, line chart.
9. a kind of production basic data index analysis method according to claim 1, it is characterised in that in the step S4
The content of displaying includes Data Quality Analysis result, defective data Result and main KPI indexs.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710539090.5A CN107341608A (en) | 2017-07-04 | 2017-07-04 | One kind production basic data index analysis method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710539090.5A CN107341608A (en) | 2017-07-04 | 2017-07-04 | One kind production basic data index analysis method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107341608A true CN107341608A (en) | 2017-11-10 |
Family
ID=60218912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710539090.5A Pending CN107341608A (en) | 2017-07-04 | 2017-07-04 | One kind production basic data index analysis method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107341608A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108073497A (en) * | 2018-01-29 | 2018-05-25 | 上海洞识信息科技有限公司 | A kind of multi objective unusual fluctuation analysis method based on data center's data acquisition platform |
| CN109583712A (en) * | 2018-11-13 | 2019-04-05 | 咪咕文化科技有限公司 | Data index analysis method and device and storage medium |
| CN109726210A (en) * | 2018-11-21 | 2019-05-07 | 中国电力科学研究院有限公司 | A kind of transmission line galloping data processing method and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104124756A (en) * | 2013-04-27 | 2014-10-29 | 国家电网公司 | Province-level power distribution network operation monitoring system based on network-wide data |
| CN105930424A (en) * | 2016-04-19 | 2016-09-07 | 国网重庆市电力公司电力科学研究院 | Method for realizing online asynchronous acquisition and intelligent mining of power distribution network data |
-
2017
- 2017-07-04 CN CN201710539090.5A patent/CN107341608A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104124756A (en) * | 2013-04-27 | 2014-10-29 | 国家电网公司 | Province-level power distribution network operation monitoring system based on network-wide data |
| CN105930424A (en) * | 2016-04-19 | 2016-09-07 | 国网重庆市电力公司电力科学研究院 | Method for realizing online asynchronous acquisition and intelligent mining of power distribution network data |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108073497A (en) * | 2018-01-29 | 2018-05-25 | 上海洞识信息科技有限公司 | A kind of multi objective unusual fluctuation analysis method based on data center's data acquisition platform |
| CN108073497B (en) * | 2018-01-29 | 2021-02-12 | 上海洞识信息科技有限公司 | Multi-index transaction analysis method based on data center data acquisition platform |
| CN109583712A (en) * | 2018-11-13 | 2019-04-05 | 咪咕文化科技有限公司 | Data index analysis method and device and storage medium |
| CN109583712B (en) * | 2018-11-13 | 2021-06-29 | 咪咕文化科技有限公司 | Data index analysis method and device and storage medium |
| CN109726210A (en) * | 2018-11-21 | 2019-05-07 | 中国电力科学研究院有限公司 | A kind of transmission line galloping data processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107730394A (en) | The polynary isomeric data fusion method of panorama power network based on big data | |
| CN109150640A (en) | A kind of method for discovering network topology and system based on double layer network agreement | |
| CN106600103A (en) | Statistic data model building method facing programs, plans, and decisions | |
| CN107341608A (en) | One kind production basic data index analysis method | |
| CN105808413A (en) | Business process visualization based SQL performance monitoring method | |
| CN107506393A (en) | A kind of agriculture big data model and its in application agriculturally | |
| CN103914500B (en) | A kind of online methods of exhibiting of configuration based on time series data | |
| CN116610747A (en) | Visual intelligent management system based on three-dimensional numbers | |
| CN108717356B (en) | Metering holographic visual display method and device | |
| CN107403257A (en) | One kind production basic data index analysing system | |
| CN102855332A (en) | Graphic configuration management database based on graphic database | |
| CN112862232A (en) | Integrated monitoring method and device for power wireless heterogeneous network | |
| CN112765232B (en) | Data management method and system for major equipment of nuclear power plant | |
| CN105978738A (en) | Distributed energy consumption monitoring unit based on smart Internet of things and monitoring method | |
| CN111711677A (en) | Virtual and real loop visualization method, system and medium for process layer switch of intelligent substation | |
| CN111985716B (en) | Passenger traffic volume prediction system with passenger traffic information visualization function | |
| CN107247797A (en) | Time scale measurement data-storage system and method in electric power scheduling automatization system based on Redis | |
| CN108572614B (en) | Casting equipment data acquisition and storage method based on configuration software KingView and PLC | |
| CN112488502A (en) | Standard water resource management integrated management and control platform | |
| CN107548087A (en) | A kind of method and device of warning association analysis | |
| CN109447466B (en) | Overall process visual management and control system based on power distribution network communication network construction | |
| CN111199055A (en) | Privacy public link block chain data visualization analysis method and system | |
| CN109726916A (en) | A method of suitable for highway life cycle management intelligent health monitoring | |
| CN111211557B (en) | Multi-level multi-branch power grid structure planning method and system | |
| CN103955863B (en) | A kind of processing method of power network monitoring device data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171110 |
|
| RJ01 | Rejection of invention patent application after publication |