CN104361086A - Data integration method for measurable asset entire life-cycle management system - Google Patents
Data integration method for measurable asset entire life-cycle management system Download PDFInfo
- Publication number
- CN104361086A CN104361086A CN201410650601.7A CN201410650601A CN104361086A CN 104361086 A CN104361086 A CN 104361086A CN 201410650601 A CN201410650601 A CN 201410650601A CN 104361086 A CN104361086 A CN 104361086A
- Authority
- CN
- China
- Prior art keywords
- data
- life cycle
- whole
- attribute
- operation system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
- G06F16/212—Schema design and management with details for data modelling support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Probability & Statistics with Applications (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a data integration method for a measurable asset entire life-cycle management system. The method comprises the following steps of [S1], establishing a unified data model and standard codes; [S2], extracting, cleaning, converting and loading data of source service systems to a structured data center; [S3], forming corresponding data analysis subjects by virtue of specific service modules of the measurable asset entire life-cycle management system; [S4], integrating the data of the structured data center to each data analysis subject in extraction, conversion and loading modes. According to the method, the data of each source service system can be efficiently integrated in the entire life-cycle management system, and the efficiency and the quality of data access integration are improved.
Description
Technical field
The present invention relates to electric-power metering field, particularly a kind of integrated method of measuring asset life-cycle management system data.
Background technology
Measuring asset life-cycle management system is with each link detailed data of withdrawal of assets, the index system, the standardized estimation flow that set up the mathematical model of the various dimensions of lean, quantize, realize the quality analysis of measuring asset life cycle management, supplier evaluation, life appraisal, risk profile, administrative evaluation comprehensively.
The service link data of measuring asset life-cycle are from marketing system, power information acquisition system and metering Production Scheduling System, because each system Construction cycle is longer, for the mode meeting the many employings of its data interactive requirements " point-to-point " interface realizes the data integration of system and external system, cause integrated complex between system, data interaction efficiency is lower, and data content, data layout and the quality of data are different, hinder data in each application system mutual with share, be unfavorable for expansion and the maintenance of system.
Therefore, carry out efficient data integration for measuring asset whole-life cycle fee system, meet the data access demand of fast and stable, improve data access efficiency, become a problem urgently to be resolved hurrily.
Summary of the invention
The object of the invention is the deficiency existed for prior art, solve existing measuring asset whole-life cycle fee system and marketing system, power information acquisition system and " point-to-point " mode between Production Scheduling System of measuring obtain data efficiency lower, be not easy to the problem safeguarded, meet the requirements for access of whole-life cycle fee system to other each system datas, make whole-life cycle fee system can obtain various related data according to self-demand, and be easy to safeguard, easy to operate.
For achieving the above object, the present invention's knowledge can adopt following technical scheme:
A kind of integrated method of measuring asset whole-life cycle fee system data, by comprising the data integration of the operation system of marketing system, power information acquisition system and metering Production Scheduling System to unified structural data center, by access structure data center integrating metrology assets whole-life cycle fee system associated traffic data;
Specifically comprise the following steps:
[S1] sets up unified data model and standard code;
[S2] is loaded into structural data center to the data pick-up of source operation system, cleaning, conversion;
The concrete business module of [S3] combining target system forms corresponding data analysis theme;
The data at structural data center carry out extracting by [S4], transform, load mode is integrated into each data analysis theme.
In described step S1, the content of unified Data Model Designing is: establish model and requirement analysis report according to IEC-CIM model, SG-CIM model, each operation system mark, extraction logic data model from top layer business object; Data Model Designing is divided into master data modelling and shared Transaction Information modelling; Master data modelling establishes middle combing archives class data and standard code from each operation system mark, and carries out integration formation to these data; Share Transaction Information modelling to be between each operation system, to have the data of integrated demand to extract between each operation system and external system to be formed.
Further, described unified standard code transfer process comprises the following steps:
11) document is established to extract the standard code of each operation system by mark;
12) to Property Name with code is identical merges;
13) attribute-name is extracted identical, the attribute that code is different;
14) question attributes that previous step is extracted is analyzed;
15) testing in depth testing, extract attribute-name different, the identical attribute of code is analyzed;
16) analytic attribute name is different, the attribute that code is identical;
17) all kinds of result is merged, formed and merge community set.
In described step S2, described source operation system content comprises: marketing system, power information acquisition system and provincial metering Production Scheduling System;
Further, the content of described extraction, cleaning, conversion, loading: extraction is the process of extracted data from data source; Those undesirable data are filtered in cleaning, comprise incomplete data, the data of mistake, the data of repetition; Conversion be the data of inconsistent data layout, mistake are inputted, different data granularities changes;
Further, the composition at described structural data center and stream compression: structural data center comprises data buffer area, common storage area (ODS), in real time ODS, Data Warehouse for Enterprises; Data Replica is directly carried out from marketing system, power information acquisition system and metering Production Scheduling System in data buffer area; Common storage area (ODS) extracts, changes, loads data from data buffer area; Real-time ODS carries out data Replica in real time from data buffer area; Data Warehouse for Enterprises is extracted data from common storage area.
In described step S3, described goal systems content: measuring asset whole-life cycle fee system;
Further, the content of described data analysis theme: data analysis theme is, according to the business of whole-life cycle fee, demand is divided into corresponding theme, and namely each theme represents the integrated data of respective business module.
In described step S4, described data converted contents: data conversion is business rule according to each data analysis theme and relevant data target, performs the process of logical calculated that business is correlated with and polymerization to the data in datumization structure centre.
The beneficial effect that the present invention reaches: the present invention is by formulating unified data model and standard code, set up structured data center, and form data analysis theme corresponding to whole-life cycle fee business, achieve marketing system, power information acquisition system and metering Production Scheduling System analyze theme data integration for whole-life cycle fee corresponding data, improve efficiency and the quality of Data Access Integration.
Accompanying drawing explanation
Fig. 1 is the integrated basic flow sheet of whole-life cycle fee system data;
Fig. 2 is the structural representation at structural data center;
Fig. 3 is the system construction drawing of a kind of embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the invention will be further described.
As depicted in figs. 1 and 2, the basic procedure of a kind of integrated method of measuring asset whole-life cycle fee system data is:
11) unified data model and standard code is set up;
12) source business datum is extracted from each system cleaning and be transformed into structural data center;
13) perform corresponding number according to life-cycle management business and extract transfer process, by Data import to corresponding data analysis theme.
For making object of the present invention, technical scheme and advantage clearly, be described in detail below in conjunction with accompanying drawing 3 pairs of specific embodiments of the invention.At this, schematic description and description of the present invention is for explaining the present invention, but not as limiting to the invention.
Embodiment one
The present embodiment is whole-life cycle fee system integrated associated traffic data from marketing system, power information acquisition system and metering Production Scheduling System.Fig. 3 is embodiments of the invention system construction drawings, and wherein, in figure, the unit of dotted line frame relevant with this method importantly associates part, but do not belong to this method system.
Specifically implement to be further described in detail to the present invention below in conjunction with accompanying drawing, the implementation step of data integration is:
21) from marketing system, power information acquisition system and metering Production Scheduling System through data Replica mode by each service source Data import to data buffer area;
22) the service source detailed data of data buffer area carried out extract according to the data model of Uniting and unified standard code, clear up, change, be loaded on common storage area (ODS), comprise primary data store district and shared transactional data memory block;
23) carry out real time business source data to marketing system, power information acquisition system and metering Production Scheduling System to copy, by Data import to real-time common storage area (real-time ODS);
24) according to the data model of Uniting and unified standard code, real time traffic data is extracted from real-time ODS, clear up, changes, is loaded on ODS;
25) master data in common storage area (ODS) and shared transactional data are drawn into data warehouse;
26) according to the business module of whole-life cycle fee system, corresponding service logic is performed by extraction, conversion regime by data analysis theme extremely corresponding for the Data import in data warehouse;
27) according to the business module of whole-life cycle fee system, perform corresponding service logic and be loaded on corresponding data analysis theme by extraction, conversion regime from real-time ODS extraction conversion;
28) namely corresponding data analysis theme represents the integrated data of respective business module.
Claims (5)
1. the integrated method of measuring asset whole-life cycle fee system data, it is characterized in that, by comprising the data integration of the operation system of marketing system, power information acquisition system and metering Production Scheduling System to unified structural data center, by access structure data center integrating metrology assets whole-life cycle fee system associated traffic data;
Specifically comprise the following steps:
[S1] sets up unified data model and standard code;
[S2] is loaded into structural data center to the data pick-up of source operation system, cleaning, conversion;
The concrete business module of [S3] combining target system forms corresponding data analysis theme;
The data at structural data center carry out extracting by [S4], transform, load mode is integrated into each data analysis theme.
2. the integrated method of measuring asset whole-life cycle fee system data according to claim 1, it is characterized in that, the content of unified Data Model Designing is: establish model and requirement analysis report according to IEC-CIM model, SG-CIM model, each operation system mark, extraction logic data model from top layer business object; Data Model Designing is divided into master data modelling and shared Transaction Information modelling; Master data modelling establishes middle combing archives class data and standard code from each operation system mark, and carries out integration formation to these data; Share Transaction Information modelling to be between each operation system, to have the data of integrated demand to extract between each operation system and external system to be formed.
3. the integrated method of measuring asset whole-life cycle fee system data according to claim 1, is characterized in that, described unified standard code transfer process comprises the following steps:
11) document is established to extract the standard code of each operation system by mark;
12) to Property Name with code is identical merges;
13) attribute-name is extracted identical, the attribute that code is different;
14) question attributes that previous step is extracted is analyzed;
15) testing in depth testing, extract attribute-name different, the identical attribute of code is analyzed;
16) analytic attribute name is different, the attribute that code is identical;
17) all kinds of result is merged, formed and merge community set.
4. the integrated method of measuring asset whole-life cycle fee system data according to claim 1, it is characterized in that, composition and the stream compression at described structural data center are specially: structural data center comprises data buffer area, common storage area, in real time common storage area, Data Warehouse for Enterprises; Data Replica is directly carried out from marketing system, power information acquisition system and metering Production Scheduling System in data buffer area; Common storage area extracts, changes, loads data from data buffer area; Real-time common storage area carries out data Replica in real time from data buffer area; Data Warehouse for Enterprises is extracted data from common storage area.
5. the integrated method of measuring asset whole-life cycle fee system data according to claim 1, it is characterized in that, the content of described data analysis theme is: data analysis theme is, according to the business of whole-life cycle fee, demand is divided into corresponding theme, and namely each theme represents the integrated data of respective operation system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410650601.7A CN104361086A (en) | 2014-11-14 | 2014-11-14 | Data integration method for measurable asset entire life-cycle management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410650601.7A CN104361086A (en) | 2014-11-14 | 2014-11-14 | Data integration method for measurable asset entire life-cycle management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104361086A true CN104361086A (en) | 2015-02-18 |
Family
ID=52528346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410650601.7A Pending CN104361086A (en) | 2014-11-14 | 2014-11-14 | Data integration method for measurable asset entire life-cycle management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104361086A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105303455A (en) * | 2015-10-16 | 2016-02-03 | 国家电网公司 | Power enterprise user data storage and analysis system |
| CN106599203A (en) * | 2016-12-15 | 2017-04-26 | 中国南方电网有限责任公司超高压输电公司 | Data quality improvement method for full life cycle of asset |
| CN107423268A (en) * | 2016-05-24 | 2017-12-01 | 罗克韦尔自动化技术公司 | Industrial automation assets model and synchronization |
| CN112511493A (en) * | 2020-10-30 | 2021-03-16 | 深圳市金蝶天燕云计算股份有限公司 | Service data message processing method and device, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101826100A (en) * | 2010-03-16 | 2010-09-08 | 中国测绘科学研究院 | Automatic integrated system and method of wide area network (WAN)-oriented multisource emergency information |
| US20110295865A1 (en) * | 2010-05-27 | 2011-12-01 | Microsoft Corporation | Schema Contracts for Data Integration |
| CN102930393A (en) * | 2012-10-25 | 2013-02-13 | 海南电网公司 | Comprehensive power grid information display visualization system |
-
2014
- 2014-11-14 CN CN201410650601.7A patent/CN104361086A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101826100A (en) * | 2010-03-16 | 2010-09-08 | 中国测绘科学研究院 | Automatic integrated system and method of wide area network (WAN)-oriented multisource emergency information |
| US20110295865A1 (en) * | 2010-05-27 | 2011-12-01 | Microsoft Corporation | Schema Contracts for Data Integration |
| CN102930393A (en) * | 2012-10-25 | 2013-02-13 | 海南电网公司 | Comprehensive power grid information display visualization system |
Non-Patent Citations (3)
| Title |
|---|
| 付立辰: "电力企业中数据仓库模型的研究与应用", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 徐晴: "计量资产全寿命周期质量管理中的大数据分析应用", 《电力需求侧管理》 * |
| 李雪梅 等: "基于企业级数据模型构建数据中心的探索", 《电力信息化》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105303455A (en) * | 2015-10-16 | 2016-02-03 | 国家电网公司 | Power enterprise user data storage and analysis system |
| CN107423268A (en) * | 2016-05-24 | 2017-12-01 | 罗克韦尔自动化技术公司 | Industrial automation assets model and synchronization |
| CN106599203A (en) * | 2016-12-15 | 2017-04-26 | 中国南方电网有限责任公司超高压输电公司 | Data quality improvement method for full life cycle of asset |
| CN106599203B (en) * | 2016-12-15 | 2021-01-01 | 中国南方电网有限责任公司超高压输电公司 | Data quality improvement method for asset full life cycle |
| CN112511493A (en) * | 2020-10-30 | 2021-03-16 | 深圳市金蝶天燕云计算股份有限公司 | Service data message processing method and device, computer equipment and storage medium |
| CN112511493B (en) * | 2020-10-30 | 2022-10-11 | 深圳市金蝶天燕云计算股份有限公司 | Service data message processing method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102609417B (en) | Engine device and method for data integration and exchange of building information mode based on IFC (industry foundation classes) standards | |
| CN103473672A (en) | System, method and platform for auditing metadata quality of enterprise-level data center | |
| CN113064866B (en) | Power business data integration system | |
| CN109885626A (en) | Urban construction digital archives intelligent management system based on structural data and BIM model | |
| CN106022617A (en) | Inspection control system based on marketing multi-system data center | |
| CN105574667A (en) | Nuclear power design data integration method and system | |
| Ni et al. | Blockchain-based BIM digital project management mechanism research | |
| CN104361086A (en) | Data integration method for measurable asset entire life-cycle management system | |
| CN102495916A (en) | Multi-application-system panoramic modeling method based on object matching | |
| CN103455896A (en) | Paperless assembling quality control method based on internet of things | |
| CN112883001A (en) | Data processing method, device and medium based on marketing and distribution through data visualization platform | |
| CN106022640B (en) | Electric quantity index checking system and method | |
| CN103606032A (en) | Two-dimensional grid GIS data concentration method | |
| CN114218291A (en) | Portrait generation method, apparatus, device and storage medium based on target object | |
| Barbini et al. | BIM objects library for information exchange in public works: The use of proprietary and open formats | |
| CN103247087A (en) | City distribution network graphical intelligent anti-misoperation system and method of system | |
| CN109522292A (en) | Data processing equipment and method based on power grid standard uniform information model | |
| Love et al. | Moving beyond CAD to an object-oriented approach for electrical control and instrumentation systems | |
| CN104077359A (en) | Data cleaning and integrating intelligent system | |
| CN201732392U (en) | Material and equipment corresponding relationship information processing device applicable to electric power system | |
| KR20210053563A (en) | Construction information management system with using big data processing | |
| CN107436928A (en) | The through-flow method of amount valency of substation project | |
| CN109947867A (en) | Electric Power Network Planning data fusion method based on function support dimension | |
| CN109522367B (en) | The data processing equipment and method of power grid uniform information model | |
| Jing et al. | Research on Data Assets and Their Appraisal Models |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151103 Address after: 210061 D11 building, hi tech Development Zone, Jiangsu, Nanjing Applicant after: Nanjing Nari Co., Ltd. Applicant after: NARI Technology Development Co., Ltd. Applicant after: SGCC NARI Nanjing Control System Co., Ltd. Address before: High road high tech Zone of Nanjing City, Jiangsu Province, No. 20 210061 Applicant before: NARI Technology Development Co., Ltd. Applicant before: SGCC NARI Nanjing Control System Co., Ltd. |
|
| CB03 | Change of inventor or designer information |
Inventor after: Li Tianyang Inventor after: Peng Chuning Inventor after: Du Xingang Inventor after: Ge Dehui Inventor after: Xu Shiming Inventor after: Liu Aihua Inventor after: Ye Jianbin Inventor after: Wang Liang Inventor after: Chu Pengfei Inventor after: Dai Rui Inventor after: Li Yanman Inventor after: Gao Chunlei Inventor after: Hou Yanli Inventor after: Du Shuwei Inventor before: Li Tianyang Inventor before: Ye Jianbin Inventor before: Wang Liang Inventor before: Chu Pengfei Inventor before: Dai Rui Inventor before: Li Yanman Inventor before: Gao Chunlei Inventor before: Hou Yanli |
|
| COR | Change of bibliographic data | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150218 |