CN112395317B - Method for collaborative design and achievement management of data model - Google Patents

Method for collaborative design and achievement management of data model Download PDF

Info

Publication number
CN112395317B
CN112395317B CN202011285390.3A CN202011285390A CN112395317B CN 112395317 B CN112395317 B CN 112395317B CN 202011285390 A CN202011285390 A CN 202011285390A CN 112395317 B CN112395317 B CN 112395317B
Authority
CN
China
Prior art keywords
model
data
design
unified
management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011285390.3A
Other languages
Chinese (zh)
Other versions
CN112395317A (en
Inventor
刘彩
陆鑫
阮秀琼
刘青
王金发
兰亮
邹枫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Big Data Center Of State Grid Corp Of China
State Grid Information and Telecommunication Co Ltd
Information and Telecommunication Branch of State Grid Fujian Electric Power Co Ltd
Great Power Science and Technology Co of State Grid Information and Telecommunication Co Ltd
Original Assignee
Big Data Center Of State Grid Corp Of China
State Grid Information and Telecommunication Co Ltd
Information and Telecommunication Branch of State Grid Fujian Electric Power Co Ltd
Great Power Science and Technology Co of State Grid Information and Telecommunication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Big Data Center Of State Grid Corp Of China, State Grid Information and Telecommunication Co Ltd, Information and Telecommunication Branch of State Grid Fujian Electric Power Co Ltd, Great Power Science and Technology Co of State Grid Information and Telecommunication Co Ltd filed Critical Big Data Center Of State Grid Corp Of China
Priority to CN202011285390.3A priority Critical patent/CN112395317B/en
Publication of CN112395317A publication Critical patent/CN112395317A/en
Application granted granted Critical
Publication of CN112395317B publication Critical patent/CN112395317B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24553Query execution of query operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/103Workflow collaboration or project management

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Resources & Organizations (AREA)
  • General Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Computational Linguistics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

A data model collaborative design and achievement management method comprises the steps that a data middle stage is built between a background stage and a foreground stage and is used for collaboration between background data development and foreground application development, a full-service unified data center is built at the background stage, a unified data model covering a plurality of theme domains is built through the full-service unified data center, the unified data model is issued to the data middle stage, and then the unified data model is processed by the data middle stage and distributed to the foreground stage; the invention establishes a unified data model standard in the early stage, lays a foundation for the subsequent development of the online management design work of the data model, establishes a data middle platform and an online management tool, modularizes the consistency processing of the design state and the operation state of the data model and the management function of the data model, realizes the online management of the design specification of the data model and the design result of the information model, realizes the online management of the whole process from design to application of the data model, and provides an online support means for the standard landing of the enterprise-level data model.

Description

Method for collaborative design and achievement management of data model
Technical Field
The invention relates to the field of data synchronization, in particular to a method for collaborative design and achievement management of a data model.
Background
At present, unified data model design and achievement management are achieved in an off-line mode, design achievements cannot be effectively precipitated, and the existing two-stage process management requirements cannot be completely met. Meanwhile, in the process of model management and use, the problems of difficulty in understanding model design abstraction, difficulty in model search and the like need to be solved.
The data model collaborative design and result management is a multi-scheme trial and multi-iteration process, and the data model collaborative design and result management process has the following problems:
(1) traditional offline management, multi-source design results are difficult to unify and management is disordered. The data model design result comprises result documents such as EA, Word, Excel and the like, is difficult to unify in the using and managing process, one-button type automatic management cannot be realized, the actual business can be continuously updated to match the management target of the company at the current stage, the data model also needs to be updated after the actual business is changed, the reporting problem of the province (municipal) company can only be realized in an offline mode, the online platform support capable of combing and reporting the demand problem is lacked, and the flow tracking and closed-loop management of the problem and the demand are difficult to be carried out. Therefore, there is a need for a unified management of historical versions of the universe standard model, keeping the data model available continuously.
(2) And (4) issuing an off-line model without a control flow, and failing to achieve two-stage user cooperative management. After the target data model is released, the two-stage versions of the personalized model of provincial (municipal) companies and the model of headquarters are not unified, the headquarters and each unit personalized data model cannot be managed, and the iterative evolution of the data model cannot form a complete closed-loop process.
(3) The model content is complex, abstract and readable, baseline control is lacked, version management is inefficient, business personnel have difficulty in understanding the model, and application capability is limited.
(4) Traditional manual traceability analysis is low in efficiency, traceability results are difficult to standardize and poor, and quality cannot be guaranteed. The model tracing analysis is to manually map a data table and map data fields, and the mapping result is managed in the form of an EXCEL table. When matching of fields and table mapping relations is carried out manually, static models and source system data need to be compared at the same time, so that efficiency is low, normalization of manually output resource manual files is insufficient, system verification cannot be effectively carried out, and quality is difficult to guarantee.
Disclosure of Invention
The invention aims to solve the problems in the prior art, provides a method for collaborative design and achievement management of a data model, and solves the problems of two-pole collaborative design, difficulty in abstract model design understanding, difficulty in model searching and the like.
The technical scheme adopted by the invention for solving the technical problems is as follows: a method for collaborative design and achievement management of a data model, comprising the steps of:
establishing a data center between a background and a foreground for cooperation between background data development and foreground application development, establishing a full-service unified data center at the background, establishing a unified data model covering a plurality of theme domains through the full-service unified data center, issuing the unified data model to the data center, and distributing the unified data model to the foreground after processing by the data center;
establishing a unified data dictionary base for uniformly extracting and displaying data models in an RDB (remote data base) database and an MPP (maximum power point) database of a source system and a data center and a data dictionary of a data center; and the smooth operation of the subsequent model auditing function is ensured.
The foreground carries out global model audit processing on the issued unified data model by using a global model audit management system, knows the overall situation by checking the local matching rate, the coverage rate and the consistency rate, respectively carries out corresponding perfection work aiming at each type of check, and ensures the support of the model on local application;
the scene model audit management system is used for carrying out scene model audit processing on the current unified data model, starting from the perspective of a business scene, carrying out local adaptability check in the range of the business scene, and ensuring the support strength of the model to the local application scene;
the foreground sorts the problems and requirements in the model application and reports the problems and requirements to the background, and the background feeds back the problems of the foreground;
based on a pre-constructed online collaborative design tool, foreground and background designers collaboratively develop model design online, record and archive the modification of design data, perform personalized design model, and output formatted model design result documents, including a personalized design result report, a resource list, an opinion confirmation and a model description;
the unified data model version on the background is compared, updated, audited, transmitted and released on line through a pre-constructed online management tool, the model visual display is realized, and model application personnel realize the model version floor implementation and the model version iterative design through model online monitoring management.
For further refinement, the construction of the unified data model comprises the following steps: accessing structured table data of a service system, cleaning and converting a source service system, a source table, a source field and a standard code, inputting cross-professional transverse service collaborative requirements and comprehensive application demonstration requirements, establishing a relational model, analyzing a data subject domain, combining data of an opinion confirmation and an individualized design result report in foreground and background collaborative design processes, designing and completing a core service logic model and a physical ER data model based on UML object-oriented design, and establishing a unified data model.
Further perfection, the subject area covers 10 subject areas, namely a personnel area, a financial area, a material area, a project area, an asset area, a power grid area, a customer area, a market area, a security area and a comprehensive area.
Further perfecting, the global model auditing treatment comprises the following steps: importing a data unified model in the global model audit management system; analyzing the model file, simultaneously carrying out model data matching rate detection and coverage rate detection, further carrying out model consistency detection after the coverage rate detection, then displaying the results of the model file, the coverage rate detection and the coverage rate detection in a sharing layer of a data center, judging whether the results are all 100%, and finishing if the results are all 100%; otherwise, reporting to the data center of the background, modifying by adopting a local perfection or on-demand supplementary access mode, and ending the flow.
Further perfecting, the scene model auditing treatment comprises the following steps: importing a data unified model after global model auditing processing into the scene model auditing system; selecting system, form and field information related to a scene; importing a scene requirement file; analyzing the model file, matching the background unified data model file, simultaneously checking the matching rate and the coverage rate of the model, further checking the consistency of the model after checking the coverage rate, checking the accuracy rate of the model after checking the consistency of the model, displaying the results of the model and the coverage rate in a sharing layer of a data center, judging whether the results are all 100 percent, and finishing the detection if the results are all 100 percent; otherwise, reporting to the data center of the background, and finishing the modification after the data modification, local perfection or supplementary access according to needs are adopted.
Further perfection, the online monitoring management comprises the following steps: service maintenance and use personnel extract metadata models of a source system, a RDB database and an MPP database of a data center regularly, the extracted data of this time is compared with the extracted data of the last time, whether information change exists or not is found, if yes, alarm information is pushed to the data center, the data center processes according to the alarm information, node objects in metadata streams are monitored, metadata of different types are extracted, metadata blood system analysis and influence analysis are conducted, data sources are deeply analyzed, the true reason of problems of backtracking path searching is found, influenced metadata are located through the incidence relation among the metadata, and targeted change is conducted.
Further perfection, the metadata model is based on CWM standard, and the incidence relation comprises the relation among the interface, the mechanism, the subject domain and the metadata of the data model; the node object comprises cross-regional circulation in the data center and an interface between the data center and an external service application system, and the metadata flow presents a monitoring result in a data flow graph mode and shows the service circulation condition of service data.
The invention has the beneficial effects that:
1. the invention optimizes the visual display function of the model, can analyze the requirements of model design and users through an online management tool, realizes the functions of model maps, model multidimensional views and the like, and can query and visually display the model on line, so that business personnel can understand the model more intuitively and the application level of the model is continuously improved.
2. The invention improves the model design auxiliary capacity, unifies the data model to standardize the model design format, provides the design template, can automatically analyze the EA model through the online collaborative design tool, derives the formatted model design result document, including the resource list, the model specification and the like, provides support for the model design work, reduces the manual input and reduces the error caused by maintaining the document.
3. The invention improves the management function of the model version, manages the comparison, update, audit, transmission and release of the unified data model version on the background on line by the online management tool which is constructed in advance, supports the tracing of the model change history and displays the version change history information;
4. the invention provides a two-stage cooperative management mechanism, which is characterized in that a data middle stage is arranged between a background and a foreground and is used for cooperation between background data development and foreground application development, a headquarter and province company two-stage model perfection, application cooperation and service support mechanism is established, the problem solving and demand response efficiency quality is improved, normal state optimization and landing application of a model are promoted together, and the model business, visual query and online management are realized through a model management tool.
5. The comprehensive support model application checking is realized by checking the model and the quality of the model through global model checking and scene model checking, the conformity checking of two-state models is supported, the comparison of a unified data model and a ground surface structure in a database is realized, the model difference is obtained, and the condition of 'two skins of the model' is found in time; supporting two-stage model conformity check, realizing model difference check of headquarters and provinces and cities, checking related model source systems according to a issued unified data model data resource manual through a traceability relation, and detecting the global model matching rate; from the perspective of business application, the coverage condition of the model to the application scene is checked by combing the model associated with the business scene, the coverage rate of the model to the application scene is evaluated, and the application level of the model is improved.
Drawings
FIG. 1 is a schematic structural view of the present invention;
FIG. 2 is a schematic diagram illustrating the global model audit management according to the present invention;
FIG. 3 is a diagram illustrating scene model audit management according to the present invention;
FIG. 4 is a schematic diagram of an online monitoring management system according to the present invention;
Detailed Description
The invention is further described below with reference to the accompanying drawings:
with reference to the accompanying drawings: in this embodiment, a method for collaborative design and achievement management of a data model includes:
a data middle stage is constructed between a background and a foreground for cooperation between background data development and foreground application development, a full-service unified data center is constructed at the background, a unified data model covering a plurality of theme domains is constructed through the full-service unified data center, and the unified data model is issued to the data middle stage and is distributed to the foreground after being processed by the data middle stage; the data center platform is a platform for performing service processing on common business and data of enterprises and precipitating globally shared data service to form flexible and strong shared service capacity for front-end business application construction or direct data analysis calling, the problems of cross-professional business process breakpoints, integrated through-wall punching, data barriers, unmatched management granularity and the like can be solved by constructing the data center platform, resources, systems and data are upgraded to an enterprise level, and an enterprise level shared service framework is constructed. The construction and application of the data center station can promote data fusion in various fields such as power grids, clients, industries, finance, internationalization and the like, provide open sharing services for various major, basic units and external partners, and stimulate the generation of new technologies, new standards and new business modes.
Establishing a unified data dictionary base for uniformly extracting and displaying data models in an RDB (remote data base) database and an MPP (maximum power point) database of a source system and a data center and a data dictionary of a data center; and ensuring the smooth operation of the subsequent model auditing function. The method has the advantages that the model design results can be quickly inquired in the database dictionary, the visual display of the model is high, and business personnel are assisted to better understand the application model. Business staff can know and look over the existing model results in a visual and understandable mode, and look up the model from different perspectives, such as: the distribution condition of each topic domain model and the change condition of the model guide a user to search the model from a business view and understand the model, directory query and model table or field positioning are carried out through a flexible retrieval mode, model changes among different versions are dynamically sensed, and the association relationship of the models is displayed. Model designers can know specific table, field and attribute information in a visual mode, and the difference and evolution process among different versions, assist the designers to find problems in the model, ensure the ordered updating and smooth transition of the model among different versions, provide support for model tracing and reexamination, and ensure the continuous iteration and perfection of the model.
The database dictionary library includes the following three functions:
(1) the model overview shows concept, logic and physical model design results from the dimensions of standard second-level themes, and mainly shows the number of the second-level themes and the number of entity tables and attributes under the themes.
(2) Model directory query, which supports the online query function of the model, realizes directory query according to the directory, multi-view directory screening and multi-condition query; and expanding detailed information of the model through the query result of the model, wherein the detailed information comprises model outline, model attribute, model correlation analysis, model relation and the like.
(3) And model guide query, wherein the model guide query provides two visual angles of service functions and service themes, and guides a user to search the model step by step in a guide manner.
The foreground carries out global model audit processing on the issued unified data model by utilizing a global model audit management system, knows the overall situation through checking the local matching rate, the coverage rate and the consistency rate, carries out corresponding perfection work aiming at each type of check respectively and ensures the support of the model to local application; because the unified data model is designed by a background headquarter design group by integrating the conditions of the foreground of each network, the unified data model does not necessarily adapt to the actual conditions of each foreground company, before the model is applied, the unified data model needs to be subjected to physical examination, and the adaptability of the unified data model in the local is checked, wherein the adaptability comprises a matching rate, a coverage rate, a consistency rate and the like. Through the matching rate check, the matching condition of the source system of the unified data model and the local source service system can be known, and whether the condition of data access is met or not is obtained; the landing condition of the data model in the MPP can be known through coverage rate inspection, and whether the current state of a data warehouse can support the development of a service scene is obtained; whether the standard model of the ground model in the MPP is consistent with the standard model of the unified data model can be known through consistency rate check, and the accuracy of data sources is guaranteed.
The scene model audit management system is used for carrying out scene model audit processing on the current unified data model, starting from the perspective of a business scene, carrying out local adaptability check in the range of the business scene, and ensuring the support strength of the model to the local application scene; the unified data model is a data format of a unified data warehouse, has a unified standard, promotes data sharing and service cooperation, and promotes iterative improvement of the model through the service scene construction requirement issued in a unified mode and the requirement of the foreground self-construction scene. The specific problems of the standard unified data model can be found through checking the matching rate, the coverage rate, the consistency rate and the accuracy rate of the scene development model, relevant departments and relevant personnel are called to perform targeted processing and solving, meanwhile, the model is continuously iterated and perfected through feeding back a background headquarter model design group, and the standard unified data model finally supports the application of all business collaboration scenes and decision analysis.
The foreground sorts the problems and requirements in the model application and reports the problems and requirements to the background, and the background feeds back the problems of the foreground; based on a pre-constructed online collaborative design tool, foreground and background designers collaboratively develop model design online, record and archive the modification of design data, individually design the model, and output formatted model design result documents, including an individual design result report, a resource list, an opinion confirmation and a model description; the unified data model design result is still managed in a offline mode, the design result cannot be effectively precipitated, and a demand flow tracking mechanism and a closed-loop management mechanism are not established yet. The online collaborative design tool realizes the construction of a two-stage collaborative system mechanism, supports the personalized online design of the model and submits the personalized online design to the headquarter through the online collaborative design tool. The two stages of supports jointly solve the problems encountered in the application of the model, the one-key release of the model is realized, and the support model effectively falls to the ground. Based on a model management tool, the model design result is solidified, the model management flow is standardized, the online management of model service requirements, problem management, version release and assessment and evaluation is realized, and the model management and application level is continuously improved. For the design of the model, a model designer mainly carries out unified data model design by an online collaborative design tool, and the design result is packed and issued to companies of various provinces by automatically generating document materials such as Word, Excel and the like, so that the updating record checking is convenient, and a tool supporting online release and management of the model design result is urgently needed.
The model design workload is large, designers in each domain can complete the design in a collaborative mode through an online collaborative design tool, the model modification records can be automatically filed, the versions are automatically compared, model achievements and output function requirements are automatically generated, and therefore the models can be liberated from transactional work.
The unified data model version on the background is compared, updated, audited, transmitted and released on line through a pre-constructed online management tool, the model visual display is realized, and model application personnel realize the model version floor implementation and the model version iterative design through model online monitoring management. The company model application personnel manage the model on line, and in the process of model iteration improvement, the model application personnel check the version difference under the line to intelligently adjust, so that the working efficiency is improved, and the model application is helped to fall to the ground. Model application personnel can manage the version in an online mode, release model results in one key mode, check maintenance updating records of a model baseline version, support automatic generation and online checking and downloading of model version revision specification documents, and check the version results before the model is released in a fixed version mode. The online difference analysis of the new and old version data models is realized, the updating content of the release version is accurately obtained, and the model version is supported to fall to the ground to implement rapid iteration.
The construction of the unified data model comprises the following steps: accessing structured table data of a service system, cleaning and converting a source service system, a source table, a source field and a standard code, inputting cross-professional transverse service collaborative requirements and comprehensive application demonstration requirements, establishing a relational model, analyzing a data subject domain, combining data of an opinion confirmation and an individualized design result report in foreground and background collaborative design processes, designing and completing a core service logic model and a physical ER data model based on UML object-oriented design, and establishing a unified data model. The subject area covers 10 subject areas, namely a personnel area, a financial area, a material area, a project area, an asset area, a power grid area, a client area, a market area, a safety area and a comprehensive area.
The global model auditing treatment comprises the following steps: importing a data unified model in the global model audit management system; analyzing the model file, simultaneously carrying out model data matching rate detection and coverage rate detection, further carrying out model consistency detection after the coverage rate detection, then displaying the results of the model file, the coverage rate detection and the coverage rate detection in a sharing layer of a data center, judging whether the results are all 100%, and finishing if the results are all 100%; otherwise, reporting to the data center of the background, modifying by adopting a local perfection or on-demand supplementary access mode, and ending the flow. The scene model auditing treatment comprises the following steps: importing a data unified model after global model auditing processing into the scene model auditing system; selecting system, table and field information related to a scene; importing a scene requirement file; analyzing the model file, matching the background unified data model file, simultaneously checking the matching rate and the coverage rate of the model, further checking the consistency of the model after checking the coverage rate, checking the accuracy rate of the model after checking the consistency of the model, displaying the results of the model and the coverage rate in a sharing layer of a data center, judging whether the results are all 100 percent, and finishing the detection if the results are all 100 percent; otherwise, reporting to the data center of the background, and finishing the modification after the data modification, local perfection or on-demand supplementary access mode is adopted. Consistency includes model structure consistency (table name, table description, field name, field type/length, field description), extension model repeatability (whether there is a duplicate definition), extension model rationality (whether the extended physical model is overlaid in the benchmark version, whether the extended physical model follows the logical model). And establishing a model application checking mechanism, and developing model checking at the stages of information project summary evaluation, third-party test and the like by an automatic means, so that the unification of the data standards of the whole network is promoted, and the service cooperation and the data sharing are realized.
The online monitoring management comprises the following steps: service maintenance and use personnel regularly extract metadata models of an RDB database and an MPP database of a source system and a data center, know metadata of nodes in each data circulation process, compare the extracted data with the extracted data last time, finally achieve the aim of monitoring all metadata and model change information, find whether information change exists or not, if so, push alarm information to the data center, the data center processes the alarm information, monitors node objects in metadata flow, extracts metadata of different types, analyzes and analyzes metadata ancestry and influence, deeply analyzes data sources, backtracks the real reason of a path search problem, positions the influenced metadata through the incidence relation between the metadata, and performs targeted change to ensure the normal operation of each module of a model online control tool. The metadata model is based on CWM standard, and the incidence relation comprises the relation among an interface, an organization, a subject domain and metadata of the data model; the node object comprises cross-regional circulation in the data center and an interface between the data center and an external service application system, and the metadata flow presents a monitoring result in a data flow graph mode and shows the service circulation condition of service data.
The invention establishes a unified data model standard in the early stage, lays a foundation for the subsequent development of the online management design work of the data model, establishes a data middle platform, a data dictionary library, a global model audit management system, a scene model audit management system, an online collaborative design tool and an online management tool, modularizes the consistency processing of the design state and the operation state of the data model and the management function of the data model, realizes the online management of the design specification of the data model and the design result of the information model, realizes the online application of the model design specification and the information model, realizes the online management of the whole process from the design to the application of the data model, and provides an online support means for the standard landing of the enterprise-level data model.
While the invention has been shown and described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the scope of the appended claims.

Claims (6)

1. A method for collaborative design and achievement management of a data model is characterized by comprising the following steps:
establishing a data center between a background and a foreground for cooperation between background data development and foreground application development, establishing a full-service unified data center at the background, establishing a unified data model covering a plurality of theme domains through the full-service unified data center, issuing the unified data model to the data center, and distributing the unified data model to the foreground after processing by the data center;
establishing a unified data dictionary base for uniformly extracting and displaying data models in the RDB database and the MPP database of the source system and the data center and a data dictionary of the data center;
the foreground carries out global model audit processing on the issued unified data model by utilizing a global model audit management system, knows the overall situation through checking the local matching rate, the coverage rate and the consistency rate, carries out corresponding perfection work aiming at each type of check respectively and ensures the support of the model to local application;
a scene model audit management system is used for carrying out scene model audit processing on the current unified data model, starting from the perspective of a business scene, local adaptability check in the business scene range is carried out, and the support strength of the model to the local application scene is guaranteed;
the foreground sorts the problems and requirements in the model application and reports the problems and requirements to the background, and the background feeds back the problems of the foreground;
based on a pre-constructed online collaborative design tool, foreground and background designers collaboratively develop model design online, record and archive the modification of design data, perform personalized design model, and output formatted model design result documents, including a personalized design result report, a resource list, an opinion confirmation and a model description;
the unified data model version on the background is managed by comparing, updating, auditing, transmitting and releasing on line through a pre-constructed online management tool, so that the model is visually displayed, and model application personnel realize model version landing implementation and model version iterative design through model online monitoring management;
the construction of the unified data model comprises the following steps: accessing structured table data of a service system, cleaning and converting a source service system, a source table, a source field and a standard code, inputting cross-professional transverse service collaborative requirements and comprehensive application demonstration requirements, establishing a relational model, analyzing a data subject domain, combining data of an opinion confirmation and an individualized design result report in foreground and background collaborative design processes, designing and completing a core service logic model and a physical ER data model based on UML object-oriented design, and establishing a unified data model.
2. The method of claim 1, wherein the data model is a collaborative design and result management method, comprising: the subject area covers 10 subject areas, namely a personnel area, a financial area, a material area, a project area, an asset area, a power grid area, a client area, a market area, a safety area and a comprehensive area.
3. The method of claim 1, wherein the data model comprises a collaborative design and result management method, and the method comprises: the global model auditing treatment comprises the following steps: importing a data unified model in the global model audit management system; analyzing the model file, simultaneously carrying out model data matching rate detection and coverage rate detection, further carrying out model consistency detection after the coverage rate detection, then displaying the results of the model file, the coverage rate detection and the coverage rate detection in a sharing layer of a data center, judging whether the results are all 100%, and finishing if the results are all 100%; otherwise, reporting to the data center of the background, modifying by adopting a local perfection or on-demand supplementary access mode, and ending the flow.
4. The method of claim 3, wherein the data model is a collaborative design and achievement management method, and the method comprises the following steps: the scene model auditing treatment comprises the following steps: importing a data unified model after global model auditing processing into the scene model auditing system; selecting system, form and field information related to a scene; importing a scene requirement file; analyzing the model file, matching the background unified data model file, simultaneously checking the matching rate and the coverage rate of the model, further checking the consistency of the model after checking the coverage rate, checking the accuracy rate of the model after checking the consistency of the model, displaying the results of the model and the coverage rate in a sharing layer of a data center, judging whether the results are all 100 percent, and finishing the detection if the results are all 100 percent; otherwise, reporting to the data center of the background, and finishing the modification after the data modification, local perfection or on-demand supplementary access mode is adopted.
5. The method of claim 1, wherein the data model comprises a collaborative design and result management method, and the method comprises: the online monitoring management comprises the following steps: service maintenance and user personnel regularly extract metadata models of a source system, a RDB (remote data base) and an MPP (maximum power point) database of a data center, compare the extracted data with the extracted data last time, find whether information change exists or not, if so, send alarm information to the data center, process the data center according to the alarm information, monitor node objects in metadata streams, extract metadata of different types, analyze and analyze influence of metadata ancestry, deeply analyze data sources, backtrack the real reason of a path search problem, locate the influenced metadata through an incidence relation between the metadata, and perform targeted change.
6. The method of claim 5, wherein the data model is a collaborative design and result management method, comprising: the metadata model is based on CWM standard, and the incidence relation comprises the relation among an interface, an organization, a subject domain and the metadata of the data model; the node object comprises cross-regional circulation in the data center and an interface between the data center and an external service application system, and the metadata flow presents a monitoring result in a data flow graph mode and shows the service circulation condition of service data.
CN202011285390.3A 2020-11-17 2020-11-17 Method for collaborative design and achievement management of data model Active CN112395317B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011285390.3A CN112395317B (en) 2020-11-17 2020-11-17 Method for collaborative design and achievement management of data model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011285390.3A CN112395317B (en) 2020-11-17 2020-11-17 Method for collaborative design and achievement management of data model

Publications (2)

Publication Number Publication Date
CN112395317A CN112395317A (en) 2021-02-23
CN112395317B true CN112395317B (en) 2022-09-09

Family

ID=74600565

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011285390.3A Active CN112395317B (en) 2020-11-17 2020-11-17 Method for collaborative design and achievement management of data model

Country Status (1)

Country Link
CN (1) CN112395317B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113204329A (en) * 2021-03-19 2021-08-03 浙江华云信息科技有限公司 Control method for driving business application by unified data model and application system thereof
CN114115883B (en) * 2022-01-26 2022-06-03 广州云徙科技有限公司 Method for quickly constructing front-end application by using middle station service capability
CN114493531A (en) * 2022-01-27 2022-05-13 广州智算信息技术有限公司 Intelligent model multi-person cooperation management platform based on AI big data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9158796B1 (en) * 2013-03-11 2015-10-13 Ca, Inc. Data source modeling methods for heterogeneous data sources and related computer program products and systems
CN106339509A (en) * 2016-10-26 2017-01-18 国网山东省电力公司临沂供电公司 Power grid operation data sharing system based on large data technology
CN109829660A (en) * 2019-03-01 2019-05-31 国网上海市电力公司 Data processing system and its design method based on electric power enterprise grade data model

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9158796B1 (en) * 2013-03-11 2015-10-13 Ca, Inc. Data source modeling methods for heterogeneous data sources and related computer program products and systems
CN106339509A (en) * 2016-10-26 2017-01-18 国网山东省电力公司临沂供电公司 Power grid operation data sharing system based on large data technology
CN109829660A (en) * 2019-03-01 2019-05-31 国网上海市电力公司 Data processing system and its design method based on electric power enterprise grade data model

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"基于数据中台的电力企业数据资产";李志, 费晓璐等;《电力信息与通信技术》;20200731;全文 *

Also Published As

Publication number Publication date
CN112395317A (en) 2021-02-23

Similar Documents

Publication Publication Date Title
CN112395317B (en) Method for collaborative design and achievement management of data model
CN112395325A (en) Data management method, system, terminal equipment and storage medium
CN105022769A (en) Data interaction system of urban underground pipeline, and method thereof
CN115934680B (en) One-stop big data analysis processing system
CN111651431A (en) Database service oriented management flow standardization method
CN105760520A (en) Data control platform and architecture
CN115271369A (en) Equipment information management method, system and storage medium based on knowledge graph
CN109213826A (en) Data processing method and equipment
CN116662441A (en) Distributed data blood margin construction and display method
CN112559351A (en) CFD software verification and confirmation database platform
CN104766240A (en) Electronic banking data processing system and method
CN115640300A (en) Big data management method, system, electronic equipment and storage medium
CN115169011A (en) Editing system and application system of airplane assembly outline
CN111475499A (en) System and method for realizing intelligent supervision service control based on data modeling analysis
CN111461644A (en) Audit information management and control platform
Glava et al. Information Systems Reengineering Approach Based on the Model of Information Systems Domains
CN113722564A (en) Visualization method and device for energy and material supply chain based on space map convolution
CN110019118A (en) The system and method for database O&M efficiency are promoted based on DevOps
Wahyudi et al. Improving company performance by the correctness of management decision through implementation dashboard using power BI tools (case study at company Y)
KR101365481B1 (en) System for generating and managing a portal for program management
CN114911773B (en) Universal meta-model design method
CN111914417A (en) Plan and budget simulation analysis system
CN112288614A (en) Data processing method and device based on data resource platform
CN117056308A (en) Method for generating financial big data blood-edge relation based on OpenLinear database
CN109670728B (en) Ship design quality information management system based on database

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant