CN110019176A - Improve the data improvement control system that data administer service success rate - Google Patents
Improve the data improvement control system that data administer service success rate Download PDFInfo
- Publication number
- CN110019176A CN110019176A CN201910288687.6A CN201910288687A CN110019176A CN 110019176 A CN110019176 A CN 110019176A CN 201910288687 A CN201910288687 A CN 201910288687A CN 110019176 A CN110019176 A CN 110019176A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- service
- metadata
- subsystem
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/604—Tools and structures for managing or administering access control systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6227—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database where protection concerns the structure of data, e.g. records, types, queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/2141—Access rights, e.g. capability lists, access control lists, access tables, access matrices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Automation & Control Theory (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Storage Device Security (AREA)
Abstract
The present invention relates to a kind of data that raising data administer service success rate to administer control system, including resource differentiated control subsystem, administers tissue, verifying user identity, rights management and distribution resource for building data；Metadata management subsystem, for acquisition technique, business, operation and the metadata of management, and association analysis metadata；Model construction subsystem, service concept for identification, and construct enterprise data model；Data standard sub-systems, for formulating unified data service language；Data administer operation subsystem, administer long-acting operation architecture for establishing data.Control system is administered using the data that raising data of the invention administer service success rate, realizes easy to operate, the efficiency of service of data improvement is can greatly improve and is implemented as the ability of power；The system that a closed loop becomes steady can also be formed simultaneously, data is established and administers long-acting operation architecture.
Description
Technical field
The present invention relates to computer software fields more particularly to big data fields, in particular to a kind of raising data to administer
The data of service success rate administer control system.
Background technique
Since the sixties, earth-shaking variation is occurring IT construction for software and hardware technology, technology in terms of data and answers
With also deepening constantly, from earliest data application, data analysis, data management, the data statistics, number of data storage till now
According to integration, data mining etc., but data are not accurate and specification, and such data will cause the wasting of resources, decision is lost
The loss such as mistake, therefore many big data analysis applications are all counted out because the quality of data is not high.Usually
Data are referred to as " young oil " now, also referred to as " new money ", it is believed that data have valence, and most of tissues are
Recognized that the big data era of development disorder closes to an end.In data process of construction, data are administered by more and more
Pay attention to, all wants that the method administered using data handles dirty data, obtain the clean data of standard, all existed based on this reason
Have a go at data improvement.Although the basic conception that data are administered, the technology essential factor that data are administered tentatively understands, to data
The construction mode method of improvement is clearly recognized there is no one, also administers operating method, and base without a kind of suitable data
This is in " moving ahead in contradiction, explore in chaos ".
Data improvement refer to from use scattered data become using unified data, from little or no tissue and
Integrated data in the improvement to enterprise-wide of process administers, from attempt processing data corruption situation to data it is in perfect order one
A process.Data improvement is a kind of data management concept, is related to that tissue is enable to ensure to deposit in the whole life cycle of data
In the ability of the high quality of data.For range, data improvement is covered from front end transacter, backend services database
Data to terminal are analyzed, and source is returned from source to terminal and forms a closed loop negative feedback system.For purpose, data
It administers and seeks to acquisition to data, processing, using supervising, the function of supervision needs to have discovery, supervision, control, ditch
Logical, integration implementation capacity.It is exactly to handle the strategies of data how to store, access, verify, protect and use number that data, which are administered,
According to.
Big data improvement can be divided into the different stages from construction content and implementation goal, and each stage completes different
Task, progressive with the stage, construction content is gradually deepened, and different enterprise's points of penetration and demand are also different.From number
Various problems and challenge can be encountered during implementing to the quality of data, landing is promoted according to asset management.Because of data
Administer the incision visual angle implemented and emphasis be different, the data that industry provides administer define it is tens kinds not lower, to being at present
The data administering method of a unified standard only has not yet been formed.And technology is not provided with and a kind of is easily successfully generally applicable at present
Data administering method, for this method also without proposing the solution of effective operability.
Summary of the invention
The purpose of the present invention is overcoming the above-mentioned prior art, provide it is a kind of meet correctness it is high, it is high-efficient,
The data that highly-safe raising data administer service success rate administer control system.
To achieve the goals above, the data that raising data of the invention administer service success rate administer control system such as
Under:
The data that the raising data administer service success rate administer control system, are mainly characterized by, the system packet
It includes:
Resource differentiated control subsystem administers tissue, verifying user identity, rights management and distribution money for building data
Source；
Metadata management subsystem is connected with the resource differentiated control subsystem, for acquisition technique, business,
The metadata of operation and management, establishes meta-model, and association analysis metadata；
Model construction subsystem is connected, for identification service concept with the metadata management subsystem, building master
Topic and entitative concept model, and construct enterprise data model；
Data standard sub-systems are connected, for formulating unified data service with the model construction subsystem
Language, and the standard contents such as record format and conversion, coding.
Data administer operation subsystem, are connected with the data standard sub-systems, administer length for establishing data
Imitate operation architecture.
Preferably, the resource differentiated control subsystem includes:
Personnel arrangement management module, for managing user group；
Authentication module is connected, for verifying subscriber identity information with the personnel arrangement management module；
Authority management module is connected with the authentication module, for for user setting resource access authority and
System operatio permission；
Resource distribution module is connected with the authority management module, for distributing resource according to user right.
Preferably, the metadata management subsystem includes:
Technology meta data block is connected with the resource differentiated control subsystem, for managing description Data Physical
The data of change；
Data service metadata module is connected with the technology meta data block, for managing the number of description data definition
According to；
Operation metadata module is connected with the data service metadata module, for managing description data handling procedure
Data；
Meta data block is managed, is connected with the operation metadata module, for managing the number of description data attribute
According to；
Meta-model module is connected with the management meta data block, meets storage business data status for managing
Model；
Metadata analysis module is connected, for the meta-model according to more granularities and level with the meta-model module
The analysis of various dimensions is carried out to metadata.
Preferably, the model construction subsystem includes:
Service concept identification module is connected, for connecting to key business with the metadata management subsystem
Continuous property analysis, identifies each key business unit；
Subject Concept model construction module is connected, for constructing general industry with the service concept identification module
Business conceptual model, the Subject Concept model is general service concept；
Entitative concept model construction module is connected, for constructing entity with the Subject Concept model construction module
Conceptual model, the entitative concept model are the unique identifications of business terms；
Data model constructs module, is connected with the entitative concept model construction module, produces for constructing in tissue
Raw and consumption data model.
Preferably, the data standard sub-systems include:
Data attribute definition module is connected, for combing data attribute with the model construction subsystem；
Data entity definition module is connected, for carrying out Various types of data object with the data attribute definition module
Service definition；
Data subject definition module is connected, for defining Data subject with the data entity definition module.
Preferably, the data improvement operation subsystem includes:
Data standard whole-process management module is connected with the data standard sub-systems, for being each business people
Member and application system provide data dictionary service and metadata query service；
Quality of data module is connected, for managing quality of data class with the data standard whole-process management module
Not, quality standard and quality check, and display data quality report；
Data security module is connected with the quality of data module, for realizing number according to data category and level of confidentiality
According to safe handling；
Message pushing module is connected with the data security module, for message to be pushed to user, and provides use
Family processing；
Data administer evaluation module, are connected with the message pushing module, for assessing governance process, generate assessment
Report.
Preferably, the personnel arrangement includes that data administer committeeman, data assets administrator, information system pipe
Reason person, Service Data Management person and ordinary user.
Preferably, the metadata includes technical attributes, management attribute and service attribute.
Control system is administered using the data that raising data of the invention administer service success rate, due to the provision of one kind
Data governing system, to solve the problems, such as that available data administers the effective data administering method of none unified standard.From
And realize easy to operate, it can greatly improve the efficiency of service of data improvement and be implemented as the ability of power；It can also be formed simultaneously
The system that one closed loop becomes steady establishes data and administers long-acting operation architecture.
Detailed description of the invention
Fig. 1 is the structural schematic diagram for the data improvement control system that raising data of the invention administer service success rate.
Fig. 2 is resource differentiated control for the data improvement control system that raising data of the invention administer service success rate
The structural schematic diagram of system.
Fig. 3 is the metadata management subsystem for the data improvement control system that raising data of the invention administer service success rate
The structural schematic diagram of system.
Fig. 4 is the model construction subsystem for the data improvement control system that raising data of the invention administer service success rate
Structural schematic diagram.
Fig. 5 is the data normalization subsystem for the data improvement control system that raising data of the invention administer service success rate
The structural schematic diagram of system.
Fig. 6 is that the data for the data improvement control system that raising data of the invention administer service success rate administer operation
The structural schematic diagram of system.
Specific embodiment
It is further to carry out combined with specific embodiments below in order to more clearly describe technology contents of the invention
Description.
The data that the raising data of the invention administer service success rate administer control system, including:
Resource differentiated control subsystem administers tissue, verifying user identity, rights management and distribution money for building data
Source；
Metadata management subsystem is connected with the resource differentiated control subsystem, for acquisition technique, business,
The metadata of operation and management, establishes meta-model, and association analysis metadata；
Model construction subsystem is connected, for identification service concept with the metadata management subsystem, building master
Topic and entitative concept model, and construct enterprise data model；
Data standard sub-systems are connected, for formulating unified data service with the model construction subsystem
Language, and the standard contents such as record format and conversion, coding.
Data administer operation subsystem, are connected with the data standard sub-systems, administer length for establishing data
Imitate operation architecture.
As the preferred embodiment of the present invention, the resource differentiated control subsystem includes:
Personnel arrangement management module, for managing user group；
Authentication module is connected, for verifying subscriber identity information with the personnel arrangement management module；
Authority management module is connected with the authentication module, for for user setting resource access authority and
System operatio permission；
Resource distribution module is connected with the authority management module, for distributing resource according to user right.
As the preferred embodiment of the present invention, the metadata management subsystem includes:
Technology meta data block is connected with the resource differentiated control subsystem, for managing description Data Physical
The data of change；
Data service metadata module is connected with the technology meta data block, for managing the number of description data definition
According to；
Operation metadata module is connected with the data service metadata module, for managing description data handling procedure
Data；
Meta data block is managed, is connected with the operation metadata module, for managing the number of description data attribute
According to；
Meta-model module is connected with the management meta data block, meets storage business data status for managing
Model；
Metadata analysis module is connected, for the meta-model according to more granularities and level with the meta-model module
The analysis of various dimensions is carried out to metadata.
As the preferred embodiment of the present invention, the model construction subsystem includes:
Service concept identification module is connected, for connecting to key business with the metadata management subsystem
Continuous property analysis, identifies each key business unit；
Subject Concept model construction module is connected, for constructing general industry with the service concept identification module
Business conceptual model, the Subject Concept model is general service concept；
Entitative concept model construction module is connected, for constructing entity with the Subject Concept model construction module
Conceptual model, the entitative concept model are the unique identifications of business terms；
Data model constructs module, is connected with the entitative concept model construction module, produces for constructing in tissue
Raw and consumption data model.
As the preferred embodiment of the present invention, the data standard sub-systems include:
Data attribute definition module is connected, for combing data attribute with the model construction subsystem；
Data entity definition module is connected, for carrying out Various types of data object with the data attribute definition module
Service definition；
Data subject definition module is connected, for defining Data subject with the data entity definition module.
As the preferred embodiment of the present invention, the data administer operation subsystem and include:
Data standard whole-process management module is connected with the data standard sub-systems, for being each business people
Member and application system provide data dictionary service and metadata query service；
Quality of data module is connected, for managing quality of data class with the data standard whole-process management module
Not, quality standard and quality check, and display data quality report；
Data security module is connected with the quality of data module, for realizing number according to data category and level of confidentiality
According to safe handling；
Message pushing module is connected with the data security module, for message to be pushed to user, and provides use
Family processing；
Data administer evaluation module, are connected with the message pushing module, for assessing governance process, generate assessment
Report.
As the preferred embodiment of the present invention, the personnel arrangement includes that data administer committeeman, data money
Produce administrator, Information System Manager, Service Data Management person and ordinary user.
As the preferred embodiment of the present invention, the metadata includes technical attributes, management attribute and service attribute.
In a specific embodiment of the invention, a kind of data improvement side of raising data improvement service success rate is provided
Method, the data administering method include: resource differentiated control subsystem, metadata management subsystem, model construction subsystem, data
Standardized subsystem, data administer operation subsystem.Wherein resource differentiated control subsystem administers building for tissue for data
And the distribution of permission；Metadata management subsystem is used for technology, the acquisition of data service metadata, management and association analysis；Model structure
Subsystem is built for constructing data model；Data standard sub-systems be tissue to the definition of data, tissue, supervision and protect into
The standardized process of row, for formulating unified data service language, the standard contents such as record format and conversion, coding；Data
It administers operation subsystem and administers long-acting operation architecture for establishing data.This method combining information technology department, business department, data pipe
The function in reason portion, progress closed loop supervision gradually form steady data and administer system, have easy to operate, easy successful characteristic, can
It greatly improves data and administers the success rate of service and the efficiency of implementation.
The object of the present invention is to provide the data improvement sides improved data and administer service success rate a kind of under big data environment
Method, to solve the problems, such as that available data administers the effective data administering method of none unified standard.To realize easily
Operation can greatly improve data and administer efficiency of service and be implemented as the ability of power；A closed loop, which can also be formed, becomes steady simultaneously
System, establish data and administer long-acting operation architecture.
In order to achieve the above purpose, a kind of raising data of the invention administer the data administering method of service success rate such as
Under: a kind of data administering method for improving data and administering service success rate is mainly characterized by, the data administering method is such as
Shown in Fig. 1, comprising:
Resource differentiated control subsystem administers the building of tissue, subscriber authentication, rights management and resource for data
Distribution；
Metadata management subsystem is connected with the resource differentiated control subsystem, for technology, business, operation,
Manage the acquisition of metadata, the foundation of meta-model, metadata association analysis.
Model construction subsystem is connected with the metadata management subsystem, identifies for service concept, building master
Topic, entitative concept model construct enterprise data model.
Data standard sub-systems are connected with the model construction subsystem, are definition of the tissue to data, group
The process being standardized is knitted, supervises and protects, for formulating unified data service language, record format and conversion, coding
Equal standard contents.
Data administer operation subsystem, are connected with the data standard sub-systems, administer length for establishing data
Imitate operation architecture.
The resource differentiated control subsystem as shown in Fig. 2, include personnel arrangement management module, authentication module,
Authority management module and resource distribution module.Here resources index carries out classification pipe to data assets according to assets, the subsystem
Reason, different personnel arrangements have different access authority, are verified by the identity information of user, and different personnel are arranged
Different resource access authority and system operatio permission, system carry out the distribution of resource according to user right.
Personnel arrangement includes: that data administer committeeman, data assets administrator, Information System Manager, business number
According to administrator, ordinary user etc., according to the different data access and operating right different with distribution using user setting, commonly
User only has the permission of access data Resource TOC, and more advanced user can obtain more data access and operating rights
Limit.
The metadata management subsystem is as shown in figure 3, include technology meta data block, data service metadata module, behaviour
Make meta data block, management meta data block, meta-model module, metadata analysis module.Metadata is to describe the data of data,
Here there are two key points, first is that data, another is description data.Metadata includes that technology, management, business of data etc. belong to
Property.Technology metadata refers to that the data of description Data Physical, data type are physical model.Data service metadata is description data
The data of definition.Operation metadata is to describe the data of data handling procedure.Management metadata is to describe the data of data attribute.
Meta-model module is the model for meeting storage business data status.Metadata analysis module is according to different grain size and level
Meta-model carries out the analysis of different dimensions to metadata.
Technical element data are including but not limited to relevant database physical model, NoSQL, class database storage model, MPP
Types of database physical model.Data service metadata is including but not limited to finger business data standard, business data quality standard, enterprise
Data target, business data dictionary, business data code, business data safety.Operation metadata includes but is not limited to ETL letter
Breath, data mart modeling processing strategie data information, data processing scheduling information, data processing exception information.Managing metadata includes
But it is not limited to attribution data information, including but not limited to the letter such as business ownership, system ownership, O&M ownership, data permission ownership
Breath also includes technical attributes information and business attribute information.Meta-model module is technology metadata, data service metadata, operation
Metadata manages one that metadata the is combed metadata schema for meeting storage business data status.Metadata point
Module is analysed according to the meta-model of different grain size and level, the analysis of different dimensions is carried out to metadata, as: the data of enterprise
Figure, data lineage, impact analysis etc..Specific embodiment is managed implementation from three dimensions, and technology dimension is around source system
System, data platform, Data Mart, data application, data model, database, table, field, field and interfield data relationship
It is managed.Business dimension, technology dimension and the Chinese for managing the data of three aspect of dimension, field of business dimension level of control
The security level of description, the Processing Strategies of table, the life cycle information of table, table or field.Realize that data platform becomes using dimension
More impact analysis, parentage analysis, high level data map.
The model construction subsystem is as shown in figure 4, include service concept identification module, Subject Concept model construction mould
Block, entitative concept model construction module, data model construct module.Service concept identification module is carried out continuously to key business
Property analysis, identify each key business unit.Subject Concept model is a high level classes of data, these data represent one
One group of concept of the important theme of a mechanism.Entitative concept model is the important thing of each business domains from the point of view of enterprise's angle
Business, is the unique identification for indicating business terms.Data model building module is produced and consumption number in enterprise entirely organizes
It is the integration definition of data sheet one according to general view.
The model construction subsystem can be conceived effective for business, demand be write, modelling, the scenes such as data application
In, solution business and technology communication cooperation hardly possible, data assets can be pushed to administer asking for achievement landing difficulty etc. using difficult, data
Topic.Service concept identification module is to carry out Continuity Analysis to key business, identifies each key business unit.Subject Concept mould
Type can indicate general service concept, such as client, product, employee and finance etc., can also indicate industry specific concept.It is real
Body conceptual model is the unique identification for indicating business terms.Data model building module is produced in enterprise entirely organizes and disappears
The data general view taken is the integration definition of data sheet one, and identifying can share or the function of redundant data and organizational boundary, is not counted
According to redundancy, data ambiguity.The implementation method can reduce business cognition cost and learning cost, reduce operation complexity, promote behaviour
Make friendly, first full backup existing business process, relevant business department of being connected in the form of business main line, an enterprise
Industry may include a plurality of business main line, segment combing its operation flow, service link, business unit one by one according to main line, finally
Identify the document that each key business unit is used or generated, business datum can circulate in document, during circulation
It can be related to the change of document status, each state change is caused by being operated as key business unit, to find these business
Data can be carried out data model building, and the building of data model need to be based on item of information or word from the angle of data application
The metadata relationship building of section, value emphasis is embodied in the abundant degree of relationship.Data model building belongs to data classification
Content, details are not described herein.
The data standard sub-systems are as shown in figure 5, define mould including data attribute definition module, data entity
Block, Data subject definition module.Data attribute includes management attribute, service attribute, technical attributes.Data entity refers to data category
Property set, data entity definition module refers to the service definition of every a kind of data object.
Data standard sub-systems specific embodiment is the combing of data attribute, and data attribute definition module, data are real
By the attribute of definition data, related technical attributes are field type, field for body definition module, Data subject definition module
Length, the contents such as related service attribute includes, data owner, business unit, service definition, related management attribute
Including contents such as version, security classification classification, management through specialized department departments.
The data administer operation subsystem as shown in fig. 6, including data standard whole-process management module, the quality of data
Module, data security module, message pushing module, data administer evaluation module.The subsystem solves metadata management, data
Standard, the quality of data, data safety, data life period, data service perforation problem.Data standard whole-process management module
The bottom component of application integration frame, including the functions such as data dictionary management and metadata management.Quality of data module is with sudden and violent
Dew and the lifting system quality of data are established for target.Data security module be realize data under appropriate safeguard protection from
By flowing, meet the needs that data safety uses.Message pushing module is a kind of feedback means that data administer long-acting operation, number
It is the module to form closed loop and supervise and promote to be formed steady data improvement system according to evaluation module is administered.
Data standard whole-process management module provides data dictionary service for each business personnel, application system and metadata is looked into
Ask service.Quality of data module is that collection quality of data category management, quality standard management, quality check management, problem data exhibition
Existing, quality of data reporting component is integrated, for the purpose of the exposed and lifting system quality of data.Specific implementation is asked with the quality of data
Topic identified, measured, being monitored, the activity of early warning etc., and the management level by improving tissue obtains the quality of data
It obtains and is further promoted.Data security module is different classes of stroke with level of confidentiality of data that combined data standardized subsystem defines
Point, different use and management principle are used according to the classification of data and level of confidentiality, data of the realization under appropriate safeguard protection are certainly
By flowing, meet the needs that data safety uses.Message pushing module is a kind of feedback means that data administer long-acting operation, number
Standard revision, standard modification, standard, which are generated, according to standard whole-process management module deletes message；Quality of data module generates data not
Unanimously, the message such as shortage of data, security module generate data and close rule use, the message such as data acquisition, and message module is by message shape
User is pushed at task, and is handled by user.Data administer evaluation module, are administered in user using above-mentioned module
When, there are in certain management tasks program execute failure or governance process do not complete the case where, in order to improve data administer
Success rate, which administers according to data requires to assess data improvement result, generates assessment report, passes through message
Pushing module is sent to user, so that user does suitable regulating measures, forms closed loop and supervises and promote to form steady data
Improvement system.
The embodiment of the invention provides the data administering method that a kind of raising data administer service success rate, which is administered
Method include: resource differentiated control subsystem, metadata management subsystem, model construction subsystem, data standard sub-systems,
Data administer operation subsystem.Wherein resource differentiated control subsystem for data administer tissue build and the distribution of permission；
Metadata management subsystem is used for technology, the acquisition of data service metadata, management and association analysis；Model construction subsystem is used for structure
Build data model；Data standard sub-systems are the mistakes that tissue is standardized the definition of data, tissue, supervision and protection
Journey, for formulating unified data service language, the standard contents such as record format and conversion, coding；Data administer operation subsystem
System administers long-acting operation architecture for establishing data.
The technical program is built by tissue, metadata association analysis, data model building, data normalization definition, is built
Vertical data are administered the data that transportation carries out and are administered, it is preferred that emphasis is carry out closed loop by tissue, model, standard, operation angle
Supervision gradually forms steady data and administers system.Resource differentiated control subsystem described in the technical program focuses on pair
Data assets carry out differentiated control, different personnel arrangements are arranged with different resource access authority, system is provided according to user
The distribution in source, for data administer committeeman, data assets administrator, Information System Manager, Service Data Management person,
Ordinary user.Metadata described in the technical program includes technology metadata, data service metadata, operation metadata, management member
Data, meta-model, and every kind of metadata all includes technology, management, three attribute of business, technical element data including but not limited to
Relevant database physical model, NoSQL, class database storage model, MPP types of database physical model.Data service metadata
Including but not limited to finger business data standard, business data quality standard, business data index, business data dictionary, enterprise's number
According to code, business data safety.Operation metadata includes but is not limited to ETL information, data mart modeling processing strategie data information, number
According to processing scheduling information, data processing exception information.Managing metadata includes but is not limited to attribution data information, including but unlimited
It also include technical attributes information and service attribute in information such as business ownership, system ownership, O&M ownership, data permission ownership
Information.Meta-model module is that technology metadata, data service metadata, operation metadata, management metadata are combed
One meets the metadata schema of storage business data status.Be in the technical program with three theme, entity, attribute stratum,
And implemented from business dimension, technology dimension and management dimension, it is directed to data and administers committeeman, data assets management
The personnel such as member, Information System Manager, Service Data Management person, ordinary user.
In the technical program metadata acquisition be technology, business, operation, manage metadata acquisition be to pass through model construction
Subsystem, the means such as the business of standardized subsystem identifies, attribute combs carry out the technology of metadata, management, service attribute
Definition.Metadata analysis module in the technical program carries out three to metadata according to the meta-model of different grain size and level
The analysis of dimension, technology dimension around source system, data platform, Data Mart, data application, data model, database,
Table, field, field and interfield data relationship analyzed.Business dimension is around data, the Chinese description of field, table
Processing Strategies, the life cycle information of table, table or field security level.Using dimension around change impact analysis, blood lineage
Analysis, high level data map, wherein change impact analysis is the variation of metadata, if it will affect the analysis of other metadata,
Parentage analysis is that some metadata is terminal node, and the analysis of all metadata of associated system.
Data administer service and deliver credible, safe data emphatically, it is seen that data administer the mistake for focusing on service implementation
Cheng Fangfa and not result.It is administered in implementation process in data, they is organically associated, effective data can be realized
It administers and implements.It is administered by effective data, process system that is unified and having standardized data improvement tissue provides retrospective
Data flow figure reduces data redundancy, data ambiguity, improves the consistency and correctness of the quality of data, general-purpose attribute
Definition and service concept identification definition, it is final that the data tracking for meeting business compliance is provided, realize support improvement business
Target forms the long-acting operation architecture that data are administered.Pass through the cooperative cooperating of above each subsystem, the data of the embodiment of the present invention
Administering method, to solve the problems, such as that available data administers the effective data administering method of none unified standard.To real
Show easy to operate, can greatly improve data and administer efficiency of service and be implemented as the ability of power；One can also be formed simultaneously to close
The system that ring becomes steady establishes data and administers long-acting operation architecture.
Control system is administered using the data that raising data of the invention administer service success rate, due to the provision of one kind
Data governing system, to solve the problems, such as that available data administers the effective data administering method of none unified standard.From
And realize easy to operate, it can greatly improve the efficiency of service of data improvement and be implemented as the ability of power；It can also be formed simultaneously
The system that one closed loop becomes steady establishes data and administers long-acting operation architecture.
In this description, the present invention is described with reference to its specific embodiment.But it is clear that can still make
Various modifications and alterations are without departing from the spirit and scope of the invention.Therefore, the description and the appended drawings should be considered as illustrative
And not restrictive.
Claims (8)
1. it is a kind of improve data and administer the data of service success rate administer control system, which is characterized in that the system includes:
Resource differentiated control subsystem administers tissue, verifying user identity, rights management and distribution resource for building data；
Metadata management subsystem is connected with the resource differentiated control subsystem, is used for acquisition technique, business, operation
With the metadata of management, meta-model, and association analysis metadata are established；
Model construction subsystem is connected, for identification service concept with the metadata management subsystem, building theme and
Entitative concept model, and construct enterprise data model.
Data standard sub-systems are connected with the model construction subsystem, for formulating unified data service language,
And the standard contents such as record format and conversion, coding；
Data administer operation subsystem, are connected with the data standard sub-systems, administer long-acting fortune for establishing data
Row system.
2. the data improvement control system according to claim 1 for improving data and administering service success rate, which is characterized in that
The resource differentiated control subsystem includes:
Personnel arrangement management module, for managing user group；
Authentication module is connected, for verifying subscriber identity information with the personnel arrangement management module；
Authority management module is connected with the authentication module, for being user setting resource access authority and system
Operating right；
Resource distribution module is connected with the authority management module, for distributing resource according to user right.
3. the data improvement control system according to claim 1 for improving data and administering service success rate, which is characterized in that
The metadata management subsystem includes:
Technology meta data block is connected with the resource differentiated control subsystem, for managing description Data Physical
Data；
Data service metadata module is connected with the technology meta data block, for managing the data of description data definition；
Operation metadata module is connected with the data service metadata module, for managing the number of description data handling procedure
According to；
Meta data block is managed, is connected with the operation metadata module, for managing the data of description data attribute；
Meta-model module is connected with the management meta data block, for managing the mould for meeting storage business data status
Type；
Metadata analysis module is connected with the meta-model module, for according to the meta-model of more granularities and level to member
The analysis of data progress various dimensions.
4. the data improvement control system according to claim 1 for improving data and administering service success rate, which is characterized in that
The model construction subsystem includes:
Service concept identification module is connected with the metadata management subsystem, for carrying out continuity to key business
Analysis, identifies each key business unit；
Subject Concept model construction module is connected with the service concept identification module, and the business for constructing general is general
Model is read, the Subject Concept model is general service concept；
Entitative concept model construction module is connected, for constructing entitative concept with the Subject Concept model construction module
Model, the entitative concept model are the unique identifications of business terms；
Data model construct module, be connected with the entitative concept model construction module, for construct in tissue generate and
The data model of consumption.
5. the data improvement control system according to claim 1 for improving data and administering service success rate, which is characterized in that
The data standard sub-systems include:
Data attribute definition module is connected, for combing data attribute with the model construction subsystem；
Data entity definition module is connected, for carrying out the industry of Various types of data object with the data attribute definition module
Business definition；
Data subject definition module is connected, for defining Data subject with the data entity definition module.
6. the data improvement control system according to claim 1 for improving data and administering service success rate, which is characterized in that
The data administer operation subsystem
Data standard whole-process management module is connected with the data standard sub-systems, for for each business personnel and
Application system provides data dictionary service and metadata query service；
Quality of data module is connected, for managing quality of data classification, matter with the data standard whole-process management module
Amount standard and quality check, and display data quality report；
Data security module is connected with the quality of data module, for realizing data peace according to data category and level of confidentiality
It entirely uses；
Message pushing module is connected with the data security module, for message to be pushed to user, and provides at user
Reason；
Data administer evaluation module, are connected with the message pushing module, for assessing governance process, generate assessment report
It accuses.
7. the data improvement control system according to claim 2 for improving data and administering service success rate, which is characterized in that
The personnel arrangement includes that data administer committeeman, data assets administrator, Information System Manager, business datum pipe
Reason person and ordinary user.
8. the data improvement control system according to claim 3 for improving data and administering service success rate, which is characterized in that
The metadata includes technical attributes, management attribute and service attribute.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910288687.6A CN110019176B (en) | 2019-04-11 | 2019-04-11 | Data management control system for improving success rate of data management service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910288687.6A CN110019176B (en) | 2019-04-11 | 2019-04-11 | Data management control system for improving success rate of data management service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110019176A true CN110019176A (en) | 2019-07-16 |
| CN110019176B CN110019176B (en) | 2023-08-18 |
Family
ID=67190977
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910288687.6A Active CN110019176B (en) | 2019-04-11 | 2019-04-11 | Data management control system for improving success rate of data management service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110019176B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110765337A (en) * | 2019-11-15 | 2020-02-07 | 中科院计算技术研究所大数据研究院 | Service providing method based on internet big data |
| CN111143616A (en) * | 2019-12-24 | 2020-05-12 | 北京中盾安全技术开发公司 | Video image data processing method |
| CN111190881A (en) * | 2019-11-13 | 2020-05-22 | 深圳市华傲数据技术有限公司 | Data management method and system |
| CN111861790A (en) * | 2020-07-24 | 2020-10-30 | 国网安徽省电力有限公司 | Electric power full-service data management system |
| CN112434071A (en) * | 2020-12-15 | 2021-03-02 | 北京三维天地科技股份有限公司 | Metadata blood relationship and influence analysis platform based on data map |
| CN112527774A (en) * | 2020-12-18 | 2021-03-19 | 通号智慧城市研究设计院有限公司 | Data center building method and system and storage medium |
| CN112800046A (en) * | 2021-02-26 | 2021-05-14 | 上海帕科信息科技有限公司 | Artificial intelligence platform applied to field data management |
| CN113032376A (en) * | 2019-12-25 | 2021-06-25 | 陕西云基华海信息技术有限公司 | Mass data quality management and treatment system |
| CN113222740A (en) * | 2021-05-27 | 2021-08-06 | 中国工商银行股份有限公司 | Asset management method, apparatus, computing device and medium executed by computing device |
| CN114298550A (en) * | 2021-12-28 | 2022-04-08 | 安徽海螺信息技术工程有限责任公司 | Method for treating cement production operation data |
| CN114881802A (en) * | 2022-07-11 | 2022-08-09 | 湖南三湘银行股份有限公司 | Metadata-based data asset management method and system |
| US20230105207A1 (en) * | 2021-10-06 | 2023-04-06 | Bank Of America Corporation | System and methods for intelligent entity-wide data protection |
| CN116431646A (en) * | 2023-04-20 | 2023-07-14 | 北京瑞风协同科技股份有限公司 | Modeling and hierarchical control device and method for data model |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002054171A2 (en) * | 2000-12-06 | 2002-07-11 | Biosentients, Inc. | System, method, software architecture and business model for an intelligent object based information technology platform |
| CN104143122A (en) * | 2013-05-07 | 2014-11-12 | 天津冠创科技有限公司 | Intelligent service approval scheme |
| CA2867589A1 (en) * | 2013-10-15 | 2015-04-15 | Coho Data Inc. | Systems, methods and devices for implementing data management in a distributed data storage system |
| CN105760980A (en) * | 2015-11-27 | 2016-07-13 | 国网山东省电力公司潍坊供电公司 | Intelligent operation system based on intelligent power grid framework |
| CN106664224A (en) * | 2014-08-20 | 2017-05-10 | 华为技术有限公司 | System and method for metadata enhanced inventory management of a communications system |
| CN107247788A (en) * | 2017-06-15 | 2017-10-13 | 山东浪潮云服务信息科技有限公司 | A kind of method of the comprehensive regulation service based on government data |
| CN107430712A (en) * | 2014-12-19 | 2017-12-01 | 艾诺茨Ip公司 | Resource management system is can access with the network that can be allocated management of |
| CN107506462A (en) * | 2017-08-30 | 2017-12-22 | 中国建设银行股份有限公司 | Data processing method, system, electronic equipment, the storage medium of Enterprise Data |
| CN107657052A (en) * | 2017-10-17 | 2018-02-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on metadata management |
| CN108171638A (en) * | 2017-12-20 | 2018-06-15 | 中国电子科技集团公司信息科学研究院 | A kind of Urban Data governing system |
| WO2018236886A1 (en) * | 2017-06-21 | 2018-12-27 | Opera Solutions Usa, Llc | System and method for code and data versioning in computerized data modeling and analysis |
| CA3072045A1 (en) * | 2017-08-02 | 2019-02-07 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment with large data sets |
-
2019
- 2019-04-11 CN CN201910288687.6A patent/CN110019176B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002054171A2 (en) * | 2000-12-06 | 2002-07-11 | Biosentients, Inc. | System, method, software architecture and business model for an intelligent object based information technology platform |
| CN104143122A (en) * | 2013-05-07 | 2014-11-12 | 天津冠创科技有限公司 | Intelligent service approval scheme |
| CA2867589A1 (en) * | 2013-10-15 | 2015-04-15 | Coho Data Inc. | Systems, methods and devices for implementing data management in a distributed data storage system |
| CN106664224A (en) * | 2014-08-20 | 2017-05-10 | 华为技术有限公司 | System and method for metadata enhanced inventory management of a communications system |
| CN107430712A (en) * | 2014-12-19 | 2017-12-01 | 艾诺茨Ip公司 | Resource management system is can access with the network that can be allocated management of |
| CN105760980A (en) * | 2015-11-27 | 2016-07-13 | 国网山东省电力公司潍坊供电公司 | Intelligent operation system based on intelligent power grid framework |
| CN107247788A (en) * | 2017-06-15 | 2017-10-13 | 山东浪潮云服务信息科技有限公司 | A kind of method of the comprehensive regulation service based on government data |
| WO2018236886A1 (en) * | 2017-06-21 | 2018-12-27 | Opera Solutions Usa, Llc | System and method for code and data versioning in computerized data modeling and analysis |
| CA3072045A1 (en) * | 2017-08-02 | 2019-02-07 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment with large data sets |
| CN107506462A (en) * | 2017-08-30 | 2017-12-22 | 中国建设银行股份有限公司 | Data processing method, system, electronic equipment, the storage medium of Enterprise Data |
| CN107657052A (en) * | 2017-10-17 | 2018-02-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on metadata management |
| CN108171638A (en) * | 2017-12-20 | 2018-06-15 | 中国电子科技集团公司信息科学研究院 | A kind of Urban Data governing system |
Non-Patent Citations (5)
| Title |
|---|
| DANIEL S. MARCUS 等: "Human Connectome Project informatics: quality control, database services, and data visualization", 《NEUROIMAGE》, vol. 80, pages 202 - 219, XP028678535, DOI: 10.1016/j.neuroimage.2013.05.077 * |
| Z. YUN: "The study of CDM-BSC-based data mining driven fishbone applied for data processing", 《2015 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING》, pages 1 - 5 * |
| 余鹏: "大数据视域下高校数据治理方案研究", 《现代教育技术》, vol. 28, no. 6, pages 60 - 66 * |
| 关丽;程承旗;肖林;: "全球格网系统的元数据管理模型", 《测绘科学》, vol. 34, no. 01, pages 138 - 140 * |
| 甘似禹 等: "大数据治理体系", 《计算机应用与软件》, vol. 35, no. 6, pages 1 - 8 * |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111190881A (en) * | 2019-11-13 | 2020-05-22 | 深圳市华傲数据技术有限公司 | Data management method and system |
| CN110765337A (en) * | 2019-11-15 | 2020-02-07 | 中科院计算技术研究所大数据研究院 | Service providing method based on internet big data |
| CN110765337B (en) * | 2019-11-15 | 2021-04-06 | 中科院计算技术研究所大数据研究院 | Service providing method based on internet big data |
| CN111143616A (en) * | 2019-12-24 | 2020-05-12 | 北京中盾安全技术开发公司 | Video image data processing method |
| CN111143616B (en) * | 2019-12-24 | 2023-09-15 | 北京中盾安全技术开发公司 | Video image data management method |
| CN113032376A (en) * | 2019-12-25 | 2021-06-25 | 陕西云基华海信息技术有限公司 | Mass data quality management and treatment system |
| CN111861790A (en) * | 2020-07-24 | 2020-10-30 | 国网安徽省电力有限公司 | Electric power full-service data management system |
| CN112434071A (en) * | 2020-12-15 | 2021-03-02 | 北京三维天地科技股份有限公司 | Metadata blood relationship and influence analysis platform based on data map |
| CN112434071B (en) * | 2020-12-15 | 2021-07-20 | 北京三维天地科技股份有限公司 | Metadata blood relationship and influence analysis platform based on data map |
| CN112527774A (en) * | 2020-12-18 | 2021-03-19 | 通号智慧城市研究设计院有限公司 | Data center building method and system and storage medium |
| CN112800046A (en) * | 2021-02-26 | 2021-05-14 | 上海帕科信息科技有限公司 | Artificial intelligence platform applied to field data management |
| CN113222740A (en) * | 2021-05-27 | 2021-08-06 | 中国工商银行股份有限公司 | Asset management method, apparatus, computing device and medium executed by computing device |
| US20230105207A1 (en) * | 2021-10-06 | 2023-04-06 | Bank Of America Corporation | System and methods for intelligent entity-wide data protection |
| CN114298550A (en) * | 2021-12-28 | 2022-04-08 | 安徽海螺信息技术工程有限责任公司 | Method for treating cement production operation data |
| CN114881802A (en) * | 2022-07-11 | 2022-08-09 | 湖南三湘银行股份有限公司 | Metadata-based data asset management method and system |
| CN114881802B (en) * | 2022-07-11 | 2022-10-04 | 湖南三湘银行股份有限公司 | Metadata-based data asset management method and system |
| CN116431646A (en) * | 2023-04-20 | 2023-07-14 | 北京瑞风协同科技股份有限公司 | Modeling and hierarchical control device and method for data model |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110019176B (en) | 2023-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110019176A (en) | Improve the data improvement control system that data administer service success rate | |
| CN112699175B (en) | Data management system and method thereof | |
| Sahama et al. | A data warehouse architecture for clinical data warehousing | |
| Smith | Governing data and data for governance: the everyday practice of Indigenous sovereignty | |
| CN107766579A (en) | The design method of master data management system based on XBRL standards | |
| CN106296378A (en) | Intelligence finance cloud platform system based on XBRL, construction method and service implementation method | |
| Hallam et al. | Culture and social capital network effects on the survival and performance of high-tech micro and small firms | |
| CN107730430A (en) | Production, teaching ＆ research public service system based on big data | |
| CN108228747A (en) | Data genetic connection visualized graphs system in data improvement | |
| Cao et al. | Nonoccurring behavior analytics: A new area | |
| Farwick et al. | A meta-model for automated enterprise architecture model maintenance | |
| CN110363493A (en) | A kind of business process management system | |
| CN115579117A (en) | Data assets system and method of medical data | |
| Hou et al. | Research on unstructured data processing technology in executing audit based on big data budget | |
| Lin | [Retracted] Research on Enterprise Employee Performance Appraisal Management System Based on CS Architecture | |
| CN111144778A (en) | Management and evaluation method and system based on data account | |
| Turluev et al. | Artificial Intelligence in Corporate Governance Systems | |
| Olawoyin et al. | Preserving privacy integration and mining for big temporal co-occurrence patterns | |
| Shen et al. | Research on application of computer technology in the optimization of department information system | |
| Zhao et al. | Evolutionary Game and Simulation Research of Blockchain‐Based Co‐Governance of Emergency Supply Allocation | |
| Eessaar et al. | A decision support method for evaluating database designs | |
| Wei et al. | Research on data traceability method based on blockchain technology | |
| Rinkenberger | Context of Self-Service Business Intelligence: A case study of IT-enabled organizational transformation | |
| Bessane et al. | Causal Model of Performance Measurement System by Combining Quantitative and Qualitative Models: A Case Study of a Hospital Information System | |
| Wu et al. | Evaluation of the Construction of a Data Center-Driven Financial Shared Service Platform From the Remote Multimedia Network Perspective |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |