CN114722110A

CN114722110A - Data management method and device

Info

Publication number: CN114722110A
Application number: CN202210434570.6A
Authority: CN
Inventors: 陈烨; 吴庭玮; 汪婕
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2022-04-24
Filing date: 2022-04-24
Publication date: 2022-07-08

Abstract

The invention provides a data management method and a data management device, and particularly relates to the technical field of big data, wherein the method comprises the following steps: acquiring genetic attribute information of the newly-built data standard according to a newly-built identifier of the newly-built data standard and an existing standard; establishing non-genetic attribute information of the newly-established data standard according to newly-introduced data; and generating a newly-built data standard according to the genetic attribute information and the non-genetic attribute information, adding the newly-built data standard into the existing standard to obtain an updated total standard, and determining a treatment range of data treatment according to the updated total standard so as to carry out data treatment according to the treatment range. The invention can improve the efficiency of data management and reduce the probability of errors in data management, thereby being beneficial to the normal operation of related data systems.

Description

Data management method and device

Technical Field

The invention relates to the technical field of data management, in particular to the technical field of big data, and particularly relates to a data management method and device.

Background

In the data governance process of banking business, new data is often introduced into a related data system, and when the new data cannot be classified into the existing data standard, a new data standard needs to be established for the new data, so that the new data can be subjected to data governance subsequently. However, the existing data management method has low efficiency for newly establishing a data standard for new introduced data, and the newly established standard is easy to conflict with the existing data standard in the related data system, so that the efficiency is low and errors are easy to occur in the subsequent data management according to the newly established standard and the existing standard, thereby being not beneficial to the normal operation of the related data system and causing adverse effects on banking services.

Disclosure of Invention

The invention aims to provide a data management method to solve the problems that the conventional data management method has low efficiency and high error probability during data management, so that the conventional data management method is not beneficial to the normal operation of a related data system and further has adverse effects on banking business. Another object of the present invention is to provide a data management apparatus. It is a further object of this invention to provide such a computer apparatus. It is a further object of this invention to provide such a readable medium.

In order to achieve the above object, an aspect of the present invention discloses a data governance method, including:

acquiring genetic attribute information of the newly-built data standard according to a newly-built identifier of the newly-built data standard and an existing standard;

establishing non-genetic attribute information of the newly-established data standard according to newly-introduced data;

and generating a newly-built data standard according to the genetic attribute information and the non-genetic attribute information, adding the newly-built data standard into the existing standard to obtain an updated total standard, and determining a treatment range of data treatment according to the updated total standard so as to carry out data treatment according to the treatment range.

Optionally, the obtaining genetic attribute information of the newly-built data standard according to the newly-built identifier of the newly-built data standard and the existing standard includes:

according to the new identification and the existing standard, obtaining an approximate identification of an approximate data standard corresponding to the new identification;

according to the approximate identification, obtaining a superior identification of a superior data standard corresponding to the new identification;

and acquiring the genetic attribute information of the newly-established data standard according to the superior identification.

Optionally, the obtaining, according to the new identifier and the existing standard, an approximate identifier of an approximate data standard corresponding to the new identifier includes:

and performing semantic analysis and index analysis on the new identifier, and obtaining an approximate identifier of an approximate data standard corresponding to the new identifier from the existing standard.

Optionally, the obtaining, according to the approximate identifier, a superior identifier of a superior data standard corresponding to the new identifier includes:

obtaining related nodes of the approximate data standard in a data standard pedigree according to the approximate identification;

and querying a root node of the related node in the data standard pedigree to obtain a root node identifier of a root node data standard corresponding to the root node, and taking the root node identifier as the superior identifier.

Optionally, the obtaining, according to the superior identifier, genetic attribute information of the newly-established data standard includes:

obtaining a superior data standard according to the superior identification;

and obtaining the genetic attribute information according to the superior data standard.

Optionally, the establishing, according to the newly introduced data, the non-genetic attribute information of the newly created data standard includes:

obtaining a new attribute corresponding to the newly introduced data according to the newly introduced data;

and establishing the non-genetic attribute information of the newly-established data standard according to the new attribute.

Optionally, the generating a new data standard according to the genetic attribute information and the non-genetic attribute information includes:

obtaining a non-genetic attribute and a first sub-standard of the non-genetic attribute information according to the non-genetic attribute information;

obtaining a genetic attribute and a second sub-standard of the genetic attribute information according to the genetic attribute information;

and generating a new data standard according to the genetic attribute, the second sub-standard, the non-genetic attribute and the first sub-standard.

Optionally, the adding the new data standard to the existing standard to obtain an updated total standard includes:

obtaining a father node of the related node in a data standard pedigree according to the related node;

adding the newly-built data standard serving as the other child node of the father node into the data standard pedigree to obtain an updated total standard;

wherein the set of data criteria of all nodes before the other child node is added to the data criteria spectrum is the existing criteria.

Optionally, further comprising:

after the worker carries out data management according to the management range, acquiring the total number of data standard attributes included by all data standards, the total number of data table attributes of all data tables, a first data record number of which the data record attribute accords with the current existing data standard, a second data record number of which the attribute value in the first data record is not vacant, and a third data record number of which all the attribute values in the second data record accord with the existing data standard;

and obtaining a data governance quality index according to the data standard attribute total number, the data table attribute total number, the first data record number, the second data record number and the third data record number, and feeding back the data governance quality index to the worker, so that the worker improves the data governance quality according to the data governance quality index.

Optionally, the obtaining a data governance quality index according to the total number of the data standard attributes, the total number of the data table attributes, the first data record number, the second data record number, and the third data record number includes:

obtaining the coverage rate according to the total number of the data standard attributes and the total number of the data table attributes;

obtaining the integrity rate according to the first data record number and the second data record number;

obtaining the accuracy according to the first data record number and the third data record number;

and obtaining a data management quality index according to the coverage rate, the integrity rate and the accuracy rate.

In order to achieve the above object, another aspect of the present invention discloses a data management apparatus, comprising:

the genetic attribute information determining module is used for obtaining the genetic attribute information of the newly-built data standard according to a newly-built identifier of the newly-built data standard and the existing standard;

the non-genetic attribute information determining module is used for establishing the non-genetic attribute information of the newly-built data standard according to the newly-introduced data;

and the new establishing module is used for generating a new data standard according to the genetic attribute information and the non-genetic attribute information, adding the new data standard into the existing standard to obtain an updated total standard, and determining a treatment range of data treatment according to the updated total standard so as to carry out data treatment according to the treatment range.

The invention also discloses a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method when executing the program.

The invention also discloses a computer-readable medium, on which a computer program is stored which, when executed by a processor, implements a method as described above.

According to the data management method and the data management device, the genetic attribute information of the newly-built data standard is obtained according to the newly-built identification and the existing standard of the newly-built data standard, and the universal attribute information, namely the genetic attribute information applicable to the newly-built data standard, can be obtained from the existing data standard according to the characteristics of the newly-built data standard reflected by the newly-built identification, so that the genetic attribute information does not need to be additionally designed and established when the newly-built data standard is established, the efficiency of generating the newly-built data standard and the compatibility of the newly-built data standard and the existing standard are improved, the data management efficiency is improved, and the error probability during data management is reduced. By establishing the non-genetic attribute information of the newly-established data standard according to the newly-introduced data, the non-genetic attribute information can be established according to the characteristic that the new data cannot be included in the existing data standard when the newly-introduced new data cannot be included in the existing data standard, so that the coverage rate of the newly-established data standard generated in the subsequent step is improved, the omission of data during the subsequent data management according to the newly-established data standard and the existing data standard is reduced, and the probability of errors during the data management is reduced. The newly-built data standard is generated according to the genetic attribute information and the non-genetic attribute information, the newly-built data standard is added into the existing standard to obtain an updated total standard, and a treatment range of data treatment is determined according to the updated total standard, so that the data treatment is carried out according to the treatment range, the newly-built data standard can cover introduced new data and existing data as much as possible, the probability of errors in subsequent data treatment according to the newly-built data standard and the existing data standard is reduced, the data treatment can be conveniently carried out according to the newly-built data standard and the existing data standard, and the efficiency of the data treatment is further improved. In conclusion, the invention can improve the efficiency of data management and reduce the probability of errors during data management, thereby being beneficial to the normal operation of related data systems.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a flow chart diagram of a data governance method according to an embodiment of the invention;

FIG. 2 is a schematic diagram illustrating an alternative step of obtaining genetic attribute information in accordance with an embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating an alternative step of establishing non-genetic attribute information in accordance with an embodiment of the present invention;

FIG. 4 is a schematic diagram illustrating an alternative step of generating a new data standard according to an embodiment of the present invention;

FIG. 5 is a schematic diagram illustrating an alternative step of obtaining a data governance quality indicator, in accordance with an embodiment of the present invention;

FIG. 6 shows a block schematic diagram of a data governance device according to an embodiment of the present invention;

FIG. 7 illustrates a schematic diagram of a computer device suitable for use in implementing embodiments of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

As used herein, the terms "first," "second," … …, etc. do not denote any order or order, nor are they used to limit the invention, but rather are used to distinguish one element from another element or operation described by the same technical terms.

As used herein, the terms "comprising," "including," "having," "containing," and the like are open-ended terms that mean including, but not limited to.

As used herein, "and/or" includes any and all combinations of the described items.

It should be noted that, in the technical solution of the present invention, the acquisition, storage, use, processing, etc. of the data all conform to the relevant regulations of the national laws and regulations.

The embodiment of the invention discloses a transfer processing method based on a block chain, which specifically comprises the following steps as shown in figure 1:

s101: and obtaining the genetic attribute information of the newly-built data standard according to the newly-built identification of the newly-built data standard and the existing standard.

S102: and establishing the non-genetic attribute information of the newly-established data standard according to the newly-introduced data.

S103: and generating a newly-built data standard according to the genetic attribute information and the non-genetic attribute information, adding the newly-built data standard into the existing standard to obtain an updated total standard, and determining a treatment range of data treatment according to the updated total standard so as to carry out data treatment according to the treatment range.

For example, the governing range of data governing is determined according to the updated total standard, which may be, but is not limited to, obtaining governing attributes of all data to be governed according to the updated total standard, and then searching for all data tables to be governed in a relevant data system, where the data tables to be governed include all or part of the governing attributes, and the data tables to be governed are the governing range. The determination of the treatment range can be realized manually or by related software, programs and the like. It should be noted that the specific implementation manner of determining the abatement range of the data abatement according to the updated total standard may be determined by those skilled in the art according to actual situations, and the foregoing description is only an example, and does not limit this.

Illustratively, the data governance according to the governance range can be implemented by relevant workers through manual means or by software, programs and the like which can be used for data governance. It should be noted that the specific implementation manner of performing data governance according to the governance range can be determined by those skilled in the art according to actual situations, and the above description is only an example, and is not limited thereto.

In an alternative embodiment, as shown in fig. 2, the obtaining genetic attribute information of the newly created data standard according to a new identifier of the newly created data standard and an existing standard includes the following steps:

s201: and obtaining an approximate identifier of the approximate data standard corresponding to the newly-built identifier according to the newly-built identifier and the existing standard.

S202: and obtaining a superior identification of a superior data standard corresponding to the new identification according to the approximate identification.

S203: and acquiring the genetic attribute information of the newly-established data standard according to the superior identification.

Illustratively, the new identifier may be, but is not limited to, a text format, a character string format, a reshaped number format, or the like. For example, the new identifier may be, but is not limited to, an "identity card", an "ID card", or "13520". The specific content of the new identifier is not limited to the above example, and may be determined by a worker according to new data introduced into the relevant data system, or automatically generated by a relevant program, software, or the like according to the new data. It should be noted that the format and content of the new identifier can be determined by those skilled in the art according to practical situations, and the above description is only an example, and is not limited thereto.

Illustratively, the approximate identifier may be, but is not limited to, a text format, a character string format, a reshaped number format, or the like.

Illustratively, the upper level identifier may be, but is not limited to, a text format, a character string format, a reshaped number format, or the like.

Through steps S201 to S203, an approximate data standard closer to the newly created data standard can be obtained from the existing data standard according to the characteristics of the newly created data standard reflected by the new identifier, and the genetic attribute information can be obtained according to the superior identifier of the superior data standard of the approximate data standard, so that the genetic attribute information more meets the requirements of the newly created data standard, the compatibility of the newly created data standard generated in the subsequent steps with the existing data standard and related data systems is indirectly improved, and the probability of errors occurring in the subsequent data management is further reduced.

In an optional implementation manner, the obtaining, according to the new identifier and an existing standard, an approximate identifier of an approximate data standard corresponding to the new identifier includes:

Illustratively, for a newly-built identifier 'bank honored guest client', after semantic analysis and index analysis, an approximate identifier 'bank common client' can be obtained. It should be noted that, the specific implementation manner of performing semantic analysis and index analysis on the new identifier to obtain the approximate identifier of the approximate data standard corresponding to the new identifier from the existing standard can be determined by those skilled in the art according to the actual situation, and the above description is only an example, and does not limit this.

Through the steps, the approach degree of the approximate identification and the newly-built identification can be improved, so that the correlation between the determined approximate data standard and the newly-built data standard which is intentionally established is improved, the genetic attribute information obtained in the subsequent step is further more in line with the requirement of the newly-built data standard, the compatibility between the newly-built data standard generated in the subsequent step and the existing data standard and related data systems is indirectly improved, and the probability of errors in the subsequent data management is further reduced.

In an optional implementation manner, the obtaining, according to the approximate identifier, an upper identifier of an upper data standard corresponding to the new identifier includes:

For example, in a banking scenario, if the following data standard pedigree (i.e. pedigree of existing data standard) exists:

illustratively, the data standard lineage can be, but is not limited to, a tree structure or a graph structure.

Wherein, if the approximate identification is "bank common customer", the related nodes (i.e. the nodes where the "bank common customer" is located in the pedigree) can be easily obtained from the pedigree. Wherein the node comprises a data standard for the node. It should be noted that, the specific implementation manner of obtaining the relevant nodes of the approximate data standard in the data standard pedigree according to the approximate identifier may be determined by those skilled in the art according to practical situations, and the above description is only an example, and does not limit this.

For example, the querying of the root node of the relevant node in the data standard pedigree is a conventional technical means in the art, and is not described herein again. For example, if the approximate identifier is "common bank client", then from the above pedigree, the root node, i.e. the node where the "business handling information" is located, can be easily obtained, and the root node identifier is the "business handling information".

Through the steps, the approach degree of the superior identification and the newly-built identification can be improved, so that the correlation between the determined superior data standard and the newly-built data standard which is intentionally established is improved, the genetic attribute information obtained in the subsequent step is further more in line with the requirement of the newly-built data standard, the compatibility between the newly-built data standard generated in the subsequent step and the existing data standard and related data systems is indirectly improved, and the probability of errors in the subsequent data management is further reduced. In addition, the time and difficulty for determining the superior identification can be reduced by accessing the data standard pedigree, the efficiency for determining the superior identification is improved, and the efficiency of the whole data management process is indirectly improved.

In an optional embodiment, the obtaining, according to the upper level identifier, genetic attribute information of the newly-created data standard includes:

obtaining a superior data standard according to the superior identification;

For example, if the upper level is identified as "business handling information", the upper level standard identified as "business handling information" may be obtained by, but is not limited to, querying a related data system or a data standard pedigree, where the upper level standard may be, but is not limited to, table 1:

TABLE 1

It should be noted that the specific implementation manner of the upper level data standard obtained according to the upper level identifier and the specific content of the upper level data standard can be determined by those skilled in the art according to actual situations, and the above description is only an example, and does not limit this.

For example, the obtaining of the genetic attribute information according to the upper level data standard may be, but is not limited to, obtaining each data attribute included in the upper level data standard and a specific sub-standard corresponding to each data attribute according to the upper level data standard, and integrating each data attribute and the specific sub-standard corresponding to each data attribute to obtain a plurality of pieces of genetic attribute information. For example, the genetic attribute information obtained according to the criteria described in table 1 may be, but is not limited to:

genetic attributes: transactor name corresponds to sub-criteria: needs to be a Chinese character string with a length of 2 to 10 and

genetic attributes: the sub-standard corresponding to the mobile phone number of the transactor is as follows: the string type needs to be number + symbol and the string length is 14.

It should be noted that, the specific implementation manner of obtaining the genetic attribute information according to the superior data standard can be determined by those skilled in the art according to actual situations, and the above description is only an example, and is not limited thereto.

Through the steps, the superior standard can be analyzed, and the genetic attribute information required by generating the new identification is extracted, so that the genetic attribute information further meets the requirement of the new data standard, the compatibility of the new data standard generated in the subsequent step with the existing data standard and a related data system is indirectly improved, and the probability of errors in the subsequent data management is reduced. In addition, the time and difficulty for determining the genetic attribute information can be reduced and the efficiency for determining the genetic attribute information can be improved by directly extracting the superior data standard, so that the efficiency of the whole data management process is indirectly improved.

In an alternative embodiment, as shown in fig. 3, the establishing of the non-genetic attribute information of the newly created data standard according to the newly introduced data includes the following steps:

s301: and obtaining a new attribute corresponding to the newly introduced data according to the newly introduced data.

S302: and establishing the non-genetic attribute information of the newly-established data standard according to the new attribute.

Illustratively, if there is newly introduced data as follows:

"zhangsan", "lie four", "+ 8612345678900", "+ 8600987654321", "male", "female".

In this case, "zhangsan", "liquad", +8612345678900 ", and" +8600987654321 "in the newly introduced data can be associated with the range of the genetic attribute, but data" male "and" female "cannot be associated with the range of the genetic attribute, and it is necessary to determine the new attribute" sex "from data" male "and" female ".

It should be noted that, the specific implementation manner of obtaining the new attribute corresponding to the newly introduced data according to the newly introduced data may be determined by a person skilled in the art according to an actual situation, and the foregoing description is only an example, and does not limit this.

Illustratively, the establishing of the non-genetic attribute information of the newly-built data standard according to the new attribute may be implemented manually, or may be implemented by combining software, program and other manners with actual service processing requirements. For example, for a new attribute "gender", the following non-genetic attribute information can be obtained:

non-genetic attributes: gender correspondence sub-criteria: it needs to be a chinese character string, and the length of the character string is 1.

It should be noted that, the specific implementation manner of the establishing the non-genetic attribute information of the new data standard according to the new attribute can be determined by those skilled in the art according to actual situations, and the above description is only an example, and is not limited thereto.

Through the steps S301 and S302, the new attribute needing to be newly introduced is determined based on the newly introduced data, and then the non-genetic attribute information is established based on the new attribute, so that the established non-genetic attribute information can be more in line with the characteristics of the newly introduced data, the newly established data standard generated in the subsequent step is more in line with the new data, and the accuracy of subsequent data management is improved.

In an alternative embodiment, as shown in fig. 4, the generating a new data standard according to the genetic attribute information and the non-genetic attribute information includes the following steps:

s401: and obtaining a non-genetic attribute and a first sub-standard of the non-genetic attribute information according to the non-genetic attribute information.

S402: and obtaining the genetic attribute and a second sub-standard of the genetic attribute information according to the genetic attribute information.

S403: and generating a new data standard according to the genetic attribute, the second sub-standard, the non-genetic attribute and the first sub-standard.

Illustratively, the following non-genetic attribute information is present:

The resulting non-genetic attribute is "gender", the first sub-criterion is "need to be a chinese string, and the string length is 1".

The non-genetic attribute information includes the non-genetic attribute and the first sub-standard, so that the non-genetic attribute and the first sub-standard of the non-genetic attribute information can be directly obtained from the non-genetic attribute information.

It should be noted that, a specific implementation manner of the first sub-standard for obtaining the non-genetic attribute and the non-genetic attribute information according to the non-genetic attribute information may be determined by a person skilled in the art according to actual situations, and the foregoing description is only an example, and is not limited thereto.

For example, if the following genetic attribute information:

The resulting genetic attributes are "name of transactor" and "mobile phone number of transactor", the resulting second sub-criteria include "need to be a chinese string and the string length is 2 to 10" and "the string type needs to be number + sign and the string length is 14".

The genetic attribute information includes the genetic attribute and the second sub-standard, so that the genetic attribute and the second sub-standard of the genetic attribute information can be directly obtained according to the genetic attribute information.

Illustratively, the generating of the new data standard according to the genetic attribute, the second sub-standard, the non-genetic attribute and the first sub-standard may be, but is not limited to, integrating the genetic attribute, the second sub-standard, the non-genetic attribute and the first sub-standard to generate the new data standard.

For example, the newly created data criteria are generated as shown in table 2 below:

TABLE 2

It should be noted that, the specific implementation manner of generating the new data standard according to the genetic attribute, the second sub-standard, the non-genetic attribute and the first sub-standard can be determined by those skilled in the art according to actual situations, and the above description is only an example, and is not limited thereto.

Through the steps S401 to S403, the content of the newly-built data standard can be made clearer, so that the treatment effect and the treatment speed during the subsequent data treatment according to the newly-built data standard are improved, and the efficiency of the data treatment is further improved. Moreover, the compatibility of the newly-built data standard with the existing data standard and a related data system can be improved, and meanwhile, the degree of correlation between the newly-built data standard and newly-introduced data is improved, so that the probability of errors occurring in the subsequent data management according to the newly-built data standard and the existing data standard is reduced.

In an optional embodiment, the adding the new data standard to the existing standard to obtain an updated total standard includes:

if the related node is a node where a 'bank common client' is located in the pedigree, the pedigree can obtain that the father node is an upper node of the related node, namely, a node where 'user side processing information' is located. It should be noted that, the specific implementation manner of obtaining the parent node of the relevant node in the data standard lineage according to the relevant node may be determined by those skilled in the art according to practical situations, and the above description is only an example, and does not limit this.

For example, if the new data standard is identified as "bank guest client", the updated overall standard may be expressed as the following pedigree:

it should be noted that, the specific implementation manner of adding the new data standard as another child node of the parent node into the data standard pedigree to obtain the updated total standard can be determined by those skilled in the art according to practical situations, and the above description is only an example, and does not limit this.

Through the steps, the newly-built data standard can be added to the proper position in the pedigree according to the relevant logic relation of the data standard pedigree, so that the maintenance of the data standard pedigree by workers is facilitated, the search and the search of the newly-built data standard are facilitated, the difficulty of data management according to the updated total standard is reduced, and the efficiency of data management is improved.

In an optional embodiment, further comprising:

Illustratively, the total number of data criteria attributes is not counted for duplicate data criteria attributes. For example, if the attribute "card number" appears in one data standard and the attribute "card number" also appears in another data standard, then the total number of data standard attributes is incremented by 1 instead of 2.

Illustratively, the total number of data table attributes is not counted for duplicate data table attributes. For example, if the attribute "card type" appears in a data table and the attribute "card type" also appears in another data standard, then 1 is added to the total number of data table attributes instead of 2.

Illustratively, the data record attributes conform to a first number of data records of the current existing data standard, specifically, the number of data records in which the data record attributes are all embodied in the current existing data standard (including the new data standard). For example, for a data record, it has three attributes of name, gender, and age, and if the three attributes are all recorded in the current existing data standard and have corresponding sub-standards, the data record is the first data record whose data record attributes conform to the current existing data standard; if one or more of the three attributes do not record or have no corresponding sub-standard in the currently existing data standard, the data record is not the first data record whose data record attribute conforms to the currently existing data standard.

For example, the number of the second data records in the first data record with no empty attribute value is specifically the number of the data records in the first data record with corresponding attribute values for each data attribute. For example, if a data record has three attributes of name, sex, and age, and if the attribute value of the name attribute of the data record is "wang five", the attribute value of the sex attribute of the data record is "man", and the attribute value of the age attribute of the data record is "20", the data record is a second data record with no gap in the attribute values. If one or more attributes in the data record do not have corresponding attribute values, the data record is not a second data record whose attribute values are not empty.

For example, the improvement of the data management quality according to the data management quality index may be, but not limited to, judging whether the data management quality index is less than or equal to an index threshold, if so, performing data management again according to all data standards, and implementing inspection after the data management of each piece of data, so as to improve the quality of the data management. The index threshold may be determined according to actual conditions, for example, but not limited to 90%, 80%, and the like.

It should be noted that, after the worker administers the data according to the administration range, the worker obtains the total number of data standard attributes included in all the data standards, the total number of data table attributes of all the data tables, the first data record number of which the data record attributes conform to the existing data standard, the second data record number of which the attribute values in the first data record are not vacant, and the third data record number of which all the attribute values in the second data record conform to the existing data standard; obtaining a data governance quality index according to the total data standard attribute number, the total data table attribute number, the first data record number, the second data record number and the third data record number, and feeding back the data governance quality index to the worker, so that the worker can determine a specific implementation manner for improving the data governance quality according to the data governance quality index by the worker in the field according to the actual situation, and the above description is only an example, and does not limit the implementation manner.

Through the steps, the quality of data management can be improved, and the normal operation of a related data system is facilitated.

In an optional embodiment, as shown in fig. 5, the obtaining a data governance quality indicator according to the total number of data standard attributes, the total number of data table attributes, the first number of data records, the second number of data records, and the third number of data records includes the following steps:

s501: and obtaining the coverage rate according to the total number of the data standard attributes and the total number of the data table attributes.

S502: and obtaining the integrity rate according to the first data record number and the second data record number.

S503: and obtaining the accuracy according to the first data record number and the third data record number.

S504: and obtaining a data management quality index according to the coverage rate, the integrity rate and the accuracy rate.

For example, the coverage obtained according to the total number of the data standard attributes and the total number of the data table attributes may be, but is not limited to, the coverage obtained by dividing the total number of the data standard attributes by the total number of the data table attributes.

Illustratively, the obtaining of the integrity rate according to the first data record number and the second data record number may be, but is not limited to, dividing the second data record number by the first data record number to obtain the integrity rate.

For example, the accuracy obtained according to the first data record number and the third data record number may be, but is not limited to, the accuracy obtained by dividing the third data record number by the first data record number.

For example, the obtaining of the data governance quality index according to the coverage rate, the integrity rate and the accuracy rate may be, but is not limited to, obtaining the data governance quality index by using an average value of the coverage rate, the integrity rate and the accuracy rate as the data governance quality index, or integrating the coverage rate, the integrity rate and the accuracy rate, so that the data governance quality index includes the coverage rate, the integrity rate and the accuracy rate.

Through the steps S501 to S504, the quantized data governance sub-indexes are obtained on the basis of the data governance condition, and then the sub-indexes are processed to obtain the data governance quality index, so that the obtained data governance quality index can better accord with the actual data governance condition, the accuracy of the data governance quality index is improved, and the improvement of the data governance quality according to the data governance quality index is facilitated.

Based on the same principle, the embodiment of the present invention discloses a data governance device 600, as shown in fig. 6, the data governance device 600 includes:

the genetic attribute information determining module 601 is configured to obtain the genetic attribute information of the newly created data standard according to the newly created identifier of the newly created data standard and the existing standard.

A non-genetic attribute information determining module 602, configured to establish, according to the newly introduced data, non-genetic attribute information of the newly created data standard.

And a new creation module 603, configured to generate a new creation data standard according to the genetic attribute information and the non-genetic attribute information, add the new creation data standard to the existing standard to obtain an updated total standard, and determine a treatment range of data treatment according to the updated total standard, so as to perform data treatment according to the treatment range.

In an alternative embodiment, the genetic attribute information determination module 601 is configured to:

and querying the root node of the related node in the data standard pedigree to obtain a root node identifier of the root node data standard corresponding to the root node, and taking the root node identifier as the superior identifier.

obtaining a superior data standard according to the superior identification;

In an alternative embodiment, the non-genetic attribute information determination module 602 is configured to:

obtaining new attributes corresponding to the newly introduced data according to the newly introduced data;

In an optional implementation manner, the newly building module 603 is configured to:

In an optional embodiment, the system further comprises a data governance improvement module, configured to:

and according to the data standard attribute total number, the data table attribute total number, the first data record number, the second data record number and the third data record number, obtaining a data governance quality index, and feeding the data governance quality index back to the worker, so that the worker can improve the data governance quality according to the data governance quality index.

Since the principle of solving the problem of the data governance device 600 is similar to the above method, the implementation of the data governance device 600 can refer to the implementation of the above method, and is not described herein again.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer device, which may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

In a typical example, the computer device comprises in particular a memory, a processor and a computer program stored on the memory and executable on the processor, which when executed by the processor implements the method as described above.

Referring now to FIG. 7, shown is a schematic block diagram of a computer device 700 suitable for use in implementing embodiments of the present application.

As shown in fig. 7, the computer apparatus 700 includes a Central Processing Unit (CPU)701, which can perform various appropriate works and processes according to a program stored in a Read Only Memory (ROM)702 or a program loaded from a storage section 708 into a Random Access Memory (RAM)) 703. In the RAM703, various programs and data necessary for the operation of the system 700 are also stored. The CPU701, the ROM702, and the RAM703 are connected to each other via a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

The following components are connected to the I/O interface 705: an input portion 706 including a keyboard, a mouse, and the like; an output section 707 including components such as a Cathode Ray Tube (CRT), a liquid crystal feedback (LCD), and the like, and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. A drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read out therefrom is mounted as necessary in the storage section 708.

In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the invention include a computer program product comprising a computer program tangibly embodied on a machine-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the various elements may be implemented in the same one or more pieces of software and/or hardware in the practice of the present application.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A data governance method, comprising:

2. The method of claim 1, wherein the obtaining genetic attribute information of the newly created data standard according to the newly created identifier of the newly created data standard and the existing standard comprises:

3. The method according to claim 2, wherein said obtaining an approximate identifier of an approximate data standard corresponding to the new identifier according to the new identifier and an existing standard comprises:

4. The method according to claim 2, wherein said obtaining, according to the approximate identifier, an upper identifier of an upper data standard corresponding to the new identifier comprises:

5. The method according to claim 2, wherein the obtaining genetic attribute information of the newly created data standard according to the superior identifier comprises:

obtaining a superior data standard according to the superior identification;

6. The method of claim 1, wherein the establishing of the non-genetic attribute information of the newly created data standard based on the newly introduced data comprises:

7. The method of claim 1, wherein generating a new data standard based on the genetic attribute information and the non-genetic attribute information comprises:

obtaining genetic attributes and second sub-standards of the genetic attribute information according to the genetic attribute information;

8. The method of claim 4, wherein adding the new data standard to the existing standard results in an updated overall standard, comprising:

9. The method of claim 1, further comprising:

after data management is carried out according to the management range, acquiring the total number of data standard attributes included by all data standards, the total number of data table attributes of all data tables, a first data record number of which the data record attribute accords with the current existing data standard, a second data record number of which the attribute value in the first data record is not vacant, and a third data record number of which all the attribute values in the second data record accord with the existing data standard;

and obtaining a data governance quality index according to the data standard attribute total number, the data table attribute total number, the first data record number, the second data record number and the third data record number, and feeding back the data governance quality index to a worker so that the worker improves the data governance quality according to the data governance quality index.

10. The method of claim 9, wherein obtaining a data governance quality indicator based on the data criteria attribute total, the data table attribute total, the first data record number, the second data record number, and the third data record number comprises:

obtaining a coverage rate according to the total number of the data standard attributes and the total number of the data table attributes;

11. A data governance device, comprising:

12. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1-10 when executing the program.

13. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-10.