CN101859303A - Metadata management method and management system - Google Patents
Metadata management method and management system Download PDFInfo
- Publication number
- CN101859303A CN101859303A CN200910131570A CN200910131570A CN101859303A CN 101859303 A CN101859303 A CN 101859303A CN 200910131570 A CN200910131570 A CN 200910131570A CN 200910131570 A CN200910131570 A CN 200910131570A CN 101859303 A CN101859303 A CN 101859303A
- Authority
- CN
- China
- Prior art keywords
- metadata
- mapping relations
- information
- sql statement
- code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a metadata management method and a metadata management system. The metadata management method comprises the following steps of: A, extracting codes formed by developing existing metadata in a metadata base; B, resolving mapping relationship information of the codes, and generating new metadata; and C, storing the new metadata into the metadata base. The metadata management method and the metadata management system of the invention resolve the codes in a development process and extract the metadata during compiling and developing a data processing program so that metadata information maintenance and practical production data can be synchronized in time, the content information is consistent and the manual maintenance workload of the metadata is reduced; the combination of the metadata and the production is improved at the same time to provide application effect and value; and the method and the system are favorable for quality management, flow monitoring and maintenance management in a requirement development process.
Description
Technical field
The present invention relates to a kind of business support technology, relate in particular to a kind of metadata management method and management system.
Background technology
In the data warehouse field, metadata is defined as: the data of data of description and environment thereof.In general, it has the purposes of two aspects.At first, metadata can provide the information based on the user, can help the user to use data as the metadata of the business description information of record data items.Secondly, metadata can back-up system to the administering and maintaining of data, as can back-up system about the metadata of store data items method with effective and efficient manner visit data.Specifically, in data warehouse, the following five type systematic management functions of the main support of metadata mechanism: which data (1) describes in data warehouse; (2) define the data that will enter the data in the data warehouse and from data warehouse, produce; (3) writing down the data pick-up working time of thereupon carrying out according to the business event generation arranges; (4) requirement and the implementation status of record and detection system data consistency; (5) weigh the quality of data.
Existing routine data warehouse metadata schema (Common WarehouseMetamodel in the prior art, be called for short CWM) the international standard theory, but, CWM can not realize between whole systems or intrasystem metadata is obtained, and there is big technical difficulty in existing metadata acquisition methods, is difficult for realizing.Simultaneously, utilize CWM can only be afterwards production information to be integrated and provide the metadata Back ground Information, and because information is difficult to consolidation or postpones omit, can't not realize that because of imperfect and progress catch up with metadata manages accurately easily.
Therefore, provide a kind of can obtaining automatically to concern between the production system data that getting the maintenance of solution metadata develops the metadata management method of asynchronous problem and the technical matters that system becomes urgent need solution in the prior art with production.
Summary of the invention
First purpose of the present invention is, safeguard, content information inconsistent defective asynchronous at metadata information in the prior art, the metadata management method that a kind of metadata information is synchronous with the online production data message and content information is consistent is provided with the actual production data.
Second purpose of the present invention is, safeguard, content information inconsistent defective asynchronous at metadata information in the prior art, the metadata management system that a kind of metadata information is synchronous with the online production data message and content information is consistent is provided with the actual production data.
According to first purpose of the present invention, a kind of metadata management method is provided, comprise A, extract and develop the code that forms according to existing metadata in the metadatabase; The mapping relations information of B, resolving code generates new metadata; C, with new metadata store in metadatabase.
According to second purpose of the present invention, a kind of metadata management system is provided, comprising: the performance analysis device is used for storing according to the existing metadata of metadatabase and develops the code that the back forms; Resolver is used to extract described code, resolves the mapping relations information of described code, generates new metadata; Metadatabase is used to store described metadata.
Among the present invention, the code that the performance analysis device generates is a SQL statement.
Metadata management method of the present invention and management system, by when writing the development data handling procedure to performance history in the parsing of code, extract metadata, can be so that metadata information be safeguarded and the actual production data can be in time synchronous, the content information unanimity, the manual maintenance workload of metadata reduces; Improve metadata simultaneously and provide effect and value with producing to combine; And help quality management, flow monitoring and maintenance management in the demand performance history.
Description of drawings
Fig. 1 is the structural drawing of embodiment of the invention metadata management system;
Fig. 2 is the structural drawing of embodiment of the invention resolver;
Fig. 3 is the process flow diagram of embodiment of the invention metadata management method;
Fig. 4 is the software synoptic diagram of embodiment of the invention SQL resolver operational process input SQL statement;
Fig. 5 is the software synoptic diagram that embodiment of the invention SQL resolver operational process is set up grammar book;
Fig. 6 is embodiment of the invention SQL resolver operational process output result's a software synoptic diagram;
Fig. 7 is the application synoptic diagram of embodiment of the invention metadata management system.
Embodiment
The present invention is described in detail below in conjunction with accompanying drawing.
As shown in Figure 1, the metadata management system of the embodiment of the invention comprises: performance analysis device 20 is used for storing according to the existing metadata of metadatabase and develops the code that the back forms; Resolver 40 is used to extract described code, resolves the mapping relations information of described code, generates new metadata; Metadatabase 60 is used to store described metadata.In the present embodiment, the code that the performance analysis device generates is a SQL statement.
As shown in Figure 2, resolver 40 comprises: analysis module 42 is used to resolve the mapping relations information of SQL statement; Metadata generation module 44 is used for generating corresponding new metadata according to described mapping relations information.Analysis module 42 comprises: field analysis module and/or table level are analyzed a module, and the field analysis submodule is used to resolve the mapping relations between the field of SQL statement; The table level is analyzed submodule, is used to resolve the source table of SQL statement and the mapping relations between the object table.
SQL statement in 40 pairs of performance historyes of resolver is analyzed, set up table level and field mappings relation, generate corresponding metadata information and be stored in metadatabase, performance analysis device 20 is published on corresponding environment and the operation module by will produce the configuration key element to the issue of metadata, make that the metadata information maintenance can be in time synchronous with the actual production data, the content information unanimity, the manual maintenance workload of metadata reduces.
As shown in Figure 3, the metadata management system management method of the embodiment of the invention comprises:
A, extraction are developed the code that forms according to existing metadata in the metadatabase;
The mapping relations information of B, resolving code generates new metadata;
C, with new metadata store in metadatabase.
In the present embodiment, this code is a SQL statement.Wherein, step B specifically comprises: step b12, resolve the table level mapping relations information of described SQL statement; Step b14 sets up mapping relations between source table and the object table according to described table level mapping relations information, generates corresponding new metadata.Above-mentioned table level mapping relations are meant the mapping relations between source table and the object table, and the source table is the basic data set that object table forms, and the source table generates object table by certain field mappings, rule condition, transformation rule etc. according to certain SQL disposal route.
Step B also comprises: step b22, the field mappings relation information of parsing SQL statement; Step b24 sets up mapping relations between the field according to the field mappings relation information, generates corresponding new metadata.
In the present embodiment, resolver 40 can be Structured Query Language (SQL) (Structured QueryLanguage is called for short SQL) resolver.
The concrete operational process of SQL resolver is as follows in the present embodiment:
(1) as shown in Figure 4, input SQL statement;
(2) as shown in Figure 5, set up mutually deserved grammar database;
(3) as shown in Figure 6, the output result can select output table level relation or field level relation.
By the SQL resolver, as long as there is the place of SQL statement just can resolve the output field map information.Obtain the SQL statement of operation system every day, every month, with these SQL statement by the SQL resolver resolves complete after, just can set up the mapping relations of comprehensive table grade and/or field.The SQL resolver be can call in the process of program development or when reaching the standard grade and new procedures, newly-built table etc. and the table of storage or the relation of program built.For the SQL program, transform the original public function of carrying out SQL statement, make it when carrying out SQL statement, write down normalized more detailed logging simultaneously, resolve according to the SQL statement in the daily record again.
When setting up the demand development management, on the demand development platform, finish program development simultaneously by setting up SQL statement, to set up concerning between each table in the metadata automatically by the SQL resolver, when finishing etc. development process, relation is also just set up automatically between table.Solved the problem that original Mr. metadata management safeguards postpartum.An and unified demand development platform that also offers business personnel and the common maintenance and management of developer.
As shown in Figure 7, embodiment of the invention metadata management system is in concrete application process, obtain exploitation code from the development management platform, resolve back generator data storage in metadatabase, by issuing these metadata, can be published on corresponding environment and the operation module producing the configuration key element, make that the metadata information maintenance can be in time synchronous with the actual production data, the content information unanimity, the manual maintenance workload of metadata reduces.Wherein, the development management platform is a business platform, adopts the management of plug-in type, only the plug-in unit of functions of modules need be configured, and just can make development platform have function corresponding.
In the present embodiment, shown in the whole performance history table specific as follows:
In the demand performance history, can instruct, retrain the developer and how on existing metadata basis, constantly, reasonably create new metadata; Workflow control has guaranteed the standardization of performance history; Various developing instruments make the developer develop easily, guarantee the efficient and the quality of metadata output; By the issue means that provide will develop the output metadata be published to test environment, production environment finish test, on line process; By calculating assessment to the workload of the metadata type correspondence of output, make the development amount assess that more science is accurate, optimize and the cooperating of developer, communication, excitation, guiding.
Metadata management method of the present invention and management system can be so that metadata information be safeguarded and the actual production data can be in time synchronous, the content information unanimity, and the manual maintenance workload of metadata reduces; Improve metadata simultaneously and provide effect and value with producing to combine; And help quality management, flow monitoring and maintenance management in the demand performance history.
It should be noted that: above embodiment is only unrestricted in order to explanation the present invention, and the present invention also is not limited in above-mentioned giving an example, and all do not break away from the technical scheme and the improvement thereof of the spirit and scope of the present invention, and it all should be encompassed in the claim scope of the present invention.
Claims (8)
1. a metadata management method is characterized in that, comprising:
A, extraction are developed the code that forms according to existing metadata in the metadatabase;
The mapping relations information of B, the described code of parsing generates new metadata;
C, with described new metadata store in metadatabase.
2. metadata management method according to claim 1 is characterized in that, described steps A specifically comprises: described code is a SQL statement.
3. metadata management method according to claim 2 is characterized in that, described step B specifically comprises:
Resolve the table level mapping relations information of described SQL statement;
Set up mapping relations between source table and the object table according to described table level mapping relations information, generate corresponding new metadata.
4. metadata management method according to claim 3 is characterized in that, described step B also comprises: the field mappings relation information of resolving described SQL statement;
Set up mapping relations between the field according to described field mappings relation information, generate corresponding new metadata.
5. a metadata management system is characterized in that, comprising:
The performance analysis device is used for storing according to the existing metadata of metadatabase and develops the code that the back forms;
Resolver is used to extract described code, resolves the mapping relations information of described code, generates new metadata;
Metadatabase is used to store described metadata.
6. metadata management system according to claim 5 is characterized in that, described code is a SQL statement.
7. metadata management system according to claim 6 is characterized in that, described resolver comprises:
Analysis module is used to resolve the mapping relations information of described SQL statement;
The metadata generation module is used for generating corresponding new metadata according to described mapping relations information.
8. metadata management system according to claim 7 is characterized in that, described analysis module comprises: field analysis module and/or table level are analyzed module,
Described field analysis submodule is used to resolve the mapping relations between the field of described SQL statement;
Described table level is analyzed submodule, is used to resolve the source table of described SQL statement and the mapping relations between the object table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910131570A CN101859303A (en) | 2009-04-07 | 2009-04-07 | Metadata management method and management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910131570A CN101859303A (en) | 2009-04-07 | 2009-04-07 | Metadata management method and management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101859303A true CN101859303A (en) | 2010-10-13 |
Family
ID=42945219
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910131570A Pending CN101859303A (en) | 2009-04-07 | 2009-04-07 | Metadata management method and management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101859303A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102289460A (en) * | 2011-07-13 | 2011-12-21 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN102567430A (en) * | 2010-12-31 | 2012-07-11 | 中国移动通信集团湖北有限公司 | Method and device for graphical display of metadata relationship |
| CN103186541A (en) * | 2011-12-27 | 2013-07-03 | 阿里巴巴集团控股有限公司 | Generation method and device for mapping relationship |
| CN103902653A (en) * | 2014-02-28 | 2014-07-02 | 珠海多玩信息技术有限公司 | Method and device for creating data warehouse table blood relationship graph |
| CN103927323A (en) * | 2014-02-26 | 2014-07-16 | 浪潮软件股份有限公司 | Information system value domain data management method |
| WO2017097125A1 (en) * | 2015-12-07 | 2017-06-15 | 阿里巴巴集团控股有限公司 | Executive code generation method and device |
| CN107239968A (en) * | 2017-05-12 | 2017-10-10 | 浙江绿森数码科技有限公司 | A kind of data management system based on big data |
| CN107657052A (en) * | 2017-10-17 | 2018-02-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on metadata management |
| CN109739893A (en) * | 2018-12-28 | 2019-05-10 | 上海连尚网络科技有限公司 | A kind of metadata management method, equipment and computer-readable medium |
| CN110807033A (en) * | 2019-10-12 | 2020-02-18 | 中思博安科技（北京）有限公司 | Data management method, device and system |
| CN111767266A (en) * | 2020-05-15 | 2020-10-13 | 杭州传化智能制造科技有限公司 | Entity contact model design method and device, computer equipment and storage medium |
| CN112347124A (en) * | 2020-11-12 | 2021-02-09 | 浙江百应科技有限公司 | Metadata management platform and metadata management method |
| CN115794214A (en) * | 2023-02-09 | 2023-03-14 | 中邮消费金融有限公司 | Application module metadata management method, device, storage medium and device |
| CN117056312A (en) * | 2023-08-17 | 2023-11-14 | 安徽派偌汇科技咨询有限公司 | Quick development platform based on metadata model |
-
2009
- 2009-04-07 CN CN200910131570A patent/CN101859303A/en active Pending
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567430A (en) * | 2010-12-31 | 2012-07-11 | 中国移动通信集团湖北有限公司 | Method and device for graphical display of metadata relationship |
| CN102567430B (en) * | 2010-12-31 | 2014-10-01 | 中国移动通信集团湖北有限公司 | Method and device for graphical display of metadata relationship |
| CN102289460B (en) * | 2011-07-13 | 2013-03-27 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN102289460A (en) * | 2011-07-13 | 2011-12-21 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN103186541A (en) * | 2011-12-27 | 2013-07-03 | 阿里巴巴集团控股有限公司 | Generation method and device for mapping relationship |
| CN103186541B (en) * | 2011-12-27 | 2016-08-24 | 阿里巴巴集团控股有限公司 | A kind of mapping relations generate method and device |
| CN103927323A (en) * | 2014-02-26 | 2014-07-16 | 浪潮软件股份有限公司 | Information system value domain data management method |
| CN103902653B (en) * | 2014-02-28 | 2017-08-01 | 珠海多玩信息技术有限公司 | A kind of method and apparatus for building data warehouse table genetic connection figure |
| CN103902653A (en) * | 2014-02-28 | 2014-07-02 | 珠海多玩信息技术有限公司 | Method and device for creating data warehouse table blood relationship graph |
| WO2017097125A1 (en) * | 2015-12-07 | 2017-06-15 | 阿里巴巴集团控股有限公司 | Executive code generation method and device |
| CN107239968A (en) * | 2017-05-12 | 2017-10-10 | 浙江绿森数码科技有限公司 | A kind of data management system based on big data |
| CN107657052A (en) * | 2017-10-17 | 2018-02-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on metadata management |
| CN109739893A (en) * | 2018-12-28 | 2019-05-10 | 上海连尚网络科技有限公司 | A kind of metadata management method, equipment and computer-readable medium |
| CN110807033A (en) * | 2019-10-12 | 2020-02-18 | 中思博安科技（北京）有限公司 | Data management method, device and system |
| CN111767266A (en) * | 2020-05-15 | 2020-10-13 | 杭州传化智能制造科技有限公司 | Entity contact model design method and device, computer equipment and storage medium |
| CN112347124A (en) * | 2020-11-12 | 2021-02-09 | 浙江百应科技有限公司 | Metadata management platform and metadata management method |
| CN115794214A (en) * | 2023-02-09 | 2023-03-14 | 中邮消费金融有限公司 | Application module metadata management method, device, storage medium and device |
| CN117056312A (en) * | 2023-08-17 | 2023-11-14 | 安徽派偌汇科技咨询有限公司 | Quick development platform based on metadata model |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101859303A (en) | Metadata management method and management system | |
| CN101661460B (en) | Method and device for generating management system report | |
| WO2020233330A1 (en) | Batch testing method, apparatus, and computer-readable storage medium | |
| Li | Transforming relational database into HBase: A case study | |
| CN104133772A (en) | Automatic test data generation method | |
| CN109299074B (en) | Data verification method and system based on templated database view | |
| CN104361139A (en) | Data importing device and method | |
| CN103186541A (en) | Generation method and device for mapping relationship | |
| CN103810152A (en) | Visualized formula editor | |
| CN103744651A (en) | Method for automatically generating business processing model oriented to business requirements | |
| CN111061739A (en) | Method and device for warehousing massive medical data, electronic equipment and storage medium | |
| CN104156198A (en) | Method and device for automatically generating software integration version updating description | |
| CN105808653A (en) | User label system-based data processing method and device | |
| CN104598570A (en) | Resource fetching method and device | |
| CN114610747A (en) | Data query method, device, equipment and storage medium | |
| CN113094039B (en) | Automatic code generation system based on database table | |
| CN112783482B (en) | Visual form generation method, device, equipment and storage medium | |
| CN103699746B (en) | CADDS5 piping three-dimensional design method based on data base and system | |
| CN102866985B (en) | For data formatter and the method for on-line analysing processing system | |
| US10924551B2 (en) | IRC-Infoid data standardization for use in a plurality of mobile applications | |
| CN116701355A (en) | Data view processing method, device, computer equipment and readable storage medium | |
| CN103020162B (en) | CC2000 model conversion imports the method for D5000 system | |
| CN103092841B (en) | A kind of data processing method and device | |
| CN114741077A (en) | Page effect preview method, device, equipment and medium based on field granularity | |
| CN115114297A (en) | Data lightweight storage and search method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20101013 |