CN109857822A - Meta-model conversion method and management system based on chart database - Google Patents

Meta-model conversion method and management system based on chart database Download PDF

Info

Publication number
CN109857822A
CN109857822A CN201811634144.7A CN201811634144A CN109857822A CN 109857822 A CN109857822 A CN 109857822A CN 201811634144 A CN201811634144 A CN 201811634144A CN 109857822 A CN109857822 A CN 109857822A
Authority
CN
China
Prior art keywords
metadata
information
meta
relationship
chart database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811634144.7A
Other languages
Chinese (zh)
Inventor
钟晓良
王剑
张欣
范媛媛
黎冬梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National Development Bank
Original Assignee
National Development Bank
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National Development Bank filed Critical National Development Bank
Priority to CN201811634144.7A priority Critical patent/CN109857822A/en
Publication of CN109857822A publication Critical patent/CN109857822A/en
Pending legal-status Critical Current

Links

Abstract

The invention discloses a kind of meta-model conversion method and management system based on chart database, the meta-model conversion method includes: to carry out processing to metadata essential information, management information and metadata relationship information to generate diagram data, wherein, diagram data includes metadata node information and metadata node relation information;The diagram data of generation is stored in graphic data base to be used to generate metadata map.Above-mentioned technical proposal of the invention is able to solve the storage problem of under big data era variety classes, different grain size metadata, and the relationship for capableing of carry out metadata rapidly and efficiently is searched and analysis, has obtained the promotion of matter to the analysis of the relationship between metadata;It solves the problems, such as the service efficiency of magnanimity metadata by graphic data base, solves the problems, such as the search efficiency of metadata;The metadata information also intuitively to show provides the foundation simultaneously.

Description

Meta-model conversion method and management system based on chart database
Technical field
The present invention relates to a kind of meta-model conversion method and management system based on chart database.
Background technique
With the arrival of big data era and the sustainable development of each business event, quantity, the type of data are more and more, Relationship between data becomes increasingly complex, and the application scenarios of data are also from traditional statistical analysis, till now based on big data Machine learning, knowledge mapping etc..The depth of data excavate use, data to the promotion of business, data in Fang Fang such as enterprise operations Face face plays increasingly important role, and data assets have gradually become one of the core asset of enterprise.
Metadata is the data about data, is that data are described, explain, position and made with its more convenient retrieval, is made With or management data.Metadata is the basis of data share, exchange, analyze, used, and big data necessarily leads to magnanimity member number According to, metadata becomes more important, metadata storage, management, use, analysis quality, directly determine that data application is being looked forward to Quality in industry.It only runs metadata well, can just make good use of data.Traditional metadata management is realized based on relevant database , the browsing of metadata relationship in traditional metadata management system is primarily present following problems under big data era:
(1) type of metadata, quantity are more and more in big data era, and the data of magnanimity necessarily lead to first number of magnanimity According to the management of traditional metadata still depends on relational database, it is clear that be unable to satisfy magnanimity variety classes, different grain size member The storage of data.
(2) relationship of metadata becomes increasingly complex, the prevailing scenario that the analysis of metadata uses first is that metadata into Row consanguinity analysis or impact analysis, the root of rapidly locating because.The pass that conventional metadata management passes through table in relational database Join influence and consanguinity analysis that recursive query realizes metadata, in the case where magnanimity metadata, efficiency is very low, to complicated member The relationship analysis of data even cannot achieve, and be unable to satisfy the demand of user.
(3) management of traditional metadata can not quickly position metadata, displaying metadata information that can not be clear.
Summary of the invention
In view of the above problems in the related art, the present invention propose a kind of meta-model conversion method based on chart database and Management system is able to solve the storage problem of magnanimity metadata, solves the problems, such as the search efficiency of metadata.
The technical scheme of the present invention is realized as follows:
According to an aspect of the invention, there is provided a kind of meta-model conversion method based on chart database, comprising:
Processing is carried out to metadata essential information, management information and metadata relationship information and generates diagram data, wherein figure number According to including metadata node information and metadata node relation information;
The diagram data of generation is stored in graphic data base to be used to generate metadata map.
According to an embodiment of the invention, metadata node information includes nodal information, attribute information and label information.
According to an embodiment of the invention, metadata node relation information includes fundamental relation information and secondary relationship information.
According to an embodiment of the invention, adding to metadata essential information, management information and metadata relationship information Work includes: classification processing, statistical analysis, position distribution, label is established, relationship conversion, level divides and attribute mapping.
According to an embodiment of the invention, meta-model conversion method further include: synchronous metadata essential information, management information and Metadata relationship information.
According to another aspect of the present invention, a kind of meta-model management system based on chart database is provided, including following Module: metadata processing module, for carrying out processing generation to metadata essential information, management information and metadata relationship information Diagram data, wherein diagram data includes metadata node information and metadata node relation information;Metadata storage module is used for The diagram data of generation is stored in graphic data base to be used to generate metadata map.
According to an embodiment of the invention, metadata node information includes nodal information, attribute information and label information.
According to an embodiment of the invention, metadata node relation information includes fundamental relation information and secondary relationship information.
According to an embodiment of the invention, metadata processing module include: classification processing submodule, statistical analysis submodule, Position distribution sub module, label setting up submodule, relationship transform subblock, level divide submodule and attribute mapping submodule.
According to an embodiment of the invention, meta-model management system further include: metadata synchronization module, for synchronizing metadata Essential information and metadata relationship information.
The present invention by graphic data base, close by the metadata node information and metadata node that can store magnanimity metadata It is information, can be good at the storage for solving relationship between metadata, to solves under big data era variety classes, no The storage problem of one-size metadata.In addition, relationship complicated between metadata has been stored in advance by graphic data base, lead to Cross the graph traversal algorithm of graphic data base, the relationship for capableing of carry out metadata rapidly and efficiently is searched and analysis, not only efficiency and Conventional metadata system has magnitude promotion, and has obtained the promotion of matter to the analysis of the relationship between metadata.Therefore, pass through Graphic data base solves the problems, such as the service efficiency of magnanimity metadata, solves the problems, such as the search efficiency of metadata.Simultaneously Metadata information intuitively to show provides the foundation.
Detailed description of the invention
It in order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, below will be to institute in embodiment Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention Example, for those of ordinary skill in the art, without creative efforts, can also obtain according to these attached drawings Obtain other attached drawings.
Fig. 1 is the flow chart of the meta-model conversion method according to an embodiment of the present invention based on chart database;
Fig. 2 is the block diagram of the meta-model management system according to an embodiment of the present invention based on chart database;
Fig. 3 is the work flow diagram of meta-model management system according to an embodiment of the present invention;
Fig. 4 is the flow process chart of the metadata of meta-model management system according to an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, those of ordinary skill in the art's every other embodiment obtained belong to what the present invention protected Range.
As shown in Figure 1, the present invention provides a kind of meta-model conversion method based on chart database, comprising the following steps:
Step S10 carries out processing to metadata essential information, management information and metadata relationship information and generates diagram data, Wherein, diagram data includes metadata node information and metadata node relation information;
The diagram data of generation is stored in graphic data base to be used to generate metadata map by step S20.
Above-mentioned technical proposal of the invention can store the metadata node letter of magnanimity metadata by graphic data base Breath and metadata node relation information can be good at the storage for solving relationship between metadata, to solve in big data The storage problem of variety classes under epoch, different grain size metadata.In addition, the inquiry of conventional metadata because underlying database also It is relational database, needs to realize by recursive algorithm when retrieving metadata relationship, the present invention passes through graphic data base, Relationship complicated between metadata has been stored in advance, it, being capable of progress rapidly and efficiently by the graph traversal algorithm of graphic data base The relationship of metadata is searched and analysis, and not only efficiency and conventional metadata system have magnitude promotion, but also between metadata The analysis of relationship has obtained the promotion of matter.Therefore, it solves the problems, such as the service efficiency of magnanimity metadata by graphic data base, solves The problem of search efficiency for metadata of having determined.The metadata information also intuitively to show provides the foundation simultaneously.
Wherein, metadata node information includes nodal information, attribute information and label information.Metadata node relation information Including fundamental relation information and secondary relationship information.Specifically, in traditional meta-model, the table and field of metadata are to deposit Storage in different places, some be relational database table, some be Excel, some even store in the text.And in diagram data In model, all metadata essential informations and label are all processed into the attribute of node and node, and metadata relationship is processed into member Back end relationship.For example, label can be established respectively to table and field in the metadata process to table and field, simultaneously Establish the relation information of table and field.Such as: field number that table includes, the type of table, meta data category information of table etc.; Table information, the meta data category information of field etc. of field ownership.In embodiments of the present invention, metadata information is to figure number Include two parts according to the conversion in library: first part is that traditional metadata information is processed the metadata section being converted into diagram data Point information, including nodal information, attribute information and label information;Second part is the relationship processing between the metadata that will disperse The metadata node relation information being converted into diagram data, including fundamental relation information and secondary relationship information.
In step slo, processing metadata essential information and metadata relationship information carried out include: classification processing, Statistical analysis, position distribution, label is established, relationship conversion, level divides and attribute mapping.Conventional metadata results from different System, the needs such as attribute, relationship, the label of metadata could be used by a large amount of arrangement, and these metadata are substantially Discrete not related data.The present invention provides standard set data processing, the process of label is converted and establishes, so that Inhomogeneous metadata can be quickly converted as the diagram data in graphic data base by the normal process, that is, forms graph data Nodal information, attribute information, label information and metadata node relation information in library.To which how solve will be traditional Metadata standard is converted into the problem of graphic data base.
It can be the following steps are included: synchronous metadata essential information and metadata relationship information before step S10.
As shown in Fig. 2, according to an embodiment of the invention, additionally providing a kind of meta-model management system based on chart database System, including metadata processing module 22 and the metadata storage module 23 communicated to connect with metadata processing module 22.Wherein, first Data mart modeling module 22 is used to carry out metadata essential information, management information and metadata relationship information processing generation figure number According to, wherein diagram data includes metadata node information and metadata node relation information;Metadata storage module 23 will be for that will give birth to At diagram data be stored in graphic data base with for generating metadata map.
Above-mentioned technical proposal of the invention can store the metadata node letter of magnanimity metadata by graphic data base Breath and metadata node relation information can be good at the storage for solving relationship between metadata, to solve in big data The storage problem of variety classes under epoch, different grain size metadata.In addition, the inquiry of conventional metadata because underlying database also It is relational database, needs to realize by recursive algorithm when retrieving metadata relationship, the present invention passes through graphic data base, Relationship complicated between metadata has been stored in advance, it, being capable of progress rapidly and efficiently by the graph traversal algorithm of graphic data base The relationship of metadata is searched and analysis, and not only efficiency and conventional metadata system have magnitude promotion, but also between metadata The analysis of relationship has obtained the promotion of matter.Therefore, it solves the problems, such as the service efficiency of magnanimity metadata by graphic data base, solves The problem of search efficiency for metadata of having determined.The metadata information also intuitively to show provides the foundation simultaneously.
With continued reference to shown in Fig. 2, meta-model management system of the invention further include: metadata synchronization module 21, for same Walk metadata essential information and metadata relationship information.
Wherein, metadata node information includes nodal information, attribute information and label information.Metadata node relation information Including fundamental relation information and secondary relationship information.
As shown in figure 3, meta-model management system of the invention is according to following step to the metadata process flow of big data Suddenly it is handled:
S31 carries out the acquisition synchronous with metadata relationship information of external metadata essential information by metadata synchronization module. After metadata synchronizes successfully, metadata processing module is transferred to carry out data mart modeling metadata information;
S32 carries out metadata processing by metadata processing module, the metadata synchronously completed is processed into metadata map Base map and figure layer data.
S33, by the base map and figure layer data of metadata storage module storage metadata map.
As shown in figure 4, metadata processing module can include: classification processing submodule, statistical analysis submodule, position distribution Submodule, label setting up submodule, relationship transform subblock, level divide submodule and attribute mapping submodule, so that Metadata processing module realizes that the classification of metadata is processed, statistical analysis, position is distributed, label is established, relationship conversion, level stroke Divide and the functions such as attribute mapping.The metadata essential information of dispersion and metadata relationship Information procession are stored at graphic data base Nodal information, relation information and label information, while the attribute of metadata being mapped, forms the attribute information of node. Metadata needs to carry out classification processing, statistical analysis, position distribution, label foundation, relationship conversion, level division, attribute mapping It just can enter graph data after standardization Deng seven steps.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention Within mind and principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (10)

1. a kind of meta-model conversion method based on chart database characterized by comprising
Processing is carried out to metadata essential information, management information and metadata relationship information and generates diagram data, wherein the figure number According to including metadata node information and metadata node relation information;By the diagram data of generation be stored in graphic data base with In generation metadata map.
2. the meta-model conversion method according to claim 1 based on chart database, which is characterized in that the metadata section Point information includes nodal information, attribute information and label information.
3. the meta-model conversion method according to claim 1 based on chart database, which is characterized in that the metadata section Point relation information includes fundamental relation information and secondary relationship information.
4. the meta-model conversion method according to claim 1 based on chart database, which is characterized in that basic to metadata The processing that information, management information and metadata relationship information carry out includes: classification processing, statistical analysis, position distribution, mark Label are established, relationship conversion, level divides and attribute mapping.
5. the meta-model conversion method according to claim 1 based on chart database, which is characterized in that further include: it is synchronous The metadata essential information, management information and the metadata relationship information.
6. a kind of meta-model management system based on chart database, which is characterized in that comprise the following modules:
Metadata processing module, for carrying out processing generation to metadata essential information, management information and metadata relationship information Diagram data, wherein the diagram data includes metadata node information and metadata node relation information;
Metadata storage module, for the diagram data of generation being stored in graphic data base to be used to generate metadata map.
7. the meta-model management system according to claim 6 based on chart database, which is characterized in that the metadata section Point information includes nodal information, attribute information and label information.
8. the meta-model management system according to claim 6 based on chart database, which is characterized in that the metadata section Point relation information includes fundamental relation information and secondary relationship information.
9. the meta-model management system according to claim 6 based on chart database, which is characterized in that the metadata adds Work module includes: classification processing submodule, statistical analysis submodule, position distribution sub module, label setting up submodule, relationship turn Change submodule, level divides submodule and attribute mapping submodule.
10. the meta-model management system according to claim 6 based on chart database, which is characterized in that further include:
Metadata synchronization module, for synchronizing the metadata essential information and the metadata relationship information.
CN201811634144.7A 2018-12-29 2018-12-29 Meta-model conversion method and management system based on chart database Pending CN109857822A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811634144.7A CN109857822A (en) 2018-12-29 2018-12-29 Meta-model conversion method and management system based on chart database

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811634144.7A CN109857822A (en) 2018-12-29 2018-12-29 Meta-model conversion method and management system based on chart database

Publications (1)

Publication Number Publication Date
CN109857822A true CN109857822A (en) 2019-06-07

Family

ID=66893270

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811634144.7A Pending CN109857822A (en) 2018-12-29 2018-12-29 Meta-model conversion method and management system based on chart database

Country Status (1)

Country Link
CN (1) CN109857822A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110287223A (en) * 2019-06-24 2019-09-27 北京明略软件系统有限公司 Information storage means and device, electronic device and storage medium
CN110516130A (en) * 2019-08-28 2019-11-29 北京明略软件系统有限公司 Metadata processing method and device, storage medium, electronic device
CN110851663A (en) * 2019-11-05 2020-02-28 北京明略软件系统有限公司 Method and apparatus for managing metadata
CN117312331A (en) * 2023-12-01 2023-12-29 浪潮云信息技术股份公司 Metadata blood-edge analysis method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102193990A (en) * 2011-03-25 2011-09-21 北京世纪互联工程技术服务有限公司 Pattern database and realization method thereof
US20140201234A1 (en) * 2013-01-15 2014-07-17 Fujitsu Limited Data storage system, and program and method for execution in a data storage system
CN104142980A (en) * 2014-07-15 2014-11-12 中电科华云信息技术有限公司 Big data-based metadata model management system and method
CN108595588A (en) * 2018-04-19 2018-09-28 中国科学院电子学研究所苏州研究院 A kind of science data storage correlating method
CN108920716A (en) * 2018-07-27 2018-11-30 中国电子科技集团公司第二十八研究所 The data retrieval and visualization system and method for knowledge based map

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102193990A (en) * 2011-03-25 2011-09-21 北京世纪互联工程技术服务有限公司 Pattern database and realization method thereof
US20140201234A1 (en) * 2013-01-15 2014-07-17 Fujitsu Limited Data storage system, and program and method for execution in a data storage system
CN104142980A (en) * 2014-07-15 2014-11-12 中电科华云信息技术有限公司 Big data-based metadata model management system and method
CN108595588A (en) * 2018-04-19 2018-09-28 中国科学院电子学研究所苏州研究院 A kind of science data storage correlating method
CN108920716A (en) * 2018-07-27 2018-11-30 中国电子科技集团公司第二十八研究所 The data retrieval and visualization system and method for knowledge based map

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李亚东: "《基于本体模型的科技信息知识库管理系统研究与实现》", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110287223A (en) * 2019-06-24 2019-09-27 北京明略软件系统有限公司 Information storage means and device, electronic device and storage medium
CN110516130A (en) * 2019-08-28 2019-11-29 北京明略软件系统有限公司 Metadata processing method and device, storage medium, electronic device
CN110851663A (en) * 2019-11-05 2020-02-28 北京明略软件系统有限公司 Method and apparatus for managing metadata
CN117312331A (en) * 2023-12-01 2023-12-29 浪潮云信息技术股份公司 Metadata blood-edge analysis method, device, equipment and storage medium
CN117312331B (en) * 2023-12-01 2024-03-29 浪潮云信息技术股份公司 Metadata blood-edge analysis method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN109857822A (en) Meta-model conversion method and management system based on chart database
US7418438B2 (en) Automated default dimension selection within a multidimensional enterprise software system
US7505888B2 (en) Reporting model generation within a multidimensional enterprise software system
US7593955B2 (en) Generation of aggregatable dimension information within a multidimensional enterprise software system
CN105183917A (en) Multi-dimensional analysis method for multi-level storage data
CN106933833B (en) Method for quickly querying position information based on spatial index technology
CN106547809A (en) Complex relation is represented in chart database
CN109902117B (en) Business system analysis method and device
US9753960B1 (en) System, method, and computer program for dynamically generating a visual representation of a subset of a graph for display, based on search criteria
CN106611053B (en) Data cleaning and indexing method
US9201700B2 (en) Provisioning computer resources on a network
CN102917009B (en) A kind of stock certificate data collection based on cloud computing technology and storage means and system
CN111506621B (en) Data statistical method and device
CN103617175A (en) Method for virtualization of large-scale distributed heterogeneous data
CN104794221A (en) Multi-dimensional data analyzing system based on service objects
CN104391908B (en) Multiple key indexing means based on local sensitivity Hash on a kind of figure
CN106547646B (en) Data backup and recovery method and data backup and recovery device
CN103177103A (en) Three-dimensional geographical information system management platform
CN103823846A (en) Method for storing and querying big data on basis of graph theories
CN107741982A (en) A kind of coordinate and administrative region matching system and method
CN103856462A (en) Method and system for managing sessions
CN114218291A (en) Portrait generation method, apparatus, device and storage medium based on target object
CN110134511A (en) A kind of shared storage optimization method of OpenTSDB
CN101916260A (en) Method for establishing semantic mapping between disaster body and relational database
CN110209749A (en) A kind of geographical information query method and device based on HBase

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190607

RJ01 Rejection of invention patent application after publication