CN105306529A - Data sharing system and method for multiple data sources - Google Patents
Data sharing system and method for multiple data sources Download PDFInfo
- Publication number
- CN105306529A CN105306529A CN201510589708.XA CN201510589708A CN105306529A CN 105306529 A CN105306529 A CN 105306529A CN 201510589708 A CN201510589708 A CN 201510589708A CN 105306529 A CN105306529 A CN 105306529A
- Authority
- CN
- China
- Prior art keywords
- data
- metadata
- services
- sharing
- shared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1073—Registration or de-registration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
Abstract
The invention relates to the field of data sharing technology, and particularly relates to a data sharing system and method for multiple data sources. The data sharing method provided by the invention comprises the steps that: a data source package module packages a plurality of dispersive data sources according to a united standard data model and submits the packaged data sources to a metadata management center; the metadata management center provides a management function of metadata information of a sharing data source to achieve centralized management on the metadata information of the sharing data source and the shared data thereof; a data service package module packages various operations of the shared data in a service manner according to the metadata information of the metadata management center, in order to provide data sharing ability; and a data service management center manages data services, comprising data service release, query, deletion and modification, etc. The data sharing system and method provided by the invention can meet the data sharing demand of the multiple data sources and can be applied to data management of the multiple data sources.
Description
Technical field
The present invention relates to data sharing technology field, particularly a kind of data-sharing systems towards multi-data source and method.
Background technology
Along with the development of the Internet and deepening continuously of informatization, the data grows that can be utilized is many, various data source is also on the increase, in order to realize the maximum value of data, the opening and shares of data is the certainty in epoch, but due to distributivity, isomerism, the problem such as autonomy and data format diversity of data source, for the associative combination of various data and utilization bring certain difficult problem.
Summary of the invention
One of technical problem that the present invention solves is to provide a kind of data-sharing systems towards multi-data source; Adopt the mode of data, services, realize data and share as required, the data sharing needs of multi-data source can be met.
Two of the technical problem that the present invention solves is to provide a kind of data sharing method towards multi-data source; Based on metadata technique, realize the unified management sharing data source and shared data, the data sharing needs of multi-data source can be met.
The technical scheme that the present invention one of solves the problems of the technologies described above is:
Described system is encapsulated and data, services administrative center four module compositions by data source encapsulation, metadata management center, data, services;
Described data source package module, utilize XML file, multiple data sources of dispersion are encapsulated according to unified normal data model, the information of encapsulation comprise logical relation between the basic link information of database, tables of data and the metadata information etc. of shared data, be submitted to metadata management center after encapsulation;
Described metadata management center, the management function of shared data source metadata information is provided, comprise Metadata registry, inquiry, deletion and amendment etc., keeper is by metadata management center registration metadata, metadata information data source being shared data is submitted to metadata management center, realizes the centralized management of the metadata information to shared data source and shared data thereof;
Described data, services encapsulation, data, services package module, according to the metadata information at metadata management center, adopts the mode of service, encapsulates, provide data sharing abilities to the various operations of shared data;
Described data, services administrative center, realize the management of data, services, comprise that data, services is issued, inquiry, to delete and amendment etc., not only can distributing data service by data, services administrative center, required data, services resource can also be found fast and accurately.
Described data source package module to tables of data level, needs the tables of data shared to encapsulate to part to the encapsulation granularity refinement of data source, realizes sharing as required.
Described data, services package module is supplied to the functional unit of application program accessing shared data source structure and semi-structured data, and through encapsulation, application programs is transparent, and application program need not be concerned about its implementation.
The present invention solve the problems of the technologies described above two technical scheme be:
Described method is according to following process step process:
The first step, keeper shares the metadata of data source by the registration of metadata management center;
Second step, when sharing the Metadata registry of data source, by data source package module, by basic for the database of shared data source link information, logical relation between shared tables of data and the metadata information of shared data encapsulate, and be submitted to metadata management center;
3rd step, data, services package module, according to the metadata information at metadata management center, encapsulates the various operations of shared data, provides data sharing abilities in the mode of serving;
4th step, keeper is by the distributing data service of data, services administrative center;
5th step, application program, by the SOA interfacing data service management center of standard, obtains data, services, completes sharing of data.
Described data, services refers to and is supplied to the structuring in application program accessing shared data source and the functional unit of semi-structured data, and data, services is through encapsulation, so application programs is transparent, application program need not be concerned about its implementation.
Adopt system and method for the present invention, there is following beneficial effect: (1) is applicable to the data sharing of multi-data source; (2) heterogeneous data source and isomorphism data source is applicable to; (3) adopt the mode of data, services, share as required; (4) metadata technique is adopted, unified management data source and shared data; (5) adopt encapsulation technology, transparent access is provided; (6) implementing structured and semi-structured data are shared.Data sharing method of the present invention and system, based on metadata technique, realize the unified management sharing data source and shared data; Adopt the mode of data, services, realize data and share as required, the data sharing needs of multi-data source can be met.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, the present invention is further described:
Fig. 1 is configuration diagram of the present invention.
Embodiment
As shown in Figure 1, system of the present invention is primarily of data source package module, metadata management center, data, services package module, data, services administrative center four module composition.
1, data source encapsulation: data source package module utilizes XML file, multiple data sources of dispersion are encapsulated according to unified normal data model, the information of encapsulation comprise logical relation between the basic link information of database, tables of data and the metadata information etc. of shared data, be submitted to metadata management center after encapsulation;
2, metadata management center: metadata management center provides the management function of shared data source metadata information, comprise Metadata registry, inquiry, deletion and amendment etc., keeper is by metadata management center registration metadata, metadata information data source being shared data is submitted to metadata management center, realizes the centralized management of the metadata information to shared data source and shared data thereof;
3, data, services encapsulation: data, services package module, according to the metadata information at metadata management center, adopts the mode of service, encapsulates, provide data sharing abilities to the various operations of shared data;
4, data, services administrative center: data, services administrative center realizes the management of data, services, comprise data, services issue, inquiry, deletion and amendment etc., not only can distributing data service by data, services administrative center, required data, services resource can also be found fast and accurately.
As shown in Figure 1, the detailed implementing procedure towards the data-sharing systems of multi-data source is:
The first step, keeper shares the metadata of data source by the registration of metadata management center;
Second step, when sharing the Metadata registry of data source, by data source package module, by basic for the database of shared data source link information, logical relation between shared tables of data and the metadata information of shared data encapsulate, and be submitted to metadata management center;
3rd step, data, services package module, according to the metadata information at metadata management center, encapsulates the various operations of shared data, provides data sharing abilities in the mode of serving;
4th step, keeper is by the distributing data service of data, services administrative center;
5th step, application program, by the SOA interfacing data service management center of standard, obtains data, services, completes sharing of data.
Described data source package module to tables of data level to the encapsulation granularity refinement of data source, needs the tables of data shared to encapsulate to part, achieves the object shared as required, instead of in order to share some data, whole Database vendors is gone out.
Described data, services refers to and is supplied to the structuring in application program accessing shared data source and the functional unit of semi-structured data, and data, services is through encapsulation, so application programs is transparent, application program need not be concerned about its implementation.
Claims (6)
1. towards a data-sharing systems for multi-data source, it is characterized in that: described system is encapsulated and data, services administrative center four module compositions by data source encapsulation, metadata management center, data, services;
Described data source package module, utilize XML file, multiple data sources of dispersion are encapsulated according to unified normal data model, the information of encapsulation comprise logical relation between the basic link information of database, tables of data and the metadata information etc. of shared data, be submitted to metadata management center after encapsulation;
Described metadata management center, the management function of shared data source metadata information is provided, comprise Metadata registry, inquiry, deletion and amendment etc., keeper is by metadata management center registration metadata, metadata information data source being shared data is submitted to metadata management center, realizes the centralized management of the metadata information to shared data source and shared data thereof;
Described data, services encapsulation, data, services package module, according to the metadata information at metadata management center, adopts the mode of service, encapsulates, provide data sharing abilities to the various operations of shared data;
Described data, services administrative center, realize the management of data, services, comprise that data, services is issued, inquiry, to delete and amendment etc., not only can distributing data service by data, services administrative center, required data, services resource can also be found fast and accurately.
2. the data-sharing systems of multi-data source according to claim 1, is characterized in that: described data source package module to tables of data level, needs the tables of data shared to encapsulate to part to the encapsulation granularity refinement of data source, realizes sharing as required.
3. the data-sharing systems of multi-data source according to claim 1, it is characterized in that: described data, services package module is supplied to the functional unit of application program accessing shared data source structure and semi-structured data, and through encapsulation, application programs is transparent, and application program need not be concerned about its implementation.
4. the data-sharing systems of multi-data source according to claim 2, it is characterized in that: described data, services package module is supplied to the functional unit of application program accessing shared data source structure and semi-structured data, and through encapsulation, application programs is transparent, and application program need not be concerned about its implementation.
5. a data sharing method for system described in any one of Claims 1-4, is characterized in that: described method is according to following process step process:
The first step, keeper shares the metadata of data source by the registration of metadata management center;
Second step, when sharing the Metadata registry of data source, by data source package module, by basic for the database of shared data source link information, logical relation between shared tables of data and the metadata information of shared data encapsulate, and be submitted to metadata management center;
3rd step, data, services package module, according to the metadata information at metadata management center, encapsulates the various operations of shared data, provides data sharing abilities in the mode of serving;
4th step, keeper is by the distributing data service of data, services administrative center;
5th step, application program, by the SOA interfacing data service management center of standard, obtains data, services, completes sharing of data.
6. data sharing method according to claim 5, it is characterized in that: described data, services refers to and is supplied to the structuring in application program accessing shared data source and the functional unit of semi-structured data, data, services is through encapsulation, so application programs is transparent, application program need not be concerned about its implementation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510589708.XA CN105306529B (en) | 2015-09-16 | 2015-09-16 | A kind of data-sharing systems and method towards multi-data source |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510589708.XA CN105306529B (en) | 2015-09-16 | 2015-09-16 | A kind of data-sharing systems and method towards multi-data source |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105306529A true CN105306529A (en) | 2016-02-03 |
| CN105306529B CN105306529B (en) | 2019-03-05 |
Family
ID=55203272
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510589708.XA Active CN105306529B (en) | 2015-09-16 | 2015-09-16 | A kind of data-sharing systems and method towards multi-data source |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105306529B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105760515A (en) * | 2016-02-24 | 2016-07-13 | 国家电网公司 | Fusion method for same object data of multiple data sources |
| CN106227842A (en) * | 2016-07-27 | 2016-12-14 | 成都三零凯天通信实业有限公司 | A kind of allos isomeric data integration system for wisdom safe city and method |
| CN108876310A (en) * | 2018-07-11 | 2018-11-23 | 国云科技股份有限公司 | Obtain the data share exchange system and method charged on demand on demand for business datum |
| CN111176867A (en) * | 2020-01-16 | 2020-05-19 | 创意信息技术股份有限公司 | Data sharing exchange and open application platform |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050216522A1 (en) * | 2004-03-23 | 2005-09-29 | Integrated Data Corporation | Multi-tier document management system |
| CN102254022A (en) * | 2011-07-27 | 2011-11-23 | 河海大学 | Method for sharing metadata of information resources of various data types |
| CN104008135A (en) * | 2014-05-07 | 2014-08-27 | 南京邮电大学 | Multi-source heterogeneous database fusion system and data query method thereof |
-
2015
- 2015-09-16 CN CN201510589708.XA patent/CN105306529B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050216522A1 (en) * | 2004-03-23 | 2005-09-29 | Integrated Data Corporation | Multi-tier document management system |
| CN102254022A (en) * | 2011-07-27 | 2011-11-23 | 河海大学 | Method for sharing metadata of information resources of various data types |
| CN104008135A (en) * | 2014-05-07 | 2014-08-27 | 南京邮电大学 | Multi-source heterogeneous database fusion system and data query method thereof |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105760515A (en) * | 2016-02-24 | 2016-07-13 | 国家电网公司 | Fusion method for same object data of multiple data sources |
| CN106227842A (en) * | 2016-07-27 | 2016-12-14 | 成都三零凯天通信实业有限公司 | A kind of allos isomeric data integration system for wisdom safe city and method |
| CN108876310A (en) * | 2018-07-11 | 2018-11-23 | 国云科技股份有限公司 | Obtain the data share exchange system and method charged on demand on demand for business datum |
| CN111176867A (en) * | 2020-01-16 | 2020-05-19 | 创意信息技术股份有限公司 | Data sharing exchange and open application platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105306529B (en) | 2019-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105306529A (en) | Data sharing system and method for multiple data sources | |
| CN107979635A (en) | System, method and storage medium based on micro services | |
| EP2891993A1 (en) | Method for virtualizing large-scale distributed heterogeneous data | |
| US20130191523A1 (en) | Real-time analytics for large data sets | |
| US20140324876A1 (en) | Management of a database system | |
| CN103870274A (en) | Visual development assembly for realizing data interaction between heterogeneous systems based on web service technology | |
| CN103268230B (en) | Can the method for cloud computing information management platform of extended theorem for building | |
| CN105405070A (en) | Distributed memory power grid system construction method | |
| CN105894159A (en) | Implementation method of cross-domain and cross-platform user unified management system | |
| CN104144215A (en) | Method for building Internet-of-Things ubiquitous device resource model | |
| CN104750810A (en) | Data querying and processing method based on configuration | |
| CN103763174A (en) | Virtual network mapping method based on function block | |
| CN106210124A (en) | A kind of unified cloud data center monitoring system | |
| WO2024001028A1 (en) | Method and apparatus for maintaining blockchain data, and electronic device and storage medium | |
| CN109189800A (en) | A kind of data Layer paging query model and querying method | |
| Wu | Advances on virtualization technology of cloud computing | |
| CN109951370B (en) | Hierarchical interconnection method and device for big data centers | |
| CN103092982A (en) | Information service system based on multiple-view business model | |
| CN113190528A (en) | Parallel distributed big data architecture construction method and system | |
| CN103268231A (en) | Realizing system and method of assembly interface of electric power information system | |
| CN105786946A (en) | Virtualized data integration and query system and implementation method thereof | |
| CN102970354A (en) | Construction method of cloud computing system based on super resource integration | |
| CN115237924A (en) | Data processing method, system, device, medium, and program product | |
| CN104572859B (en) | A kind of distributed complex event handling system | |
| CN107273047A (en) | A kind of buffer memory management method, cache manager and storage management software |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 523808 19th Floor, Cloud Computing Center, Chinese Academy of Sciences, No. 1 Kehui Road, Songshan Lake Hi-tech Industrial Development Zone, Dongguan City, Guangdong Province Applicant after: G-Cloud Technology Co., Ltd. Address before: 523808 No. 14 Building, Songke Garden, Songshan Lake Science and Technology Industrial Park, Dongguan City, Guangdong Province Applicant before: G-Cloud Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |