CN101799826B - Networking data sharing system and method based on virtual view - Google Patents

Networking data sharing system and method based on virtual view Download PDF

Info

Publication number
CN101799826B
CN101799826B CN2010101186156A CN201010118615A CN101799826B CN 101799826 B CN101799826 B CN 101799826B CN 2010101186156 A CN2010101186156 A CN 2010101186156A CN 201010118615 A CN201010118615 A CN 201010118615A CN 101799826 B CN101799826 B CN 101799826B
Authority
CN
China
Prior art keywords
data
data source
metadata
query
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2010101186156A
Other languages
Chinese (zh)
Other versions
CN101799826A (en
Inventor
宗士强
吴姗姗
林剑柠
朱双华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CETC 28 Research Institute
Original Assignee
CETC 28 Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CETC 28 Research Institute filed Critical CETC 28 Research Institute
Priority to CN2010101186156A priority Critical patent/CN101799826B/en
Publication of CN101799826A publication Critical patent/CN101799826A/en
Application granted granted Critical
Publication of CN101799826B publication Critical patent/CN101799826B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a networking data sharing system and a method based on a virtual view, a description part of a data source is used to describe the data source; an editing part of the virtual view is used to edit the virtual view; a registering part of metadata is used to register the metadata of the data source and/or the metadata of the virtual view; a metadata directory service is used to receive, list, store and query the data source and/or the metadata of the virtual view; a data sharing query service is used to receive a query request of an external application, a final result is generated after steps such as query request analysis, query decomposition, data obtaining, result generating and the like and is returned to the external application by an XML file type. Data sharing query cross multiple data sources is supported by the invention, customizing virtual view according to data requirement is supported, data source expansion is conveniently supported, thereby being helpful to increase the usage ratio of the existing data resource and providing a real feasibility for the reorganization and recycle of the data resource.

Description

A kind of networking data sharing system and method based on virtual view
Technical field
The present invention relates to a kind of data sharing field, particularly relate to a kind of in networked environment between heterogeneous data source based on the networking data sharing system and the method for virtual view.
Background technology
At present, along with the development of IT technology, every profession and trade, unit or mechanism, department inside have been realized the IT application of service gradually, have set up a large amount of infosystems, have also accumulated the more and more data assets.Yet these data are at different time phases, produce at different demands, lack unified design between these data, the platform of being stored is also had nothing in common with each other, formed a large amount of distributed isomeric datas source, these isolated heterogeneous data sources are also referred to as " information island ".These data assets be difficult to be shared, and for the method for the shared routine of carrying out data resource is to set up data center, and set up the center shared data bank at the center, have preserved in the shared data bank of center from each data source and have extracted the data that the needs of coming are externally shared.The center shared library is only carried out reading of data generally speaking, and each data source end that is modified in of data carries out, and the center shared data bank relies on the data of data sync and data source to be consistent.There are shortcomings such as the software and hardware maintenance cost is quite high, the pressure of data center is excessive, data sync is of a high price in this mode.
Commercial database also provides the partial function that carries out data sharing between heterogeneous data source, provide the isomery service can support to stride the data query of a plurality of data sources (heterogeneous database platform) as Oracle, but this need depend on specific commercial data base platform, and different commercial data base platforms differs greatly very difficult unified.
Summary of the invention
Goal of the invention: technical matters to be solved by this invention is at the deficiencies in the prior art, provide a kind of in LAN (Local Area Network) and/or wan environment, networking data sharing system and the method based on virtual view that a plurality of data sources are carried out data sharing striden in the support with open and dirigibility.
Technical scheme: the invention discloses a kind of networking data sharing system based on virtual view, comprise that data provide unit and data to use the unit, described data are included in the plurality of data source in LAN (Local Area Network) and/or the wan environment, also comprise a networking data sharing system service unit in the described system;
Described data provide in the unit, database access unit of the corresponding respectively connection of described each data source, data Source Description unit of the common connection of all data source addressed locations, the corresponding connection with the metadata registering unit of data source description unit;
Described data are used in the unit, comprise metadata registering unit and the virtual view edit cell that is connected with the metadata registering unit;
In the described networking data sharing system service unit, the metadata catalog service unit and the data sharing query service unit that comprise metadatabase and be connected with metadatabase respectively.
Described data source description unit provides the data source metadata description, is used for that the data source metadata extracts, the data source metadata represents and the data source metadata is safeguarded;
Described data source addressed location is used for metadata query, data query; The data source addressed location is converted to the local search of data source according to the type of data source with general inquiry or subquery, and the data access interface that calls respective data sources is carried out corresponding inquiry or subquery and generated corresponding results and turn back to data source description unit or networking data sharing system service unit;
Described metadata registration part is used for metadata loading, metadata verification, is that data source metadata and/or virtual view metadata are registered to described metadata catalog service unit with metadata;
Described virtual view edit segment provides the virtual view metadata description, is used for that the data source metadata loads, the data source metadata represents, virtual view customization, virtual view map edits;
Described metadata catalog service unit is used for metadata catalogue, metadata issue, metadata store and metadata retrieval inquiry;
Described data sharing query service unit is inner query requests bag with the data query request analysis of outside, carries out this query requests bag, and Query Result is returned to the external application that data are used the unit;
The data source description unit, the metadata registering unit runs on data that end is provided, and provides that the data source metadata description generates, the registration of data source metadata; Virtual view edit cell, metadata registering unit run on the data use side, realize the editor of virtual view, the registration of virtual view metadata; Metadata catalog service and data sharing query service operation are realized the retrieval and inquisition and the data sharing query processing of request of metadata in the networking data sharing system service unit, realize the shared inquiry of data; The data source addressed location runs on data the unit is provided, specific implementation data source metadata query and data source inquiry;
Described data source description unit has been preserved the metadata query scheme in different types of data source, can choose the extraction that the corresponding metadata query scheme carries out the data source metadata according to the type of data source;
The virtual view of a plurality of data sources is striden in the support of described virtual view edit cell, the function (student movement calculation in full, logical operation, character string function, mathematical function etc.) that the mapping expression formula of virtual view and conditional expression support are commonly used.
Among the present invention, described metadata registration part describes standard according to data source and/or virtual view is described the completeness check that standard is carried out respective meta-data;
Described data source is described the essential information that standard comprises data source, the access method of data source, the user of data source, the data entity of data source, the field of data entity; The essential information of described data source comprises that DSN, sign, affiliated classification and classification foundation, key word, descriptor and thesaurus, data source type, the data of data source provide client information, data source Description of content; The access method of described data source comprises data source method of attachment, data access service address, port, parameter, access method general introduction; The data entity information of described data source comprises title, the owner, Chinese, the entity Description of content of entity; The field information of described data entity comprises type, length, precision, unit, default value, Chinese, the explaination of field implication of field;
Described virtual view is described the essential information that standard comprises virtual view, the field of virtual view, the mapping from the data source to the virtual view; The essential information of described virtual view comprises title, sign, affiliated classification and classification foundation, key word, descriptor and thesaurus, virtual view type, the general introduction of virtual view data content of virtual view; The field of described virtual view comprises type, length, precision, unit, default value, Chinese, the explaination of field implication of field; Described mapping from the data source to the virtual view, the entity of the data source that comprise involved data source, relates to, the field of entity, data source entity field are to the mapping expression formula of virtual view field, the condition of contact expression formula between the data source entity.
Among the present invention, described data sharing query service unit comprises that query requests parsing, query decomposition, data are obtained, the result synthesizes;
Described query requests is resolved the query requests that receives is resolved, the generated query request package, inquire about described metadata catalog service, the data source of configuring request bag and/or the metadata of virtual view, judge the type of query requests bag, give respectively according to type that described data are obtained and/or described query decomposition; Described result is synthesized in described query requests parsing and/or data are obtained the external application that the Query Result bag that transmits returns to described data use unit;
Described query decomposition is to the pre-service that standardizes of virtual view query requests bag, the generated query tree, carry out query decomposition and optimization, obtain data source query requests bag and composition rule bag as a result, wherein the subquery request package is given described data and is obtained, and to give described result synthetic for the composition rule bag as a result;
Described data are obtained reception from described query requests is resolved and/or described query decomposition transmits data source query requests bag, visit information according to data source is given described data source addressed location by network with query requests, receive the Query Result generated query that transmits from described data source addressed location bag as a result simultaneously, give that described query requests is resolved or the result is synthetic;
The synthetic bag of composition rule as a result that transmits by described query decomposition that receives of described result, the Query Result bag that transmits is obtained in reception by described data, carry out the synthetic of net result by Compositing Engine as a result according to composition rule as a result, generate final Query Result bag, return to described request analysis.
Among the present invention, the conversion mapping scheme that it is the data source local search that described data source access portion comprises inner conventional data query conversion, and externally provide the uniform data source access interface, the metadata in data query source and data turn back to data source description unit or networking data sharing system service unit with Query Result.
Among the present invention, described data source description unit and metadata registering unit are with XML file layout transmission data.
Among the present invention, described virtual view edit cell and metadata registering unit are with XML file layout transmission data.
The invention also discloses a kind of networked data sharing method based on virtual view, this method comprises the following steps:
Utilize data source to describe part and carry out the extraction of data source metadata, represent, the line data source metadata of going forward side by side is safeguarded; Add the essential information of data source; Add the access method information of data source; Information in supplementary data source entity and the field metadata; Generate data source descriptive metadata file;
Utilize the virtual view edit segment to create virtual view, configuration essential information, the field information of customizing virtual view; The map information of definition from data source data to the virtual view data generates virtual view descriptive metadata file;
Utilize metadata registering unit loading data source metadata and/or virtual view metadata, describe standard and/or virtual view according to data source and describe standard and carry out the metadata integrity verification, and submit to the metadata catalog service by network;
Utilize the metadata catalog service to receive metadata, make a catalogue, be published to metadata catalog, and be saved in metadatabase according to classification in the metadata and subject information; Utilize metadata catalog service-seeking metadata;
Utilize the query requests of data sharing query service to resolve the data sharing query request that receives the applications submission, resolve the generated query request package; Giving data with data source query requests bag obtains; Give query decomposition with virtual view query requests bag and generate data source query requests bag and Query Result composition rule bag; Information according to data source is obtained by network call data source addressed location execution data source request package by data, generated query is bag as a result, directly returns to query requests according to request type and resolves or transfer to the synthetic synthetic back of net result of carrying out of result and resolve giving query requests; Query requests is resolved net result is returned to the applications that data are used the unit;
Utilizing the data source addressed location to receive the data query request of being transmitted by the data sharing query service, is local search according to the data source difference with query conversion, carries out this local search and the result is turned back to the data sharing query service; Receiving the metadata query request that the data source description unit transmits, is local search according to the data source difference with query conversion, carries out this local search and the result is turned back to the data source description unit.
Beneficial effect: the present invention compared with prior art has the following advantages:
1. support to stride the data sharing query of data source.A data sharing query can be obtained data and be integrated into a complete results from a plurality of data sources simultaneously and return.
2. virtual support view customization.The user is according to shared query demand, customizing virtual view.The virtual view that is customized can also be shared with other user.
3. support the data source expansion.Add fashionablely as new data source, only its data source need be described and register, provide data source access portion of end administration to get final product in data simultaneously to networking data sharing system.
4. support observability, the property found of data.The user by the metadata (description of data source or the description of virtual view) to the registered data of data directory service-seeking, and can get access to corresponding data according to the demand data of concrete application by the data sharing query service.
5. support the intelligibility of data.In data source description and virtual view description, comprised semantic information and content information, helped the understanding of user data.
6. support the replacement of data source.But, it can be replaced with the data source that identical data is provided when certain data source time spent (as the machine etc. that rolls off the production line, delays) no longer.
7. help to improve the utilization factor of available data resource.Except 4,5 described characteristics help to provide the utilization factor of data resource, in addition, the available data resource can also be made up (setting up virtual view) and generate the data that satisfy its demand, thereby improve the utilization factor of data resource.
Description of drawings
Below in conjunction with the drawings and specific embodiments the present invention is done further to specify, above-mentioned and/or otherwise advantage of the present invention will become apparent.
Fig. 1 is the The general frame that the present invention is based on the networking data sharing system of virtual view.
Fig. 2 describes product process figure for data source of the present invention.
Fig. 3 is virtual view definition process flow diagram of the present invention.
Fig. 4 is metadata register flow path figure of the present invention.
Fig. 5 is a data sharing query service synoptic diagram of the present invention.
Fig. 6 is a query decomposition part synoptic diagram of the present invention.
Embodiment:
Among Fig. 1, the present invention is based on the The general frame of the networking data sharing system of virtual view, in Fig. 1, the present invention includes data source description unit 1, virtual view edit cell 2, metadata registering unit 3, metadata catalog service 4, data sharing query service 5, metadatabase 6, data source addressed location 7.
Data source description unit 1 provides the descriptive metadata of the data source in the networking data sharing system, realize that the data source metadata extracts, realizes disposition data source essential information, the access method of data source, the data entity information of data source, the field information of data entity, realizes data source metadata graphic exhibition; Virtual view edit cell 2 provides the descriptive metadata of the virtual view in the networking data sharing system, realizes that the data source metadata represents, the essential information of configuration virtual view, the field of customizing virtual view, the mapping of appointment from the data source to the virtual view; Metadata registering unit 3 realizes that metadata (data source metadata and/or virtual view metadata) loads, and the metadata integrity verification realizes the transmission of metadata to metadata catalog service 4; Metadata catalog service 4 realizes metadata catalogue, metadata issue, metadata store and metadata retrieval inquiry, described metadata retrieval inquiry realizes inquiry modes such as keyword query, condition query, query composition, supports to download according to the metadata of authority; Data sharing query service 5 provides the interface that uses the unit applications with data, the data query request analysis of applications is converted to the query requests bag that networking data sharing system is discerned, difference according to query type is handled respectively, and the function that final Query Result is returned to data use side applications is provided; Metadatabase 6 provides information such as data resource commonly used classification and theme, has realized the storage of metadata; Data source addressed location 7 has been preserved the mapping scheme of general polling to the data source local search, has realized the mapping conversion of general polling to local search, has realized uniform data source metadata access interface and data access interface.
Realize the transmission of metadata between data source addressed location 1, virtual view edit cell 2, the metadata registering unit 3 by meta data file (XML file); Network communication protocol by standard between data sharing query service 5 and data source addressed location 7 and the applications carries out data transmission.
Fig. 2 has at length illustrated data source and has described the flow process that generates.
In step 21, the disposition data source visit information mainly comprises information such as data source method of attachment, data access service address, port, parameter; And be connected to the data source addressed location according to visit information;
In step 22, call data source addressed location extracted data source entity descriptor, mainly comprise title, the owner, Chinese, entity Description of content of entity etc.;
In step 23,, mainly comprise title, the owner, Chinese of entity etc. by data source access portion extracted data source entity descriptor;
In step 24,, mainly comprise major key, external key relation etc. by data source addressed location extracted data source constraint specification information;
In step 25, by the data source description unit with tree structure, forms mode, patterned way demonstrating data Source Description information;
In step 26, use data source to describe the metadata that part is edited entity and/or field, with the not externally metadata of the metadata of shared entity and/or field deletion, replenish the metadata (as entity Description of content, the explaination of field implication etc.) of improving entity and/or field;
In step 27, use data source to describe part and edit constraint specification information, exist on the logic of supplementarity but the constraint that does not physically have to set;
In step 28, use data source to describe part editing data source essential information, the DSN of disposition data source, sign, affiliated classification and classification foundation, key word, descriptor and thesaurus, data source type, data set provider information etc.;
In step 29, use the data source description unit that data source is described and save as the XML file.
Fig. 3 has at length illustrated the flow process of virtual view definition.
In step 31, the essential information of configuration virtual view mainly comprises title, sign, affiliated classification and classification foundation, key word, descriptor and thesaurus, virtual view type, Description of content of virtual view etc.;
In step 32, the field information of defining virtual view mainly comprises type, length, precision, unit, default value, Chinese, the explaination of field implication of field etc.;
In step 33, the metadata of the data source that need use from the metadata catalog service-seeking;
In step 34, the field mappings of definition from the data source to the virtual view, the expression formula of mapping expression formula for using operational symbol, constant, data source entity field and function etc. to form, involved data source entity field can be the field of a plurality of entities in individual data source, also can be the field of a plurality of entities of a plurality of data sources;
In step 35, condition of contact between the configuration-related data source entity, the expression formula of condition of contact expression formula for using operational symbol, constant, data source entity field and function etc. to form, involved data source entity field can be the field of a plurality of entities in individual data source, also can be the field of a plurality of entities of a plurality of data sources;
In step 36, the definition of virtual view is saved as the virtual view description document---the XML file.
Fig. 4 has at length illustrated the flow process of metadata registration.
In step 41, use metadata registering unit metadata about load file, described meta data file is data source description document and/or virtual view description document;
In step 42, use the metadata registering unit to carry out the metadata integrity verification according to the metadata description standard, described metadata specification is that data source is described standard and/or virtual view is described standard, if verification by enter step 44, otherwise enter step 43;
In step 43, the use data source describes the portion unit and/or the virtual view edit cell updates modification data source descriptive metadata and/or virtual view metadata, enters step 41 after edit-modify is finished once more;
In step 44, use the metadata registering unit to submit to the metadata catalog service by network;
In step 45, to use the metadata catalog service that metadata is carried out automated cataloging and handle, described list processing is meant according to information such as affiliated classification that is comprised in the metadata and thesaurus carries out the automatic generation of metadata catalog;
In step 46, the metadata catalog service is returned to the metadata registering unit by network and is succeeded in registration.
Fig. 5 has at length illustrated the block diagram of data sharing query service unit.
Query requests is resolved 51 and is realized that reception provides the end data sharing query request that applications transmits by data, this request analysis is converted to the query requests bag that networking data sharing system is discerned, to the relevant metadata of metadata catalog service 55 inquiries, disposition data source metadata and/or virtual view metadata, give query decomposition 52 respectively with the query requests bag and/or data obtain 53 according to the difference of query type, and provide reception to obtain 53 and/or the synthetic 54 Query Result bags that transmit of result by data, final Query Result is handed to applications;
Query decomposition 52 receives query requests and resolves the 51 query requests bags that transmit, carry out the query specification pre-service, the generated query tree carries out query decomposition and optimization, obtain data source query requests bag and composition rule bag as a result, hand to data respectively and obtain 53 and result synthetic 54;
Data are obtained 53 and are received data source query requests bag and/or the query requests parsing 51 query requests bags that transmit that transmitted by query decomposition 52, pass through network call data source addressed location 56 according to the data source visit information, receive Query Result, generated query is bag as a result, returns to result synthetic 54 and/or query requests and resolves 51;
Result synthetic 54 receives the bag of composition rule as a result and the data that are transmitted by query decomposition 52 and obtains the 53 data source Query Result bags that transmit, and calling as a result Compositing Engine, to carry out the result synthetic, generates final Query Result bag, gives query requests and resolve 51;
Metadata catalog service 55 receives by query requests resolves the 51 metadata query requests of transmitting, and carries out and the metadata query result is returned;
Data source addressed location 56 receives and obtains the 53 data source query requests that transmit by data, is local search according to the data source difference with query conversion, carries out this local search and the result is returned.
Fig. 6 has at length illustrated the flow process of query decomposition part.
In step 601, resolve reception query requests bag from query requests;
In step 602, carry out the query specification pre-service;
In step 603, the generated query tree;
In step 604, the traversal queries tree;
In step 605, judge whether that all leaf nodes that traveled through are positioned at same data source, if then enter step 604, otherwise enter step 606;
In step 606, the maximum subtree of success traversal is set as subquery;
In step 607, traversal subquery tree generates subquery;
In step 608, judge whether that all leaf nodes all traveled through, if enter step 609, otherwise enter step 604;
In step 609, with remaining query tree composition rule tree as a result of;
In step 610, traversing result composition rule tree generates composition rule as a result;
In step 611, give data with all subqueries and obtain, it is synthetic that composition rule is given the result as a result.
The present invention can be applicable to the data sharing field of networking, can effectively improve the data sharing ability, have characteristics such as exploitation is easy to use, dirigibility is strong, easy to maintenance, configuration mode makes up virtual view to allow the data consumer to pass through flexibly, difference between the shadow data source realizes the networked data sharing of distributed multi-data source, and the transparent shared ability of data is provided for application developer and final user, it has a extensive future, and can create considerable social benefit and economic benefit.
The invention provides a kind of based on the networking data sharing system of virtual view and the thinking and the method for method; the method and the approach of this technical scheme of specific implementation are a lot; the above only is a preferred implementation of the present invention; should be understood that; for those skilled in the art; under the prerequisite that does not break away from the principle of the invention, can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.The all available prior art of each ingredient not clear and definite in the present embodiment is realized.

Claims (7)

1. networking data sharing system based on virtual view, comprise that data provide unit and data to use the unit, described data are included in the plurality of data source in LAN (Local Area Network) and/or the wan environment, it is characterized in that, also comprise a networking data sharing system service unit in the described system;
Described data provide in the unit, data source addressed location of the corresponding respectively connection of each data source, data Source Description unit of the common connection of all data source addressed locations, the corresponding connection with the metadata registering unit of data source description unit;
Described data are used in the unit, comprise metadata registering unit and the virtual view edit cell that is connected with the metadata registering unit;
In the described networking data sharing system service unit, the metadata catalog service unit and the data sharing query service unit that comprise metadatabase and be connected with metadatabase respectively;
Described data source description unit provides the data source metadata description, is used for that the data source metadata extracts, the data source metadata represents and the data source metadata is safeguarded;
Described data source addressed location is used for metadata query, data query; The data source addressed location is converted to the local search of data source according to the type of data source with general inquiry or subquery, and the data access interface that calls respective data sources is carried out corresponding inquiry or subquery and generated corresponding results and turn back to data source description unit or networking data sharing system service unit;
Described metadata registering unit is used for metadata loading, metadata verification, is that data source metadata and/or virtual view metadata are registered to described metadata catalog service unit with metadata;
Described virtual view edit cell provides the virtual view metadata description, is used for that the data source metadata loads, the data source metadata represents, virtual view customization, virtual view map edits;
Described metadata catalog service unit is used for metadata catalogue, metadata issue, metadata store and metadata retrieval inquiry;
Described data sharing query service unit is inner query requests bag with the data query request analysis of outside, carries out this query requests bag, and Query Result is returned to the external application that data are used the unit.
2. a kind of networking data sharing system based on virtual view according to claim 1 is characterized in that described metadata registering unit describes standard according to data source and/or virtual view is described the completeness check that standard is carried out respective meta-data;
Described data source is described the essential information that standard comprises data source, the access method of data source, the user of data source, the data entity of data source, the field of data entity; The essential information of described data source comprises that DSN, sign, affiliated classification and classification foundation, key word, descriptor and thesaurus, data source type, the data of data source provide client information, data source Description of content; The access method of described data source comprises data source method of attachment, data access service address, port, parameter, access method general introduction; The data entity information of described data source comprises title, the owner, Chinese, the entity Description of content of entity; The field information of described data entity comprises type, length, precision, unit, default value, Chinese, the explaination of field implication of field;
Described virtual view is described the essential information that standard comprises virtual view, the field of virtual view, the mapping from the data source to the virtual view; The essential information of described virtual view comprises title, sign, affiliated classification and classification foundation, key word, descriptor and thesaurus, virtual view type, the general introduction of virtual view data content of virtual view; The field of described virtual view comprises type, length, precision, unit, default value, Chinese, the explaination of field implication of field; Described mapping from the data source to the virtual view, the entity of the data source that comprise involved data source, relates to, the field of entity, data source entity field are to the mapping expression formula of virtual view field, the condition of contact expression formula between the data source entity.
3. a kind of networking data sharing system based on virtual view according to claim 1 is characterized in that, described data sharing query service unit comprises query requests resolution unit, query decomposition unit, data capture unit, synthesis unit as a result;
Described query requests resolution unit is resolved the query requests that receives, the generated query request package, inquire about described metadata catalog service unit, the data source of configuring request bag and/or the metadata of virtual view, judge the type of query requests bag, give described data capture unit and/or described query decomposition unit respectively according to type; The Query Result bag that described query requests resolution unit transmits described synthesis unit as a result and/or data capture unit returns to the external application of described data use side;
Described query decomposition unit is to the pre-service that standardizes of virtual view query requests bag, the generated query tree, carry out query decomposition, obtain data source query requests bag and composition rule bag as a result, wherein the subquery request package is given described data capture unit, and the composition rule bag is given described synthesis unit as a result as a result;
Described data capture unit receives the data source query requests bag that transmits from described query requests resolution unit and/or described query decomposition unit, visit information according to data source is given described data source addressed location by network with query requests, receive the Query Result generated query that transmits from described data source addressed location bag as a result simultaneously, give described query requests resolution unit or synthesis unit as a result;
Described synthesis unit as a result receives the bag of composition rule as a result that is transmitted by described query decomposition unit, the Query Result bag that reception is transmitted by described data capture unit, carry out the synthetic of net result by synthesis unit as a result according to composition rule as a result, generate final Query Result bag, return to described request analysis unit.
4. a kind of networking data sharing system according to claim 1 based on virtual view, it is characterized in that, the conversion mapping scheme that it is the data source local search that described data source addressed location comprises inner conventional data query conversion, and externally provide the uniform data source access interface, the metadata in data query source and data turn back to data source description unit or networking data sharing system service unit with Query Result.
5. a kind of networking data sharing system based on virtual view according to claim 1 is characterized in that, described data source description unit and metadata registering unit are with XML file layout transmission data.
6. a kind of networking data sharing system based on virtual view according to claim 1 is characterized in that, described virtual view edit cell and metadata registering unit are with XML file layout transmission data.
7. the networked data sharing method based on virtual view is characterized in that, may further comprise the steps:
Utilize the data source description unit to carry out the data source metadata and extract, represent, the line data source metadata of going forward side by side is safeguarded; Add the essential information of data source; Add the access method information of data source; Information in supplementary data source entity and the field metadata; Generate data source descriptive metadata file;
Utilize the virtual view edit cell to create virtual view, configuration essential information, the field information of customizing virtual view; The map information of definition from data source data to the virtual view data generates virtual view descriptive metadata file;
Utilize metadata registering unit loading data source metadata and/or virtual view metadata, describe standard and/or virtual view according to data source and describe standard and carry out the metadata integrity verification, and submit to the metadata catalog service unit by network;
Utilize the metadata catalog service unit to receive metadata, make a catalogue, be published to metadata catalog, and be saved in metadatabase according to classification in the metadata and subject information; Utilize metadata catalog service unit query metadata;
Utilize the query requests resolution unit of data sharing query service unit to receive the data sharing query request that applications is submitted to, resolve the generated query request package; Give data capture unit with data source query requests bag; Give the query decomposition unit with virtual view query requests bag and generate data source query requests bag and Query Result composition rule bag; Information according to data source is carried out the data source request package by data capture unit by network call data source addressed location, generated query is bag as a result, directly returns to the request analysis unit or transfers to as a result synthesis unit and carry out net result and give the request analysis unit again after synthetic according to request type; The query requests resolution unit returns to the external application that data are used the unit with net result;
Utilizing the data source addressed location to receive the data query request of being transmitted by the data sharing query service unit, is local search according to the data source difference with query conversion, carries out this local search and the result is turned back to the data sharing query service unit; Receiving the metadata query request that the data source description unit transmits, is local search according to the data source difference with query conversion, carries out this local search and the result is turned back to the data source description unit.
CN2010101186156A 2010-03-04 2010-03-04 Networking data sharing system and method based on virtual view Expired - Fee Related CN101799826B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010101186156A CN101799826B (en) 2010-03-04 2010-03-04 Networking data sharing system and method based on virtual view

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010101186156A CN101799826B (en) 2010-03-04 2010-03-04 Networking data sharing system and method based on virtual view

Publications (2)

Publication Number Publication Date
CN101799826A CN101799826A (en) 2010-08-11
CN101799826B true CN101799826B (en) 2011-09-14

Family

ID=42595502

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010101186156A Expired - Fee Related CN101799826B (en) 2010-03-04 2010-03-04 Networking data sharing system and method based on virtual view

Country Status (1)

Country Link
CN (1) CN101799826B (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9977819B2 (en) * 2010-08-09 2018-05-22 Ianywhere Solutions, Inc. Sharing data on mobile devices
CN102479218A (en) * 2010-11-30 2012-05-30 深圳市金蝶友商电子商务服务有限公司 Method and server for express query based on API (Application Program Interface)
CN102521232B (en) * 2011-11-09 2014-05-07 Ut斯达康通讯有限公司 Distributed acquisition and processing system and method of internet metadata
US8938550B2 (en) * 2011-12-15 2015-01-20 Microsoft Corporation Autonomous network streaming
US8832296B2 (en) 2011-12-15 2014-09-09 Microsoft Corporation Fast application streaming using on-demand staging
CN104133889B (en) * 2014-07-30 2017-04-19 国云科技股份有限公司 Database virtualization microkernel data source registration and encapsulation method
CN107515866B (en) * 2016-06-15 2021-01-29 阿里巴巴集团控股有限公司 Data operation method, device and system
CN106383914B (en) * 2016-10-21 2020-03-17 广东亿迅科技有限公司 Method and system for realizing configuration of multiple data sources based on cloud call platform
CN107103025B (en) * 2017-01-05 2020-08-14 亚信科技(中国)有限公司 Data processing method and data processing platform
CN107463603B (en) * 2017-06-16 2021-01-12 中国科学院计算机网络信息中心 Scientific research project life cycle data management customized control method and system based on quantitative DMP
CN110442629B (en) * 2019-08-02 2022-11-25 珠海得分金融科技有限公司 Big data multi-center heterogeneous dynamic data conversion method
CN110674163A (en) * 2019-08-26 2020-01-10 天津浪淘科技股份有限公司 Heterogeneous data query system and method based on BS framework
CN110730201A (en) * 2019-08-27 2020-01-24 北京市农林科学院 Data sharing method and system based on metadata
CN110826096A (en) * 2019-10-29 2020-02-21 杭州趣链科技有限公司 Data source sharing method based on block chain
CN111538854B (en) * 2020-04-27 2023-08-08 北京百度网讯科技有限公司 Searching method and device
CN113190579B (en) * 2021-03-31 2023-01-24 深圳市鹰硕技术有限公司 Method, device and system for constructing and querying virtual data view and storage medium
CN116383238B (en) * 2023-06-06 2023-08-29 湖南红普创新科技发展有限公司 Data virtualization system, method, device, equipment and medium based on graph structure

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7146356B2 (en) * 2003-03-21 2006-12-05 International Business Machines Corporation Real-time aggregation of unstructured data into structured data for SQL processing by a relational database engine
CN100561475C (en) * 2006-10-19 2009-11-18 维豪信息技术有限公司 The integration method of heterogeneous different source different platform data and switching method
CN101576921A (en) * 2009-06-15 2009-11-11 用友软件股份有限公司 Data query system and data query engine device

Also Published As

Publication number Publication date
CN101799826A (en) 2010-08-11

Similar Documents

Publication Publication Date Title
CN101799826B (en) Networking data sharing system and method based on virtual view
Fonseca et al. Ontology-driven geographic information systems
Banerjee et al. Oracle8i-the XML enabled data management system
CN100573528C (en) Digital museum gridding and building method thereof
CN100458793C (en) Mapping conversion method between data access level Xml format data and relational data
TWI490716B (en) Method for developing multi-tenant application and data accessing method of multi-tenant application and system using the same
US6418448B1 (en) Method and apparatus for processing markup language specifications for data and metadata used inside multiple related internet documents to navigate, query and manipulate information from a plurality of object relational databases over the web
US7877682B2 (en) Modular distributed mobile data applications
RU2409847C2 (en) Mapping system model to database object
CN101493825B (en) GIS middleware collocation and management method
US20060282482A1 (en) Method and system for model-based replication of data
CN100501731C (en) System and method for delayed fetching of designated members of a user defined type
CN101344881A (en) Index generation method and device and search system for mass file type data
CN102402507B (en) Heterogeneous data integration system for service-oriented architecture (SOA) multi-message mechanism
WO2018036324A1 (en) Smart city information sharing method and device
WO2005057365A2 (en) System to automatically regenerate software code
CN102810114A (en) Personal computer resource management system based on body
CN105843867A (en) Metadata model-based search method and search device based on metadata model
Tsou An operational metadata framework for searching, indexing, and retrieving distributed geographic information services on the Internet
Zhao et al. Grid metadata catalog service-based OGC web registry service
KR100417569B1 (en) Search method of distributed/heterogeneous gis databases using metadata interchange standard
JP3671765B2 (en) Heterogeneous information source query conversion method and apparatus, and storage medium storing heterogeneous information source query conversion program
CN103809944A (en) Web database development component processing method based on JDBC
CN101419611A (en) Method for performing an operation on an XML database
JP3565117B2 (en) Access method for multiple different information sources, client device, and storage medium storing multiple different information source access program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20110914

Termination date: 20160304