CN108134764B - Distributed data sharing and exchanging method and system - Google Patents
Distributed data sharing and exchanging method and system Download PDFInfo
- Publication number
- CN108134764B CN108134764B CN201611093867.1A CN201611093867A CN108134764B CN 108134764 B CN108134764 B CN 108134764B CN 201611093867 A CN201611093867 A CN 201611093867A CN 108134764 B CN108134764 B CN 108134764B
- Authority
- CN
- China
- Prior art keywords
- data
- exchange
- requester
- provider
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000007726 management method Methods 0.000 claims description 71
- 238000012544 monitoring process Methods 0.000 claims description 19
- 238000012360 testing method Methods 0.000 claims description 14
- 238000012550 audit Methods 0.000 claims description 8
- 238000012790 confirmation Methods 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 8
- 230000004044 response Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 abstract description 2
- 230000000007 visual effect Effects 0.000 abstract description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/10—Network architectures or network communication protocols for network security for controlling access to devices or network resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- Economics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention provides a distributed data sharing and exchanging method and a system, wherein the method comprises the following steps: the data provider registers the data catalog of the shared data and the description information of the data service to the data exchange management center; a data requester initiates a data service access authority application; the data requester approves the data service access authority application; a data requester submits a data service application; and the system establishes a data exchange channel between the data provider and the data user by using the data exchange gateway according to the data service application, thereby realizing data sharing exchange. The invention realizes the data sharing exchange between the distributed heterogeneous service application systems; the data exchange process is more visual, so that each department can more conveniently and comprehensively know the data exchange operation condition; the method has high expandability, flexibility and safety, and reduces the difficulty and cost of sharing data of subsequent business application systems.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a distributed data sharing and exchanging method and system.
Background
With the rapid development of electronic government affairs, various government departments such as public security, traffic, civil affairs, sanitation, education, tax, grain, tourism face the business requirements of respective fields, various electronic government affair business application systems are built, and huge government data resources are gradually accumulated. The data resources are widely stored in different units, different departments, different systems and even different network environments of various regions, different levels of government institutions and the like, the data are various in types, high in quality, high in potential value and low in utilization rate. Due to the dispersed management of the service application systems, the adopted technical systems are not uniform, the software and hardware standards are not consistent, and the compatibility of data interfaces is poor, so that the problems of data resource islanding and private sealing are serious, most government data resources cannot be fused and shared, and the serious challenge is brought to the efficient and accurate government control. The national thirteen-five planning outline proposes to implement a national big data strategy, definitely indicates that the government data open sharing is accelerated, and accelerates the promotion of the cross-department data resource sharing and sharing by depending on a government data uniform sharing and exchanging platform; the construction of a national government data unified open platform is accelerated, and the interconnection, open sharing of a government information system and public data is promoted.
How to promote interconnection and intercommunication and transverse integration among distributed heterogeneous service application systems under the condition of respecting the responsibility management pattern of the existing government department, and realize open sharing and fusion treatment of data across regions, fields, departments and systems is a difficult problem to be broken through urgently. The traditional middleware technology platform is mainly a special data exchange platform facing to specific exchange requirements, lacks flexibility and expansibility, is difficult to multiplex and maintain functions, has insufficient safety access control capability, and is difficult to meet the business and technical management requirements of various departments. The data resource servization supports data interconnection and intercommunication based on a data service platform between distributed heterogeneous business application systems by packaging data resource access capacity into a standard service interface, is a key and development trend for realizing open sharing of government data, and can effectively improve the utilization efficiency of government data resources.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a distributed data sharing and exchanging method and system, which overcome the defect that data cannot be shared and used between the existing heterogeneous service application systems.
The technical scheme adopted by the invention is that the distributed data sharing and exchanging method comprises the following steps:
step one, a data provider classifies metadata of shared data according to preset data to generate a data directory, and registers the data directory to a data exchange management center; the data exchange management center checks the data directory and stores the data directory passing the check into a central directory library; the data provider sets the access authority of the registered data directory, and the data exchange management center issues the registered data directory to the data requester conforming to the access authority;
step two, the data provider sends the shared data service corresponding to the data directory to a data exchange management center; the data exchange management center stores the shared data service into a central data service library; the data provider sets the access authority of the registered data service;
step three, the data provider deploys a data provider data exchange gateway at a network node of the data provider service application system; a data requester deploys a data requester data exchange gateway at a network node of a data requester service application system;
step four, the data request party searches the data directory of the data to be exchanged in the central directory library according to the access authority of the registered data directory; when a data request party retrieves a data directory of data to be exchanged, the data request party inquires a data service corresponding to the data directory of the data to be exchanged; when a data requester queries a data service corresponding to a data directory of data to be exchanged, the data requester sends an access authority application of the data service corresponding to the data directory of the data to be exchanged to a data exchange management center; the data provider approves the access authority application according to the access authority of the registered data service set by the data provider; if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged;
step five, when the data request party obtains the access right of the data service corresponding to the data directory of the data to be exchanged, the data request party sends a data exchange application of the data service corresponding to the data directory of the data to be exchanged to the data exchange management center; the data exchange management center receives the data exchange application sent by the data request party, generates a data order and stores the data order into a data order library;
step six, when the data order is generated, the data exchange management center respectively sends exchange channel establishment instructions to the data exchange gateway of the data provider and the data exchange gateway of the data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, the data exchange management center establishes a data exchange channel between the data provider and the data requester and generates data exchange channel information;
step seven, the data provider data exchange gateway sends a data service calling request to the data provider service application system according to the data exchange channel information, acquires the data to be exchanged, and then sends the data to be exchanged to the data requester data exchange gateway; and the data exchange gateway of the data requester sends the required exchange data to the service application system of the data requester according to the data exchange channel information.
Further, the method further comprises:
step eight, the data exchange management center monitors the operation state of the data exchange gateway of the data provider, the operation state of the data exchange gateway of the data requester and the operation state of the data exchange channel, and counts the data exchange amount;
the operating states include: run, stop, and fail.
Further, the metadata of the shared data resource includes: data resource name, data resource classification, data resource type, belonging system, belonging department, data security level and data attribute list.
Further, the shared data service includes: data service name, version number, keyword, service description and service interface;
the service interface includes: interface name, interface address, support format, request mode, request parameter list and return value;
the return value is shared data provided by the service interface;
the number of the service interfaces is one or more.
Further, the third step further includes: a data provider sets the name of the data provider data exchange gateway, the network address of the data provider data exchange gateway and the port number of the data provider data exchange gateway; performing connectivity test on the data exchange gateway of the data provider;
the data requester sets the name of the data exchange gateway of the data requester, the network address of the data exchange gateway of the data requester and the port number of the data exchange gateway of the data requester; and performing connectivity test on the data exchange gateway of the data requester.
Further, the data directory corresponds to one or more data services.
Further, the data exchange channel information includes: the data order form comprises a data order form identifier, a data resource name, a data service interface name, a request parameter list, a data provider gateway, a data consumer gateway and a data receiving service address.
The invention also provides a distributed data sharing and exchanging system, comprising:
the system comprises a data directory management subsystem, a data service management subsystem, a data exchange gateway subsystem, a data exchange management subsystem, a data access control subsystem, a data exchange monitoring subsystem and a user management subsystem;
the data exchange gateway subsystem and the data exchange management subsystem are communicated in a network web service mode through a network;
the data exchange management subsystem is respectively communicated with the data directory management subsystem, the data service management subsystem, the data access control subsystem and the data exchange monitoring subsystem through web service interfaces;
the user management subsystem is respectively communicated with the data exchange management subsystem, the data directory management subsystem, the data service management subsystem, the data access control subsystem and the data exchange monitoring subsystem through a web service interface;
the data catalog management subsystem is used for registering and checking the metadata of the shared data and generating a data catalog according to the metadata of the shared data provided by the data provider by preset data classification; carrying out retrieval query on metadata of the shared data;
the data service management subsystem is used for registering, retrieving and inquiring metadata of data service corresponding to the shared data; setting an association relation between a data service corresponding to the shared data and the shared data;
the data exchange gateway subsystem is used for deploying a data provider data exchange gateway at a network node of a data provider service application system, setting the name of the data provider data exchange gateway, the network address of the data provider data exchange gateway and the port number of the data provider data exchange gateway, and carrying out connectivity test on the data provider data exchange gateway; providing a data access end agent for a data provider, and performing data interaction with the data provider; deploying a data requester data exchange gateway at a network node of a data requester service application system, setting the name of the data requester data exchange gateway, the network address of the data requester data exchange gateway and the port number of the data requester data exchange gateway, and performing connectivity test on the data requester data exchange gateway; providing a data transmitting end agent for a data request party, and performing data interaction with the data request party; establishing a data exchange channel between a data exchange gateway of a data provider and a data exchange gateway of a data requester, and sending data to be exchanged to the data requester from the data provider;
the data access control subsystem is used for setting and judging the access authority of the data directory and issuing the registered data directory to a data requester conforming to the access authority; setting and judging the access authority of the data service corresponding to the data directory, and issuing the data service corresponding to the data directory to a data requester meeting the access authority; performing security audit on the authority setting of the data directory, and performing audit on the authority setting of the data service corresponding to the data directory;
the data exchange management subsystem is used for receiving an access authority application of a data service corresponding to a data directory of data to be exchanged, which is sent by a data requester; when receiving the access authority application, sending the access authority application to a data access control subsystem for authority judgment; according to the access authority of the registered data service set by the data provider, the access authority application is examined and approved; if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged; when a data request party obtains the access right of the data service corresponding to the data directory of the data to be exchanged, obtaining a data exchange application of the data service corresponding to the data directory of the data to be exchanged by the data request party, and generating a data order; when the data order is generated, respectively sending an exchange channel establishment instruction to a data exchange gateway of a data provider and a data exchange gateway of a data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, establishing a data exchange channel between the data provider and the data requester and generating the information of the data exchange channel;
the data exchange monitoring subsystem is used for monitoring the operating state of the data exchange gateway of the data provider, the operating state of the data exchange gateway of the data requester, the fault of data exchange and the operating state of the data exchange channel and counting the exchange amount of data to be exchanged;
and the user management subsystem is used for managing the registration information of the data provider and the data requester and authenticating the login requests of the data provider and the data requester.
Further, the data directory management subsystem is further configured to modify or delete metadata of the shared data.
Further, the data service management subsystem is further configured to modify or delete metadata information of a data service corresponding to the shared data.
By adopting the technical scheme, the invention at least has the following advantages:
the distributed data sharing and exchanging method and the system can release the data access capability of the heterogeneous service application system as a standard data service interface, provide end-to-end data exchange support capability and realize the distributed data sharing and exchanging of cross-region, cross-field, cross-department and cross-system; the data exchange process is more visual, so that each department can more conveniently and comprehensively know the data exchange operation condition; the method has high expandability, flexibility and safety, and reduces the difficulty and cost of sharing data of subsequent business application systems.
Drawings
Fig. 1 is a schematic structural diagram of a distributed data sharing switching system according to a third embodiment of the present invention.
Detailed Description
To further explain the technical means and effects of the present invention adopted to achieve the intended purpose, the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments.
A first embodiment of the present invention provides a distributed data sharing and exchanging method, including the following specific steps:
step S101, a data provider classifies metadata of shared data according to preset data to generate a data directory, and registers the data directory to a data exchange management center; the data exchange management center checks the data directory and stores the data directory passing the check into a central directory library; the data provider sets the access authority of the registered data directory, and the data exchange management center issues the registered data directory to the data requester conforming to the access authority.
Wherein, the metadata of the shared data resource includes but is not limited to: data resource name, data resource classification, data resource type, belonging system, belonging department, data security level, data attribute list and the like.
Step S102, a data provider sends a shared data service corresponding to a data directory to a data exchange management center; the data exchange management center stores the shared data service into a central data service library; the data provider sets access rights for the registered data service.
Shared data services include, but are not limited to: data service name, version number, keyword, service description, service interface and the like;
the service interface includes: interface name, interface address, support format, request mode, request parameter list and return value;
returning the shared data provided by the service interface;
the number of service interfaces is one or more.
Data directory corresponding to one or more data services
Step S103, a data provider deploys a data provider data exchange gateway at a network node of a data provider service application system; and the data requester deploys a data requester data exchange gateway at a network node of the data requester service application system.
Step S104, the data request party retrieves the data directory of the data to be exchanged in the central directory library according to the access authority of the registered data directory; when a data request party retrieves a data directory of data to be exchanged, the data request party inquires a data service corresponding to the data directory of the data to be exchanged; when a data requester queries a data service corresponding to a data directory of data to be exchanged, the data requester sends an access authority application of the data service corresponding to the data directory of the data to be exchanged to a data exchange management center; the data provider approves the access authority application according to the access authority of the registered data service set by the data provider; and if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged.
Step S105, when the data request party obtains the access right of the data service corresponding to the data catalog of the data to be exchanged, the data request party sends a data exchange application of the data service corresponding to the data catalog of the data to be exchanged to a data exchange management center; and the data exchange management center receives the data exchange application sent by the data request party, generates a data order and stores the data order into a data order library.
Step S106, when the data order is generated, the data exchange management center respectively sends exchange channel establishment instructions to the data exchange gateway of the data provider and the data exchange gateway of the data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, the data exchange management center establishes a data exchange channel between the data provider and the data requester and generates data exchange channel information.
The data exchange channel information includes but is not limited to: the data order form comprises a data order form identifier, a data resource name, a data service interface name, a request parameter list, a data provider gateway, a data consumer gateway, a data receiving service address and the like.
Step S107, the data provider data exchange gateway sends a data service calling request to the data provider service application system according to the data exchange channel information, acquires the data to be exchanged, and then sends the data to be exchanged to the data requester data exchange gateway; and the data exchange gateway of the data requester sends the required exchange data to the service application system of the data requester according to the data exchange channel information.
A second embodiment of the present invention provides a distributed data sharing and exchanging method, including the following specific steps:
step S201, a data provider classifies metadata of shared data according to preset data to generate a data directory, and registers the data directory to a data exchange management center; the data exchange management center checks the data directory and stores the data directory passing the check into a central directory library; and the data provider sets the access authority of the registered data directory and issues the registered data directory to the data requester conforming to the access authority.
Wherein, the metadata of the shared data resource includes but is not limited to: data resource name, data resource classification, data resource type, belonging system, belonging department, data security level, data attribute list and the like.
Step S202, a data provider sends a shared data service corresponding to the data directory to a data exchange management center; the data exchange management center stores the shared data service into a central data service library; the data provider sets access rights for the registered data service.
Shared data services include, but are not limited to: data service name, version number, keyword, service description, service interface and the like;
the service interface includes: interface name, interface address, support format, request mode, request parameter list and return value;
returning the shared data provided by the service interface;
the number of service interfaces is one or more.
Data directory corresponding to one or more data services
Step S203, the data provider deploys a data provider data exchange gateway at a network node of the data provider service application system; a data requester deploys a data requester data exchange gateway at a network node of a data requester service application system;
the data provider sets the name of the data exchange gateway of the data provider, the network address of the data exchange gateway of the data provider and the port number of the data exchange gateway of the data provider; performing connectivity test on the data exchange gateway of the data provider;
the data requester sets the name of the data exchange gateway of the data requester, the network address of the data exchange gateway of the data requester and the port number of the data exchange gateway of the data requester; and performing connectivity test on the data exchange gateway of the data requester.
Step S204, the data request party retrieves the data directory of the data to be exchanged in the central directory library according to the access authority of the registered data directory; when a data request party retrieves a data directory of data to be exchanged, the data request party inquires a data service corresponding to the data directory of the data to be exchanged; when a data requester queries a data service corresponding to a data directory of data to be exchanged, the data requester sends an access authority application of the data service corresponding to the data directory of the data to be exchanged to a data exchange management center; the data provider approves the access authority application according to the access authority of the registered data service set by the data provider; and if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged.
Step S205, when the data request party obtains the access right of the data service corresponding to the data directory of the data to be exchanged, the data request party sends a data exchange application of the data service corresponding to the data directory of the data to be exchanged to the data exchange management center; and the data exchange management center receives the data exchange application sent by the data request party, generates a data order and stores the data order into a data order library.
Step S206, when the data order is generated, the data exchange management center respectively sends exchange channel establishment instructions to the data exchange gateway of the data provider and the data exchange gateway of the data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, the data exchange management center establishes a data exchange channel between the data provider and the data requester and generates data exchange channel information.
The data exchange channel information includes but is not limited to: the data order form comprises a data order form identifier, a data resource name, a data service interface name, a request parameter list, a data provider gateway, a data consumer gateway, a data receiving service address and the like.
Step S207, the data provider data exchange gateway sends a data service calling request to the data provider service application system according to the data exchange channel information, acquires the data to be exchanged, and then sends the data to be exchanged to the data requester data exchange gateway; and the data exchange gateway of the data requester sends the required exchange data to the service application system of the data requester according to the data exchange channel information.
Step S208, the data exchange management center monitors the operation state of the data exchange gateway of the data provider, the operation state of the data exchange gateway of the data requester and the operation state of the data exchange channel, and counts the data exchange amount;
wherein, the running state includes: run, stop, and fail.
A third embodiment of the present invention is a distributed data sharing and exchanging system, as shown in fig. 1, including the following components:
a data directory management subsystem 300, a data service management subsystem 400, a data exchange gateway subsystem 100, a data exchange management subsystem 200, a data access control subsystem 500, a data exchange monitoring subsystem 600 and a user management subsystem 700;
wherein, the data exchange gateway subsystem 100 and the data exchange management subsystem 200 communicate in the form of network web service through the network;
the data exchange management subsystem 200 communicates with the data directory management subsystem 300, the data service management subsystem 400, the data access control subsystem 500 and the data exchange monitoring subsystem 600 through web service interfaces respectively;
the user management subsystem 700 communicates with the data exchange management subsystem 200, the data directory management subsystem 300, the data service management subsystem 400, the data access control subsystem 500 and the data exchange monitoring subsystem 600 through web service interfaces, respectively;
the data catalog management subsystem 300 is used for registering and checking the metadata of the shared data, and generating a data catalog according to the metadata of the shared data provided by the data provider by preset data classification; carrying out retrieval query on metadata of the shared data;
the data service management subsystem 400 is used for registering, retrieving and querying metadata of a data service corresponding to the shared data; setting an association relation between a data service corresponding to the shared data and the shared data;
a data exchange gateway subsystem 100, configured to deploy a data provider data exchange gateway at a network node of a data provider service application system, set a name of the data provider data exchange gateway, a network address of the data provider data exchange gateway, and a port number of the data provider data exchange gateway, and perform connectivity test on the data provider data exchange gateway; providing a data access end agent for a data provider, and performing data interaction with the data provider; deploying a data requester data exchange gateway at a network node of a data requester service application system, setting the name of the data requester data exchange gateway, the network address of the data requester data exchange gateway and the port number of the data requester data exchange gateway, and performing connectivity test on the data requester data exchange gateway; providing a data transmitting end agent for a data request party, and performing data interaction with the data request party; establishing a data exchange channel between a data exchange gateway of a data provider and a data exchange gateway of a data requester, and sending data to be exchanged to the data requester from the data provider;
the data access control subsystem 500 is used for setting and judging the access authority of the data directory and issuing the registered data directory to a data requester meeting the access authority; setting and judging the access authority of the data service corresponding to the data directory, and issuing the data service corresponding to the data directory to a data requester meeting the access authority; performing security audit on the authority setting of the data directory, and performing audit on the authority setting of the data service corresponding to the data directory;
the data exchange management subsystem 200 is configured to receive an access right application of a data service corresponding to a data directory of data to be exchanged, where the data access right application is sent by a data requester; when receiving the access authority application, sending the access authority application to the data access control subsystem 500 for authority judgment; according to the access authority of the registered data service set by the data provider, the access authority application is examined and approved; if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged; when a data request party obtains the access right of the data service corresponding to the data directory of the data to be exchanged, obtaining a data exchange application of the data service corresponding to the data directory of the data to be exchanged by the data request party, and generating a data order; when a data order is generated, respectively sending an exchange channel establishment instruction to a data exchange gateway of a data provider and a data exchange gateway of a data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, establishing a data exchange channel between the data provider and the data requester and generating data exchange channel information;
a data exchange monitoring subsystem 600, configured to monitor an operating state of a data exchange gateway of a data provider, an operating state of a data exchange gateway of a data requester, a fault of data exchange, and an operating state of a data exchange channel, and count an exchange amount of data to be exchanged;
the user management subsystem 700 is configured to manage registration information of the data provider and the data requester, and authenticate login requests of the data provider and the data requester.
A fourth embodiment of the present invention provides a distributed data sharing and exchanging system, including the following components:
the system comprises a data directory management subsystem, a data service management subsystem, a data exchange gateway subsystem, a data exchange management subsystem, a data access control subsystem, a data exchange monitoring subsystem and a user management subsystem;
the data exchange gateway subsystem and the data exchange management subsystem are communicated in a network web service mode through a network;
the data exchange management subsystem is respectively communicated with the data directory management subsystem, the data service management subsystem, the data access control subsystem and the data exchange monitoring subsystem through web service interfaces;
the user management subsystem is respectively communicated with the data exchange management subsystem, the data directory management subsystem, the data service management subsystem, the data access control subsystem and the data exchange monitoring subsystem through a web service interface;
the data catalog management subsystem is used for registering and checking the metadata of the shared data and generating a data catalog according to the metadata of the shared data provided by the data provider by preset data classification; carrying out retrieval query on metadata of the shared data; modifying or deleting metadata of the shared data;
the data service management subsystem is used for registering, retrieving and inquiring metadata of data service corresponding to the shared data; setting an association relation between a data service corresponding to the shared data and the shared data; modifying or deleting metadata information of a data service corresponding to the shared data;
the data exchange gateway subsystem is used for deploying a data provider data exchange gateway at a network node of the data provider service application system, setting the name of the data provider data exchange gateway, the network address of the data provider data exchange gateway and the port number of the data provider data exchange gateway, and carrying out connectivity test on the data provider data exchange gateway; providing a data access end agent for a data provider, and performing data interaction with the data provider; deploying a data requester data exchange gateway at a network node of a data requester service application system, setting the name of the data requester data exchange gateway, the network address of the data requester data exchange gateway and the port number of the data requester data exchange gateway, and performing connectivity test on the data requester data exchange gateway; providing a data transmitting end agent for a data request party, and performing data interaction with the data request party; establishing a data exchange channel between a data exchange gateway of a data provider and a data exchange gateway of a data requester, and sending data to be exchanged to the data requester from the data provider;
the data access control subsystem is used for setting and judging the access authority of the data directory and issuing the registered data directory to a data requester meeting the access authority; setting and judging the access authority of the data service corresponding to the data directory, and issuing the data service corresponding to the data directory to a data requester meeting the access authority; performing security audit on the authority setting of the data directory, and performing audit on the authority setting of the data service corresponding to the data directory;
the data exchange management subsystem is used for receiving an access authority application of a data service corresponding to a data directory of data to be exchanged, which is sent by a data requester; when receiving an access authority application, sending the access authority application to a data access control subsystem for authority judgment; according to the access authority of the registered data service set by the data provider, the access authority application is examined and approved; if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged; when a data request party obtains the access right of the data service corresponding to the data directory of the data to be exchanged, obtaining a data exchange application of the data service corresponding to the data directory of the data to be exchanged by the data request party, and generating a data order; when a data order is generated, respectively sending an exchange channel establishment instruction to a data exchange gateway of a data provider and a data exchange gateway of a data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, establishing a data exchange channel between the data provider and the data requester and generating data exchange channel information;
the data exchange monitoring subsystem is used for monitoring the operating state of the data exchange gateway of the data provider, the operating state of the data exchange gateway of the data requester, the fault of data exchange and the operating state of the data exchange channel and counting the exchange amount of data to be exchanged;
and the user management subsystem is used for managing the registration information of the data provider and the data requester and authenticating the login requests of the data provider and the data requester.
While the invention has been described in connection with specific embodiments thereof, it is to be understood that it is intended by the appended drawings and description that the invention may be embodied in other specific forms without departing from the spirit or scope of the invention.
Claims (10)
1. A distributed data sharing exchange method, comprising:
step one, a data provider classifies metadata of shared data according to preset data to generate a data directory, and registers the data directory to a data exchange management center; the data exchange management center checks the data directory and stores the data directory passing the check into a central directory library; the data exchange management center issues the registered data catalog to a data requester conforming to the access authority;
step two, the data provider sends the shared data service corresponding to the data directory to a data exchange management center; the data exchange management center stores the shared data service into a central data service library; the data provider sets the access authority of the registered data service;
step three, the data provider deploys a data provider data exchange gateway at a network node of the data provider service application system; a data requester deploys a data requester data exchange gateway at a network node of a data requester service application system;
step four, the data request party searches the data directory of the data to be exchanged in the central directory library according to the access authority of the registered data directory; when a data request party retrieves a data directory of data to be exchanged, the data request party inquires a data service corresponding to the data directory of the data to be exchanged; when a data requester queries a data service corresponding to a data directory of data to be exchanged, the data requester sends an access authority application of the data service corresponding to the data directory of the data to be exchanged to a data exchange management center; the data provider approves the access authority application according to the access authority of the registered data service set by the data provider; if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged;
step five, when the data request party obtains the access right of the data service corresponding to the data directory of the data to be exchanged, the data request party sends a data exchange application of the data service corresponding to the data directory of the data to be exchanged to the data exchange management center; the data exchange management center receives the data exchange application sent by the data request party, generates a data order and stores the data order into a data order library;
step six, when the data order is generated, the data exchange management center respectively sends exchange channel establishment instructions to the data exchange gateway of the data provider and the data exchange gateway of the data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, the data exchange management center establishes a data exchange channel between the data provider and the data requester and generates data exchange channel information;
step seven, the data provider data exchange gateway sends a data service calling request to the data provider service application system according to the data exchange channel information, acquires the data to be exchanged, and then sends the data to be exchanged to the data requester data exchange gateway; and the data exchange gateway of the data requester sends the required exchange data to the service application system of the data requester according to the data exchange channel information.
2. The distributed data sharing exchange method according to claim 1, characterized in that said method further comprises:
step eight, the data exchange management center monitors the operation state of the data exchange gateway of the data provider, the operation state of the data exchange gateway of the data requester and the operation state of the data exchange channel, and counts the data exchange amount;
the operating states include: run, stop, and fail.
3. The distributed data sharing exchange method of claim 1, wherein the metadata of the shared data resource comprises: data resource name, data resource classification, data resource type, belonging system, belonging department, data security level and data attribute list.
4. The distributed data sharing exchange method according to claim 1, wherein the shared data service includes: data service name, version number, keyword, service description and service interface;
the service interface includes: interface name, interface address, support format, request mode, request parameter list and return value;
the return value is shared data provided by the service interface;
the number of the service interfaces is one or more.
5. The distributed data sharing exchange method according to claim 1, wherein the third step further comprises: a data provider sets the name of the data provider data exchange gateway, the network address of the data provider data exchange gateway and the port number of the data provider data exchange gateway; performing connectivity test on the data exchange gateway of the data provider;
the data requester sets the name of the data exchange gateway of the data requester, the network address of the data exchange gateway of the data requester and the port number of the data exchange gateway of the data requester; and performing connectivity test on the data exchange gateway of the data requester.
6. The distributed data sharing exchange method of claim 1, wherein the data directory corresponds to one or more data services.
7. The distributed data sharing exchange method according to claim 1, wherein the data exchange channel information includes: the data order form comprises a data order form identifier, a data resource name, a data service interface name, a request parameter list, a data provider gateway, a data consumer gateway and a data receiving service address.
8. A distributed data sharing switching system, comprising: the system comprises a data directory management subsystem, a data service management subsystem, a data exchange gateway subsystem, a data exchange management subsystem, a data access control subsystem, a data exchange monitoring subsystem and a user management subsystem;
the data exchange gateway subsystem and the data exchange management subsystem are communicated in a network web service mode through a network;
the data exchange management subsystem is respectively communicated with the data directory management subsystem, the data service management subsystem, the data access control subsystem and the data exchange monitoring subsystem through web service interfaces;
the user management subsystem is respectively communicated with the data exchange management subsystem, the data directory management subsystem, the data service management subsystem, the data access control subsystem and the data exchange monitoring subsystem through a web service interface;
the data catalog management subsystem is used for registering and checking the metadata of the shared data and generating a data catalog according to the metadata of the shared data provided by the data provider by preset data classification; carrying out retrieval query on metadata of the shared data;
the data service management subsystem is used for registering, retrieving and inquiring metadata of data service corresponding to the shared data; setting an association relation between a data service corresponding to the shared data and the shared data;
the data exchange gateway subsystem is used for deploying a data provider data exchange gateway at a network node of a data provider service application system, setting the name of the data provider data exchange gateway, the network address of the data provider data exchange gateway and the port number of the data provider data exchange gateway, and carrying out connectivity test on the data provider data exchange gateway; providing a data access end agent for a data provider, and performing data interaction with the data provider; deploying a data requester data exchange gateway at a network node of a data requester service application system, setting the name of the data requester data exchange gateway, the network address of the data requester data exchange gateway and the port number of the data requester data exchange gateway, and performing connectivity test on the data requester data exchange gateway; providing a data transmitting end agent for a data request party, and performing data interaction with the data request party; establishing a data exchange channel between a data exchange gateway of a data provider and a data exchange gateway of a data requester, and sending data to be exchanged to the data requester from the data provider;
the data access control subsystem is used for setting and judging the access authority of the data directory and issuing the registered data directory to a data requester conforming to the access authority; setting and judging the access authority of the data service corresponding to the data directory, and issuing the data service corresponding to the data directory to a data requester meeting the access authority; performing security audit on the authority setting of the data directory, and performing audit on the authority setting of the data service corresponding to the data directory;
the data exchange management subsystem is used for receiving an access authority application of a data service corresponding to a data directory of data to be exchanged, which is sent by a data requester; when receiving the access authority application, sending the access authority application to a data access control subsystem for authority judgment; according to the access authority of the registered data service set by the data provider, the access authority application is examined and approved; if the access authority application passes the examination and approval, the data requester obtains the access authority of the data service corresponding to the data directory of the data to be exchanged; when a data request party obtains the access right of the data service corresponding to the data directory of the data to be exchanged, obtaining a data exchange application of the data service corresponding to the data directory of the data to be exchanged by the data request party, and generating a data order; when the data order is generated, respectively sending an exchange channel establishment instruction to a data exchange gateway of a data provider and a data exchange gateway of a data requester; when receiving the confirmation response returned by the data exchange gateway of the data provider and the data exchange gateway of the data requester, establishing a data exchange channel between the data provider and the data requester and generating the information of the data exchange channel;
the data exchange monitoring subsystem is used for monitoring the operating state of the data exchange gateway of the data provider, the operating state of the data exchange gateway of the data requester, the fault of data exchange and the operating state of the data exchange channel and counting the exchange amount of data to be exchanged;
and the user management subsystem is used for managing the registration information of the data provider and the data requester and authenticating the login requests of the data provider and the data requester.
9. The distributed data sharing switching system of claim 8 wherein the data directory management subsystem is further configured to modify or delete metadata of the shared data.
10. The distributed data sharing switching system according to claim 8, wherein the data service management subsystem is further configured to modify or delete metadata information of a data service corresponding to the shared data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611093867.1A CN108134764B (en) | 2016-12-01 | 2016-12-01 | Distributed data sharing and exchanging method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611093867.1A CN108134764B (en) | 2016-12-01 | 2016-12-01 | Distributed data sharing and exchanging method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108134764A CN108134764A (en) | 2018-06-08 |
| CN108134764B true CN108134764B (en) | 2021-01-29 |
Family
ID=62388215
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611093867.1A Active CN108134764B (en) | 2016-12-01 | 2016-12-01 | Distributed data sharing and exchanging method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108134764B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108876310A (en) * | 2018-07-11 | 2018-11-23 | 国云科技股份有限公司 | Obtain the data share exchange system and method charged on demand on demand for business datum |
| CN108920702A (en) * | 2018-07-18 | 2018-11-30 | 四川师范大学 | Realize that heterogeneous database synchronizes the online method exchanged and share |
| CN109656902A (en) * | 2018-10-26 | 2019-04-19 | 阿里巴巴集团控股有限公司 | A kind of data load method and system |
| CN109471839A (en) * | 2018-10-29 | 2019-03-15 | 杭州数梦工场科技有限公司 | Inventory management of resources method and device |
| CN111737536B (en) * | 2018-10-29 | 2024-05-14 | 杭州数梦工场科技有限公司 | Resource management method and system |
| CN109936571B (en) * | 2019-02-22 | 2020-05-29 | 全球能源互联网研究院有限公司 | Mass data sharing method, open sharing platform and electronic equipment |
| CN109933587B (en) * | 2019-02-26 | 2023-04-11 | 厦门市美亚柏科信息股份有限公司 | Data processing method, device and system based on directory registration and storage medium |
| CN111143391A (en) * | 2020-01-16 | 2020-05-12 | 创意信息技术股份有限公司 | Data sharing exchange method and system |
| CN111752726B (en) * | 2020-06-25 | 2023-07-14 | 武汉众邦银行股份有限公司 | Method for quickly cross sharing data among multiple systems |
| CN111787096B (en) * | 2020-06-29 | 2023-04-07 | 杭州数梦工场科技有限公司 | Data sharing exchange method, device and system |
| CN112583927B (en) * | 2020-12-23 | 2022-04-15 | 北京航空航天大学 | Service management system based on airborne embedded real-time operating system |
| CN113110945A (en) * | 2021-04-06 | 2021-07-13 | 创意信息技术股份有限公司 | Data sharing method and system under specific scene |
| CN113409021B (en) * | 2021-06-28 | 2023-06-06 | 广东电网有限责任公司 | Power grid data sharing system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101925888A (en) * | 2008-01-25 | 2010-12-22 | 三星电子株式会社 | Method and apparatus for providing metadata of contents, and method and apparatus for limiting use-authortity of contents |
| CN105302845A (en) * | 2014-08-01 | 2016-02-03 | 华为技术有限公司 | Data information transaction method and system |
| CN105871794A (en) * | 2015-11-13 | 2016-08-17 | 乐视云计算有限公司 | Distributed file system date storage method and system, client and server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160253662A1 (en) * | 2015-02-27 | 2016-09-01 | Visa International Service Association | Method to use a payment gateway as contextual enabler between different parties |
-
2016
- 2016-12-01 CN CN201611093867.1A patent/CN108134764B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101925888A (en) * | 2008-01-25 | 2010-12-22 | 三星电子株式会社 | Method and apparatus for providing metadata of contents, and method and apparatus for limiting use-authortity of contents |
| CN105302845A (en) * | 2014-08-01 | 2016-02-03 | 华为技术有限公司 | Data information transaction method and system |
| CN105871794A (en) * | 2015-11-13 | 2016-08-17 | 乐视云计算有限公司 | Distributed file system date storage method and system, client and server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108134764A (en) | 2018-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108134764B (en) | Distributed data sharing and exchanging method and system | |
| CN111488595B (en) | Method for realizing authority control and related equipment | |
| US8813225B1 (en) | Provider-arbitrated mandatory access control policies in cloud computing environments | |
| CN104168333B (en) | The working method of PROXZONE service platforms | |
| CN110851278A (en) | Distribution network automation master station mobile application service management method and system based on micro-service architecture | |
| US20050108394A1 (en) | Grid-based computing to search a network | |
| US20070088825A1 (en) | System and method of distributed license management | |
| CN107153565A (en) | Configure the method and its network equipment of resource | |
| CN112702402A (en) | System, method, device, processor and storage medium for realizing government affair information resource sharing and exchange based on block chain technology | |
| CN110554927A (en) | Micro-service calling method based on block chain | |
| CN110740057B (en) | Service deployment method and block chain platform | |
| CN113973275B (en) | Data processing method, device and medium | |
| CN105225072A (en) | A kind of access management method of multi-application system and system | |
| CN113098982B (en) | Block chain message transmission method and device | |
| CN105468619A (en) | Resource distribution method and device used for database connection pool | |
| CN114036236A (en) | Multi-gateway cluster system | |
| CN110289971B (en) | Shared service management method and system | |
| CN113542033B (en) | Many-to-many mapping method and system for alliance chain foundation establishment and management platform | |
| CN106506239B (en) | Method and system for authentication in organization unit domain | |
| KR20150067037A (en) | The methods and apparatuses of optimization for criteria of subscription in M2M Systems | |
| WO2023185043A1 (en) | Method and apparatus for allocating invokable resources | |
| CN116389385A (en) | System resource processing method, device, storage medium and equipment | |
| CN101471799B (en) | Method for sending on-line announcement message in IGRS network | |
| CN115296866A (en) | Access method and device for edge node | |
| CN105071959A (en) | Plug-and-play management method and system based on unified registration of power network devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |