CN111752726A - Method for quickly and crossly sharing data among multiple systems - Google Patents
Method for quickly and crossly sharing data among multiple systems Download PDFInfo
- Publication number
- CN111752726A CN111752726A CN202010609124.5A CN202010609124A CN111752726A CN 111752726 A CN111752726 A CN 111752726A CN 202010609124 A CN202010609124 A CN 202010609124A CN 111752726 A CN111752726 A CN 111752726A
- Authority
- CN
- China
- Prior art keywords
- data
- central node
- data sharing
- sharing service
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/544—Buffers; Shared memory; Pipes
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of information, and provides a method for quickly cross-sharing data among multiple systems, aiming at solving the problems that the traditional mesh topology structure is complex and cannot be centrally managed, the data transmission pressure of a central node of a star topology structure is high, and the stability is poor due to the complexity of the central node. The main scheme comprises collecting system configuration information of all data sharing participants and establishing a central node; the target system registers data sharing service to the central node, and a data sharing service pool is formed on the central node; the source end system sends a data request to the central node, the central node matches data sharing services in the data sharing service pool according to data request information, and returns a data sharing service address and a token to the source end system after distributing an access token, and the source end system holds the access token to directly access the data sharing service address to form 'source end system-target system' data direct connection and perform data interaction.
Description
Technical Field
The invention relates to the technical field of information, and provides a method for quickly and crossly sharing data among multiple systems.
Background
For a better understanding of the present application, the following basic techniques need to be understood:
mesh topology: the topological structure mainly means that all nodes are connected through transmission line interconnection, and each node is connected with at least two other nodes. The mesh topology has high reliability, but the structure is complex and cannot be managed centrally.
Star topology: a central node and nodes connected to the central node by point-to-point links. The star topology structure has the characteristics of convenience in service, easiness in fault diagnosis and the like, but the dependency on the central node is strong.
Method for realizing data access between traditional information systems
Mesh topology: the information systems are directly connected with each other, the source end system actively acquires required data from the target system, and because the technical framework and the programming language adopted by each information system are different, each system participating in data sharing needs to be adapted to the data interfaces of a plurality of target systems, so that various problems that the number of data participants is increased, the system is more complex, the target system is uncontrollable and the like are caused. For example, if N systems participate in data sharing, then in the limit each participant must adapt to the interface of the data class in N-1.
Star topology: each information system achieves the purpose of data sharing through the central node. The central node is responsible for data interaction among all data sharing participants, the dependence degree of the whole system on the central node is high, and the central node is out of order, so that the whole network is unavailable.
Disclosure of Invention
The invention aims to solve the problems that the traditional mesh topology structure is complex and cannot be managed in a centralized way, the data transmission pressure of a central node of a star topology structure is high, and the stability is poor due to the complexity of the central node.
The invention does not solve the technical problems and adopts the following technical scheme:
a method for quickly cross-sharing data among multiple systems is characterized by comprising the following steps:
step 1: collecting system configuration information of all data sharing participants, and building a central node;
step 2: the target system registers data sharing service to the central node, and a data sharing service pool is formed on the central node;
and step 3: the source end system sends a data request to the central node, the central node matches data sharing services in the data sharing service pool according to data request information, and returns a data sharing service address and a token to the source end system after distributing an access token, and the source end system holds the access token to directly access the data sharing service address to form 'source end system-target system' data direct connection and perform data interaction.
In the above technical solution, step 1 specifically includes the following steps:
step 1.1: collecting system configuration information of all data sharing participants to obtain a data interface configuration information list of all systems, wherein the configuration information comprises: development language, data interface type, available resource quantity;
step 1.2: developing a general SDK on a central node according to a configuration list, wherein any participant in the network can use the SDK to request data from a target end;
step 1.3: the central node develops an interface registration service for the data sharing participants to register data interface information.
In the above technical solution, the method for implementing the general SDK according to step 1.2 includes the following steps:
step 1.2.1, developing a class according to each development language, wherein the class comprises configuration parameters: a central node server IP and an address port for receiving the request;
step 1.2.2, an API use request method is developed in class, an API use request can be sent to a relevant port of a central node, and the API use request contains a data sharing service name registered by a data sharing service provider in the central node;
step 1.2.3, developing a data request method in class, and carrying out data request according to the data sharing service address returned by the central node.
In the above technical solution, step 2 specifically includes the following steps:
step 2.1: the central node starts an interface registration service, and a target system registers a data sharing service to the central node to obtain a list of all data sharing services in the network;
step 2.2: the central node sends a detection instruction to a data sharing service address of a target system periodically, detects whether the data sharing service is normal or not, maintains a data sharing service list, takes the service with the current recording state of valid and the detection result of invalid off-line, takes the service with the current recording state of invalid and the detection result of valid on-line, and summarizes the available data sharing service list to form a data sharing service pool.
In the above technical solution, step 3 specifically includes the following steps:
step 3.1: the source end system integrates the SDK to obtain a universal data request method, and the universal data request method comprises two methods: API use request method, data request method;
step 3.2: the source end system sends an API (application programming interface) use request to the central node through the SDK, and the central node matches data sharing service in the data sharing service pool according to the data request information to obtain a proper and available data sharing service address;
step 3.3: the central node judges the number of available resources registered by the target system and produces an access token;
step 3.4: the central node returns the data sharing service address and the access token to the source end system, and the source end system obtains a data request response result;
step 3.5: the source end system directly requests the target system for data according to the data request response result, and the target system returns corresponding data after receiving the request.
Because the invention adopts the technical scheme, the invention has the following beneficial effects:
firstly, the proposal utilizes the mesh topology to carry out actual data transmission, greatly reduces the data transmission pressure of the central node and the complexity of the central node, thereby providing the stability of the central node.
The global data sharing management configuration centralization is carried out by utilizing the star topology, all data sharing centralized scheduling is carried out, the network complexity is reduced, each data sharing participant only concentrates on providing data sharing service, the data is not required to be concerned about who uses the data, and the service in the whole network is controllable.
Thirdly, the proposal adopts a mode of combining mesh topology and star topology to share data, and integrates the advantages of the two modes. The star-shaped topological structure is responsible for centralized management, and the central node is responsible for overall scheduling, so that the data sharing service can be globally controllable; the mesh topology structure is responsible for actual data transmission, and a point-to-point direct connection mode ensures the data transmission speed, reduces the pressure of a central node and improves the data transmission speed of the whole network.
Fourthly, compared with the mesh topology, the proposal has one more central management node. The mesh topology has no central management node, which means that each participant must locally store data service information of all participants in the mesh, wherein the change of information of one participant requires broadcasting all servers for configuration update, and the more participants, the more complicated the management. The proposal adds a management node, the information of all participants is registered on the management node, and the participants can obtain the configuration information of all the participants in the network only by communicating with the central node.
Compared with the star topology, the function of the central node is weakened, and the traditional star topology central node is not only responsible for the whole network management but also serves as a data center of the whole network. All data exchange in the network needs to pass through the central node, and the pressure on the central node is large. The proposal separates data exchange from a central node by fusing mesh topology, reduces the pressure of the central node and improves the stability of the whole network.
Sixth, the scheme of the present disclosure "star topology and mesh topology combination" achieves the effects of manageability, high stability, and high throughput through a special information interaction manner on the basis of combining the advantages of the two manners, which cannot be achieved by a single star topology or mesh topology.
Drawings
FIG. 1 is a schematic diagram of a mesh topology;
FIG. 2 is a schematic diagram of a mesh topology;
fig. 3 is a schematic view of the topology of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the detailed description and specific examples, while indicating the preferred embodiment of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
It is noted that relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
A method for quickly cross-sharing data among multiple systems is characterized by comprising the following steps:
step 1: collecting system configuration information of all data sharing participants, and building a central node;
step 2: the target system registers data sharing service to the central node, and a data sharing service pool is formed on the central node;
and step 3: the source end system sends a data request to the central node, the central node matches data sharing services in the data sharing service pool according to data request information, and returns a data sharing service address and a token to the source end system after distributing an access token, and the source end system holds the access token to directly access the data sharing service address to form 'source end system-target system' data direct connection and perform data interaction.
In the above technical solution, step 1 specifically includes the following steps:
step 1.1: collecting system configuration information of all data sharing participants to obtain a data interface configuration information list of all systems, wherein the configuration information comprises: development language, data interface type, available resource quantity;
step 1.2: developing a general SDK on a central node according to a configuration list, wherein any participant in the network can use the SDK to request data from a target end; the general SDK is an API calling program tool package which is general for the system in the network, and the principle of the SDK is that API use request and data request methods are packaged, a standardized and unified use mode is exposed to an external system, and when the SDK is used, a certain series of API operations can be completed only by calling the SDK according to a fixed method. Each time data is shared, two steps are required:
and the data request party sends an API (application program interface) use request to the central node through the SDK, and the request message contains the requested data sharing service name. After receiving the request, the central node inquires corresponding service in the data sharing service pool according to the name of the data sharing service, verifies whether the service is effective or not, and returns the IP (Internet protocol) and the port address of a server providing the data sharing service to the data requester after the verification is passed;
after receiving the return information of the central node, the data requester sends a data request to the IP and the port of the server providing the data sharing service through the SDK, and the service provider returns data to the requester after receiving the request.
Step 1.3: the central node develops an interface registration service for the data sharing participants to register data interface information.
In the above scheme, the implementation method of the general SDK in step 1.2 includes the following steps:
step 1.2.1, developing a class according to each development language, wherein the class comprises configuration parameters: a central node server IP and an address port for receiving the request;
step 1.2.2, an API use request method is developed in class, an API use request can be sent to a relevant port of a central node, and the API use request contains a data sharing service name registered by a data sharing service provider in the central node;
step 1.2.3, developing a data request method in class, and carrying out data request according to the data sharing service address returned by the central node.
In the above technical solution, step 2 specifically includes the following steps:
step 2.1: the central node starts an interface registration service, and a target system registers a data sharing service to the central node to obtain a list of all data sharing services in the network;
step 2.2: the central node sends a detection instruction to a data sharing service address of a target system periodically, detects whether the data sharing service is normal or not, maintains a data sharing service list, takes the service with the current recording state of valid and the detection result of invalid off-line, takes the service with the current recording state of invalid and the detection result of valid on-line, and summarizes the available data sharing service list to form a data sharing service pool.
In the above technical solution, step 3 specifically includes the following steps:
step 3.1: the source end system integrates the SDK to obtain a universal data request method, and the universal data request method comprises two methods: API use request method, data request method;
step 3.2: the source end system sends an API (application programming interface) use request to the central node through the SDK, and the central node matches data sharing service in the data sharing service pool according to the data request information to obtain a proper and available data sharing service address;
step 3.3: the central node judges the number of available resources registered by the target system and produces an access token;
step 3.4: the central node returns the data sharing service address and the access token to the source end system, and the source end system obtains a data request response result;
step 3.5: the source end system directly requests the target system for data according to the data request response result, and the target system returns corresponding data after receiving the request.
Claims (5)
1. A method for quickly cross-sharing data among multiple systems is characterized by comprising the following steps:
step 1: collecting system configuration information of all data sharing participants, and building a central node;
step 2: the target system registers data sharing service to the central node, and a data sharing service pool is formed on the central node;
and step 3: the source end system sends a data request to the central node, the central node matches data sharing services in the data sharing service pool according to data request information, and returns a data sharing service address and a token to the source end system after distributing an access token, and the source end system holds the access token to directly access the data sharing service address to form 'source end system-target system' data direct connection and perform data interaction.
2. The method of claim 1, wherein the method comprises the following steps: the step 1 specifically comprises the following steps:
step 1.1: collecting system configuration information of all data sharing participants to obtain a data interface configuration information list of all systems, wherein the configuration information comprises: development language, data interface type, available resource quantity;
step 1.2: developing a general SDK on a central node according to a configuration list, wherein any participant in the network can use the SDK to request data from a target end;
step 1.3: the central node develops an interface registration service for the data sharing participants to register data interface information.
3. The method of claim 1, wherein the method comprises the following steps: step 1.2 the method for implementing the general SDK comprises the following steps:
step 1.2.1, developing a class according to each development language, wherein the class comprises configuration parameters: a central node server IP and an address port for receiving the request;
step 1.2.2, an API use request method is developed in class, an API use request can be sent to a relevant port of a central node, and the API use request contains a data sharing service name registered by a data sharing service provider in the central node;
step 1.2.3, developing a data request method in class, and carrying out data request according to the data sharing service address returned by the central node.
4. The method of claim 1, wherein the method comprises the following steps: the step 2 specifically comprises the following steps:
step 2.1: the central node starts an interface registration service, and a target system registers a data sharing service to the central node to obtain a list of all data sharing services in the network;
step 2.2: the central node sends a detection instruction to a data sharing service address of a target system periodically, detects whether the data sharing service is normal or not, maintains a data sharing service list, takes the service with the current recording state of valid and the detection result of invalid off-line, takes the service with the current recording state of invalid and the detection result of valid on-line, and summarizes the available data sharing service list to form a data sharing service pool.
5. The method of claim 1, wherein the method comprises the following steps: the step 3 specifically comprises the following steps:
step 3.1: the source end system integrates the SDK to obtain a universal data request method, and the universal data request method comprises two methods: API use request method, data request method;
step 3.2: the source end system sends an API (application programming interface) use request to the central node through the SDK, and the central node matches data sharing service in the data sharing service pool according to the data request information to obtain a proper and available data sharing service address;
step 3.3: the central node judges the number of available resources registered by the target system and produces an access token;
step 3.4: the central node returns the data sharing service address and the access token to the source end system, and the source end system obtains a data request response result;
step 3.5: the source end system directly requests the target system for data according to the data request response result, and the target system returns corresponding data after receiving the request.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010609124.5A CN111752726B (en) | 2020-06-25 | 2020-06-25 | Method for quickly cross sharing data among multiple systems |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010609124.5A CN111752726B (en) | 2020-06-25 | 2020-06-25 | Method for quickly cross sharing data among multiple systems |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111752726A true CN111752726A (en) | 2020-10-09 |
CN111752726B CN111752726B (en) | 2023-07-14 |
Family
ID=72678143
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010609124.5A Active CN111752726B (en) | 2020-06-25 | 2020-06-25 | Method for quickly cross sharing data among multiple systems |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111752726B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113807960A (en) * | 2021-03-04 | 2021-12-17 | 京东科技控股股份有限公司 | Cross-link processing method, device and system between heterogeneous chains and electronic equipment |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1670694A (en) * | 2004-01-30 | 2005-09-21 | 捷讯研究有限公司 | System and method for publishing and accessing application API on a generic terminal |
CN103281368A (en) * | 2013-05-22 | 2013-09-04 | 河海大学 | Data sharing exchange model and method based on cloud computation |
CN103731400A (en) * | 2012-10-12 | 2014-04-16 | 三星电子(中国)研发中心 | Resource sharing system and method |
CN104253865A (en) * | 2014-09-18 | 2014-12-31 | 华南理工大学 | Two-level management method for hybrid desktop cloud service platform |
CN108134764A (en) * | 2016-12-01 | 2018-06-08 | 中国电子科技集团公司第十五研究所 | A kind of Distributed data share exchange method and system |
CN108551464A (en) * | 2018-03-08 | 2018-09-18 | 网宿科技股份有限公司 | A kind of connection foundation of mixed cloud, data transmission method, device and system |
CN109547562A (en) * | 2018-12-13 | 2019-03-29 | 爱普(福建)科技有限公司 | A kind of data sharing method and system based on data sharing gateway |
CN109617990A (en) * | 2018-12-29 | 2019-04-12 | 长威信息科技发展股份有限公司 | A kind of converged communication resource cloud sharing method and system |
CN110071965A (en) * | 2019-03-27 | 2019-07-30 | 上海德衡数据科技有限公司 | A kind of data center management system based on cloud platform |
CN111309691A (en) * | 2020-01-15 | 2020-06-19 | 深圳市华傲数据技术有限公司 | Data sharing exchange system and exchange method based on bus architecture |
-
2020
- 2020-06-25 CN CN202010609124.5A patent/CN111752726B/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1670694A (en) * | 2004-01-30 | 2005-09-21 | 捷讯研究有限公司 | System and method for publishing and accessing application API on a generic terminal |
CN103731400A (en) * | 2012-10-12 | 2014-04-16 | 三星电子(中国)研发中心 | Resource sharing system and method |
CN103281368A (en) * | 2013-05-22 | 2013-09-04 | 河海大学 | Data sharing exchange model and method based on cloud computation |
CN104253865A (en) * | 2014-09-18 | 2014-12-31 | 华南理工大学 | Two-level management method for hybrid desktop cloud service platform |
CN108134764A (en) * | 2016-12-01 | 2018-06-08 | 中国电子科技集团公司第十五研究所 | A kind of Distributed data share exchange method and system |
CN108551464A (en) * | 2018-03-08 | 2018-09-18 | 网宿科技股份有限公司 | A kind of connection foundation of mixed cloud, data transmission method, device and system |
CN109547562A (en) * | 2018-12-13 | 2019-03-29 | 爱普(福建)科技有限公司 | A kind of data sharing method and system based on data sharing gateway |
CN109617990A (en) * | 2018-12-29 | 2019-04-12 | 长威信息科技发展股份有限公司 | A kind of converged communication resource cloud sharing method and system |
CN110071965A (en) * | 2019-03-27 | 2019-07-30 | 上海德衡数据科技有限公司 | A kind of data center management system based on cloud platform |
CN111309691A (en) * | 2020-01-15 | 2020-06-19 | 深圳市华傲数据技术有限公司 | Data sharing exchange system and exchange method based on bus architecture |
Non-Patent Citations (2)
Title |
---|
孙岩;: "基于可持续发展的水文水资源信息共享及实践探讨", 河南水利与南水北调, no. 17, pages 49 - 51 * |
张莉艳: "基于云计算的铁路信息共享平台及关键技术研究", 《中国博士学位论文全文数据库信息科技辑》, pages 138 - 11 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113807960A (en) * | 2021-03-04 | 2021-12-17 | 京东科技控股股份有限公司 | Cross-link processing method, device and system between heterogeneous chains and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
CN111752726B (en) | 2023-07-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109618005B (en) | Method for calling server and proxy server | |
US7437417B2 (en) | Method for publish/subscribe messaging | |
Pietzuch et al. | Hermes: A distributed event-based middleware architecture | |
EP1311946B1 (en) | System and method for concentration and load-balancing of requests | |
WO2019141111A1 (en) | Communication method and communication apparatus | |
CN102347959B (en) | Resource access system and method based on identity and session | |
EP0776502A2 (en) | Scalable distributed computing environment | |
KR20000006360A (en) | publish&subscribe data processing apparatus, method, and computer program product with use of a stream to distribute local information between neighbors in a broker structure | |
US10411911B2 (en) | Network as service service cross-domain orchestration method, orchestration device, and control device | |
JP3557405B2 (en) | Protocol information management of interface hierarchical network between dedicated networks | |
US7907544B2 (en) | Overlay network for location-independent communication between computer systems | |
US11343787B2 (en) | Method and system for processing node registration notification | |
JP3400916B2 (en) | Server address management method | |
CN111752726B (en) | Method for quickly cross sharing data among multiple systems | |
JP2003508955A (en) | System and method for interconnecting multiple virtual private networks | |
CN109587062B (en) | Load balancing information synchronization method, device and processing equipment | |
CN110247778A (en) | Installation method of operating system, device, electronic equipment and storage medium | |
US20200296552A1 (en) | Method, device and system for transmitting multicast group information | |
CN113055461B (en) | ZooKeeper-based unmanned cluster distributed cooperative command control method | |
JP2006059370A (en) | System, apparatus and program for integrated application management, server, system, program, server case and communication system for integrated session management, session control server and integrated application server | |
CN106936900B (en) | Clustered node statistical method and device | |
Grace et al. | Overstar: An open approach to end-to-end middleware services in systems of systems | |
JP2007026236A (en) | Application integration management system, device and program, and integrated session management server, system, program and server casing, and communication system, session control server and integrated application server | |
CN108093147B (en) | Distributed multi-stage scheduling method and equipment | |
JP4491351B2 (en) | Application integrated management system, apparatus and program, integrated session management server, system, program and server housing, communication system, session control server, and integrated application server |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |