CN111371621A - Data exchange method and device based on hybrid cloud and computer readable medium - Google Patents
Data exchange method and device based on hybrid cloud and computer readable medium Download PDFInfo
- Publication number
- CN111371621A CN111371621A CN202010170388.5A CN202010170388A CN111371621A CN 111371621 A CN111371621 A CN 111371621A CN 202010170388 A CN202010170388 A CN 202010170388A CN 111371621 A CN111371621 A CN 111371621A
- Authority
- CN
- China
- Prior art keywords
- data
- configuration information
- subscriber
- target data
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
- H04L43/106—Active monitoring, e.g. heartbeat, ping or trace-route using time related information in packets, e.g. by adding timestamps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
Abstract
The invention provides a data exchange method, a device and a computer readable medium based on a hybrid cloud, according to a subscription mechanism, a data interface provided by a data provider is registered as a data service, first configuration information of the data interface comprises a source cloud identifier, a source system identifier and a data main body, a data consumption logic interface provided by a data consumer is registered as a subscriber, and second configuration information of the data interface comprises the source cloud identifier, the source system identifier and the subscribed data service; when any data provider is monitored to provide any target data, determining each subscriber capable of subscribing the target data according to each configured first configuration information and second configuration information; and aiming at each determined subscriber, sending the target data to the data consumer to which the subscriber belongs according to the second configuration information of the subscriber. The scheme can improve the data exchange efficiency, is safe and reliable, is real-time and efficient, meets the requirement of user data exchange of a hybrid cloud enterprise, and has good popularization value.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a data exchange method and device based on a hybrid cloud and a computer readable medium.
Background
With the popularization of cloud computing technology, more and more enterprises use cloud computing technology to meet IT (internet technology) requirements, and enterprise competitiveness is improved. The hybrid cloud has the advantages of reducing cost, increasing storage and expansibility, improving usability and accessibility, improving agility and flexibility, having an application integration function and the like, and is highly appreciated by enterprise users. In order to fully utilize information and realize service automation, interconnection and intercommunication of various systems deployed in a hybrid cloud environment need to be realized, for example, data exchange needs to be realized between an application system deployed in a public cloud and an application system deployed in a private cloud or a managed cloud.
At present, data exchange between different systems deployed in a hybrid cloud environment is basically realized by manually exporting an exchange mode of importing data files, but the data exchange efficiency is low.
Disclosure of Invention
The invention provides a data exchange method and device based on a hybrid cloud and a computer readable medium, which can improve the data exchange efficiency. Compared with the prior art, the data exchange method provided by the invention is safe, reliable, real-time and efficient, meets the requirements of user data exchange of a hybrid cloud enterprise, and has good popularization value.
In order to achieve the purpose, the invention is realized by the following technical scheme:
in a first aspect, the present invention provides a data exchange method based on a hybrid cloud, including:
according to a preset subscription mechanism, registering a data interface provided by a data provider as a data service, and configuring first configuration information of the data service, wherein the first configuration information comprises a source cloud identifier, a source system identifier and a data main body;
according to the subscription mechanism, registering a data consumption logic interface provided by a data consumer as a subscriber, and configuring second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service;
when any target data provided by any first data provider is monitored, determining each first subscriber capable of subscribing the target data according to each configured first configuration information and each configured second configuration information;
for each of the first subscribers, performing: and sending the target data to a first data consumer to which the current first subscriber belongs according to the second configuration information of the current first subscriber.
Further, after the target data is listened to, further comprising: caching the target data to a preset cache region;
after the sending the target data to the first data consumer to which the current first subscriber belongs, further comprising: receiving a subscription success notification for the target data returned by the first data consumer;
and deleting the target data from the cache region when determining that each first subscriber returns a subscription success notification for the target data.
Further, when the target data is monitored, the method further comprises: recording the current time as the timestamp of the target data;
for each data cached in the cache region, executing: and monitoring whether the caching duration of the current data reaches a preset duration or not in real time according to the timestamp of the current data, and if so, deleting the current data from the caching area.
Further, the caching the target data in a preset cache region includes: and caching the target data to a preset cache region by adopting Kafka middleware.
In a second aspect, the present invention provides a hybrid cloud-based data exchange apparatus, including:
the data service publishing module is used for registering a data interface provided by a data provider as a data service according to a preset subscription mechanism and configuring first configuration information of the data service, wherein the first configuration information comprises a source cloud identifier, a source system identifier and a data main body;
the data service subscription module is used for registering a data consumption logic interface provided by a data consumer as a subscriber according to the subscription mechanism and configuring second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service;
the data monitoring module is used for triggering the data publishing module when any first data provider is monitored to provide any target data;
the data publishing module is configured to determine each first subscriber that can subscribe to the target data according to the configured first configuration information and the second configuration information;
a data consumption module for performing, for each of the first subscribers: and sending the target data to a first data consumer to which the current first subscriber belongs according to the second configuration information of the current first subscriber.
Further, the data monitoring module is configured to cache the target data to a preset cache region;
the data consumption module is used for receiving a subscription success notification aiming at the target data, which is returned by the first data consumption party; and deleting the target data from the cache region when determining that each first subscriber returns a subscription success notification for the target data.
Further, the data monitoring module is configured to record a current time as a timestamp of the target data when the target data is monitored;
the data consumption module is configured to, for each piece of data cached in the cache region, perform: and monitoring whether the caching duration of the current data reaches a preset duration or not in real time according to the timestamp of the current data, and if so, deleting the current data from the caching area.
Further, the data monitoring module is configured to cache the target data to a preset cache region by using Kafka middleware.
In a third aspect, the present invention provides a data exchange device based on a hybrid cloud, including: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor is configured to invoke the machine-readable program to perform the method of any of the above first aspects.
In a fourth aspect, the present invention provides a computer readable medium having stored thereon computer instructions which, when executed by a processor, cause the processor to perform the method of any of the first aspects above.
The invention provides a data exchange method, a data exchange device and a computer readable medium based on a hybrid cloud, wherein the method comprises the following steps: registering a data interface provided by a data provider as a data service according to a subscription mechanism, and configuring first configuration information of the data service to comprise a source cloud identifier, a source system identifier and a data main body; registering a data consumption logic interface provided by a data consumer as a subscriber according to a subscription mechanism, and configuring second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service; when any target data provided by any first data provider is monitored, each subscriber capable of subscribing the target data is determined according to each configured first configuration information and each configured second configuration information; executing for each determined subscriber: and sending the target data to the data consumer to which the subscriber belongs according to the second configuration information of the subscriber. The invention can improve the data exchange efficiency. Compared with the prior art, the data exchange method provided by the invention is safe, reliable, real-time and efficient, meets the requirements of user data exchange of a hybrid cloud enterprise, and has good popularization value.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a hybrid cloud-based data exchange method according to an embodiment of the present invention;
fig. 2 is a flowchart of another hybrid cloud-based data exchange method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a data exchange device based on a hybrid cloud according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention, and based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts belong to the scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a data exchange method based on a hybrid cloud, which may include the following steps:
step 101: according to a preset subscription mechanism, a data interface provided by a data provider is registered as a data service, and first configuration information of the data service is configured, wherein the first configuration information comprises a source cloud identifier, a source system identifier and a data main body.
Step 102: according to the subscription mechanism, a data consumption logic interface provided by a data consumer is registered as a subscriber, and second configuration information of the subscriber is configured, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service.
Step 103: and when any first data provider is monitored to provide any target data, determining each first subscriber which can subscribe the target data according to the configured first configuration information and the second configuration information.
Step 104: for each of the first subscribers, performing: and sending the target data to a first data consumer to which the current first subscriber belongs according to the second configuration information of the current first subscriber.
The data exchange method based on the hybrid cloud provided by the embodiment of the invention comprises the following steps: registering a data interface provided by a data provider as a data service according to a subscription mechanism, and configuring first configuration information of the data service to comprise a source cloud identifier, a source system identifier and a data main body; registering a data consumption logic interface provided by a data consumer as a subscriber according to a subscription mechanism, and configuring second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service; when any data provider is monitored to provide any target data, each subscriber capable of subscribing the target data is determined according to the configured first configuration information and the second configuration information; executing for each determined subscriber: and sending the target data to the data consumer to which the subscriber belongs according to the second configuration information of the subscriber. The embodiment of the invention can improve the data exchange efficiency. Compared with the prior art, the data exchange method provided by the embodiment of the invention is safe, reliable, real-time and efficient, meets the requirements of user data exchange of a hybrid cloud enterprise, and has good popularization value.
In the embodiment of the invention, based on the giving relationship of the data, the data provider and the data consumer can be understood as a relative concept, and any execution subject can be a data provider which provides data for other data consumers, and can also be used as a data consumer which consumes the data provided by other data providers.
In the embodiment of the present invention, the apparatus for performing the data exchange method is referred to as a data box hereinafter for convenience of technical description. A subscription mechanism is preset in the data box, so that the registration of a data interface of a data provider and the registration of a data consumption logic interface of a data consumer can be realized, and relevant information is configured. For example, in the subscription mechanism, it may be defined which cloud systems may participate in data exchange, which application systems may participate in data exchange, which data principals may be involved in data exchange, at least which information needs to be configured when registering a data service, at least which information needs to be configured when registering a subscriber, and so on.
In the embodiment of the present invention, the related cloud system may include a public cloud and a private cloud, such as an aricloud, an AWS (Amazon Web Services, Amazon cloud computing service), and other public clouds; the related application systems may include an MDM (Master Data Management) system, a CRM (Customer Relationship Management) system, an SCM (Supply Chain Management) system, and the like; the data body involved can be client class data, product class data, personnel class data and the like.
In the embodiment of the invention, when a data interface provided by a data provider is registered as a data service, a source cloud identifier, a source system identifier and a corresponding data main body of the data interface need to be configured, and when a data consumption logic interface provided by a data consumer is registered as a subscriber, the source cloud identifier, the source system identifier and the subscribed data service need to be configured. When any data provider provides any data, the data can be distributed to corresponding data consumers based on the configuration information.
Of course, the data box can also add, delete, modify and the like to the registered content according to the actual requirements of the data provider and the data consumer.
For example, in the data box, the data interface provided by the MDM system is registered as a data service for the data consumer to subscribe and consume. The data services registered by the data box and configuration information thereof may be as shown in table 1 below.
TABLE 1
| Data service | Belonging cloud | Belonging system | Data body |
| Newly added client | Aliyun (Aliyun) | MDM | Customer |
| New product | Aliyun (Aliyun) | MDM | Product(s) |
In the data box, the data consumer is registered and establishes a subscription relationship with the data service. The registered subscribers of the data box and their configuration information are shown in table 2 below.
TABLE 2
| Subscriber's subscriber | Belonging cloud | Belonging system | Subscribed data services |
| CRM client | AWS | CRM | Newly added client |
| SCM client | xxx private clouds | SCM | Newly added client |
| CRM products | AWS | CRM | New product |
| SCM product | xxx private clouds | SCM | New product |
Based on the configuration items shown in tables 1 and 2, when the MDM system in the ali cloud provides a customer data, the data service corresponding to the customer data is the "new customer", and the subscribers subscribing to the data service are the "CRM customer" and the "SCM customer", so that the customer data can be distributed to the "CRM customer" through the AWS and CRM systems, and the customer data can be distributed to the "SCM customer" through the xxx private cloud and SCM system.
In summary, the embodiment of the present invention may implement data exchange between different clouds by using a data publish-subscribe mechanism. Compared with the prior art, the data exchange method provided by the embodiment of the invention is safe, reliable, real-time and efficient, meets the requirements of user data exchange of a hybrid cloud enterprise, and has good popularization value.
In the embodiment of the invention, data exchange based on the hybrid cloud can be realized through interconnection and intercommunication of the data box and each data provider and data consumer. When data service or data consumption logic change, only need the configuration information in the adjustment data box, can normally receive and distribute data for the execution of data exchange between the hybrid cloud is more nimble, reliable, easily expands, easily satisfies the demand of hybrid cloud enterprise user real-time data exchange.
In one embodiment of the invention, the data box may include a data service publishing module, a data service subscribing module, a data monitoring module, a data publishing module and a data consuming module. The data service publishing module can be used for registering a data interface of a data provider (namely a source system) as a data service; the data service subscription module can be used for registering data consumption logic and subscribing data services; the data monitoring module can be used for monitoring data provided by a data provider; the data publishing module can be used for distributing the monitored data; the data consumption module may be used to schedule data processing logic (such as data format conversion, data encryption, etc.) of the data consumer.
In one embodiment of the invention, the data service provided by the source system can support the REST (Representational State Transfer) style, the interior of the data service complies with the security protocol, and sensitive private data and illegal public data are prohibited from being released. The data consumption end can provide a data consumption logic interface supporting REST style, register in the data box and support idempotent to avoid repeated data consumption.
In an embodiment of the present invention, to illustrate a possible implementation manner of the data distribution process, after the target data is listened to, the method further includes: caching the target data to a preset cache region;
after the sending the target data to the first data consumer to which the current first subscriber belongs, further comprising: receiving a subscription success notification for the target data returned by the first data consumer; and deleting the target data from the cache region when determining that each first subscriber returns a subscription success notification for the target data.
In detail, the data box may employ Kafka middleware for caching data.
In the embodiment of the invention, the data box publishes the monitored data, and distributes the data in the cache region to subscribers (namely consumers) for consumption according to the subscription relation of the data service. After the subscriber consumes the data, the data processing result can be fed back to the data box. After the data box knows that the data is successfully consumed, the corresponding data can be deleted from the cache region, and the resource occupation of the data is reduced.
In an embodiment of the present invention, when the target data is listened to, further comprising: recording the current time as the timestamp of the target data;
for each data cached in the cache region, executing: and monitoring whether the caching duration of the current data reaches a preset duration or not in real time according to the timestamp of the current data, and if so, deleting the current data from the caching area.
In the embodiment of the invention, when the data which is not processed for a long time in the cache region exceeds the set time limit, the data can be determined to be dead data, and the data box can automatically delete the dead data.
In the embodiment of the invention, the data box can receive and distribute the data through the message queue to provide the guarantee of data time sequence, ensure that the data come first, ensure that the consumption end consumes the data in sequence and ensure that the data is consumed accurately.
As shown in fig. 2, an embodiment of the present invention provides another data exchange method based on a hybrid cloud, which may include the following steps:
step 201: a subscription mechanism is set in the data box and steps 202 and 210 are performed.
Step 202: the data box registers a data interface provided by a data provider as a data service according to a subscription mechanism, and configures first configuration information of the data service, wherein the first configuration information comprises a source cloud identifier, a source system identifier and a data main body.
Step 203: the data box registers a data consumption logic interface provided by a data consumer as a subscriber according to a subscription mechanism, and configures second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service.
Step 204: when monitoring that any target data is provided by any first data provider, the data box caches the target data to a preset cache region by adopting Kafka middleware, and records the current time as a time stamp of the target data.
Step 205: and the data box determines each first subscriber which can subscribe the target data according to the configured first configuration information and the second configuration information.
Step 206: the data box performs for each first subscriber: and determining a first data consumer belonging to the current first subscriber according to the second configuration information of the current first subscriber.
Step 207: the data box sends the target data to the first data consumer.
Step 208: and the first data consumer consumes the target data and returns a successful subscription notice aiming at the target data to the data box.
Step 209: and when the data box determines that each first subscriber returns a subscription success notice aiming at the target data, deleting the target data from the cache region and finishing the current process.
Step 210: the data box executes the following steps aiming at each data cached in the cache region: and monitoring whether the caching duration of the current data reaches a preset duration or not in real time according to the timestamp of the current data, and if so, deleting the current data from the caching area.
As shown in fig. 3, an embodiment of the present invention provides a data exchange apparatus based on a hybrid cloud, which may include:
the data service publishing module 301 is configured to register a data interface provided by a data provider as a data service according to a preset subscription mechanism, and configure first configuration information of the data service, where the first configuration information includes a source cloud identifier, a source system identifier, and a data main body;
a data service subscription module 302, configured to register a data consumption logic interface provided by a data consumer as a subscriber according to the subscription mechanism, and configure second configuration information of the subscriber, where the second configuration information includes a source cloud identifier, a source system identifier, and a subscribed data service;
the data monitoring module 303 is configured to trigger the data publishing module 304 when any one of the first data providers is monitored to provide any one of the target data;
the data publishing module 304 is configured to determine each first subscriber that can subscribe to the target data according to the configured respective first configuration information and the respective second configuration information;
a data consuming module 305, configured to perform, for each of the first subscribers: and sending the target data to a first data consumer to which the current first subscriber belongs according to the second configuration information of the current first subscriber.
The embodiment of the invention provides a data exchange device based on a hybrid cloud, which is simple in configuration, high in safety, strong in reliability and reasonable in design, and has the advantages of safe data transmission, high data exchange efficiency and the like. The embodiment of the invention changes the low-efficiency, manual and rigid data exchange mode between the existing hybrid clouds, realizes the real-time data exchange between the application systems under the public cloud and the private cloud, meets the requirement of the hybrid cloud enterprise users on real-time information sharing, and has good popularization value.
In an embodiment of the present invention, the data monitoring module 303 is configured to cache the target data in a preset cache region;
the data consuming module 305 is configured to receive a subscription success notification for the target data, which is returned by the first data consuming party; and deleting the target data from the cache region when determining that each first subscriber returns a subscription success notification for the target data.
In an embodiment of the present invention, the data monitoring module 303 is configured to record a current time as a timestamp of the target data when the target data is monitored;
the data consuming module 305 is configured to, for each piece of data cached in the cache region, perform: and monitoring whether the caching duration of the current data reaches a preset duration or not in real time according to the timestamp of the current data, and if so, deleting the current data from the caching area.
In an embodiment of the present invention, the data snooping module 303 is configured to cache the target data to a preset cache region by using Kafka middleware.
Because the information interaction, execution process, and other contents between the units in the device are based on the same concept as the method embodiment of the present invention, specific contents may refer to the description in the method embodiment of the present invention, and are not described herein again.
Embodiments of the present invention also provide a computer-readable medium storing instructions for causing a computer to perform a hybrid cloud-based data exchange method as described herein. Specifically, a system or an apparatus equipped with a storage medium on which software program codes that realize the functions of any of the above-described embodiments are stored may be provided, and a computer (or a CPU or MPU) of the system or the apparatus is caused to read out and execute the program codes stored in the storage medium.
In this case, the program code itself read from the storage medium can realize the functions of any of the above-described embodiments, and thus the program code and the storage medium storing the program code constitute a part of the present invention.
Examples of the storage medium for supplying the program code include a floppy disk, a hard disk, a magneto-optical disk, an optical disk (e.g., CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW), a magnetic tape, a nonvolatile memory card, and a ROM. Alternatively, the program code may be downloaded from a server computer via a communications network.
Further, it should be clear that the functions of any one of the above-described embodiments may be implemented not only by executing the program code read out by the computer, but also by causing an operating system or the like operating on the computer to perform a part or all of the actual operations based on instructions of the program code.
Further, it is to be understood that the program code read out from the storage medium is written to a memory provided in an expansion board inserted into the computer or to a memory provided in an expansion unit connected to the computer, and then causes a CPU or the like mounted on the expansion board or the expansion unit to perform part or all of the actual operations based on instructions of the program code, thereby realizing the functions of any of the above-described embodiments.
In summary, the embodiments of the present invention have at least the following advantages:
1. in the embodiment of the invention, a data interface provided by a data provider is registered as a data service according to a subscription mechanism, and first configuration information of the data service is configured to comprise a source cloud identifier, a source system identifier and a data main body; registering a data consumption logic interface provided by a data consumer as a subscriber according to a subscription mechanism, and configuring second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service; when any target data provided by any first data provider is monitored, each subscriber capable of subscribing the target data is determined according to each configured first configuration information and each configured second configuration information; executing for each determined subscriber: and sending the target data to the data consumer to which the subscriber belongs according to the second configuration information of the subscriber. The embodiment of the invention can improve the data exchange efficiency. Compared with the prior art, the data exchange method provided by the embodiment of the invention is safe, reliable, real-time and efficient, meets the requirements of user data exchange of a hybrid cloud enterprise, and has good popularization value.
2. The embodiment of the invention can realize data exchange among different clouds by means of a data publishing and subscribing mechanism. Compared with the prior art, the data exchange method provided by the embodiment of the invention is safe, reliable, real-time and efficient, meets the requirements of user data exchange of a hybrid cloud enterprise, and has good popularization value.
3. The embodiment of the invention provides a data exchange device based on a hybrid cloud, which is simple in configuration, high in safety, strong in reliability and reasonable in design, and has the advantages of safe data transmission, high data exchange efficiency and the like. The embodiment of the invention changes the low-efficiency, manual and rigid data exchange mode between the existing hybrid clouds, realizes the real-time data exchange between the application systems under the public cloud and the private cloud, meets the requirement of the hybrid cloud enterprise users on real-time information sharing, and has good popularization value.
It should be noted that not all steps and modules in the above flows and system structure diagrams are necessary, and some steps or modules may be omitted according to actual needs. The execution order of the steps is not fixed and can be adjusted as required. The system structure described in the above embodiments may be a physical structure or a logical structure, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by a plurality of physical entities, or some components in a plurality of independent devices may be implemented together.
In the above embodiments, the hardware unit may be implemented mechanically or electrically. For example, a hardware element may comprise permanently dedicated circuitry or logic (such as a dedicated processor, FPGA or ASIC) to perform the corresponding operations. The hardware elements may also comprise programmable logic or circuitry, such as a general purpose processor or other programmable processor, that may be temporarily configured by software to perform the corresponding operations. The specific implementation (mechanical, or dedicated permanent, or temporarily set) may be determined based on cost and time considerations.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other similar elements in a process, method, article, or apparatus that comprises the element.
While the invention has been shown and described in detail in the drawings and in the preferred embodiments, it is not intended to limit the invention to the embodiments disclosed, and it will be apparent to those skilled in the art that various combinations of the code auditing means in the various embodiments described above may be used to obtain further embodiments of the invention, which are also within the scope of the invention.
Claims (10)
1. The data exchange method based on the hybrid cloud is characterized by comprising the following steps:
according to a preset subscription mechanism, registering a data interface provided by a data provider as a data service, and configuring first configuration information of the data service, wherein the first configuration information comprises a source cloud identifier, a source system identifier and a data main body;
according to the subscription mechanism, registering a data consumption logic interface provided by a data consumer as a subscriber, and configuring second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service;
when any target data provided by any first data provider is monitored, determining each first subscriber capable of subscribing the target data according to each configured first configuration information and each configured second configuration information;
for each of the first subscribers, performing: and sending the target data to a first data consumer to which the current first subscriber belongs according to the second configuration information of the current first subscriber.
2. The method of claim 1,
after the target data is listened to, further comprising: caching the target data to a preset cache region;
after the sending the target data to the first data consumer to which the current first subscriber belongs, further comprising: receiving a subscription success notification for the target data returned by the first data consumer;
and deleting the target data from the cache region when determining that each first subscriber returns a subscription success notification for the target data.
3. The method of claim 2,
when the target data is monitored, the method further comprises the following steps: recording the current time as the timestamp of the target data;
for each data cached in the cache region, executing: and monitoring whether the caching duration of the current data reaches a preset duration or not in real time according to the timestamp of the current data, and if so, deleting the current data from the caching area.
4. The method according to claim 2 or 3,
the caching the target data to a preset cache region includes: and caching the target data to a preset cache region by adopting Kafka middleware.
5. Hybrid cloud-based data exchange apparatus, comprising:
the data service publishing module is used for registering a data interface provided by a data provider as a data service according to a preset subscription mechanism and configuring first configuration information of the data service, wherein the first configuration information comprises a source cloud identifier, a source system identifier and a data main body;
the data service subscription module is used for registering a data consumption logic interface provided by a data consumer as a subscriber according to the subscription mechanism and configuring second configuration information of the subscriber, wherein the second configuration information comprises a source cloud identifier, a source system identifier and a subscribed data service;
the data monitoring module is used for triggering the data publishing module when any first data provider is monitored to provide any target data;
the data publishing module is configured to determine each first subscriber that can subscribe to the target data according to the configured first configuration information and the second configuration information;
a data consumption module for performing, for each of the first subscribers: and sending the target data to a first data consumer to which the current first subscriber belongs according to the second configuration information of the current first subscriber.
6. The hybrid cloud based data exchange device of claim 5,
the data monitoring module is used for caching the target data to a preset cache region;
the data consumption module is used for receiving a subscription success notification aiming at the target data, which is returned by the first data consumption party; and deleting the target data from the cache region when determining that each first subscriber returns a subscription success notification for the target data.
7. The hybrid cloud based data exchange device of claim 6,
the data monitoring module is used for recording the current time as the timestamp of the target data when the target data is monitored;
the data consumption module is configured to, for each piece of data cached in the cache region, perform: and monitoring whether the caching duration of the current data reaches a preset duration or not in real time according to the timestamp of the current data, and if so, deleting the current data from the caching area.
8. The hybrid cloud based data exchange device of claim 6 or 7,
and the data monitoring module is used for caching the target data to a preset cache region by adopting Kafka middleware.
9. Hybrid cloud-based data exchange apparatus, comprising: at least one memory and at least one processor;
the at least one memory to store a machine readable program;
the at least one processor, configured to invoke the machine readable program to perform the method of any of claims 1 to 4.
10. Computer readable medium, characterized in that it has stored thereon computer instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010170388.5A CN111371621A (en) | 2020-03-12 | 2020-03-12 | Data exchange method and device based on hybrid cloud and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010170388.5A CN111371621A (en) | 2020-03-12 | 2020-03-12 | Data exchange method and device based on hybrid cloud and computer readable medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111371621A true CN111371621A (en) | 2020-07-03 |
Family
ID=71212329
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010170388.5A Pending CN111371621A (en) | 2020-03-12 | 2020-03-12 | Data exchange method and device based on hybrid cloud and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111371621A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111913821A (en) * | 2020-08-17 | 2020-11-10 | 武汉众邦银行股份有限公司 | Method for realizing cross-data-source real-time data stream production consumption |
| CN112468574A (en) * | 2020-11-25 | 2021-03-09 | 中国工商银行股份有限公司 | Processing method, device and system for application service publishing and subscribing mechanism |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102255934A (en) * | 2010-05-20 | 2011-11-23 | 中兴通讯股份有限公司 | Cloud service publishing method, cloud service publishing interface message packet and cloud service broker |
| CN103944924A (en) * | 2014-05-15 | 2014-07-23 | 重庆邮电大学 | Ubiquitous network publish-subscribe middleware model based on RESTful |
| US20160359964A1 (en) * | 2015-06-04 | 2016-12-08 | Oracle International Corporation | System and method for decoupling a source application from a target application in an integration cloud service |
| CN107038036A (en) * | 2017-05-02 | 2017-08-11 | 山东浪潮通软信息科技有限公司 | A kind of implementation method of SaaS delivery of services platform |
-
2020
- 2020-03-12 CN CN202010170388.5A patent/CN111371621A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102255934A (en) * | 2010-05-20 | 2011-11-23 | 中兴通讯股份有限公司 | Cloud service publishing method, cloud service publishing interface message packet and cloud service broker |
| CN103944924A (en) * | 2014-05-15 | 2014-07-23 | 重庆邮电大学 | Ubiquitous network publish-subscribe middleware model based on RESTful |
| US20160359964A1 (en) * | 2015-06-04 | 2016-12-08 | Oracle International Corporation | System and method for decoupling a source application from a target application in an integration cloud service |
| CN107038036A (en) * | 2017-05-02 | 2017-08-11 | 山东浪潮通软信息科技有限公司 | A kind of implementation method of SaaS delivery of services platform |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111913821A (en) * | 2020-08-17 | 2020-11-10 | 武汉众邦银行股份有限公司 | Method for realizing cross-data-source real-time data stream production consumption |
| CN112468574A (en) * | 2020-11-25 | 2021-03-09 | 中国工商银行股份有限公司 | Processing method, device and system for application service publishing and subscribing mechanism |
| CN112468574B (en) * | 2020-11-25 | 2022-10-18 | 中国工商银行股份有限公司 | Processing method, device and system for application service publishing and subscribing mechanism |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109636492B (en) | Tax administration method, device, medium and electronic equipment based on block chain system | |
| CN108449410B (en) | Message management method, system and related device in cloud platform | |
| US9274828B2 (en) | Systems and methods for event driven object management and distribution among multiple client applications | |
| CN102255933B (en) | Cloud service intermediary, cloud computing method and cloud system | |
| US8195742B2 (en) | Distributed client services based on execution of service attributes and data attributes by multiple nodes in resource groups | |
| JP7195684B2 (en) | Blockchain system data management method, device, computer program, and electronic device | |
| US9191236B2 (en) | Message broadcasting in a clustered computing environment | |
| US8761727B2 (en) | Method and apparatus for pre-caching in a telecommunication system | |
| CN109831501B (en) | Information distribution method and system based on block chain | |
| US20130159517A1 (en) | Sending synchronous responses to requests from frontend applications | |
| CN113329069B (en) | Instant messaging method, system and computing device | |
| CN101729491A (en) | Method, device and system for enhancing application reliability of script-based business | |
| CN111371621A (en) | Data exchange method and device based on hybrid cloud and computer readable medium | |
| CN115567251A (en) | Multi-service isolation method and system for micro-service cluster | |
| CN109558710B (en) | User login method, device, system and storage medium | |
| CN110750780A (en) | User role permission fusion method, device and equipment based on multi-service system | |
| CN113778499B (en) | Method, apparatus, device and computer readable medium for publishing services | |
| CN103685576A (en) | Interaction method for CDN (Content Delivery Network) nodes and CDN management system | |
| CN113840013B (en) | Document system for hierarchical management | |
| CN106559454B (en) | Resource access method, device and system | |
| KR20220006463A (en) | Apparatus and method for sharing resources of telecommunication subscribers for content service and rewarding telecommunication subscribers | |
| US20130254342A1 (en) | Method and system for edge server cache | |
| CN115086425B (en) | Message transmission method, device, program product, medium and electronic equipment | |
| CN115550439B (en) | Event management system and method | |
| CN114727239B (en) | Video short message processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200703 |
|
| RJ01 | Rejection of invention patent application after publication |