CN110727736A - Data synchronization method and device, electronic equipment and storage medium - Google Patents
Data synchronization method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110727736A CN110727736A CN201911016526.8A CN201911016526A CN110727736A CN 110727736 A CN110727736 A CN 110727736A CN 201911016526 A CN201911016526 A CN 201911016526A CN 110727736 A CN110727736 A CN 110727736A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- receiver
- provider
- target data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000005540 biological transmission Effects 0.000 claims abstract description 51
- 238000012545 processing Methods 0.000 claims description 29
- 238000004806 packaging method and process Methods 0.000 claims description 10
- 238000012546 transfer Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 230000015654 memory Effects 0.000 description 16
- 230000008569 process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 6
- 230000003993 interaction Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 4
- 230000002688 persistence Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000002085 persistent effect Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a data synchronization method, a data synchronization device, electronic equipment and a storage medium, wherein the method comprises the following steps: receiving target data sent by a data provider, and determining a data identifier of the target data; determining a target receiver of the target data by using the data identifier of the target data and a corresponding relation between a pre-configured data identifier and a data receiver; and actively synchronizing the target data to the target receiver by using the same data transmission mode as that of the target data sent by the data provider. The embodiment of the invention can actively synchronize data to the data receiver on the premise of not sending a data acquisition request to the data receiver, thereby improving the data synchronization efficiency.
Description
Technical Field
The embodiment of the invention relates to the technical field of data processing, in particular to a data synchronization method, a data synchronization device, electronic equipment and a storage medium.
Background
The data exchange platform is an information exchange platform constructed by integrating data of scattered application information systems and a computer network, so that a plurality of application information systems transmit and share data, the utilization rate of data resources is improved, the basic goal of digital construction is achieved, interconnection and intercommunication among distributed heterogeneous systems are guaranteed, extraction, concentration, processing and display of data are completed, and unified data exchange and processing are constructed.
Generally, in a distributed heterogeneous system, data synchronization between a data provider and a data receiver is implemented based on a data request and a request response, that is, the data receiver needs to send a data acquisition request to the data provider through a data exchange platform, and after the request is responded by the data provider, the data receiver can acquire required data, which is not favorable for improving data synchronization efficiency.
Disclosure of Invention
Embodiments of the present invention provide a data synchronization method and apparatus, an electronic device, and a storage medium, so as to actively synchronize data to a data receiver without sending a data acquisition request by the data receiver, thereby improving data synchronization efficiency.
In a first aspect, an embodiment of the present invention provides a data synchronization method, where the method includes:
receiving target data sent by a data provider, and determining a data identifier of the target data;
determining a target receiver of the target data by using the data identifier of the target data and a corresponding relation between a pre-configured data identifier and a data receiver;
and actively synchronizing the target data to the target receiver by using the same data transmission mode as that of the target data sent by the data provider.
In a second aspect, an embodiment of the present invention further provides a data synchronization apparatus, where the apparatus includes:
the data receiving module is used for receiving target data sent by a data provider and determining a data identifier of the target data;
the data receiver determining module is used for determining a target receiver of the target data by using the data identifier of the target data and the corresponding relation between the pre-configured data identifier and the data receiver;
and the data synchronization module is used for actively synchronizing the target data to the target receiver by using the same data transmission mode as that of the target data sent by the data provider.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a data synchronization method as in any embodiment of the invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data synchronization method according to any embodiment of the present invention.
The embodiment of the invention determines the target receiver of the target data by utilizing the corresponding relation between the data identification and the data receiver, and actively synchronizes the target data to the target receiver, thereby solving the problem of low data synchronization efficiency caused by the need of sending a data acquisition request to a data provider by the data receiver in the data synchronization process in the prior art, realizing the effect of actively synchronizing the data to the data receiver on the premise of not sending the data acquisition request by the data receiver, and improving the data synchronization efficiency.
Drawings
FIG. 1 is a flow chart of a data synchronization method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an overall architecture of a data synchronization method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a data synchronization method according to a second embodiment of the present invention;
FIG. 4 is a flow chart of another data synchronization method disclosed in the second embodiment of the present invention;
fig. 5 is a schematic structural diagram of a data synchronization apparatus according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a data synchronization method disclosed in an embodiment of the present invention, where the embodiment is applicable to a data synchronization scenario between a data provider and a data receiver, and the synchronized data includes any updated data that is changed in a manner of adding, deleting, modifying, and the like. The data provider refers to a source data system that generates update data, the data receiver refers to a target system that has a demand for using data provided by the source data system, the data provider and the data receiver may be different modules integrated on the same electronic device, or different modules integrated on different electronic devices, or the data provider and the data receiver refer to different electronic devices, which is not limited in this embodiment. For example, in a bank asset management business, a data provider may refer to a source data storage module related to asset management, and a data receiver may refer to a data management module that analyzes and visually displays source data related to assets.
The data synchronization method disclosed in this embodiment may be executed by a data synchronization apparatus, which may be implemented in a software and/or hardware manner, and may be integrated on the same electronic device as at least one of a data provider and a data receiver, and the data synchronization apparatus may refer to a data exchange platform or a functional module integrated in the data exchange platform, and is configured to forward, store, or analyze and process synchronization data based on a service requirement during data synchronization between the data provider and the data receiver.
As shown in fig. 1, the data synchronization method disclosed in this embodiment may include:
s110, receiving target data sent by a data provider, and determining a data identifier of the target data.
When the data provider detects that the source data changes, for example, a user updates the source data through operations such as addition, deletion, modification and the like, the data provider can trigger data synchronization operation to the data receiver, and adopt a corresponding data transmission mode according to the type of target data, wherein the target data is data required to be synchronized. If the type of the target data belongs to single data, namely the data volume is small in each data synchronization process, real-time synchronization can be realized among a data provider, a data receiver and a data synchronization device by using a message publishing and subscribing mechanism; if the type of the target data belongs to batch data, namely the data volume is large in each data synchronization process, the target data can be sent periodically or at regular time by using a file transmission mechanism between the data provider and the data synchronization device, and can be sent in real time by using the file transmission mechanism between the data synchronization device and the data receiver, so that the data synchronization between the data receiver and the data provider is realized.
The data provider transmits the target data in real time or periodically, and the data provider is related to a specific service logic, and the embodiment is not particularly limited.
S120, determining a target receiver of the target data by using the data identifier of the target data and the corresponding relation between the pre-configured data identifier and the data receiver.
In the process of sending the target data to the data synchronization device from the data receiving side, the data identifier of the target data can be carried in the target data and sent together, and the data identifier of the target data can be used for indicating a data receiving side of the target data, namely the target receiving side. The data synchronization device can determine the data identifier carried in the target data by analyzing the target data. In this embodiment, the data synchronization device can perform data interaction with multiple data providers and multiple data receivers simultaneously, implement distributed data services, and is compatible with different data systems, so that the data receivers corresponding to different target data can be determined according to the data identifier, on one hand, distributed data synchronization can be implemented, and on the other hand, data synchronization errors can be avoided. For example, the target data includes a data table a and a data table B, the data table a and the data table B correspond to different data receiving parties respectively, and after receiving the data table a and the data table B, the data synchronization device determines the corresponding data receiving party accurately according to the data identifier.
And S130, actively synchronizing the target data to the target receiver by using the same data transmission mode as that of the target data sent by the data provider.
The data transmission mode adopted by the data provider when the data provider sends the target data to the data synchronization device is determined by the data provider according to the type of single data or batch data of the target data, and after the data transmission mode is determined, the data synchronization device still adopts the same data transmission mode to synchronize the target data to the data receiver in the subsequent data synchronization process, so that the phenomena of data format damage, data loss and the like in the data synchronization process can be avoided.
Optionally, the method of this embodiment further includes: and according to the service requirement of the target receiver, performing processing operation matched with the service requirement on the target data, and storing a processing result, so that the processing result is fed back to the target receiver or the data provider according to a processing result acquisition request of the target receiver or the data provider. The data synchronization device can support data persistence storage based on oracle, mysql, hbase and other databases. The data synchronization device is used for correspondingly processing the target data, so that the data processing pressure of a data receiving party can be relieved, and meanwhile, when the data receiving party and the data providing party both have the requirement for acquiring the processing result, the secondary processing of the data receiving party and the data providing party on the target data can be avoided.
According to different service requirements of the target receiving party, the matched processing operation may be adaptively determined, and the embodiment is not particularly limited. For example, in a banking system, a data synchronization device or a data exchange platform will ultimately serve the report presentation and asset search of an asset management platform, and thus, the data synchronization device or the data exchange platform may be divided into two categories in the data processing aspect: under the condition that the first type of report shows services, a data processing model is defined in advance, and the data processing model aims at processing logic and storage of target data based on report dimensions and indexes; in the case of the second type asset search, another data processing model is defined in advance, which is directed to processing logic and storage of target data based on indexes and data maps. Fig. 2 shows, as an example, an overall architecture schematic diagram of a data synchronization method in an embodiment of the present invention, and as shown in fig. 2, the data receiving party, the data interaction platform, and the data providing party are respectively configured to execute different functional operations, and implement data synchronization between the data providing party and the data receiving party through data interaction among the three. The control interface file in the data provider is used for defining a communication interface which needs to be called in the data interaction process between the data provider and the data exchange platform.
According to the technical scheme, the target receiving party of the target data is determined by utilizing the corresponding relation between the data identification and the data receiving party, and the target data is actively synchronized to the target receiving party, so that the problem that the data synchronization efficiency is low due to the fact that the data receiving party needs to send a data acquisition request to a data providing party in the data synchronization process in the prior art is solved, the effect of actively synchronizing the data to the data receiving party on the premise that the data receiving party does not need to send the data acquisition request is achieved, and the data synchronization efficiency is improved.
Example two
Fig. 3 is a flowchart of a data synchronization method disclosed in the second embodiment of the present invention, and this embodiment is further optimized based on the above embodiments and can be combined with various alternatives in the above embodiments. As shown in fig. 3, the method may include:
and S210, if the target data is single data, receiving the target data sent by the data provider in a message form in real time through the message middleware.
In this embodiment, different data transmission modes, such as a data transmission mode based on a message middleware and a data transmission mode based on a file transmission middleware, may be deployed in advance among the data synchronization device, the data provider, and the data receiver based on the type of the synchronization data provided by the data provider, such as single data or batch data, and a corresponding data transmission mode may be invoked according to a target data type.
The message middleware is a data transfer sub-module realized based on a message publishing and subscribing mechanism, and can realize real-time data synchronization between a data receiver and a data provider. Regarding the deployment of the message middleware, any available manner in the prior art that supports the receiving and sending of the synchronization message may be adopted, and the embodiment is not particularly limited, for example, the implementation may be realized by using a distributed publish-subscribe message system based on a card (Apache Kafka), where a data provider corresponds to a message generator, a data receiver corresponds to a message consumer, and a data synchronization device corresponds to a service agent of the message.
And S220, if the target data is batch data, periodically receiving the target data sent by the data provider in a file form through the file transmission middleware.
The file transfer middleware is a data transfer submodule for implementing data transfer in a file form, and may be implemented based on a set transfer protocol, for example, may be implemented by using a web service architecture based on a hypertext transfer protocol (HTTP), such as a REST service architecture.
And S230, determining the data identification of the target data. The data synchronization device can determine the data identifier carried in the target data by analyzing the target data.
S240, determining the target receiver of the target data by using the data identifier of the target data and the corresponding relation between the pre-configured data identifier and the data receiver.
And S250, actively synchronizing the target data to the target receiver by using a data transmission mode based on the message middleware. The operation proceeds from operation S210 through operations S230-S240.
And S260, actively synchronizing the target data to the target receiver by using a data transmission mode based on the file transmission middleware. The operation proceeds from operation S220 through operations S230-S240.
Namely, the data synchronization device actively synchronizes the target data to the target receiving party by using the same data transmission mode as that of the target data sent by the data providing party. Further, actively synchronizing the target data to the target receiving party by using the same data transmission mode as that of the target data sent by the data provider comprises: packaging the target data according to a data packaging format corresponding to a data transmission mode of the target data sent by a data provider; and actively synchronizing the encapsulated target data to a target receiver by using a data transmission mode. For example, for a data transmission mode based on message middleware, the data synchronization device may encapsulate target data in a predefined message format, where the message format may be a JSON serialization format; for the data transmission mode based on the file transmission middleware, the data synchronization device may package the target data in a predefined file format, where the file format may be a format in which each piece of data in the file is isolated and packaged by a separator. And the integrity of the target data in the data synchronization process can be ensured by data encapsulation in a reasonable mode.
Fig. 4 is a flowchart illustrating another data synchronization method provided in the present embodiment as an example. Taking a data synchronization device as a data exchange platform as an example, as shown in fig. 4, for a single piece of data, such as a single piece of data detail, data synchronization can be realized by using a distributed message middleware, the data exchange platform packages and sends the data according to a predefined message format to target data sent by a data provider, a data receiving toolkit (SDK) integrated in a data receiver receives and automatically analyzes the message, and then the data receiver automatically stores the target data in a persistent manner; for batch data, file transmission middleware can be adopted to realize data synchronization, a data exchange platform encapsulates and sends target data sent by a data provider according to a predefined file format, a data receiving tool kit (SDK) integrated in a data receiver receives messages and automatically analyzes the messages, and then the data receiver automatically stores the target data in a persistent mode. The data persistence storage supported by the data receiver comprises storage based on databases of oracle, mysql, hbase and the like. The data receiver automatically completes the analysis and storage of the target data, and the system research and development cost of the data receiver can be reduced.
The data synchronization strategy is stored in the data exchange platform, and after the data receiving party and the data transmission mode are determined, the target data are forwarded to the data receiving party, wherein the data persistence mode, the interface implementation class, the persistence SQL statement and the like can be transmitted to the data receiving party together with the target data, so that the data receiving toolkit integrated in the data receiving party can perform corresponding logic processing.
According to the technical scheme, real-time synchronization of single data is achieved by using the message middleware, periodic synchronization of batch data is achieved by using the file transmission middleware, a data synchronization mode is expanded, the effect of actively synchronizing data to a data receiver is achieved on the premise that the data receiver does not need to send a data acquisition request, and the data synchronization efficiency is improved.
EXAMPLE III
Fig. 5 is a schematic structural diagram of a data synchronization apparatus according to a third embodiment of the present invention, where the present embodiment is applicable to a data synchronization scenario between a data provider and a data receiver, and the synchronization data includes any updated data that is changed in a manner of adding, deleting, modifying, and the like.
The data synchronization device disclosed in this embodiment may be implemented in software and/or hardware, and may be integrated on the same electronic device as at least one of the data provider and the data receiver, and the data synchronization device may refer to a data exchange platform, or a functional module integrated in the data exchange platform, and is configured to transfer, store, or analyze and process the synchronization data based on a service requirement during data synchronization between the data provider and the data receiver.
As shown in fig. 5, the data synchronization apparatus disclosed in this embodiment may include a data receiving module 310, a data receiving party determining module 320, and a data synchronization module 330, wherein:
the data receiving module 310 is configured to receive target data sent by a data provider, and determine a data identifier of the target data;
a data receiving party determining module 320, configured to determine a data receiving party of the target data by using the data identifier of the target data and a pre-configured correspondence between the data identifier and the data receiving party;
and the data synchronization module 330 is configured to actively synchronize the target data to the target recipient by using the same data transmission manner as that in which the data provider sends the target data.
Optionally, the data receiving module 310 includes:
the first data receiving unit is used for receiving the target data sent by the data provider in a message form in real time through message middleware if the target data is single data;
the second data receiving unit is used for periodically receiving the target data sent by the data provider in a file form through the file transmission middleware if the target data is batch data;
accordingly, the data synchronization module 330 is configured to:
and actively synchronizing the target data to a target receiver by using a data transmission mode based on message middleware or a data transmission mode based on file transmission middleware.
Optionally, the data synchronization module 330 includes:
the data packaging unit is used for packaging the target data according to a data packaging format corresponding to a data transmission mode of the target data sent by the data provider;
and the encapsulated data synchronization unit is used for actively synchronizing the encapsulated target data to a target receiver by utilizing a data transmission mode.
Optionally, the apparatus of this embodiment further includes:
and the data processing module is used for executing processing operation matched with the service requirement on the target data according to the service requirement of the target receiver and storing a processing result.
The data synchronization device disclosed by the embodiment of the invention can execute the data synchronization method disclosed by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. Details not described in detail in this embodiment may refer to the description in the above method embodiment.
Example four
The embodiment of the application also provides the electronic equipment and the readable storage medium.
Fig. 6 is a block diagram of an electronic device used in the data synchronization method according to the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of embodiments of the present application described and/or claimed herein.
As shown in fig. 6, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display Graphical information for a Graphical User Interface (GUI) on an external input/output device, such as a display device coupled to the Interface. In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations, e.g., as a server array, a group of blade servers, or a multi-processor system. In fig. 6, one processor 601 is taken as an example.
The memory 602 is a non-transitory computer readable storage medium provided by the embodiments of the present application. The memory stores instructions executable by at least one processor, so that the at least one processor executes the data synchronization method provided by the embodiment of the application. The non-transitory computer readable storage medium of the embodiments of the present application stores computer instructions for causing a computer to perform the data synchronization method provided by the embodiments of the present application.
The memory 602, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the data synchronization method in the embodiment of the present application, for example, the data receiving module 310, the data receiving party determining module 320, and the data synchronization module 330 shown in fig. 5. The processor 601 executes various functional applications of the server and data processing by running non-transitory software programs, instructions, and modules stored in the memory 602, that is, implementing the data synchronization method in the above method embodiments.
The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of an electronic device for implementing the data synchronization method in the embodiment of the present application, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory located remotely from the processor 601, and these remote memories may be connected via a network to an electronic device for implementing the data synchronization method of the embodiments of the present application. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device for implementing the data synchronization method in the embodiment of the present application may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and fig. 6 illustrates the connection by a bus as an example.
The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of an electronic apparatus for implementing the data synchronization method in the embodiments of the present application, such as an input device of a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or the like. The output device 604 may include a display device, an auxiliary lighting device such as a Light Emitting Diode (LED), a tactile feedback device, and the like; the tactile feedback device is, for example, a vibration motor or the like. The Display device may include, but is not limited to, a Liquid Crystal Display (LCD), an LED Display, and a plasma Display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, Integrated circuitry, Application Specific Integrated Circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs, also known as programs, software applications, or code, include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or Device for providing machine instructions and/or data to a Programmable processor, such as a magnetic disk, optical disk, memory, Programmable Logic Device (PLD), including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device for displaying information to a user, for example, a Cathode Ray Tube (CRT) or an LCD monitor; and a keyboard and a pointing device, such as a mouse or a trackball, by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front-end component, e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here, or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method of data synchronization, comprising:
receiving target data sent by a data provider, and determining a data identifier of the target data;
determining a target receiver of the target data by using the data identifier of the target data and a corresponding relation between a pre-configured data identifier and a data receiver;
and actively synchronizing the target data to the target receiver by using the same data transmission mode as that of the target data sent by the data provider.
2. The method of claim 1, wherein receiving the target data from the data provider comprises:
if the target data is single data, receiving the target data sent by the data provider in a message form in real time through message middleware;
if the target data is batch data, periodically receiving the target data sent by the data provider in a file form through file transmission middleware;
correspondingly, the data transmission mode which is the same as that of the data provider for sending the target data comprises the following steps:
and the data transmission mode is based on the message middleware or the data transmission mode of the file transmission middleware.
3. The method of claim 1, wherein actively synchronizing the targeted data to the targeted recipient using the same data transfer as the data provider sent the targeted data comprises:
packaging the target data according to a data packaging format corresponding to a data transmission mode of the target data sent by the data provider;
and actively synchronizing the encapsulated target data to the target receiver by utilizing the data transmission mode.
4. The method of claim 1, further comprising:
and according to the service requirement of the target receiver, executing processing operation matched with the service requirement on the target data, and storing a processing result.
5. A data synchronization apparatus, comprising:
the data receiving module is used for receiving target data sent by a data provider and determining a data identifier of the target data;
the data receiver determining module is used for determining a target receiver of the target data by using the data identifier of the target data and the corresponding relation between the pre-configured data identifier and the data receiver;
and the data synchronization module is used for actively synchronizing the target data to the target receiver by using the same data transmission mode as that of the target data sent by the data provider.
6. The apparatus of claim 5, wherein the data receiving module comprises:
the first data receiving unit is used for receiving the target data sent by the data provider in a message form in real time through message middleware if the target data is single data;
the second data receiving unit is used for periodically receiving the target data sent by the data provider in a file form through file transmission middleware if the target data is batch data;
correspondingly, the data synchronization module is configured to:
and actively synchronizing the target data to the target receiver by using a data transmission mode based on the message middleware or a data transmission mode based on the file transmission middleware.
7. The apparatus of claim 5, wherein the data synchronization module comprises:
the data packaging unit is used for packaging the target data according to a data packaging format corresponding to a data transmission mode of the target data sent by the data provider;
and the encapsulated data synchronization unit is used for actively synchronizing the encapsulated target data to the target receiver by utilizing the data transmission mode.
8. The apparatus of claim 5, further comprising:
and the data processing module is used for executing processing operation matched with the service requirement on the target data according to the service requirement of the target receiver and storing a processing result.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the data synchronization method of any of claims 1-4.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of backing up multimedia data according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911016526.8A CN110727736A (en) | 2019-10-24 | 2019-10-24 | Data synchronization method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911016526.8A CN110727736A (en) | 2019-10-24 | 2019-10-24 | Data synchronization method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110727736A true CN110727736A (en) | 2020-01-24 |
Family
ID=69223090
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911016526.8A Pending CN110727736A (en) | 2019-10-24 | 2019-10-24 | Data synchronization method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110727736A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187916A (en) * | 2020-09-27 | 2021-01-05 | 中国银联股份有限公司 | Cross-system data synchronization method and device |
| CN115967754A (en) * | 2022-12-26 | 2023-04-14 | 杭州和利时自动化有限公司 | Industrial data acquisition method, device, equipment and storage medium |
| CN117033087A (en) * | 2023-10-10 | 2023-11-10 | 武汉吧哒科技股份有限公司 | Data processing method, device, storage medium and management server |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106993041A (en) * | 2017-04-01 | 2017-07-28 | 国网福建省电力有限公司 | A kind of power marketing moves work data synchronous method |
| CN109815028A (en) * | 2018-12-27 | 2019-05-28 | 北京摩拜科技有限公司 | Data synchronous system, method, apparatus and computer storage medium |
-
2019
- 2019-10-24 CN CN201911016526.8A patent/CN110727736A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106993041A (en) * | 2017-04-01 | 2017-07-28 | 国网福建省电力有限公司 | A kind of power marketing moves work data synchronous method |
| CN109815028A (en) * | 2018-12-27 | 2019-05-28 | 北京摩拜科技有限公司 | Data synchronous system, method, apparatus and computer storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112187916A (en) * | 2020-09-27 | 2021-01-05 | 中国银联股份有限公司 | Cross-system data synchronization method and device |
| CN112187916B (en) * | 2020-09-27 | 2023-12-05 | 中国银联股份有限公司 | Cross-system data synchronization method and device |
| CN115967754A (en) * | 2022-12-26 | 2023-04-14 | 杭州和利时自动化有限公司 | Industrial data acquisition method, device, equipment and storage medium |
| CN117033087A (en) * | 2023-10-10 | 2023-11-10 | 武汉吧哒科技股份有限公司 | Data processing method, device, storage medium and management server |
| CN117033087B (en) * | 2023-10-10 | 2024-01-19 | 武汉吧哒科技股份有限公司 | Data processing method, device, storage medium and management server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111858248B (en) | Application monitoring method, device, equipment and storage medium | |
| CN111741026B (en) | Cross-chain transaction request processing method, device, equipment and storage medium | |
| CN110727736A (en) | Data synchronization method and device, electronic equipment and storage medium | |
| CN111586128B (en) | Method, device, equipment and storage medium for acquiring applet data | |
| CN111694857B (en) | Method, device, electronic equipment and computer readable medium for storing resource data | |
| EP3836484A2 (en) | Method for transmitting live message, apparatus, electronic device, medium and computer program product | |
| CN113162848B (en) | Method, device, gateway and medium for realizing block chain gateway | |
| CN111966651A (en) | Data synchronization method and device, electronic equipment and storage medium | |
| EP3816802A2 (en) | Method and device for processing mini program data | |
| US11711285B2 (en) | Method, apparatus, electronic device and readable storage medium for adjusting instance number | |
| US20220247702A1 (en) | Mail processing method and apparatus, device and medium | |
| CN111367635A (en) | Method, apparatus, device and medium for implementing application interface in host platform layer | |
| CN113285866A (en) | Information sending method and device and electronic equipment | |
| CN111610972A (en) | Page generation method, device, equipment and storage medium | |
| US11783565B2 (en) | Image processing method, electronic device and readable storage medium for maintaining a face image buffer queue | |
| CN110517079B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN110659184B (en) | Health state checking method, device and system | |
| CN111555894A (en) | Data processing method, device, equipment and storage medium | |
| CN112069137A (en) | Method and device for generating information, electronic equipment and computer readable storage medium | |
| CN113051510B (en) | Interactive processing method, device, front-end equipment, back-end equipment and storage medium | |
| US11277300B2 (en) | Method and apparatus for outputting information | |
| CN115361382A (en) | Data processing method, device, equipment and storage medium based on data group | |
| CN113891441A (en) | Network connection method and device and electronic equipment | |
| CN112489659A (en) | Data processing method, system, server and terminal equipment based on input method | |
| CN112035279B (en) | Service calling method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220919 Address after: 25 Financial Street, Xicheng District, Beijing 100033 Applicant after: CHINA CONSTRUCTION BANK Corp. Address before: 25 Financial Street, Xicheng District, Beijing 100033 Applicant before: CHINA CONSTRUCTION BANK Corp. Applicant before: Jianxin Financial Science and Technology Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200124 |