CN111552746A - Data synchronization method and device, electronic equipment and storage medium - Google Patents

Data synchronization method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN111552746A
CN111552746A CN202010361786.5A CN202010361786A CN111552746A CN 111552746 A CN111552746 A CN 111552746A CN 202010361786 A CN202010361786 A CN 202010361786A CN 111552746 A CN111552746 A CN 111552746A
Authority
CN
China
Prior art keywords
data
synchronized
adopting
loading
configuring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010361786.5A
Other languages
Chinese (zh)
Other versions
CN111552746B (en
Inventor
闫浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Si Tech Information Technology Co Ltd
Original Assignee
Beijing Si Tech Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Si Tech Information Technology Co Ltd filed Critical Beijing Si Tech Information Technology Co Ltd
Priority to CN202010361786.5A priority Critical patent/CN111552746B/en
Publication of CN111552746A publication Critical patent/CN111552746A/en
Application granted granted Critical
Publication of CN111552746B publication Critical patent/CN111552746B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/606Protecting data by securing the transmission between two devices or processes
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the application provides a data synchronization method and device, electronic equipment and a storage medium. The data synchronization method is applied to first terminal equipment, and comprises the following steps: acquiring encrypted data transmitted by second terminal equipment, wherein the encrypted data is generated by encrypting to-be-synchronized data by the second terminal equipment by adopting a preset encryption algorithm; decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized; configuring a preset loading script according to the model name; and configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized. The data synchronization method and the data synchronization device can improve data synchronization efficiency.

Description

Data synchronization method and device, electronic equipment and storage medium
Technical Field
The present application relates to the field of computer network technologies, and in particular, to a data synchronization method and apparatus, an electronic device, and a storage medium.
Background
With the continuous development of modern information technology, the world has spanned the internet + big data era. The communications industry has also seen increased demand for large data processing. The communication industry has a large user group, the related data is more, the data related systems are more and wider, a large amount of data interaction exists among different systems every day, a real-time interface can process real-time data, but in the aspect of big data, the real-time interface cannot be used with great care, most big data are transmitted and processed in a data mode at present, and the big data transmission has the current situations of no data monitoring, scattered synchronous programs, serious code coupling and no early warning. Under the condition, code decoupling, safe execution and failure early warning are urgently needed to be solved. And has the disadvantage of low synchronization efficiency.
In view of the above problems, no effective technical solution exists at present.
Disclosure of Invention
An object of the embodiments of the present application is to provide a data synchronization method, an apparatus, an electronic device, and a storage medium, which can achieve data synchronization efficiency.
In a first aspect, an embodiment of the present application provides a data synchronization method, which is applied to a first terminal device, and the method includes the following steps:
acquiring encrypted data transmitted by second terminal equipment, wherein the encrypted data is generated by encrypting to-be-synchronized data by the second terminal equipment by adopting a preset encryption algorithm;
decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized;
configuring a preset loading script according to the model name;
and configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized.
Optionally, in the data synchronization method according to the embodiment of the present application, the step of configuring a timing task at the crontab by using a configured preset loading script to load the data to be synchronized includes:
acquiring a type identifier of a database storing the data to be synchronized;
acquiring a corresponding target data import function according to the type identifier;
and configuring a timing task at the crontab by adopting the configured preset loading script, and loading the data to be synchronized into a database by adopting the target data import function.
Optionally, in the data synchronization method according to the embodiment of the present application, the step of obtaining the corresponding target data import function according to the type identifier includes:
if the database is an oracle database, adopting an sqlldr function as a target data import function;
and if the database is a mysql database, adopting a mysql-h function as a target data import function.
Optionally, in the data synchronization method according to the embodiment of the present application, when the data to be synchronized is loaded, the preset loading script is executed serially or concurrently.
Optionally, in the data synchronization method according to the embodiment of the present application, when the data to be synchronized is loaded, a data loading condition is monitored, and when abnormal data is monitored, a prompt message is generated.
Optionally, in the data synchronization method according to the embodiment of the present application, when acquiring encrypted data transmitted by a second terminal device, the second terminal device transmits the encrypted data in an sftp manner.
In a second aspect, an embodiment of the present application further provides a data synchronization apparatus, which is applied to a first terminal device, and the apparatus includes:
the acquisition module is used for acquiring encrypted data transmitted by second terminal equipment, and the encrypted data is generated by encrypting the data to be synchronized by the second terminal equipment by adopting a preset encryption algorithm;
the decryption module is used for decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized;
the configuration module is used for configuring a preset loading script according to the model name;
and the loading module is used for configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized.
Optionally, in the data synchronization apparatus according to an embodiment of the present application, the loading module includes:
the first acquisition unit is used for acquiring the type identifier of the database storing the data to be synchronized;
the second acquisition unit is used for acquiring a corresponding target data import function according to the type identifier;
and the loading unit is used for configuring a timing task at the crontab by adopting the configured preset loading script and loading the data to be synchronized into the database by adopting the target data import function.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, where the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the method as provided in the first aspect are executed.
In a fourth aspect, embodiments of the present application provide a storage medium, on which a computer program is stored, where the computer program, when executed by a processor, performs the steps in the method as provided in the first aspect.
As can be seen from the above, in the embodiment of the present application, by acquiring encrypted data transmitted by a second terminal device, the encrypted data is generated by encrypting to-be-synchronized data by the second terminal device using a preset encryption algorithm; decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized; configuring a preset loading script according to the model name; configuring a timing task at the crontab by adopting a configured preset loading script so as to load the data to be synchronized; therefore, the data to be synchronized can be quickly loaded, the loading efficiency of the data to be synchronized can be improved, and the centralized management of data transmission, loading and early warning is realized by adopting timing operation, so that the data transmission risk is reduced, and the safety is improved. The development work of the data synchronization program is reduced, the data loading efficiency is improved, and the cost is saved. And the maintenance cost is reduced, and the timeliness of exception handling is improved.
Additional features and advantages of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the present application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a flowchart of a data synchronization method according to an embodiment of the present application.
Fig. 2 is a schematic structural diagram of a data synchronization apparatus according to an embodiment of the present disclosure.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, fig. 1 is a flowchart illustrating a data synchronization method according to some embodiments of the present application. The data synchronization method is applied to a first terminal device, and the first terminal device is used for receiving data to be synchronized in a second terminal device. The method comprises the following steps:
s101, encrypted data transmitted by second terminal equipment are obtained, and the second terminal equipment of the encrypted data encrypts and generates to-be-synchronized data by adopting a preset encryption algorithm.
S102, decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized.
S103, configuring a preset loading script according to the model name.
And S104, configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized.
In step S101, before data transmission, the first terminal device configures a model of the data to be synchronized, where the model name is consistent with the type of the data to be synchronized. The second terminal device encrypts the data to be synchronized by using a preset encryption algorithm to obtain encrypted data, which may be symmetric encryption or asymmetric encryption. The second terminal device may transmit the encrypted data in an sftp manner.
In step S102, if the second terminal device adopts a symmetric encryption algorithm, the first terminal device may perform decryption by using a corresponding key. And when the second terminal device encrypts the data to be synchronized, the model names corresponding to the data to be synchronized are encrypted together and transmitted to the second terminal device together with the encrypted data. The model name may be arranged at the forefront of the encrypted data, that is, in the data after decrypting the encrypted data, the model name is obtained from a preset number of preceding data segments.
In step S103, different preset loading scripts are correspondingly used for the data to be synchronized of different categories, so that the data loading efficiency can be improved. Since different types of data to be synchronized have different model names, the preset loading script can be directly configured with parameters according to the model names.
In step S104, because different databases make it faster to load data using different functions, step S104 includes the following sub-steps: s1041, obtaining a type identifier of a database storing the data to be synchronized; s1042, acquiring a corresponding target data import function according to the type identifier; and S1043, configuring a timing task at the crontab by using the configured preset loading script, and loading the data to be synchronized into a database by using the target data import function. When data to be synchronized is loaded in an unix environment, if the database is an oracle database, an sqlldr function is used as a target data import function; and if the database is a mysql database, adopting a mysql-h function as a target data import function. The method has the advantages that the script is configured, code coupling is reduced, program different points are obtained in a configuration mode, the effect that data synchronization can be newly added by configuring the model name is achieved, development efficiency is improved, cost is reduced, and maintenance is facilitated.
Optionally, in the data synchronization method according to the embodiment of the present application, when the data to be synchronized is loaded, the preset loading script is executed serially or concurrently.
In some embodiments, when the data to be synchronized is loaded, the data loading condition is monitored, and when abnormal data is monitored, a reminding message is generated. Therefore, the abnormal conditions are timely processed, the data are timely loaded, and the influence on the service is avoided.
As can be seen from the above, in the embodiment of the present application, by acquiring encrypted data transmitted by a second terminal device, the encrypted data is generated by encrypting to-be-synchronized data by the second terminal device using a preset encryption algorithm; decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized; configuring a preset loading script according to the model name; configuring a timing task at the crontab by adopting a configured preset loading script so as to load the data to be synchronized; therefore, the data to be synchronized can be quickly loaded, the loading efficiency of the data to be synchronized can be improved, and the centralized management of data transmission, loading and early warning is realized by adopting timing operation, so that the data transmission risk is reduced, and the safety is improved. The development work of the data synchronization program is reduced, the data loading efficiency is improved, and the cost is saved. And the maintenance cost is reduced, and the timeliness of exception handling is improved.
Referring to fig. 2, fig. 2 is a structural diagram of a data synchronization apparatus in some embodiments of the present application. The data synchronization device is applied to first terminal equipment, and comprises: the device comprises an acquisition module 201, a decryption module 202, a configuration module 203 and a loading module 204.
The obtaining module 201 is configured to obtain encrypted data transmitted by a second terminal device, where the encrypted data is generated by encrypting data to be synchronized by the second terminal device using a preset encryption algorithm; before data transmission, the first terminal device configures the mode of the data to be synchronized, and the model name is consistent with the type of the data to be synchronized. The second terminal device encrypts the data to be synchronized by using a preset encryption algorithm to obtain encrypted data, which may be symmetric encryption or asymmetric encryption. The second terminal device may transmit the encrypted data in an sftp manner.
The decryption module 202 is configured to decrypt the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized; if the second terminal device adopts a symmetric encryption algorithm, the first terminal device can decrypt with the corresponding key. And when the second terminal device encrypts the data to be synchronized, the model names corresponding to the data to be synchronized are encrypted together and transmitted to the second terminal device together with the encrypted data. The model name may be arranged at the forefront of the encrypted data, that is, in the data after decrypting the encrypted data, the model name is obtained from a preset number of preceding data segments.
The configuration module 203 is configured to configure a preset loading script according to the model name; different types of data to be synchronized correspondingly adopt different preset loading scripts, so that the data loading efficiency can be improved. Since different types of data to be synchronized have different model names, the preset loading script can be directly configured with parameters according to the model names.
The loading module 204 is configured to configure a timing task at the crontab by using a configured preset loading script, so as to load the data to be synchronized. The loading module 204 includes: the first acquisition unit is used for acquiring the type identifier of the database storing the data to be synchronized; the second acquisition unit is used for acquiring a corresponding target data import function according to the type identifier; and the loading unit is used for configuring a timing task at the crontab by adopting the configured preset loading script and loading the data to be synchronized into the database by adopting the target data import function. Because different databases, it is faster to load data using different functions, this step S104 includes the following sub-steps: s1041, obtaining a type identifier of a database storing the data to be synchronized; s1042, acquiring a corresponding target data import function according to the type identifier; and S1043, configuring a timing task at the crontab by using the configured preset loading script, and loading the data to be synchronized into a database by using the target data import function. When data to be synchronized is loaded in an unix environment, if the database is an oracle database, an sqlldr function is used as a target data import function; and if the database is a mysql database, adopting a mysql-h function as a target data import function. The method has the advantages that the script is configured, code coupling is reduced, program different points are obtained in a configuration mode, the effect that data synchronization can be newly added by configuring the model name is achieved, development efficiency is improved, cost is reduced, and maintenance is facilitated.
Optionally, in the data synchronization method according to the embodiment of the present application, when the data to be synchronized is loaded, the preset loading script is executed serially or concurrently.
In some embodiments, when the data to be synchronized is loaded, the data loading condition is monitored, and when abnormal data is monitored, a reminding message is generated. Therefore, the abnormal conditions are timely processed, the data are timely loaded, and the influence on the service is avoided.
As can be seen from the above, the data synchronization apparatus provided in the embodiment of the present application obtains the encrypted data transmitted by the second terminal device, where the encrypted data is generated by encrypting the data to be synchronized by the second terminal device using the preset encryption algorithm; decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized; configuring a preset loading script according to the model name; configuring a timing task at the crontab by adopting a configured preset loading script so as to load the data to be synchronized; therefore, the data to be synchronized can be quickly loaded, the loading efficiency of the data to be synchronized can be improved, and the centralized management of data transmission, loading and early warning is realized by adopting timing operation, so that the data transmission risk is reduced, and the safety is improved. The development work of the data synchronization program is reduced, the data loading efficiency is improved, and the cost is saved. And the maintenance cost is reduced, and the timeliness of exception handling is improved.
Referring to fig. 3, fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure, where the present disclosure provides an electronic device 3, including: the processor 301 and the memory 302, the processor 301 and the memory 302 being interconnected and communicating with each other via a communication bus 303 and/or other form of connection mechanism (not shown), the memory 302 storing a computer program executable by the processor 301, the computer program being executable by the processor 301 when the computing device is running to perform the method in any of the alternative implementations of the above embodiments when the processor 301 executes the computer program to perform the following functions: acquiring encrypted data transmitted by second terminal equipment, wherein the encrypted data is generated by encrypting to-be-synchronized data by the second terminal equipment by adopting a preset encryption algorithm; decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized; configuring a preset loading script according to the model name; and configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized.
An embodiment of the present application provides a storage medium, and when being executed by a processor, the computer program performs a method in any optional implementation manner of the foregoing embodiment to implement the following functions:
acquiring encrypted data transmitted by second terminal equipment, wherein the encrypted data is generated by encrypting to-be-synchronized data by the second terminal equipment by adopting a preset encryption algorithm; decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized; configuring a preset loading script according to the model name; and configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized.
The storage medium may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as a Static Random Access Memory (SRAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), an Erasable Programmable Read-Only Memory (EPROM), a Programmable Read-Only Memory (PROM), a Read-Only Memory (ROM), a magnetic Memory, a flash Memory, a magnetic disk, or an optical disk.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (10)

1. A data synchronization method is applied to a first terminal device, and is characterized by comprising the following steps:
acquiring encrypted data transmitted by second terminal equipment, wherein the encrypted data is generated by encrypting to-be-synchronized data by the second terminal equipment by adopting a preset encryption algorithm;
decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized;
configuring a preset loading script according to the model name;
and configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized.
2. The data synchronization method according to claim 1, wherein the step of configuring a timing task at a crontab by using a configured preset loading script to load the data to be synchronized comprises:
acquiring a type identifier of a database storing the data to be synchronized;
acquiring a corresponding target data import function according to the type identifier;
and configuring a timing task at the crontab by adopting the configured preset loading script, and loading the data to be synchronized into a database by adopting the target data import function.
3. The data synchronization method according to claim 1, wherein the step of obtaining the corresponding target data import function according to the type identifier comprises:
if the database is an oracle database, adopting an sqlldr function as a target data import function;
and if the database is a mysql database, adopting a mysql-h function as a target data import function.
4. The data synchronization method according to claim 1, wherein when the data to be synchronized is loaded, the preset loading script is executed serially or concurrently.
5. The data synchronization method according to claim 1, wherein when the data to be synchronized is loaded, the data loading condition is monitored, and when abnormal data loading is monitored, a reminding message is generated.
6. The data synchronization method according to claim 1, wherein when acquiring the encrypted data transmitted by the second terminal device, the second terminal device transmits the encrypted data by using an sftp method.
7. A data synchronization apparatus applied to a first terminal device, the apparatus comprising:
the acquisition module is used for acquiring encrypted data transmitted by second terminal equipment, and the encrypted data is generated by encrypting the data to be synchronized by the second terminal equipment by adopting a preset encryption algorithm;
the decryption module is used for decrypting the encrypted data according to a decryption algorithm corresponding to the encryption algorithm to obtain data to be synchronized and a model name corresponding to the data to be synchronized;
the configuration module is used for configuring a preset loading script according to the model name;
and the loading module is used for configuring a timing task at the crontab by adopting the configured preset loading script so as to load the data to be synchronized.
8. The data synchronization apparatus of claim 7, wherein the loading module comprises:
the first acquisition unit is used for acquiring the type identifier of the database storing the data to be synchronized;
the second acquisition unit is used for acquiring a corresponding target data import function according to the type identifier;
and the loading unit is used for configuring a timing task at the crontab by adopting the configured preset loading script and loading the data to be synchronized into the database by adopting the target data import function.
9. An electronic device comprising a processor and a memory, said memory storing computer readable instructions which, when executed by said processor, perform the steps of the method of any of claims 1-6.
10. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, performs the steps of the method according to any one of claims 1-6.
CN202010361786.5A 2020-04-30 2020-04-30 Data synchronization method, device, electronic equipment and storage medium Active CN111552746B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010361786.5A CN111552746B (en) 2020-04-30 2020-04-30 Data synchronization method, device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010361786.5A CN111552746B (en) 2020-04-30 2020-04-30 Data synchronization method, device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111552746A true CN111552746A (en) 2020-08-18
CN111552746B CN111552746B (en) 2023-04-28

Family

ID=72001481

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010361786.5A Active CN111552746B (en) 2020-04-30 2020-04-30 Data synchronization method, device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111552746B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113268378A (en) * 2021-05-18 2021-08-17 Oppo广东移动通信有限公司 Data disaster tolerance method and device, storage medium and electronic equipment
CN114430343A (en) * 2022-01-21 2022-05-03 北京数字认证股份有限公司 Data synchronization method and device, electronic equipment and readable storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020021887A1 (en) * 2000-08-09 2002-02-21 Masato Yoshikawa Image reproduction system and data synchronization method
US6449638B1 (en) * 1998-01-07 2002-09-10 Microsoft Corporation Channel definition architecture extension
CN105867978A (en) * 2016-04-11 2016-08-17 平安科技(深圳)有限公司 OGG version deployment method and system
CN107908631A (en) * 2017-07-25 2018-04-13 平安科技(深圳)有限公司 Data processing method, device, storage medium and computer equipment
CN108958729A (en) * 2017-05-19 2018-12-07 腾讯科技(深圳)有限公司 A kind of data processing method, device and storage medium
CN109241760A (en) * 2018-09-28 2019-01-18 北京北信源信息安全技术有限公司 Data ciphering method, decryption method, encryption device and decryption device
CN110222122A (en) * 2019-07-26 2019-09-10 深圳市元征科技股份有限公司 A kind of method of data synchronization and relevant device of MongoDB
CN110245145A (en) * 2019-04-25 2019-09-17 深圳壹账通智能科技有限公司 Structure synchronization method and apparatus of the relevant database to Hadoop database
CN110321387A (en) * 2019-07-10 2019-10-11 中国联合网络通信集团有限公司 Method of data synchronization, equipment and terminal device
CN110543476A (en) * 2019-07-03 2019-12-06 威富通科技有限公司 Synchronization method and device of database table structure and server

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6449638B1 (en) * 1998-01-07 2002-09-10 Microsoft Corporation Channel definition architecture extension
US20020021887A1 (en) * 2000-08-09 2002-02-21 Masato Yoshikawa Image reproduction system and data synchronization method
CN105867978A (en) * 2016-04-11 2016-08-17 平安科技(深圳)有限公司 OGG version deployment method and system
CN108958729A (en) * 2017-05-19 2018-12-07 腾讯科技(深圳)有限公司 A kind of data processing method, device and storage medium
CN107908631A (en) * 2017-07-25 2018-04-13 平安科技(深圳)有限公司 Data processing method, device, storage medium and computer equipment
CN109241760A (en) * 2018-09-28 2019-01-18 北京北信源信息安全技术有限公司 Data ciphering method, decryption method, encryption device and decryption device
CN110245145A (en) * 2019-04-25 2019-09-17 深圳壹账通智能科技有限公司 Structure synchronization method and apparatus of the relevant database to Hadoop database
CN110543476A (en) * 2019-07-03 2019-12-06 威富通科技有限公司 Synchronization method and device of database table structure and server
CN110321387A (en) * 2019-07-10 2019-10-11 中国联合网络通信集团有限公司 Method of data synchronization, equipment and terminal device
CN110222122A (en) * 2019-07-26 2019-09-10 深圳市元征科技股份有限公司 A kind of method of data synchronization and relevant device of MongoDB

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
任开银;孔震;叶敏;: "通用数据交换系统架构设计与实现" *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113268378A (en) * 2021-05-18 2021-08-17 Oppo广东移动通信有限公司 Data disaster tolerance method and device, storage medium and electronic equipment
CN114430343A (en) * 2022-01-21 2022-05-03 北京数字认证股份有限公司 Data synchronization method and device, electronic equipment and readable storage medium
CN114430343B (en) * 2022-01-21 2023-12-01 北京数字认证股份有限公司 Data synchronization method and device, electronic equipment and readable storage medium

Also Published As

Publication number Publication date
CN111552746B (en) 2023-04-28

Similar Documents

Publication Publication Date Title
CN108600029B (en) Configuration file updating method and device, terminal equipment and storage medium
CN108234170B (en) Monitoring method and device for server cluster
CN107704360B (en) Monitoring data processing method, equipment, server and storage medium
CN110493080B (en) Block link point monitoring method and device, electronic equipment and storage medium
CN107729213B (en) Background task monitoring method and device
CN105095056A (en) Method for monitoring data in data warehouse
US9519537B2 (en) Apparatus, system and method for application log data processing
CN111563016A (en) Log collection and analysis method and device, computer system and readable storage medium
CN111934920A (en) Monitoring alarm method, device, equipment and storage medium
CN111552746A (en) Data synchronization method and device, electronic equipment and storage medium
CN112527484A (en) Workflow breakpoint continuous running method and device, computer equipment and readable storage medium
CN111654522A (en) File synchronization method, file synchronization server and storage medium
CN111782456B (en) Anomaly detection method, device, computer equipment and storage medium
CN108376154B (en) System base table synchronization method and device, computer equipment and storage medium
CN117608825A (en) Resource management method based on multi-cloud management platform and related equipment
CN105303103A (en) Method for protecting service process in mobile terminal and mobile terminal
CN112631866A (en) Server hardware state monitoring method and device, electronic equipment and medium
CN104168126A (en) Self-maintenance and management system and method for unattended intelligent device
CN115248826A (en) Method and system for large-scale distributed graph database cluster operation and maintenance management
CN112099878A (en) Application software configuration management method, device and system
CN102890486A (en) Center boiler remote monitoring system and control method thereof
CN113094053A (en) Product delivery method and device and computer storage medium
CN114157613A (en) Data reporting method, gateway, server, electronic device and storage medium
CN113704037A (en) Equipment testing method and device, computer equipment and storage medium
CN113031997A (en) Upgrade package generation and management method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant