WO2021082104A1 - Procédé et appareil de migration de données, dispositif informatique et support de stockage - Google Patents

Procédé et appareil de migration de données, dispositif informatique et support de stockage Download PDF

Info

Publication number
WO2021082104A1
WO2021082104A1 PCT/CN2019/119566 CN2019119566W WO2021082104A1 WO 2021082104 A1 WO2021082104 A1 WO 2021082104A1 CN 2019119566 W CN2019119566 W CN 2019119566W WO 2021082104 A1 WO2021082104 A1 WO 2021082104A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
time
migration
designated
migrated
Prior art date
Application number
PCT/CN2019/119566
Other languages
English (en)
Chinese (zh)
Inventor
罗国强
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2021082104A1 publication Critical patent/WO2021082104A1/fr

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/214Database migration support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • This application relates to the field of data processing technology, and in particular to a data migration method, device, computer equipment, and storage medium.
  • the common method of data migration includes the following steps: 1) Set the target database for receiving the data to be migrated in the target server; 2) Read the information of all the objects to be migrated in the source database, and analyze all the objects to be migrated 3) According to the order of the dependency relationship, perform object creation and data loading in the target database.
  • this method needs to read out the information of all the objects to be migrated in the source database before performing object creation and data loading in the target database.
  • the data migration process when performing a read operation to read the information of all the objects to be migrated, if the objects to be migrated are massive data, there will be a lot of content to be queried, which may easily lead to time-consuming read operations. .
  • the speed of reading information will become slower and slower, resulting in subsequent object creation and data loading unable to start for a long time, which seriously affects the efficiency of data migration and the migration experience of users.
  • the main purpose of this application is to provide a data migration method, device, computer equipment, and storage medium. It aims to solve the problem that the existing data migration method needs to read all the information of the object to be migrated in the source database before the target. The creation of execution objects and the loading of data in the database seriously affect the efficiency of data migration and the technical problems of the user's migration experience.
  • this application proposes a data migration method, which includes the steps:
  • the data to be migrated are sequentially queried out of the data to be migrated in the same quantity as the specified number of designated data to be migrated.
  • the designated data is migrated to the target database through a preset number of designated migration servers, and so on, until all the data to be migrated in the source database is migrated to the target database.
  • This application also provides a data migration device, including:
  • the first acquisition module is configured to acquire the first time corresponding to the first piece of data in the source database to be migrated, and the second time corresponding to the last piece of data in the data to be migrated, where the first time is The time when the first piece of data was entered into the source database, and the second time is the time when the last piece of data was entered into the source database;
  • a splitting module configured to split the time period between the first time and the second time according to a first preset rule to obtain multiple corresponding time segments
  • the determining module is configured to determine the designated migration quantity corresponding to the designated time segment according to the second preset rule, wherein the designated time segment is any one of the multiple time segments;
  • the query module is used to query the data to be migrated according to the sequence of the time when each piece of data in the data to be migrated is respectively entered into the source database, and query the data to be migrated in turn to find out that the quantity is the same as the specified number of migrations Of multiple specified data;
  • the migration module is configured to migrate the designated data to the target database through a preset number of designated migration servers, and so on, until all the data to be migrated in the source database is migrated to the target database.
  • the present application provides a computer device including a memory and a processor.
  • the memory stores computer-readable instructions, and the processor implements the steps of the above method when the computer-readable instructions are executed by the processor.
  • the present application also provides a computer-readable storage medium on which computer-readable instructions are stored, and when the computer-readable instructions are executed by a processor, the steps of the foregoing method are implemented.
  • each time segment is executed.
  • each time segment can be intelligently allocated a specified number of designated data for migration for migration, and then a preset number of designated migration servers can be called to achieve rapid migration of designated data in the data to be migrated , Which effectively reduces the time spent in the data migration process, reduces the cost of data migration, and improves the efficiency of the migration server.
  • FIG. 1 is a schematic flowchart of a data migration method according to an embodiment of the present application
  • FIG. 2 is a schematic structural diagram of a data migration device according to an embodiment of the present application.
  • Fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present application.
  • a data migration method includes:
  • S1 Obtain the first time corresponding to the first piece of data of the data to be migrated in the source database, and the second time corresponding to the last piece of data of the data to be migrated, where the first time is the first piece of data The time entered into the source database, and the second time is the time when the last piece of data was entered into the source database;
  • S3 Determine the designated migration quantity corresponding to the designated time segment according to the second preset rule, where the designated time segment is any one of the multiple time segments;
  • S5 Migrate the designated data to the target database through a preset number of designated migration servers, and so on, until all the data to be migrated in the source database is migrated to the target database.
  • the execution subject of the embodiment of the present invention is a data migration device, by which the data to be migrated can be quickly migrated, effectively reducing the time spent in the data migration process.
  • the original data to be migrated from the source database can be synchronized to the temporary database according to the time sequence of the original data to be migrated, so as to store the data to be migrated corresponding to the original data to be migrated through the temporary database.
  • the temporary database has the same structure type as the aforementioned source database. For example, if the source database is a mysql database, the temporary database is also a mysql database.
  • the first time corresponding to the first piece of data in the source database and the second time corresponding to the last piece of data in the data to be migrated are acquired.
  • the corresponding entry time is recorded in the source database.
  • the first time is the time when the first piece of data is entered into the source database
  • the second time is the last The time when a piece of data was entered into the source database.
  • the time period between the first time and the second time is split according to the first preset rule to obtain multiple corresponding time segments.
  • the above-mentioned first preset rule may include: averagely split the time period between the first time and the second time according to the preset number of divisions to obtain multiple time segments with the same number of divisions.
  • the above-mentioned number of divisions can be set according to actual conditions, for example, it can be input by the user according to personal needs, or it can be set by the data migration device itself.
  • the aforementioned time segment only refers to one time interval, and the time segment has no direct relationship with the time when the data to be migrated is entered into the source data. For example, a certain time segment is 30 minutes, such as 09:00-09:30.
  • the designated migration quantity corresponding to the designated time segment is determined according to the second preset rule, where the designated time segment is any one of the multiple time segments.
  • the second preset rule may include: acquiring the total number of data to be migrated and the number of time segments, calculating the first quotient between the total number of data and the number of time segments, and calculating the first quotient The value is determined as the number of migrations specified above.
  • the designated data is migrated to the target database through a preset number of designated migration servers, and so on, until all the data to be migrated in the temporary database is transferred to the target database, where the target server is set to be used on the target server.
  • the database that receives the data to be migrated can be a database with a different data structure type from the source database.
  • the original data to be migrated in the source database is first synchronized to a temporary database, and then multiple time segments are set for the data to be migrated in the temporary database.
  • each time segment can be intelligently allocated a designated number of designated data for migration to be migrated, and a preset number of designated migration servers can be called to realize data migration for the designated data in the data to be migrated.
  • Fast migration effectively reduces the time spent in the data migration process, reduces the cost of data migration, and improves the efficiency of the migration server.
  • the data to be migrated in the source database can be first transferred. Synchronize to a temporary database, where the temporary database has the same structure type as the source database.
  • the temporary database is also a mysql database.
  • the data to be migrated stored in the temporary database is migrated to the target database, so as to realize the migration process of the data to be migrated.
  • it is beneficial to reduce the pressure on the source database avoid the situation of excessively high concurrency caused by data migration directly through the source database, and effectively reduce the The influence of the online normal business of the source database.
  • step S2 includes:
  • S200 Use the first time as the left endpoint value of the first time segment, and determine whether the first time is within a preset time range, where the first time segment is based on the previous The first time segment divided in the order after arrival;
  • S201 If the first time is within the preset time range, calculate the first sum of the first time and the first preset time value to obtain the first specified time, and compare the first time with the The time period between the first designated times is marked as the first time segment;
  • S202 If the first time is not within the preset time range, calculate the second sum of the first time and the second preset time value to obtain the first specified time, and compare the first time with all The time period between the first designated times is marked as the first time segment;
  • S202 Use the first designated time as the left endpoint value of the second time segment, and determine whether the first designated time is within a preset time range, where the second time segment is the same as the first time segment. The next time segment adjacent to the segment;
  • S204 If the first specified time is within the preset time range, calculate the third sum of the first specified time and the first preset time value to obtain the second specified time, and add the first specified time The time period between and the second designated time is marked as the second time segment;
  • S205 If the first specified time is not within the preset time range, calculate the fourth sum of the first specified time and the second preset time value to obtain the second specified time, and compare the first specified time The time period between the time and the second designated time is marked as the second time segment, and so on, until the time period between the first time and the second time is split.
  • this embodiment can implement the division of time segments through the first preset rule.
  • the above step of splitting the time period between the first time and the second time according to the first preset rule to obtain multiple corresponding time segments may specifically include: first taking the first time as the first time segment The left endpoint value, and determine whether the first time is within the preset time range, where the first time segment is the first time segment that is divided in order from front to back among all the time segments.
  • the time range is not specifically limited, for example, it can be set to a range from 9 o'clock to 21 o'clock.
  • the time period of is marked as the above-mentioned first time segment, where the specific value of the first preset time value is not limited, and can be set according to actual needs, for example, it can be set to 5 minutes.
  • the second sum of the first time and the second preset time value is calculated to obtain the first designated time, and the first time and the first designated time are combined
  • the time period between is marked as the aforementioned first time segment; wherein, the aforementioned second preset time value is not specifically limited, and can be set according to actual needs, for example, it can be set to 30 minutes.
  • the first designated time is then used as the left end value of the second time segment, and it is determined whether the first designated time is within the preset time range, where the second time segment is The next time segment adjacent to the above-mentioned first time segment.
  • first specified time is within the preset time range, calculate the third sum of the first specified time and the first preset time value to obtain the second specified time, and combine the first specified time with the second specified time
  • the time period between is marked as the second time segment described above. If the first specified time is not within the preset time range, calculate the fourth sum of the first specified time and the second preset time value to obtain the second specified time, and compare the first specified time with the second specified time.
  • the time period between the designated times is marked as the above-mentioned second time segment, and so on, until the time period between the above-mentioned first time and the above-mentioned second time is split.
  • step S3 includes:
  • S305 By analogy, in the process of data migration for other time segments, when the designated initial query quantity corresponding to the current time segment is equal to the preset query quantity threshold, after completing the data to be migrated to the source database After the migration of multiple pieces of third data with the same amount of the specified initial query, calculate the specified average response time of each piece of the third data during the migration process, and determine whether the specified average response time is equal to the preset first 2. Response time threshold;
  • the second preset rule can be used to determine the specified number of migrations.
  • the above step of determining the designated migration quantity corresponding to the designated time segment according to the second preset rule specifically includes: when the designated time segment is the first time segment, determining the preset first initial query quantity as the designated migration quantity, Among them, the first initial query quantity is the result of the stress test of the data migration work under the normal state in the test environment, and can be specifically set to 200.
  • the first response time threshold can be set according to actual conditions, for example, it can be set to 200ms. If the first average response time is less than the first response time threshold, the fifth sum of the first initial query quantity and the first preset quantity value is calculated to obtain the second initial query quantity, and the second initial query quantity is determined as the first The designated migration quantity corresponding to the second time segment, wherein the first preset quantity value is not specifically limited, and can be set according to the actual situation, for example, it can be set to 30.
  • the second average response time of each piece of second data during the migration process calculates the second average response time of each piece of second data during the migration process, and determine the second Whether the average response time is less than the preset first response time threshold. If the second average response time is less than the first response time threshold, the sixth sum of the second initial query quantity and the first preset quantity value is calculated to obtain the third initial query quantity, and the third initial query quantity is determined as the first The specified number of migrations corresponding to the three time segments, where the third time segment is the next time segment adjacent to the second time segment.
  • the data to be migrated from the source database is completed with the specified After the migration of multiple pieces of third data with the same initial query amount, calculate the specified average response time of each piece of third data during the migration process, and determine whether the specified average response time is equal to the preset second response time threshold.
  • the above-mentioned second response time threshold is greater than the first response time threshold, and can be specifically set to 300 ms according to actual conditions. If the specified average response time is equal to the second response time threshold, it is further judged whether the target database is at full load.
  • the CPU data and memory data of the target database can be obtained, and then the target database can be analyzed based on the CPU data and memory data The current load situation. If the target database is in a full load state, the query volume threshold is determined as the designated migration number corresponding to all remaining time segments.
  • the designated data of the designated migration quantity can be intelligently allocated for migration according to the second preset rule, which effectively realizes the rapid migration of the data to be migrated.
  • the data migration device will continue to transfer data in the source database.
  • the remaining un-migrated data is re-migrated, so as to realize the complete migration of all the data to be migrated.
  • the number of data corresponding to the un-migrated data currently in the data to be migrated is obtained;
  • the second quotient of the total amount of data and the query volume threshold is calculated Value; according to the second quotient, set multiple specific time segments with the same number as the second quotient; according to the chronological order of each of the above-mentioned unmigrated data, in each of the above specific time segments, call a certain number of migration servers to Multiple pieces of specific data that are the same as the query volume threshold are migrated to the target server until the migration of all the non-migrated data is completed, where the specific data is any piece of non-migrated data of the non-migrated data.
  • the complete migration of all the data to be migrated in the source database is effectively realized, and the integrity of the data migration is
  • the method before the foregoing step S5, the method includes:
  • S500 Obtain the migration server IP input by the user, and configure the migration server IP to implement the invocation of the migration server;
  • S501 Obtain the number of migration server IPs, and determine whether the number of migration server IPs is greater than a preset configuration number threshold;
  • a process of determining a designated migration server for data migration is also included. Specifically, first obtain the migration server IP (Internet Protocol, Internet Protocol address) input by the user, and configure the migration server IP to implement the invocation of the migration server. Then obtain the number of migration server IPs, and determine whether the number of migration server IPs is greater than a preset configuration number threshold, where the configuration number threshold can be set according to actual conditions, for example, it can be set to 4.
  • the configuration number threshold can be set according to actual conditions, for example, it can be set to 4.
  • the first migration server with the same number as the configuration number threshold is selected from the migration server IP, and the first migration server is determined as the designated migration server. For example, if the user configures five migration server IPs, four first migration servers with the same number as the configured number threshold will be randomly selected from the six migration server IPs as the designated migration server. If the number of migration server IPs is not greater than the preset configured number threshold, all second migration servers corresponding to the migration server IPs are determined as the designated migration servers. For example, if the user only configures three migration server IPs, three second migration servers corresponding to the three migration server IPs will be directly used as the designated migration server.
  • step S5 includes:
  • S511 Divide all the designated data into multiple data sets with the same number as the designated migration server;
  • S512 Bind each designated migration server to a data set one by one, and migrate each data set to the target database one by one through each designated migration server.
  • the step of migrating the designated data to the target database through a preset number of designated migration servers may specifically include: first obtaining the number of designated migration servers, and then according to the number of designated migration servers , Divide all the above specified data into multiple data sets with the same number of the above specified migration servers. For example, if the number of designated migration servers is 4, the designated data can be divided into 4 data sets correspondingly.
  • each designated migration server is bound to a data set one by one, and each of the above-mentioned data sets is migrated to the target database through each of the above-mentioned designated migration servers.
  • the binding of the designated migration server and the data set is not specifically limited, and the two can be randomly bound one by one.
  • multiple pieces of designated data are divided into multiple data sets with the same number of designated migration servers, and then each designated migration server bound to each data set is used to complete the migration of the designated data, which improves the migration.
  • the use efficiency of the server effectively reduces the time spent in the data migration process and reduces the cost of data migration.
  • the method includes:
  • S521 Determine, according to the migration record, whether there is migration failure data in the data to be migrated;
  • S523 Determine whether there is any successful migration of the failed data after a preset number of retry repair processing.
  • the data to be migrated in the temporary database will be recorded in the first state mark that has not been migrated; during the migration of the data to be migrated, the data to be migrated in the temporary database will be recorded There is a second state mark in the migration; after the migration of the data to be migrated is completed, the successfully migrated data in the data to be migrated will be recorded with the third state mark of successful migration; and the unsuccessful in the data to be migrated The migrated data will be recorded with a fourth status mark that the migration failed. After the migration record is obtained, it is determined whether there is migration failure data in the data to be migrated according to the migration record.
  • the failed data is retryed and repaired a preset number of times, where the failed data can be repaired by calling a pre-stored automatic repair program.
  • the preset number of times can be based on The actual request is set, for example, it can be set to 3 times. Then it is determined whether there is any successful migration of the above-mentioned failed data after a preset number of retry repair processing. If it does not exist, it means that the failed data has a problem and cannot be repaired through a normal automatic repair procedure, and a reminder message will be sent to transfer the failed data to manual repair processing. After the failed data is successfully repaired manually, the failed data is re-migrated.
  • the data to be migrated after the data to be migrated has failed data that fails to migrate, it will intelligently perform a preset number of retry repair processing on the failed data, so as to effectively repair the failed data that failed to migrate due to network fluctuations or database abnormalities. .
  • the failed data will be manually repaired to ensure that the failed data can be effectively repaired, which effectively guarantees the data to be migrated during the migration process. Data integrity.
  • the method includes:
  • S531 Determine whether the first header information and the first data size value of the first migration data are the same as the prestored second header information and the second data size value of the corresponding first data to be migrated;
  • the current complete data migration process usually includes two parts: migration and reconciliation. After completing the migration process of the data to be migrated, further reconciliation of the data to be migrated is required to Ensure the smooth and complete completion of the migration process for the data to be migrated. Specifically, after completing the migration process of the above-mentioned data to be migrated, first obtain the first header information and the first data size value of the first migration data, where the above-mentioned first migration data is any of all the migration data in the target database. One piece of migration data. In addition, the migration data is in a corresponding relationship with the data to be migrated, that is, the migration data is data obtained after the data to be migrated is migrated.
  • the above-mentioned first header information includes at least the MD5 value and file format of the first migration data.
  • the first header information and the first data size value are obtained, it is then judged whether the first header information and the first data size value are the same as the second header information and the second data size value of the pre-stored first data to be migrated. the same. If they are the same, it indicates that the first migration data and the first data to be migrated are the same data, and the first migration data is marked as the reconciliation completed state. If they are not the same, it indicates that the first migration data and the first data to be migrated are not the same data. For example, there may be data missing during the migration of the first data to be migrated. The data is marked as a reconciliation abnormal state.
  • the first migration data with the abnormally marked first migration data can be subsequently transferred to manual abnormality processing, so that the corresponding maintenance personnel can perform abnormality detection and subsequent abnormality repair processing on the first migration data.
  • an embodiment of the present application also provides a data migration device, including:
  • the first acquisition module 1 is configured to acquire the first time corresponding to the first piece of data in the data to be migrated in the source database, and the second time corresponding to the last piece of data in the data to be migrated, where the first time Is the time when the first piece of data is entered into the source database, and the second time is the time when the last piece of data is entered into the source database;
  • the splitting module 2 is configured to split the time period between the first time and the second time according to a first preset rule to obtain multiple corresponding time segments;
  • the first determining module 3 is configured to determine a designated migration quantity corresponding to a designated time segment according to a second preset rule, wherein the designated time segment is any one of the multiple time segments;
  • the query module 4 is configured to query the data to be migrated in the order of the time when each piece of data in the data to be migrated is separately entered into the source database to query the number of data to be migrated that corresponds to the specified number of migrations. The same multiple specified data;
  • the migration module 5 is configured to migrate the designated data to the target database through a preset number of designated migration servers, and so on, until all the data to be migrated in the source database is migrated to the target database.
  • an embodiment of the present application also provides a computer device, and the computer device may be a server.
  • the computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus.
  • the processor designed for the computer equipment is used to provide calculation and control capabilities.
  • the memory of the computer device includes a volatile or non-volatile storage medium and internal memory.
  • the volatile or non-volatile storage medium stores an operating system, computer readable instructions, and a database.
  • the internal memory provides an environment for the operation of the operating system and computer-readable instructions in the volatile or non-volatile storage medium.
  • the database of the computer equipment is used to store data such as time segments and designated migration quantities.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the computer-readable instructions are executed by the processor to implement the data migration method shown in any of the above exemplary embodiments.
  • FIG. 3 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the devices and computer equipment to which the solution of the present application is applied.
  • An embodiment of the present application also provides a computer-readable storage medium.
  • the computer-readable storage medium may be volatile or non-volatile, and computer-readable instructions are stored thereon. When executed by one or more processors, the steps in the foregoing data migration method embodiment are realized when executed by one or more processors.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

L'invention concerne un procédé et un appareil de migration de données, un dispositif informatique, et un support de stockage, le procédé comprenant les étapes consistant à : acquérir un premier instant correspondant à un premier élément de données dans des données à migrer dans une base de données source et un second instant correspondant à un dernier élément de données dans les données à migrer ; selon une première règle prédéfinie, diviser la période de temps entre le premier instant et le second instant pour obtenir une pluralité de tranches de temps ; selon une seconde règle prédéfinie, déterminer une quantité de migration spécifiée correspondant à une tranche de temps spécifiée ; en fonction de la séquence successive des instants auxquels chaque élément de données dans les données à migrer est entré dans la base de données source, interroger séquentiellement à partir des données à migrer la même quantité d'une pluralité d'éléments de données spécifiées en tant que quantité de migration spécifiée ; et migrer les données spécifiées vers une base de données cible au moyen d'une quantité prédéfinie de serveurs de migration spécifiés, et continuer jusqu'à ce que toutes les données à migrer dans la base de données source soient migrées vers la base de données cible. Ainsi, la migration rapide de données à migrer peut être obtenue et les coûts de migration de données sont réduits.
PCT/CN2019/119566 2019-10-29 2019-11-20 Procédé et appareil de migration de données, dispositif informatique et support de stockage WO2021082104A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911038072.4 2019-10-29
CN201911038072.4A CN111008188B (zh) 2019-10-29 2019-10-29 数据迁移方法、装置、计算机设备和存储介质

Publications (1)

Publication Number Publication Date
WO2021082104A1 true WO2021082104A1 (fr) 2021-05-06

Family

ID=70111499

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/119566 WO2021082104A1 (fr) 2019-10-29 2019-11-20 Procédé et appareil de migration de données, dispositif informatique et support de stockage

Country Status (2)

Country Link
CN (1) CN111008188B (fr)
WO (1) WO2021082104A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117591497A (zh) * 2024-01-18 2024-02-23 中核武汉核电运行技术股份有限公司 一种核电历史数据跨系统迁移方法

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112131179B (zh) * 2020-09-23 2023-11-21 平安科技(深圳)有限公司 任务状态检测方法、装置、计算机设备及存储介质
CN113220660A (zh) * 2021-04-15 2021-08-06 远景智能国际私人投资有限公司 一种数据迁移方法、装置、设备及可读存储介质
CN113342780A (zh) * 2021-06-28 2021-09-03 深圳壹账通智能科技有限公司 Dsu数据的迁移方法、装置和计算机设备
CN113360479B (zh) * 2021-06-29 2023-10-20 深圳市天汇世纪科技有限公司 数据迁移方法、装置、计算机设备和存储介质
CN113326074B (zh) * 2021-06-30 2022-04-15 中国平安人寿保险股份有限公司 延时事件处理方法、装置、计算机设备和存储介质
CN113515503A (zh) * 2021-07-23 2021-10-19 浩鲸云计算科技股份有限公司 一种基于表的InfluxDB数据迁移方法
CN114020281B (zh) * 2021-11-08 2022-10-14 中电金信软件有限公司 一种数据库的部署方法、应用服务部署方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102004746A (zh) * 2009-09-02 2011-04-06 中国银联股份有限公司 数据转移控制方法及装置
CN107977462A (zh) * 2017-12-21 2018-05-01 泰康保险集团股份有限公司 数据迁移方法及装置
CN108509556A (zh) * 2018-03-22 2018-09-07 上海达梦数据库有限公司 数据迁移方法和装置、服务器、存储介质
CN109460188A (zh) * 2018-11-13 2019-03-12 郑州云海信息技术有限公司 一种数据迁移方法、系统、设备及计算机可读存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9619474B2 (en) * 2011-03-31 2017-04-11 EMC IP Holding Company LLC Time-based data partitioning
US20150200833A1 (en) * 2014-01-10 2015-07-16 Seagate Technology Llc Adaptive Data Migration Using Available System Bandwidth
CN105338051B (zh) * 2014-08-15 2018-09-18 阿里巴巴集团控股有限公司 一种数据同步方法及设备
CN105183582B (zh) * 2015-07-30 2019-03-08 北京奇虎科技有限公司 数据备份方法及装置
CN106502576B (zh) * 2015-09-06 2020-06-23 中兴通讯股份有限公司 迁移策略调整方法及装置
CN106970921B (zh) * 2016-01-14 2020-10-16 阿里巴巴集团控股有限公司 一种数据迁移方法及装置
CN105808376B (zh) * 2016-02-24 2019-06-14 北京金山安全软件有限公司 一种数据备份方法、装置及电子设备
JP6495872B2 (ja) * 2016-08-17 2019-04-03 日本電信電話株式会社 移行システム、移行方法および移行プログラム
CN109376196B (zh) * 2018-09-25 2021-04-13 浪潮软件科技有限公司 一种redo日志批量同步方法及装置
CN110287258A (zh) * 2019-06-26 2019-09-27 深圳前海微众银行股份有限公司 一种基于双数据源的数据同步处理方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102004746A (zh) * 2009-09-02 2011-04-06 中国银联股份有限公司 数据转移控制方法及装置
CN107977462A (zh) * 2017-12-21 2018-05-01 泰康保险集团股份有限公司 数据迁移方法及装置
CN108509556A (zh) * 2018-03-22 2018-09-07 上海达梦数据库有限公司 数据迁移方法和装置、服务器、存储介质
CN109460188A (zh) * 2018-11-13 2019-03-12 郑州云海信息技术有限公司 一种数据迁移方法、系统、设备及计算机可读存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117591497A (zh) * 2024-01-18 2024-02-23 中核武汉核电运行技术股份有限公司 一种核电历史数据跨系统迁移方法
CN117591497B (zh) * 2024-01-18 2024-05-03 中核武汉核电运行技术股份有限公司 一种核电历史数据跨系统迁移方法

Also Published As

Publication number Publication date
CN111008188A (zh) 2020-04-14
CN111008188B (zh) 2023-08-15

Similar Documents

Publication Publication Date Title
WO2021082104A1 (fr) Procédé et appareil de migration de données, dispositif informatique et support de stockage
CN110990432B (zh) 一种跨机房同步分布式缓存集群的装置和方法
US10489378B2 (en) Detection and resolution of conflicts in data synchronization
CN109933632B (zh) 一种数据库的数据迁移方法、装置及设备
US8683263B2 (en) Cooperative client and server logging
WO2023005075A1 (fr) Procédé et système de reprise après sinistre pour données, équipement terminal et support d'enregistrement informatique
CN112434043B (zh) 一种数据同步方法、装置、电子设备及介质
US9183038B2 (en) Job management system that determines if master data has been updated, then re-executes a sub-job based on available executing computers and data sharing status
WO2021139322A1 (fr) Procédé et appareil de traitement de données de dispositif de réseau, équipement informatique et support de stockage
WO2019047565A1 (fr) Procédé de traitement de tâches, dispositif, dispositif informatique, et support d'informations
WO2009089746A1 (fr) Procédé, dispositif et système de réalisation d'une tâche dans un environnement de grappes
CN110647531A (zh) 数据同步方法、装置、设备及计算机可读存储介质
US20180032567A1 (en) Method and device for processing data blocks in a distributed database
CN106354566A (zh) 一种命令处理的方法以及服务器
CN111177173A (zh) 大数据环境下实现数据同步优化处理的系统及其方法
WO2012101531A1 (fr) Protection de l'intégrité des données dans des volumes de stockage
CN108255703B (zh) 一种sql脚本的故障修复方法及其终端
WO2024087914A1 (fr) Procédé de synchronisation de données et dispositif informatique
WO2024051454A1 (fr) Procédé et appareil de traitement de journal de transactions
CN111078418B (zh) 操作同步方法、装置、电子设备及计算机可读存储介质
CN115640280A (zh) 数据迁移方法及装置
CN112162964B (zh) 一种自适应数据同步方法、装置、计算机设备及存储介质
WO2023024248A1 (fr) Procédé et appareil de gestion d'anomalie de bus, dispositif électronique et support de stockage lisible
JP2009181495A (ja) ジョブ処理システムおよびジョブ管理方法
CN114756410A (zh) 一种双机热备系统的数据恢复方法、装置及介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19950897

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19950897

Country of ref document: EP

Kind code of ref document: A1