WO2020232884A1

WO2020232884A1 - Data table migration method, apparatus, computer device and storage medium

Info

Publication number: WO2020232884A1
Application number: PCT/CN2019/103170
Authority: WO
Inventors: 刘志涛
Original assignee: 平安科技（深圳）有限公司
Priority date: 2019-05-20
Filing date: 2019-08-29
Publication date: 2020-11-26
Also published as: CN110209652B; CN110209652A

Abstract

A data table migration method, comprising: acquiring a migration template configuration request; determining a preset script template corresponding to the migration task type in the migration template configuration request; adding configuration parameters in the migration template configuration request to the preset script template, and generating a data migration script; executing the data migration script, and reading a table screening condition, an outward migration database address, and an inward migration database address in the data migration script; according to the table screening condition, screening out a data table from a database corresponding to the outward migration database address; and importing the screened data table into a database corresponding to the inward migration database address.

Description

Data table migration method, device, computer equipment and storage medium

Cross references to related applications

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on May 20, 2019, the application number is 2019104195035, and the application name is "Data sheet migration method, device, computer equipment and storage medium", the entire content of which is by reference Incorporated in this application.

Technical field

This application relates to a data table migration method, device, computer equipment and storage medium.

Background technique

With the development of computer technology and Internet technology, big data technology has emerged. Big data technology includes data storage, data analysis, and data mining. The basis of these technologies requires data collection.

However, the inventor realizes that when collecting data, it is necessary to perform batch data migration processing on the data in the database. In the traditional data migration process, it is necessary to edit the code script for data migration, and perform data from the database according to the code script. Migration to gather data to form a large database, so as to process the data in the large database. It takes time to edit the corresponding code scripts in the traditional data migration process, resulting in low migration efficiency of the data migration process in the database.

Summary of the invention

According to various embodiments disclosed in the present application, a data table migration method, device, computer equipment, and storage medium are provided.

A data table migration method, executed by a server, includes:

Obtain the migration template configuration request;

Determining the preset script template corresponding to the migration task type in the migration template configuration request;

Adding the configuration parameters in the migration template configuration request to the preset script template to generate a data migration script;

Execute the data migration script, and read the table filter conditions, the migration-out database address and the migration-in database address in the data migration script;

Filter data tables from the database corresponding to the move-out database address according to the table filtering conditions; and

Import the filtered data table into the database corresponding to the migration-in database address.

A data table migration device includes:

Request acquisition module, used to acquire migration template configuration request;

A template determining module, configured to determine a preset script template corresponding to the migration task type in the migration template configuration request;

A script generation module, configured to add the configuration parameters in the migration template configuration request to the preset script template to generate a data migration script;

The script execution module is used to execute the data migration script, and read the table filter conditions, the migration-out database address and the migration-in database address in the data migration script;

The data table screening module is used to screen data tables from the database corresponding to the move-out database address according to the table screening conditions; and

The data table migration module is used to import the filtered data table into the database corresponding to the migration database address.

A computer device, including a memory and one or more processors, the memory stores computer readable instructions, when the computer readable instructions are executed by the processor, the one or more processors execute The following steps: a computer device including a memory and a processor, the memory stores a computer-readable storage medium, and the processor implements the following steps when executing the computer-readable storage medium:

Obtain the migration template configuration request;

One or more non-volatile computer-readable storage media storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors perform the following steps: Obtain the migration template configuration request;

The details of one or more embodiments of the application are set forth in the following drawings and description. Other features and advantages of this application will become apparent from the description, drawings and claims.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

Fig. 1 is an application scenario diagram of a data table migration method according to one or more embodiments;

2 is a schematic flowchart of a data table migration method according to one or more embodiments;

FIG. 3 is a schematic flowchart of the steps of configuring a preset script module according to one or more embodiments;

FIG. 4 is a schematic flowchart of the steps of constructing an externally accessed data table according to one or more embodiments;

FIG. 5 is a schematic flowchart of the steps of importing a data table according to one or more embodiments;

FIG. 6 is a schematic flowchart of the steps of converting the data table format according to one or more embodiments;

FIG. 7 is a schematic flowchart of steps of configuring access permissions according to one or more embodiments;

Fig. 8 is a structural block diagram of a data table migration device according to one or more embodiments;

Fig. 9 is an internal structure diagram of a computer device according to one or more embodiments.

Detailed ways

In order to make the purpose, technical solutions, and advantages of this application clearer, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the application, and not used to limit the application.

The data table migration method provided in this application can be applied to the application environment as shown in FIG. 1. Wherein, the terminal 102 communicates with the server 104 through the network through the network. The terminal 102 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices. The server 104 may be implemented as an independent server or a server cluster composed of multiple servers.

In one of the embodiments, as shown in FIG. 2, a data table migration method is provided. Taking the method applied to the server in FIG. 1 as an example, the method includes the following steps:

S202: Obtain a migration template configuration request.

Specifically, the table migration page is displayed in the terminal. The table migration page is provided with a table migration button and a configuration parameter input box. When a click operation of the table migration button on the table migration page is detected, the configuration input in the configuration parameter input box is obtained Parameters, generate a migration template configuration request according to the acquired configuration parameters, and send the migration template configuration request to the server. The server receives the migration template configuration request sent by the terminal. The migration template configuration request is a request for configuring a preset script template.

S204: Determine a preset script template corresponding to the migration task type in the migration template configuration request.

Specifically, the server parses the received migration template configuration request, extracts the migration task type in the migration template configuration request by parsing, and queries the script template library for the preset script template corresponding to the migration task type. The preset script template is a script template for parameters to be configured for migrating the data table. The script template library includes multiple preset script templates, and each preset script template corresponds to a different migration task type.

S206: Add the configuration parameters in the migration template configuration request to the preset script template, and generate a data migration script.

Specifically, after querying the preset script template, the server obtains the configuration parameters in the migration template configuration request, determines where the configuration parameters are to be added in the preset script template, adds the configuration parameters to the preset script template, and generates data migration script.

S208: Execute the data migration script, and read the table filtering conditions, the migration-out database address and the migration-in database address in the data migration script.

Specifically, after the server generates the data migration script, it executes the data migration script to generate a data migration instruction, and runs the data migration script according to the data migration instruction. When running the data migration script, executes the script statements in the data migration script and reads by executing the script statements Go to the table filter conditions, check-out database address and check-in database address in the data migration script. Table filter conditions are the conditions that need to be met by the data tables that need to be migrated. Move out of the database address The address of the database to which the data table is moved, and the address of the database to which the data table is moved into.

S210: Filter data tables from the database corresponding to the move-out database address according to the table filtering conditions.

Specifically, the server accesses the data table in the database corresponding to the outgoing database address, detects whether the accessed data table meets the table filter condition, filters out the data table that meets the table filter condition from the database, and obtains the filtered data table.

S212: Import the filtered data table into the database corresponding to the migrated database address.

Specifically, the server accesses the database corresponding to the moved-in database address, obtains the remaining capacity in the database, and determines whether the capacity of storing the filtered data table is less than or equal to the remaining capacity in the database. When the capacity of storing the filtered data table is less than or equal to When there is remaining capacity in the database, import the filtered data table into the database corresponding to the migration database address, so as to store the filtered data table in the database corresponding to the migration database address.

In one of the embodiments, the server creates a migration task queue according to the filtered data table, reads the migration task from the migration task queue, obtains the corresponding data table according to the migration task, and imports the obtained data table into the corresponding database address. Database.

In one of the embodiments, the server creates migration tasks corresponding to each data table according to the filtered data tables, and constructs a preset number of migration task queues according to the migration tasks. The server receives the migration task read request sent by the terminal, reads the migration task from the migration task queue according to the migration task read request, and returns the read migration task to the terminal.

In this embodiment, during the process of data table migration, there is no need to rewrite the data migration script for migrating the data table. It only needs to configure the preset script template according to the configuration parameters in the migration template configuration request to generate the data migration script. , Improve the efficiency of data migration scripts. The data table migration is performed directly according to the table filter conditions, the move-out database address and the move-in database address in the generated data migration script, thereby improving the efficiency of the data table migration.

As shown in FIG. 3, in one of the embodiments, S206 specifically includes a step of configuring a preset script module, and this step specifically includes the following content:

S302: Obtain configuration parameters in the migration template configuration request.

Specifically, the server obtains data migration configuration data by analyzing the migration template configuration request, identifies configuration parameters in the data migration configuration data, and extracts the identified configuration parameters from the data migration configuration data. The configuration parameters may specifically include the number of migration tasks to be created, the number of task queues, table filtering conditions, the address of the migration database, and the address of the migration database.

S304: Determine a parameter identifier corresponding to the configuration parameter.

Specifically, the configuration parameter has a corresponding parameter identifier. The parameter identifier is an identifier used to identify the type or name of the configuration parameter. The server determines the parameter identifier corresponding to the identified configuration parameter in the preset script template.

S306: Determine a parameter configuration location corresponding to the parameter identifier in the preset script template.

Specifically, the parameter configuration position is the position where the configuration parameter is added in the preset script template. The server queries the parameter identifier in the preset script template, determines the position of the queried parameter identifier in the preset script, and records the determined position as the parameter configuration position.

S308: Add the obtained configuration parameters to the preset script module according to the parameter configuration position.

Specifically, the server determines the configuration parameter corresponding to the parameter configuration position, and adds the configuration parameter to the corresponding parameter configuration position in the preset script module, so as to generate the data migration script according to the preset script module to which the configuration parameter is added.

In this embodiment, it is determined that the parameter identifier corresponding to the configuration parameter is obtained, the parameter configuration position corresponding to the parameter identifier in the preset script template, and the configuration parameter is added to the preset script template according to the parameter configuration position, ensuring that the preset script template The configuration accuracy of the configuration.

As shown in FIG. 4, in one of the embodiments, after S210, a step of constructing an external access data table is specifically included, and this step specifically includes the following content:

S402: Construct an external access data table according to the filtered data table.

Specifically, after filtering the data table, the server copies the filtered data table to obtain the data replication table, and uses the data replication table as the externally accessed data table corresponding to the filtered data table. The external access data table is a data table created to meet the requirement of normal access to the filtered data table sent from outside.

S404: When the access request corresponding to the filtered data table is monitored, point the data access address in the access request to the external access data table.

Specifically, the server monitors the access request of the database corresponding to the out-of-database address, extracts the data access address from the monitored access request, and when it determines that the data table corresponding to the data access address is the filtered data table, obtains the filtered data table location. Corresponding to the external data table address of the external access data table, modify the data access address in the access request to the obtained external data table address, so as to point the data access address in the access request to the external access data table.

S406: When it is monitored that the filtered data table is migrated, delete the externally accessed data table.

Specifically, the server monitors the migration process of the filtered data table, and when it detects that the filtered data table is migrated, it determines the external access data table corresponding to the filtered data table, and deletes the determined external access data table. .

In this embodiment, during the data table migration process, an external access data table corresponding to the filtered data table is created, and when an access request corresponding to the filtered data table is monitored, the data access address in the access request is pointed to External access to the data table to ensure normal access to the filtered data table during the data migration process.

As shown in Figure 5, in one of the embodiments, S212 specifically includes a step of importing a data table, and this step specifically includes the following content:

S502: Determine the table dependency between the filtered data tables.

Specifically, the server extracts the data table identifier corresponding to the filtered data table, queries the table dependency relationship corresponding to the data table identifier from the table dependency relationship stored in the database corresponding to the outgoing database address, and extracts the queried table dependency relationship.

S504: Determine the data table migration sequence according to the table dependency.

For example, the table dependency relationship between data table 1, data table 2 and data table 3 is that data table 3 depends on data table 2, and data table 2 depends on data table 1, and the data migration order is determined according to the table dependency. 1→Data sheet 2→Data sheet 3.

S506: Import the filtered data tables into the database corresponding to the migrated database address according to the data table migration sequence.

For example, when the data migration sequence is data table 1 → data table 2 → data table 3, first import data table 1 from the database corresponding to the migration database address to the database corresponding to the migration database address, and then import data table 2 Import the database corresponding to the migration database address from the database corresponding to the migration database address, and finally import the data table 3 from the database corresponding to the migration database address into the database corresponding to the migration database address to complete the data table 1, data table 2 and 3 data table migration.

In this embodiment, the table dependency relationship between the filtered data tables is determined, the data table migration order is determined according to the table dependency relationship, and the filtered data tables are imported into the database corresponding to the migration database address according to the data table migration order to ensure the data After the table migration is completed, the migrated data table can be accessed normally based on the table dependency, thereby improving the accuracy of the data table migration.

As shown in FIG. 6, in one of the embodiments, S212 specifically includes a step of converting the data table format, and this step specifically includes the following content:

S602: Determine the data format in the database corresponding to the address of the migrated database.

Specifically, the server generates data format detection information according to the migration-in database address, and sends the data format detection information to the database corresponding to the migration-in database address to determine the data format in the database. The data format is the format of the data table stored in the database.

S604: Perform format conversion on the filtered data table according to the determined data format to obtain a data table in the converted format.

Specifically, the server obtains the data format of the filtered data table, and compares the data format of the filtered data table with the data format in the database corresponding to the moved-in database address. If the data format is inconsistent, the filtered data table is compared The data format is converted, and the filtered data table is converted into the data format in the database corresponding to the moved into the database address, and the data table in the converted format is obtained.

S606: Store the converted data table in the database corresponding to the migration-in database address.

Specifically, the server establishes a communication channel with the database corresponding to the migrated database address, and sends the converted data table to the database corresponding to the migrated database address for storage through the communication channel.

In one of the embodiments, the server determines the data format in the database corresponding to the database address after determining the data table migration sequence according to the table dependency, and performs format conversion on the filtered data table according to the determined data format to obtain the conversion According to the data table migration sequence, the converted data table is stored in the database corresponding to the migration database address.

In this embodiment, in the process of data table migration, the data format of the filtered data table is converted to the data format in the database corresponding to the migrated database address, which further ensures the compatibility of the database with the migrated data table. The data table that is moved in can be processed and accessed normally.

As shown in Figure 7, in one of the embodiments, after S212, a step of configuring access permissions is further included, and this step specifically includes the following content:

S702: Obtain access authority information corresponding to the filtered data table from the database corresponding to the move-out database address.

Specifically, the server statically generates an access permission acquisition request corresponding to the data table address, sends the access permission acquisition request to the database corresponding to the outgoing database address, and obtains the access permission corresponding to the filtered data table queried by the database according to the access permission acquisition request information.

S704: According to the acquired access permission information, configure the access permission information for the data in the database corresponding to the moved-in database address.

Specifically, after the server imports the filtered data table into the database corresponding to the migration database address, it obtains the migration data table address corresponding to the imported data table corresponding to the filtered data table, and transfers the filtered data table The outgoing data table address is stored correspondingly to the incoming data table address. The server configures the access rights for the moved-in data table address according to the moved-in data table address corresponding to the moved-out data table address of the filtered data table, and configures the access right information corresponding to the filtered data table among the obtained access right information information.

In this embodiment, after the filtered data table is imported into the database corresponding to the address of the migrated data table, according to the access authority information of the filtered data table, the data imported in the database corresponding to the imported data address The table is configured with access authority information to ensure access control to the migrated data table and ensure the security of the migrated data table.

It should be understood that although the various steps in the flowcharts of FIGS. 2-7 are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless specifically stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least part of the steps in Figures 2-7 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. These sub-steps or stages The execution order of is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

In one of the embodiments, as shown in FIG. 8, a data table migration device 800 is provided, which includes: a request acquisition module 802, a template determination module 804, a script generation module 806, a script execution module 808, and a data table screening module 810 And the data table is moved into module 812, where:

The request obtaining module 802 is used to obtain a migration template configuration request.

The template determination module 804 is configured to determine the preset script template corresponding to the migration task type in the migration template configuration request.

The script generation module 806 is used to add the configuration parameters in the migration template configuration request to the preset script template to generate a data migration script.

The script execution module 808 is used to execute the data migration script, and read the table filtering conditions, the migration-out database address and the migration-in database address in the data migration script.

The data table filtering module 810 is used to filter data tables from the database corresponding to the move-out database address according to the table filtering conditions.

The data table migration module 812 is used for importing the filtered data table into the database corresponding to the migration database address.

In one of the embodiments, the script generation module 806 is also used to obtain the configuration parameters in the migration template configuration request; determine the parameter identifier corresponding to the configuration parameter; determine the parameter configuration location corresponding to the parameter identifier in the preset script template; configure according to the parameter The location adds the acquired configuration parameters to the preset script module.

In one of the embodiments, the data table migration device 800 further includes a data table monitoring module.

The data table monitoring module is used to construct an external access data table according to the filtered data table; when the access request corresponding to the filtered data table is monitored, the data access address in the access request points to the external access data table; when monitoring When the filtered data table is migrated, delete the external access data table.

In one of the embodiments, the data table migration module 812 is also used to determine the table dependency between the filtered data tables; determine the data table migration order according to the table dependency; and select the filtered data tables according to the data table migration order Import the database corresponding to the moved-in database address.

In one of the embodiments, the data table migration module 812 is also used to determine the data format in the database corresponding to the database address to be migrated; format the filtered data table according to the determined data format to obtain the data table in the converted format ; Store the converted data table to the database corresponding to the migration database address.

In one of the embodiments, the data table migration device 800 further includes a permission configuration module.

The authority configuration module is used to obtain the access authority information corresponding to the filtered data table from the database corresponding to the migration database address; according to the acquired access authority information, configure the access authority for the data in the database corresponding to the migration database address information.

In this embodiment, during the process of data table migration, there is no need to rewrite the data migration script for migrating the data table. It only needs to configure the preset script template according to the configuration parameters in the migration template configuration request to generate the data migration script. , Improve the efficiency of data migration scripts. The data table migration is performed directly according to the table filtering conditions, the move-out database address and the move-in database address in the generated data migration script, thereby improving the efficiency of the data table migration.

For the specific definition of the data table migration device, please refer to the above definition of the data table migration method. Each module in the above-mentioned data table migration device can be implemented in whole or in part by software, hardware, and a combination thereof. The foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.

In one of the embodiments, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. 9. The computer equipment includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer-readable storage medium, and a database. The internal memory provides an environment for the operation of the operating system in the non-volatile storage medium and the computer-readable storage medium. The database of the computer equipment is used to store data tables. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer-readable storage medium implements a data table migration method when executed by the processor.

Those skilled in the art can understand that the structure shown in FIG. 9 is only a block diagram of part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may Including more or less parts than shown in the figure, or combining some parts, or having a different part arrangement.

In one embodiment, a computer device includes a memory and one or more processors. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the one or more processors perform the following steps : Provides a computer device, including a memory and a processor, the memory stores a computer-readable storage medium, and the processor implements the following steps when executing the computer-readable storage medium:

Obtain the migration template configuration request; determine the preset script template corresponding to the migration task type in the migration template configuration request; add the configuration parameters in the migration template configuration request to the preset script template to generate the data migration script; execute the data migration script and read The table screening conditions, the move-out database address and the move-in database address in the data migration script; filter data tables from the database corresponding to the move-out database address according to the table filter conditions; and import the filtered data tables into the move-in database address The corresponding database.

In one of the embodiments, the configuration parameters in the migration template configuration request are added to the preset script template, and generating the data migration script includes: obtaining the configuration parameters in the migration template configuration request; determining the parameter identifier corresponding to the configuration parameter; The parameter configuration position corresponding to the parameter identifier is determined in the script template; and the obtained configuration parameter is added to the preset script module according to the parameter configuration position.

In one of the embodiments, after filtering the data tables from the database corresponding to the out-of-database address according to the table filtering conditions, the processor further implements the following steps when executing the computer-readable storage medium: constructing an external access data table according to the filtered data tables ; When the access request corresponding to the filtered data table is monitored, the data access address in the access request is pointed to the external access data table; and when the migration of the filtered data table is monitored, the external access data table is deleted.

In one of the embodiments, importing the filtered data tables into the database corresponding to the migration database address includes: determining the table dependency relationship between the filtered data tables; determining the data table migration sequence according to the table dependency; and according to the data table The migration sequence imports the filtered data table into the database corresponding to the migration database address.

In one of the embodiments, importing the filtered data table into the database corresponding to the moved-in database address includes: determining the data format in the database corresponding to the moved-in database address; and performing format conversion on the filtered data table according to the determined data format , Obtain the data table in the converted format; and store the data table in the converted format in the database corresponding to the migration-in database address.

In one of the embodiments, after importing the filtered data table into the database corresponding to the migrated database address, the processor also implements the following steps when executing the computer-readable storage medium: obtain the filtered data from the database corresponding to the migrated database address The access authority information corresponding to the data table of the data table; and according to the obtained access authority information, the access authority information is configured for the data in the database corresponding to the moved-in database address.

One or more non-volatile computer-readable storage media storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the following steps:

In one of the embodiments, the configuration parameters in the migration template configuration request are added to the preset script template, and generating the data migration script includes: obtaining the configuration parameters in the migration template configuration request; determining the parameter identifier corresponding to the configuration parameter; and It is assumed that the parameter configuration position corresponding to the parameter identifier is determined in the script template; the obtained configuration parameters are added to the preset script module according to the parameter configuration position.

In one of the embodiments, after filtering the data tables from the database corresponding to the outgoing database address according to the table filtering conditions, the computer-readable storage medium further implements the following steps when being executed by the processor: constructing external access data according to the filtered data tables Table; when the access request corresponding to the filtered data table is monitored, the data access address in the access request is pointed to the external access data table; and when the migration of the filtered data table is monitored, the external access data table is deleted.

In one of the embodiments, importing the filtered data table into the database corresponding to the inbound database address includes: determining the data format in the database corresponding to the inbound database address; performing format conversion on the filtered data table according to the determined data format, Obtain the converted format data table; and store the converted format data table in the database corresponding to the migration-in database address.

In one of the embodiments, after the filtered data table is imported into the database corresponding to the migrated database address, the computer-readable storage medium further implements the following steps when being executed by the processor: obtain the filtered data from the database corresponding to the migrated database address Access authority information corresponding to the obtained data table; and according to the obtained access authority information, configure the access authority information for the data in the database corresponding to the moved-in database address.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing relevant hardware through a computer-readable storage medium. The computer-readable storage medium may be stored in a non-volatile memory. In a computer-readable storage medium, when the computer-readable storage medium is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and/or volatile memory. Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, they should It is considered as the range described in this specification.

The above-mentioned embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation on the scope of the invention patent. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can be made, and these all fall within the protection scope of this application. Therefore, the scope of protection of the patent of this application shall be subject to the appended claims.

Claims

A data table migration method, executed by a server, includes:

Obtain the migration template configuration request;

Determining the preset script template corresponding to the migration task type in the migration template configuration request;

Adding the configuration parameters in the migration template configuration request to the preset script template to generate a data migration script;

Execute the data migration script, and read the table filter conditions, the migration-out database address and the migration-in database address in the data migration script;

Filter data tables from the database corresponding to the move-out database address according to the table filtering conditions; and

Import the filtered data table into the database corresponding to the migration-in database address.
The method according to claim 1, wherein the adding the configuration parameters in the migration template configuration request to the preset script template, and generating the data migration script comprises:

Acquiring the configuration parameters in the migration template configuration request;

Determine the parameter identifier corresponding to the configuration parameter;

Determining the parameter configuration location corresponding to the parameter identifier in the preset script template; and

Add the acquired configuration parameters to the preset script module according to the parameter configuration position.
The method according to claim 1, wherein after filtering data tables from the database corresponding to the outgoing database address according to the table filtering conditions, the method further comprises:

Construct an external access data table based on the filtered data table;

When an access request corresponding to the filtered data table is monitored, pointing the data access address in the access request to the external access data table; and

When it is monitored that the filtered data table is migrated, the externally accessed data table is deleted.
The method according to claim 1, wherein the importing the filtered data table into the database corresponding to the migration database address comprises:

Determine the table dependency between the filtered data tables;

Determine the data table migration sequence according to the table dependency; and

Import the filtered data tables into the database corresponding to the moved-in database address according to the data table migration sequence.
The method according to claim 1, wherein the importing the filtered data table into the database corresponding to the migration database address comprises:

Determine the data format in the database corresponding to the moved-in database address;

Perform format conversion on the filtered data table according to the determined data format to obtain a data table in the converted format; and

The data table in the converted format is stored in the database corresponding to the migration-in database address.
The method according to any one of claims 1-5, wherein after importing the filtered data table into the database corresponding to the migration database address, the method further comprises:

Obtain the access authority information corresponding to the filtered data table from the database corresponding to the move-out database address; and

According to the obtained access authority information, the access authority information is configured for the data in the database corresponding to the migration-in database address.
The method according to claim 1, wherein the determining the preset script template corresponding to the migration task type in the migration template configuration request comprises:

Parse the migration template configuration request to obtain the migration task type in the migration template configuration request; and

Query the preset script template corresponding to the migration task type in the script template library.
The method according to claim 1, wherein the filtering data tables from the database corresponding to the move-out database address according to the table filtering conditions comprises:

Access the data table in the database corresponding to the address of the moved-out database;

Check whether the accessed data table meets the table filter conditions; and

If the filter condition is met, the data table that meets the table filter condition is selected from the database.
The method according to claim 1, wherein the importing the filtered data table into the database corresponding to the migration database address comprises:

Access the database corresponding to the address of the migrated database to obtain the remaining capacity of the database;

Determine whether the data amount of the filtered data table is less than or equal to the remaining capacity; and

If yes, import the filtered data table into the database.
A data table migration device, characterized in that the device includes:

Request acquisition module, used to acquire migration template configuration request;

A template determining module, configured to determine a preset script template corresponding to the migration task type in the migration template configuration request;

A script generation module, configured to add the configuration parameters in the migration template configuration request to the preset script template to generate a data migration script;

The script execution module is used to execute the data migration script, and read the table filter conditions, the migration-out database address and the migration-in database address in the data migration script;

The data table screening module is used to screen data tables from the database corresponding to the move-out database address according to the table screening conditions; and

The data table migration module is used to import the filtered data table into the database corresponding to the migration database address.
The device according to claim 10, wherein the script generation module is further configured to obtain configuration parameters in the migration template configuration request; determine the parameter identifier corresponding to the configuration parameter; and set the parameter in the preset script The parameter configuration location corresponding to the parameter identifier is determined in the template; the obtained configuration parameter is added to the preset script module according to the parameter configuration location.
A computer device includes a memory and one or more processors. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the one or more processors, the one or more Each processor performs the following steps:

Obtain the migration template configuration request;

Determining the preset script template corresponding to the migration task type in the migration template configuration request;

Adding the configuration parameters in the migration template configuration request to the preset script template to generate a data migration script;

Execute the data migration script, and read the table filter conditions, the migration-out database address and the migration-in database address in the data migration script;

Filter data tables from the database corresponding to the move-out database address according to the table filtering conditions; and

Import the filtered data table into the database corresponding to the migration-in database address.
The computer device according to claim 12, wherein the configuration parameters in the migration template configuration request are added to the preset script template to generate a data migration script; the processor executes the computer The following steps are also performed when reading instructions:

Acquiring the configuration parameters in the migration template configuration request;

Determine the parameter identifier corresponding to the configuration parameter;

Determining the parameter configuration location corresponding to the parameter identifier in the preset script template; and

Add the acquired configuration parameters to the preset script module according to the parameter configuration position.
The computer device according to claim 12, wherein after the data table is selected from the database corresponding to the out-of-database address according to the table filter condition, when the processor executes the computer-readable instruction Also perform the following steps:

Construct an external access data table based on the filtered data table;

When an access request corresponding to the filtered data table is monitored, pointing the data access address in the access request to the external access data table; and

When it is monitored that the filtered data table is migrated, the externally accessed data table is deleted.
The computer device according to claim 12, wherein the selected data table is imported into the database corresponding to the migration database address, and the processor further executes the following steps when executing the computer-readable instruction:

Determine the table dependency between the filtered data tables;

Determine the data table migration sequence according to the table dependency; and

Import the filtered data tables into the database corresponding to the moved-in database address according to the data table migration sequence.
The computer device according to claim 12, wherein the selected data table is imported into the database corresponding to the migration database address, and the processor further executes the following steps when executing the computer-readable instruction:

Determine the data format in the database corresponding to the moved-in database address;

Perform format conversion on the filtered data table according to the determined data format to obtain a data table in the converted format; and

The data table in the converted format is stored in the database corresponding to the migration-in database address.
One or more non-volatile computer-readable storage media storing computer-readable instructions, which when executed by one or more processors, cause the one or more processors to perform the following steps:

Obtain the migration template configuration request;

Determining the preset script template corresponding to the migration task type in the migration template configuration request;

Adding the configuration parameters in the migration template configuration request to the preset script template to generate a data migration script;

Execute the data migration script, and read the table filter conditions, the migration-out database address and the migration-in database address in the data migration script;

Filter data tables from the database corresponding to the move-out database address according to the table filtering conditions; and

Import the filtered data table into the database corresponding to the migration-in database address.
The storage medium according to claim 16, wherein the configuration parameters in the migration template configuration request are added to the preset script template to generate a data migration script, and the computer-readable instructions are The processor also performs the following steps when executing:

Acquiring the configuration parameters in the migration template configuration request;

Determine the parameter identifier corresponding to the configuration parameter;

Determining the parameter configuration location corresponding to the parameter identifier in the preset script template; and

Add the acquired configuration parameters to the preset script module according to the parameter configuration position.
The storage medium according to claim 16, wherein the computer-readable instructions are executed by the processor after the data table is filtered from the database corresponding to the out-of-database address according to the table filtering condition Also perform the following steps:

Construct an external access data table based on the filtered data table;

When an access request corresponding to the filtered data table is monitored, pointing the data access address in the access request to the external access data table; and

When it is monitored that the filtered data table is migrated, the externally accessed data table is deleted.
The storage medium according to claim 16, wherein the selected data table is imported into the database corresponding to the migration database address, and the following steps are performed when the computer-readable instruction is executed by the processor :

Determine the table dependency between the filtered data tables;

Determine the data table migration sequence according to the table dependency; and

Import the filtered data tables into the database corresponding to the moved-in database address according to the data table migration sequence.