WO2019127282A1

WO2019127282A1 - Database merging method and apparatus

Info

Publication number: WO2019127282A1
Application number: PCT/CN2017/119588
Authority: WO
Inventors: 庞华冲
Original assignee: 深圳配天智能技术研究院有限公司
Priority date: 2017-12-28
Filing date: 2017-12-28
Publication date: 2019-07-04
Also published as: CN109690521A; CN109690521B

Abstract

Disclosed in the present application are a database merging method and apparatus. The method comprises: respectively obtaining a target data table and a source data table from a target database and a source database, wherein the target data table comprises a plurality of fields and a plurality of entries, the source data table also comprises a plurality of fields and a plurality of entries, and each entry comprises field values respectively corresponding to the fields; performing same-structural processing on the target data table according to a field different between the target data table and the source data table to obtain a same-structured target data table; and performing data merging on the source data table and the same-structured target data table. According to the method above, the present application can merge databases quickly and improve the merging modes in the prior art.

Description

Method and device for database merging

[Technical Field]

The present application relates to the field of databases, and in particular, to a method and apparatus for database merging.

【Background technique】

Databases have become the preferred method of data storage due to their high load, high response, multiple concurrency, support for atomic operations, and support for multi-version control. Many software and websites today, from cloud computing centers to instant chat software, use databases to store data. In the process of using the database, it is often necessary to use a source database to update a target database. At this point, you need to merge the databases. In addition, there are other ways to consolidate data and also need to merge the databases.

Common merged databases are usually done manually by database maintainers. The maintenance personnel separately export the two databases to be merged, open them in a certain view, and then merge the databases with other comparison tools, and the degree of automation is relatively low. Some commercial databases may provide associated merge tools, but only for their associated database products. And because some relational databases are free software and developers don't provide tools, the merge tool can't be used in some relational databases. There are also some database service vendors that tend to offer a full suite of database services for high service fees. Accordingly, such products are often bulky, sloppy, and difficult to maintain.

[Summary of the Invention]

The present application provides a method and apparatus for database merging, which quickly and securely merges databases through a lightweight method.

A technical solution adopted by the present application is to provide a method for database merging, comprising the steps of: obtaining a target data table and a source data table respectively from a target database and a source database, wherein the target data table includes multiple fields and multiple records. The source data table also includes a plurality of fields and a plurality of records, each of the records including a field value respectively corresponding to the field; and the target data according to a field difference between the target data table and the source data table The table performs the same structured processing to obtain the same structured target data table; and the data is merged on the basis of the source data table and the same structured target data table.

In order to solve the above technical problem, another technical solution adopted by the present application is: a device for database consolidation, comprising: a processor, a memory, the processor is connected to the memory, and the processor is configured to run the in-memory storage The program performs the following steps: obtaining a target data table and a source data table from the target database and the source database, wherein the target data table includes a plurality of fields and a plurality of records, the source data table also includes a plurality of fields and a plurality of Recording, each record includes a field value corresponding to the field respectively; performing the same structural processing on the target data table according to the difference between the target data table and the source data table to obtain the same structured target data a table; data merging is performed on the basis of the source data table and the same structured target data table.

The beneficial effects of the present application are as follows: a method and a device for merging a database are provided, which are realized by merging the source data table and the target data table respectively obtained from the source database and the target database. A quantitative approach to the rapid and secure consolidation of databases.

[Description of the Drawings]

1 is a schematic flow chart of an embodiment of a method for merging databases in the present application

2 is a schematic diagram of a sub-flow of the embodiment of step S10 of FIG. 1;

3 is a schematic diagram of a sub-flow of the embodiment of step S11 of FIG. 1;

Figure 4 is a detailed schematic view of the same structure of Figure 3;

5 is a schematic diagram of a sub-flow of the embodiment of step S12 of FIG. 1;

6 is a schematic diagram of two source data tables of a structured target data table that need to be merged in the method for database merge of the present application;

7 is a schematic diagram of still another sub-flow of an embodiment of step S12 of FIG. 1;

Figure 8 is a schematic diagram of the same structured target data table of Figure 6 merged according to the method of Figure 7;

FIG. 9 is a schematic diagram of still another sub-flow of the embodiment of step S12 of FIG.

Figure 10 is a schematic diagram of the same structured target data table of Figure 6 merged according to the method of Figure 9;

11 is a schematic diagram of still another sub-flow of the embodiment of step S12 of FIG. 1;

12 is a schematic diagram of the same structured target data table of FIG. 6 merged according to the method of FIG. 11;

FIG. 13 is a schematic diagram of still another sub-flow of the embodiment of step S12 of FIG.

FIG. 14 is a schematic structural diagram of an apparatus for merging a database according to the present application.

【Detailed ways】

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

Referring to FIG. 1 , FIG. 1 is a schematic flowchart of a method for merging a database of the present application, and the specific gap detection method includes the following steps:

S10: Obtain a target data table and a source data table from the target database and the source database, respectively.

In this embodiment, since the specific operation object is each data table in the database, the target data table and the source data table are respectively acquired from the target database and the source database. Specifically, the table name of all the tables stored in the target database is traversed, and the table names of all the tables stored in the source database are traversed, and two tables corresponding to the table names are respectively selected from the two databases. As the target data table and the source data table. Each target data table and source data table includes multiple fields and multiple records, and includes multiple field values. Preferably, a field refers to a column of a table, a record refers to a row of a table, and a field value refers to a field and a specific value corresponding to the record.

In particular, in this embodiment, both the target data table and the source data table have a unique identification field. For a table, all field values under this identity field are unique, such as number, student ID, and so on.

S11: Perform the same structural processing on the target data table according to the field difference between the target data table and the source data table to obtain the same structured target data table.

Before the merge, the same data structure needs to be performed on the target data table and the source data table, that is, the target data table has the same field as the source data table. In this embodiment, the target data table is operated, so the target database can be backed up and the source database can be read-only. In order to make the target data table and the source data table have the same field, it is necessary to traverse the target data table and the source data table to obtain a field that the target data table is redundant or missing from the source data table, and then create a temporary table. The temporary table adds missing fields or deletes redundant fields relative to the target data table, or adds missing fields and deletes redundant fields. In addition, the same structured target data table may be filled and filled as needed, so that the same field value as the structured target data table field is retained in the record of the target data table in the same structured target data table. The field value of the same field as the temporary table in the record of the target data table may be filled into the temporary table, and the field value corresponding to the field in the record of the temporary table different from the target data table shall be the corresponding field of the corresponding record in the source data table. The field values are populated. Finally, the temporary table is set to the same structured target data table, so that the same structured target data table after the same structured processing is obtained.

S12: Perform data combining on the basis of the source data table and the same structured target data table.

After obtaining the same structured target data table and the source data table, the obtained source data table is merged with the same structured target data table. However, in actual operation, the user may need to protect part of the data, so in the actual merge process, first determine the protection data, including the protection record and the field, or choose not to protect, here is not limited, and then according to the user Choose to use a different method.

Referring to FIG. 2, FIG. 2 is a schematic diagram of a sub-flow of a method for merging a database of the present application. FIG. 1 is a sub-flow diagram of an embodiment of step S10 of the present application, and the embodiment is further extended based on step S10 of the first embodiment of the present application. The embodiment includes the following sub-steps.

S101, traversing the table name of the table stored in the target data and the original data, respectively.

In the actual operation of the database, it is actually the operation of the table stored in the database, so you need to find the source data table and the target data table that need to be merged. In the specific operation process, for a table in the database to be merged, there is such a corresponding table in the source data. Specifically, the table name has a corresponding relationship, and the table names may be the same or similar, so the table names of the tables stored in the target data are respectively traversed, and the source database is traversed by the same method.

S102, a table corresponding to the table name and stored in the target database and the source database respectively is used as the target data table and the source data table.

For a table in the target data, if there is a table in the source data corresponding to the table name of the table, the table in the target database is used as the target data table, and the table corresponding to the table name in the source data is used. As a source data table. The correspondence here may be the same or similar or other correspondence.

Referring to FIG. 3, FIG. 3 is a schematic diagram of a sub-flow of the method for merging the database of the present application. FIG. 1 is a schematic diagram of a sub-flow of the step S11 of the first embodiment of the present application, and the embodiment is further extended based on the step S11 of the first embodiment of the present application. The following substeps are included.

S111, traversing the fields in the target data table and the source data table respectively to determine a field and an extra field that are missing from the target data table relative to the source data table.

Because the source data table and the possible fields in the target data table are different, this will result in data errors during the merge. Therefore, the target data table must first be structured the same as the source data table, that is, the target data table has the same fields as the source data table. Therefore, the target data table and the fields in the source data table are traversed, and some fields and some redundant fields in the target data table that are missing from the source data table are obtained and recorded.

S112. Create a temporary table and set the field so that the temporary table adds missing fields and deletes redundant fields with respect to the target data table.

In the specific database operation, in order to protect the data and prevent the accidental deletion, loss, etc. of the data during the operation, the backup and the method of establishing the temporary table are generally adopted. So first create a temporary table, and then set the field to the temporary table, so that the temporary table relative to the target data table, the missing field in the previous step is added, and the redundant fields recorded in the previous step are deleted. That is, this temporary table has the same fields as the source data table.

S113. Fill in the field value of the same field as the temporary table in the record of the target data table into the temporary table.

Since only the fields are set for the temporary table, it is also necessary to fill the temporary table with records, including recording and filling the same fields of the temporary table and the target data table. For the same field in the temporary table as in the target database, the field values corresponding to this field in the target data table are sequentially filled into the fields corresponding to the temporary table in order. In particular, since both the target data table and the source data table have an identification field, there must be an identification field in the temporary table.

S114. Fill the field value corresponding to the field different from the target data table in the record of the temporary table by the field value of the corresponding field of the corresponding record in the source data table.

Since the temporary table has a certain number of fields relative to the target data table, and these fields are from the source data table, the field values corresponding to these fields do not exist in the target data table, so the field values of these fields need to be obtained from the source database. In practice, for example, a field refers to age, and a record refers to information of A. The value of this field of age is determined by the field and the record. Therefore, it can be known that for a field that does not exist, such as no salary in the target data table, but the temporary table has a salary field, if the salary of A needs to be filled, it needs to be obtained from the source database. Here we need a field value that uniquely identifies the field to determine, assuming that the unique identifier field in the table is the name, for the salary of A, if the field value of the unique identifier field in the source data table also has A, then the source data table The salary corresponding to A is filled in to the salary corresponding to the temporary table A. If the field value of the unique identification field in the source data table does not exist, then no padding is performed.

S115, setting the temporary table to the same structured target data table.

The current temporary table already has the same fields as the source data table, that is, it has the same structure, and also populates the temporary table with data, that is, the same structural completion, and sets the temporary table to the same structured target data table. .

Please refer to FIG. 4 for details. FIG. 4 is a detailed schematic diagram of the same structure of FIG. This includes source data tables, target data tables, and temporary tables. In this embodiment, the name is used as the identification field.

It can be seen that in the temporary table, for A, the job number and age in the field exist in both the source data table and the target data table, so the field value is obtained from the target data table, but for the salary field, as The identification field, A is the target data table and the identifier field value shared by the source data table, so the salary of A can be filled by the salary of the source data table corresponding to A, but for Ding, because the identification field in the source data table is also That is, there is no such field value under the name, so it cannot be filled, it is empty.

FIG. 5 is a schematic diagram of a sub-flow of the embodiment of the present invention. The following substeps are included.

S121, specifying a protected record or a protected field in the same structured target data table.

In actual operation, the user may need to protect certain data, so the user-protected data needs to be determined, and the data to be protected is skipped in the subsequent merge process. The protected data may be a field or a record. To determine the data to be protected, the protection data here is specifically to specify the same structured target data table.

S122: Perform data combining on the same structured target data table and the source data table on the basis of skipping the protected record or the protected field.

After the protected field or hand protection record is determined, in the subsequent merge process, the data is skipped, that is, in the subsequent merge process, the records or fields do not participate in the merge, and no changes are made, and then the same The structured data table and the source data table are merged.

Referring to FIG. 6, FIG. 6 is a schematic diagram of two source data tables of a structured target data table that need to be merged in the method for database merge of the present application.

The identification fields of the same structured data table and the source data table are numbered. In other embodiments, the identification field herein is not limited, and may be a job number, a student number, a name, and the like. Among them, 1, 2, 3 are the field values of the identification field of the same structured data table, the row where 1 is located is the record corresponding to it, and Zhang San is the field value of the name field in the same structured data table, that is, 1 A field value for the corresponding record.

Referring to FIG. 7, FIG. 7 is a schematic diagram of another sub-flow of the embodiment of step S12 of FIG. The embodiment is a further extension based on the step S12 of the first embodiment of the present application, and is also one of three combinations, and the embodiment specifically includes the following sub-steps.

S121a compares the value of the field corresponding to the identification field in the record of the source data table and the identifier of the source data table.

In this embodiment, the comparison field is required to be compared by the identification field, that is, to compare the field values of the structured target data table and the identification field of the source data table. If the source data table and the identification field of the structured target data table are numbered, each numbered value of the structured target data table is compared with each numbered value of the source data table.

S122a, determining records and/or redundant records that are missing from the source data table with the structured target data table.

After the comparison, the records corresponding to the field values of the identification fields different from the source data table are determined. That is to say, as the identification fields of the structured data table and the source data table are numbered, the numbered value of the number in the same structured data table is 1, 2, 3, and the number of the number in the source data table has 3, 4, 5, the same structured data table relative to the source data table, the lack of 4, 5, that is, the record corresponding to 4, 5, the excess of 1, 2, that is, the excess of 1, 2 Corresponding records are determined and recorded.

S123a, adding missing records in the same structured target data table/or deleting the redundant records.

Add the identified missing records to the same structured target data table. That is, as in the above steps, adding the records of the same structured target data table relative to the source data is the records corresponding to 4 and 5, and deleting the redundant records, that is, deleting the same structured target data table relative to the source data. The missing records are the records corresponding to 1 and 2.

Please refer to FIG. 8. FIG. 8 is a schematic diagram of the same structured target data table merged by FIG. 6 according to the method of FIG.

The structured target data table is redundant with the records corresponding to 1 and 2 with respect to the source data table, but the records corresponding to 4 and 5 are missing. Therefore, in the merged data table, the records corresponding to 1 and 2 are deleted from the target data table, and the records corresponding to 4 and 5 are added, and the records corresponding to 3 are not modified, and FIG. 8 is obtained.

Referring to FIG. 9 , FIG. 9 is a schematic diagram of still another sub-flow of the embodiment of step S12 of FIG. 1 , which is a further extension of step S12 of the first embodiment of the present application. One of the ways of combining. This embodiment specifically includes the following sub-steps.

S121b compares the field values in the records of the structured target data table with the source data table.

S122b: Determine, that the identifier field corresponding to the identifier field has the same field value but the field values corresponding to the remaining fields are at least partially different.

That is to say, as the identification fields of the structured data table and the source data table are numbered, the numbered value of the number in the same structured data table is 1, 2, 3, and the number of the number in the source data table has 3, 4, 5, there is a common field value of 3. In determining the record corresponding to 3 in the structured target data table, and 3 the record corresponding to the source data table, the field values different for the two records are determined.

S123b, updating the corresponding record in the same structured target data table by using the record determined in the source data table.

That is to say, if the source data table is different from a certain field value in the record corresponding to the same structured target data table 3 for a field value corresponding to the 3 corresponding records, the same data in the same structured target data table will be used. The field value is replaced with this field value of the source data table, and the others remain unchanged.

Please refer to FIG. 10 further. FIG. 10 is a schematic diagram of the same structured target data table merged by FIG. 6 according to the method of FIG.

Structured target data table Relative to the source data table, the identification field of the structured target data table has 1, 2, 3, and the identification field of the source data table has 3, 4, and 5, and the identification fields of the two data tables are common. One of the same 3. In the structured data table, the corresponding records for 3 are: 3, Sheri, 3K. In the source data table, the corresponding records of 3 are: 3,

Wang

2, 6K. Obviously, in the structured data table, the field value of the record corresponding to 3 is different from the field value of the record corresponding to 3 in the source data table, and the record corresponding to 3 in the structured data table is replaced with the source data table. 3 corresponding records, get Figure 10.

Referring to FIG. 11 , FIG. 11 is a schematic diagram of still another sub-flow of the embodiment of step S12 of FIG. 1 according to the method for database merging of the present application, and the embodiment is further extended based on step S12 of the first embodiment of the present application. One of the combinations, the embodiment specifically includes the following sub-steps.

S121c, replace all the records in the same structured target data table with the records in the source data table.

That is, the structured target data table is emptied and all records of the source data table are populated such that the records of the source data table overwrite the structured target data table.

Please refer to FIG. 12 further. FIG. 12 is a schematic diagram of the same structured target data table merged by FIG. 6 according to the method of FIG.

The source data table completely covers the structured data table, that is, the records in the same structured target data table are all replaced with the records in the source data table, and FIG. 12 is obtained.

Referring to FIG. 13 , FIG. 13 is a schematic diagram of still another sub-flow of the embodiment of the step S12 of FIG. 1 according to the method for database merging of the present application, and the embodiment is further extended based on the step S12 of the first embodiment of the present application. It should be noted that the present embodiment is a schematic diagram of an implementation manner of the specific implementation method of the embodiment of FIG. 7, FIG. 9, and FIG. 11, and specifically has the following steps:

S121d: The record is read from the source data table cyclically by the first thread and stored in the first buffer area.

In this implementation, the implementation of the merge is mainly explained by a specific implementation method. Here is achieved by using multiple threads. First, the first thread is used to read a row of records from the source data table, and stored as a list of strings, and the list of strings is stored in the first buffer area. The above operation is repeated until the first buffer area is filled.

S122d: The second thread is used to cyclically read the record from the first buffer area and store it in the second buffer area.

A record is taken from the first buffer area by the second thread loop and placed in the second buffer area. It should be noted that the second buffer area is smaller than the first buffer area. If the first buffer is empty or the second buffer is full, the second thread goes to sleep, ie it does not work. After the write is successful, since the first buffer area is empty again, the first cache is used to write to the first buffer area.

S123d, the third thread is used to cyclically read the record from the same structured target data table and store it in the third buffer area.

After the operation of the source data table, it is necessary to operate on the same structured target data table. First, a row of records is read from the same structured target data table by using a third thread loop, and stored as a string list, and the string list is stored in the third buffer area. The above operation is repeated until the first buffer area is filled.

S124d: The fourth thread is used to cyclically read the record from the third buffer area and store it in the fourth buffer area.

A record is taken from the third buffer area by the fourth thread loop and placed in the fourth buffer area. It should be noted that the fourth buffer area is smaller than the third buffer area. If the third buffer is empty or the fourth buffer area is full, the fourth thread enters a sleep state, that is, does not work. When the write is successful, since the third buffer area is empty again, the third cache is used to write to the third buffer area.

S125d: The fifth thread is used to compare the record stored in the second buffer area and the record stored in the fourth buffer area, and perform a corresponding data merge operation according to the comparison result.

That is to say, when the second buffer area and the fourth buffer area are not empty, the record stored in the second buffer area by the fifth thread is compared with the record stored in the fourth buffer area, and the result of the comparison is obtained. And the selected merge mode to add, delete, replace, and so on. After the comparison and the operation are completed, the second buffer area and the fourth buffer area are cleared, and the second thread and the fourth thread are awake to work.

Referring to FIG. 14, FIG. 14 is a schematic structural diagram of an apparatus for merging a database according to the present application.

In this embodiment, the apparatus includes a processor 10 and a memory 11, and the processor 10 is connected to the memory 11.

The processor 10 is configured to determine protection data, set a temporary table, and fill the temporary table, traverse the database and the data table, and compare and merge the data tables by using multiple threads and multiple buffers.

The processor 10 may also be referred to as a CPU (Central Processing Unit). Processor 10 may be an integrated circuit chip with signal processing capabilities. The processor 10 can also be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. . The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

The module terminals of the above-mentioned devices can respectively perform the corresponding steps in the foregoing method embodiments, and therefore, the modules are not described herein. For details, refer to the description of the corresponding steps.

The storage device storage 20 of the present application has an instruction file capable of implementing all of the above methods, and the program file may be stored in the storage device in the form of a software product, and also records various calculated data, including a plurality of instructions for causing one A computer device (which may be a personal computer, server, or network device, etc.) or a processor performs all or part of the steps of the various embodiments of the present application. The foregoing storage device includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, which can store program codes. Or a terminal device such as a computer, a server, a mobile phone, or a tablet.

In summary, those skilled in the art will readily understand that the present application provides a method and apparatus for merging databases by taking two data tables from two databases by traversing, and then performing the same structure on the two data tables. After determining the protection data, the two data tables are merged in multiple ways by means of multi-threading and buffers, thereby quickly completing the merge, and in the present application, there is a perfect data protection mechanism in the merge process. There will be no loss or damage to the data.

The above is only the embodiment of the present application, and thus does not limit the scope of patents of the present application, and the equivalent structure or equivalent process transformation made by using the specification and the contents of the drawings, or directly or indirectly applied to other related technical fields, The same is included in the scope of patent protection of this application.

Claims

A method for merging a database, comprising the steps of:

Obtaining a target data table and a source data table respectively from the target database and the source database, wherein the target data table includes a plurality of fields and a plurality of records, the source data table also includes a plurality of fields and a plurality of records, each of the records includes Field values corresponding to the fields respectively;

Performing the same structural processing on the target data table according to the difference between the target data table and the source data table to obtain the same structured target data table;

Data merging is performed on the basis of the source data table and the same structured target data table.
The method according to claim 1, wherein the step of obtaining the target data table and the source data table from the target database and the source database respectively comprises:

And respectively traversing the table name of the table stored in the target database and the source database, and storing the table name in a table corresponding to the target database and the source database as the target data table And the source data table.
The method according to claim 1, wherein the step of performing the same structured processing on the target data table according to the field difference between the target data table and the source data table comprises:

Performing field addition and/or field deletion on the target data table according to a field difference between the target data table and the source data table to obtain the same structured target data table, wherein the same structured target data table The fields in are the same as the fields in the source data table.
The method according to claim 3, wherein the step of performing the same structured processing on the target data table according to the field difference between the target data table and the source data table further comprises:

Recording and filling the same structured target data table, so that the same field value of the same structured target data table field in the record of the target data table is retained in the same structured target data table, and The field value corresponding to the remaining fields in the record of the same structured target data table is filled by the field value of the corresponding field of the corresponding record in the source data table.
The method according to claim 4, wherein the step of performing field addition and/or field deletion on the target data table according to a field difference between the target data table and the source data table comprises:

Traversing the fields in the target data table and the source data table respectively to determine fields and redundant fields that are missing from the target data table relative to the source data table;

Establishing a temporary table and performing field setting such that the temporary table adds the missing field with respect to the target data table and deletes the redundant field;

The step of performing record filling on the same structured target data table includes:

Filling a field value of the same field as the temporary table in the record of the target data table into the temporary table, and setting a field value corresponding to a field different from the target data table in the record of the temporary table by Filling in the field value of the corresponding field of the corresponding record in the source data table;

The temporary table is set to the same structured target data table.
The method according to claim 1, wherein the step of data merging on the basis of the same structured target data table and the source data table comprises:

Comparing the same structured target data table with a field value corresponding to the identifier field in the record of the source data table for identifying, to determine the same structured target data table relative to the source data table Missing records and/or redundant records;

Adding the missing record and/or deleting the redundant record in the same structured target data table.
The method according to claim 1, wherein the step of data merging on the basis of the same structured target data table and the source data table comprises:

Comparing the same structured target data table with the field value in the record of the source data table to determine that the field value corresponding to the identifier field functioning as the identifier is the same but the field values corresponding to the remaining fields are at least partially different. record of;

Updating corresponding records in the same structured target data table using the records determined in the source data table.
The method according to claim 1, wherein the step of data merging on the basis of the same structured target data table and the source data table comprises:

All of the records in the same structured target data table are replaced with records in the source data table.
The method of claim 1, wherein the step of data merging on the basis of the same structured target data table and the source data table comprises:

Specifying a protected record or protected field in the same structured target data table;

Data is merged between the same structured target data table and the source data table based on skipping the protected record or protected field.
The method according to claim 1, wherein the step of data merging on the basis of the same structured target data table and the source data table comprises:

Reading the record from the source data table cyclically with the first thread and storing it in the first buffer area;

Reading the record from the first buffer area cyclically by the second thread and storing it in the second buffer area, wherein the number of records stored in the first buffer area is greater than the number of records stored in the second buffer area ;

Reading the record from the same structured target data table cyclically by the third thread and storing it in the third buffer area;

Reading the record from the third buffer area cyclically by the fourth thread and writing to the fourth buffer area, wherein the third buffer area stores the number of records larger than the number of records stored in the fourth buffer area;

The fifth thread stores the records stored in the second buffer area and the records stored in the fourth buffer area, and performs a corresponding data merge operation according to the comparison result.
An apparatus for merging a database, the apparatus comprising: a processor, a memory, the processor is coupled to the memory, and the processor performs the following steps by running a program stored in the memory:

Obtaining a target data table and a source data table respectively from the target database and the source database, wherein the target data table includes a plurality of fields and a plurality of records, the source data table also includes a plurality of fields and a plurality of records, each of the records includes Field values corresponding to the fields respectively;

Performing the same structural processing on the target data table according to the difference between the target data table and the source data table to obtain the same structured target data table;

Data merging is performed on the basis of the source data table and the same structured target data table.
The apparatus according to claim 11, wherein the steps of respectively obtaining the target data table and the source data table from the target database and the source database comprise:

And respectively traversing the table name of the table stored in the target database and the source database, and storing the table name in a table corresponding to the target database and the source database as the target data table And the source data table.
The apparatus according to claim 11, wherein the step of performing a structural structuring on the target data table according to a field difference between the target data table and the source data table comprises:

Performing field addition and/or field deletion on the target data table according to a field difference between the target data table and the source data table to obtain the same structured target data table, wherein the same structured target data table The fields in are the same as the fields in the source data table.
The device according to claim 13, wherein the step of performing the same structured processing on the target data table according to the field difference between the target data table and the source data table further comprises:

Recording and filling the same structured target data table, so that the same field value of the same structured target data table field in the record of the target data table is retained in the same structured target data table, and The field value corresponding to the remaining fields in the record of the same structured target data table is filled by the field value of the corresponding field of the corresponding record in the source data table.
The apparatus according to claim 14, wherein the step of performing field addition and/or field deletion on the target data table according to a field difference between the target data table and the source data table comprises:

Traversing the fields in the target data table and the source data table respectively to determine fields and redundant fields that are missing from the target data table relative to the source data table;

Establishing a temporary table and performing field setting such that the temporary table adds the missing field with respect to the target data table and deletes the redundant field;

The step of performing record filling on the same structured target data table includes:

Filling a field value of the same field as the temporary table in the record of the target data table into the temporary table, and setting a field value corresponding to a field different from the target data table in the record of the temporary table by Filling in the field value of the corresponding field of the corresponding record in the source data table;

The temporary table is set to the same structured target data table.
The apparatus according to claim 11, wherein said step of combining data on the basis of the same structured target data table and said source data table comprises:

Comparing the same structured target data table with a field value corresponding to the identifier field in the record of the source data table for identifying, to determine the same structured target data table relative to the source data table Missing records and/or redundant records;

Adding the missing record and/or deleting the redundant record in the same structured target data table.
The apparatus according to claim 11, wherein the step of performing data merging on the basis of the same structured target data table and the source data table comprises:

Comparing the same structured target data table with the field value in the record of the source data table to determine that the field value corresponding to the identifier field functioning as the identifier is the same but the field values corresponding to the remaining fields are at least partially different. record of;

Updating corresponding records in the same structured target data table using the records determined in the source data table.
The apparatus according to claim 11, wherein the step of performing data merging on the basis of the same structured target data table and the source data table comprises:

All of the records in the same structured target data table are replaced with records in the source data table.
The apparatus according to claim 11, wherein the step of performing data merging on the basis of the same structured target data table and the source data table comprises:

Specifying a protected record or protected field in the same structured target data table;

Data is merged between the same structured target data table and the source data table based on skipping the protected record or protected field.
The apparatus according to claim 11, wherein the step of performing data merging on the basis of the same structured target data table and the source data table comprises:

Reading the record from the source data table cyclically with the first thread and storing it in the first buffer area;

Reading the record from the first buffer area cyclically by the second thread and storing it in the second buffer area, wherein the number of records stored in the first buffer area is greater than the number of records stored in the second buffer area ;

Reading the record from the same structured target data table cyclically by the third thread and storing it in the third buffer area;

Reading the record from the third buffer area cyclically by the fourth thread and writing to the fourth buffer area, wherein the third buffer area stores the number of records larger than the number of records stored in the fourth buffer area;

The fifth thread stores the records stored in the second buffer area and the records stored in the fourth buffer area, and performs a corresponding data merge operation according to the comparison result.