CN112749163B - Data transmission method, device and medium - Google Patents
Data transmission method, device and medium Download PDFInfo
- Publication number
- CN112749163B CN112749163B CN202011631154.2A CN202011631154A CN112749163B CN 112749163 B CN112749163 B CN 112749163B CN 202011631154 A CN202011631154 A CN 202011631154A CN 112749163 B CN112749163 B CN 112749163B
- Authority
- CN
- China
- Prior art keywords
- data
- target
- setting instruction
- intermediate table
- synchronized
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 80
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000001360 synchronised effect Effects 0.000 claims abstract description 54
- 238000013507 mapping Methods 0.000 claims description 36
- 238000001514 detection method Methods 0.000 claims description 10
- 238000010586 diagram Methods 0.000 description 18
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000013524 data verification Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application discloses a data transmission method, equipment and medium, wherein a corresponding target table and a data table structure of the target table are determined based on an acquired data transmission request; constructing a corresponding intermediate table according to the data table structure of the target table; receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction; receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table; receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction; according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table; and transmitting the data to be transmitted in the target intermediate table to the target table.
Description
Technical Field
The present disclosure relates to the field of data transmission technologies, and in particular, to a data transmission method, device, and medium.
Background
In practical applications, in many situations, data transmission or transfer between data tables with different table structures is required. For example, in the funding industry, customers may consider the funding system as a whole according to various situations, and the funding system may be from each manufacturer, each manufacturer may store data by using a data table with a different table structure, and data transmission needs to be performed between the database tables of the manufacturers and the funding system.
Aiming at the situation, the data transmission among the data tables is realized in a worker input mode in the prior art. Therefore, the energy of the staff is occupied by basic data input, a great deal of labor cost is consumed, the data transmission efficiency is extremely low, and the office efficiency is low. But also is prone to manual entry errors.
Disclosure of Invention
The embodiment of the specification provides a data transmission method, device and medium, which are used for solving the following technical problems in the prior art: when data transmission is carried out among database tables with different table structures, the data transmission is realized in a manual input mode, a large amount of human resources are consumed, and the office efficiency is low.
The embodiment of the specification adopts the following technical scheme:
a data transmission method, comprising:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
and transmitting the data to be transmitted in the target intermediate table to the target table.
In one possible implementation, the intermediate table is the same as the database table structure of the target table.
In one possible implementation manner, the association relationship at least includes one of the following:
data table structure mapping relation and field mapping relation.
In one possible implementation manner, when the association relationship is a mapping relationship of a data table structure, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction specifically includes:
and according to the third setting instruction, at least one of the following is adjusted to the mapping relation of the data table structures of the synchronized intermediate table and the source table:
newly increasing a number condition; modifying the fetch condition; newly adding a plurality of numbers; modifying access numbers a number of bars; write-back mode.
In one possible implementation manner, when the association relationship is a field information mapping relationship, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction specifically includes:
and adjusting the field mapping relation between the synchronized intermediate table and the source table, wherein the field mapping relation comprises at least one of the following steps:
field length, field name.
In one possible implementation, the method further includes:
receiving a fourth setting instruction, and adjusting the data structure of the synchronized intermediate table according to the fourth setting instruction;
wherein the data structure comprises at least any one of the following: table name, service description, database type, master-slave table.
In one possible implementation, the method further includes:
receiving a fifth setting instruction, and determining a data transmission mode between a target intermediate table and the target table according to the fifth setting instruction; the data transmission mode is used for representing the data transmission direction between the target intermediate table and the target table.
In one possible implementation manner, before the data to be transmitted in the target intermediate table is transmitted to the target table, the method further includes:
and detecting the target intermediate table according to the source table, and determining whether the target intermediate table meets corresponding preset conditions.
A data transmission apparatus, comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
and transmitting the data to be transmitted in the target intermediate table to the target table.
A non-transitory computer storage medium for data transmission, storing computer-executable instructions configured to:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
and transmitting the data to be transmitted in the target intermediate table to the target table.
The above-mentioned at least one technical scheme that this description embodiment adopted can reach following beneficial effect: when data transmission is carried out among the data tables with different data table structures, a corresponding intermediate table can be constructed, whether the data tables with the same data table structure are used or not, the data can be transmitted to the intermediate table before the data transmission is carried out, and then the data can be acquired from the intermediate table for data transmission. Therefore, on one hand, the safety of data transmission is improved, on the other hand, the problem that business personnel input data manually is solved, and the working efficiency is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
fig. 1 is a schematic flow chart of a data transmission method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 5 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 7 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 8 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 9 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 10 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 11 is a schematic diagram of a data transmission method according to an embodiment of the present disclosure;
fig. 12 is a schematic flow chart of another data transmission method according to the embodiment of the present disclosure;
fig. 13 is a schematic structural diagram of a data transmission device corresponding to fig. 1 for carrying the above data transmission method according to an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the present specification more apparent, the technical solutions of the present application will be clearly and completely described below with reference to specific embodiments of the present specification and corresponding drawings. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the disclosure, are intended to be within the scope of the present application based on the embodiments described herein.
The following describes in detail the technical solutions provided by the embodiments of the present application with reference to the accompanying drawings.
Fig. 1 is a schematic flow chart of a data transmission method according to an embodiment of the present disclosure. As shown in fig. 1, the data transmission method provided in the embodiment of the present disclosure may include the following steps:
s101, the server determines a corresponding target table and a data table structure of the target table based on the acquired data transmission request.
Wherein, the data transmission request may include: information such as the identity of the target table, the identity of the source table and the like.
Specifically, the server may receive a data transmission request, determine a corresponding target table according to an identity of the target table in the data transmission request, and obtain a data table structure of the target table.
It will be appreciated by those skilled in the art that the data table structures of the data tables in the same database may be different, the data table structures in different databases may be different, and the data table structures in the same database may be different. Therefore, in the embodiment of the present specification, the target table and the source table may be in the same database, may be in different databases, or may even be in the same database, which is not limited in the embodiment of the present specification.
S102, constructing a corresponding intermediate table according to the data table structure of the target table.
In some embodiments of the present description, the intermediate table is the same as the data table structure of the target table.
In order to ensure that the data in the intermediate table can be automatically and accurately transmitted to the target table, the data table structure of the intermediate table and the data table structure of the target table can be set to be the same data table structure.
In some embodiments of the present disclosure, the built intermediate table needs to set corresponding configuration information, such as a server address, a database to which the intermediate table belongs, a login user, a login password, etc., as shown in fig. 2, where the intermediate table in fig. 2 is the database in which the intermediate table is located. It is also necessary to set an instance number of the database to which the source table belongs, as shown in fig. 3, and the GS library in fig. 3 is the database in which the source table is located.
In addition, in the embodiment of the present specification, the intermediate table may be set in the database where the source table is located, the intermediate table may be set in the database where the target table is located, or an independent database of the intermediate table may be established, which is not limited in the embodiment of the present specification.
In the following, the source table and the target table belong to different databases, and in this embodiment of the present disclosure, a common parameter between the two databases needs to be set, as shown in fig. 4, to obtain the location information of the source table and the intermediate table.
S103, receiving a first setting instruction, and acquiring data to be transmitted of the source table according to the first setting instruction.
Specifically, after receiving the first setting instruction, determining a source table needing to transmit data according to the identity of the source table in the data transmission request, and acquiring data to be transmitted of the source table.
It should be noted that, in the embodiment of the present specification, the acquired data to be transmitted of the source table may be displayed to the user.
S104, receiving a second setting instruction, and transmitting the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain the transmitted intermediate table.
At this time, the intermediate table after transmission has stored therein the corresponding data.
As shown in fig. 5, the acquired data to be transmitted of the source table is transmitted to the intermediate table, so that the data table information shown in fig. 5 can be obtained, the main table information is above, the field information is below, the main table data is recorded and then stored, the field information of the table can be loaded by clicking the field information, adjustment can be performed, and the operation of data synchronization can be completed by clicking the configuration.
S105, receiving a fourth setting instruction, and adjusting the data structure of the synchronized intermediate table according to the fourth setting instruction.
Wherein the data structure comprises at least any one of the following: table name, service description, database type, master-slave table, as shown in fig. 6.
S106, receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction.
Wherein, the above-mentioned association includes at least one of the following: data model relationships, field mappings.
Specifically, under the condition that the association relationship is a data table structure mapping relationship, at least one of the following is adjusted according to a third setting instruction to the data table structure mapping relationship between the synchronized intermediate table and the source table:
newly increasing a number condition; modifying the fetch condition; newly adding a plurality of numbers; modifying access numbers a number of bars; write-back mode.
The newly added number condition is used to indicate that some data is newly added in the source table (or the source table is never subjected to data synchronization), and the newly added data is synchronized to the condition of the target table. The modified access condition refers to a condition that some data is modified in the source table and the modified data is synchronized to the target table. The newly added number refers to the maximum number of synchronization bars when some data is newly added in the source table (or the source table is never subjected to data synchronization), and the newly added data is synchronized to the target table. The modified number of entries refers to the maximum number of sync entries when some data is modified in the source table and the modified data is synchronized to the target table. The write-back mode is a flag (or a time stamp of successful synchronization) of writing back the source table after the data synchronization is completed, as shown in fig. 7.
And under the condition that the association relationship is a field information mapping relationship, at least one of the following is adjusted according to a third setting instruction on the field information mapping relationship of the synchronized intermediate table and the source table: the field length, field name, as shown in fig. 8.
And S107, adjusting the synchronized intermediate table according to the adjusted association relation to obtain a target intermediate table.
Before step S107, in order to ensure the authenticity, integrity, feasibility and security of the data transmission, the method further comprises: and detecting the target intermediate table according to the source table, and determining whether the target intermediate table meets corresponding preset conditions. As shown in fig. 9, clicking on the synchronization test in fig. 9 can complete the detection of the target intermediate table.
Wherein, the corresponding preset conditions can comprise any one or more of the following: and detecting the number of transmitted data items (detecting whether the quantity of data to be transmitted is consistent with the quantity of actual archived data), detecting a data summary (detecting whether a data stream is tampered in the transmission process), and detecting the internal and external repeatability of the transmitted data (detecting whether the transmitted data is duplicated according to a customized rule).
S108, transmitting the data to be transmitted in the target intermediate table to the target table.
As shown in fig. 10, clicking on the execution call in fig. 10 completes the data transfer process.
It should be noted that, before step S107, a sixth setting instruction may also be received, and a data transmission manner between the target intermediate table and the target table may be determined according to the sixth setting instruction, as shown in fig. 11.
The data transmission mode is used for representing the data transmission direction between the target intermediate table and the target table.
Taking the difference between the database where the source table and the target table are, as shown in fig. 12, table a is the source table, table B is the target table, the database where table a is the database a, and the database where table B is the database B. The table a realizes basic data synchronization through the steps S101-S104, synchronizes the data to be transmitted in the table a into the intermediate table, and then transmits the data in the intermediate table into the table B through data structure setting, model mapping (i.e. data table structure mapping relation), field mapping, model association, synchronization flow and automatic task.
In some embodiments of the present description, a corresponding data transfer log may also be generated to record the process of data transfer. Thereby facilitating later verification of data transmission.
Based on the scheme, when data transmission is carried out among the data tables with different data table structures, a corresponding intermediate table can be constructed, whether the data tables with the same data table structure are used or not, the data can be transmitted to the intermediate table before the data transmission is carried out, and then the data can be acquired from the intermediate table for data transmission. On the one hand, the security of data transmission is improved, for example, data synchronization is carried out among data tables of different data table structures: the data of A can be pushed to the middle table D firstly by pushing the data of A to C, at the moment, the data structures of D and C are the same, and then the data is acquired from D by C, so that the problem that service personnel input the data manually is solved, and the working efficiency is improved.
Based on the same thought, some embodiments of the present application further provide a device and a non-volatile computer storage medium corresponding to the above method.
Fig. 13 is a schematic structural diagram of a data transmission device corresponding to fig. 1 for carrying the above data transmission method according to an embodiment of the present application, where the device includes:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
and transmitting the data to be transmitted in the target intermediate table to the target table.
Some embodiments of the present application provide a non-volatile computer storage medium corresponding to one of the data transmissions of fig. 1, storing computer-executable instructions configured to:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
and transmitting the data to be transmitted in the target intermediate table to the target table.
All embodiments in the application are described in a progressive manner, and identical and similar parts of all embodiments are mutually referred, so that each embodiment mainly describes differences from other embodiments. In particular, for the apparatus and medium embodiments, the description is relatively simple, as it is substantially similar to the method embodiments, with reference to the section of the method embodiments being relevant.
The devices and media provided in the embodiments of the present application are in one-to-one correspondence with the methods, so that the devices and media also have similar beneficial technical effects as the corresponding methods, and since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the devices and media are not described in detail herein.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (6)
1. A method of data transmission, the method comprising:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
transmitting the data to be transmitted in the target intermediate table to the target table;
before the data to be transmitted in the target intermediate table is transmitted to the target table, the method further comprises:
detecting the target intermediate table according to the source table, and determining whether the target intermediate table meets corresponding preset conditions; the corresponding preset conditions comprise at least one of transmission data item number detection, data abstract detection and transmission data internal and external repeatability detection;
the association relation at least comprises one of the following: data table structure mapping relation and field mapping relation;
and under the condition that the association relationship is a data table structure mapping relationship, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction, wherein the method specifically comprises the following steps:
and according to the third setting instruction, at least one of the following is adjusted to the mapping relation of the data table structures of the synchronized intermediate table and the source table:
newly increasing a number condition; modifying the fetch condition; newly adding a plurality of numbers; modifying access numbers a number of bars; a write-back mode;
and under the condition that the association relationship is a field information mapping relationship, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction, wherein the method specifically comprises the following steps:
and adjusting the field mapping relation between the synchronized intermediate table and the source table, wherein the field mapping relation comprises at least one of the following steps: field length, field name.
2. The method of claim 1, wherein the intermediate table is the same as the database table structure of the target table.
3. The method according to claim 1, wherein the method further comprises:
receiving a fourth setting instruction, and adjusting the data structure of the synchronized intermediate table according to the fourth setting instruction;
wherein the data structure comprises at least any one of the following: table name, service description, database type, master-slave table.
4. The method according to claim 1, wherein the method further comprises:
receiving a fifth setting instruction, and determining a data transmission mode between a target intermediate table and the target table according to the fifth setting instruction; the data transmission mode is used for representing the data transmission direction between the target intermediate table and the target table.
5. A data transmission apparatus, comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
transmitting the data to be transmitted in the target intermediate table to the target table;
before the data to be transmitted in the target intermediate table is transmitted to the target table, detecting the target intermediate table according to the source table, and determining whether the target intermediate table meets corresponding preset conditions; the corresponding preset conditions comprise at least one of transmission data item number detection, data abstract detection and transmission data internal and external repeatability detection;
the association relation at least comprises one of the following: data table structure mapping relation and field mapping relation;
and under the condition that the association relationship is a data table structure mapping relationship, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction, wherein the method specifically comprises the following steps:
and according to the third setting instruction, at least one of the following is adjusted to the mapping relation of the data table structures of the synchronized intermediate table and the source table:
newly increasing a number condition; modifying the fetch condition; newly adding a plurality of numbers; modifying access numbers a number of bars; a write-back mode;
and under the condition that the association relationship is a field information mapping relationship, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction, wherein the method specifically comprises the following steps:
and adjusting the field mapping relation between the synchronized intermediate table and the source table, wherein the field mapping relation comprises at least one of the following steps: field length, field name.
6. A non-transitory computer storage medium storing computer executable instructions for data transmission, the computer executable instructions configured to:
based on the acquired data transmission request, determining a corresponding target table and a data table structure of the target table;
constructing a corresponding intermediate table according to the data table structure of the target table;
receiving a first setting instruction, and acquiring data to be transmitted of a source table according to the first setting instruction;
receiving a second setting instruction, and synchronizing the acquired data to be transmitted of the source table to the intermediate table according to the second setting instruction to obtain a synchronized intermediate table;
receiving a third setting instruction, and adjusting the association relation between the synchronized intermediate table and the source table according to the third setting instruction;
according to the adjusted association relation, adjusting the synchronized intermediate table to obtain a target intermediate table;
transmitting the data to be transmitted in the target intermediate table to the target table;
before the data to be transmitted in the target intermediate table is transmitted to the target table, detecting the target intermediate table according to the source table, and determining whether the target intermediate table meets corresponding preset conditions; the corresponding preset conditions comprise at least one of transmission data item number detection, data abstract detection and transmission data internal and external repeatability detection;
the association relation at least comprises one of the following: data table structure mapping relation and field mapping relation;
and under the condition that the association relationship is a data table structure mapping relationship, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction, wherein the method specifically comprises the following steps:
and according to the third setting instruction, at least one of the following is adjusted to the mapping relation of the data table structures of the synchronized intermediate table and the source table:
newly increasing a number condition; modifying the fetch condition; newly adding a plurality of numbers; modifying access numbers a number of bars; a write-back mode;
and under the condition that the association relationship is a field information mapping relationship, adjusting the association relationship between the synchronized intermediate table and the source table according to the third setting instruction, wherein the method specifically comprises the following steps:
and adjusting the field mapping relation between the synchronized intermediate table and the source table, wherein the field mapping relation comprises at least one of the following steps: field length, field name.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011631154.2A CN112749163B (en) | 2020-12-30 | 2020-12-30 | Data transmission method, device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011631154.2A CN112749163B (en) | 2020-12-30 | 2020-12-30 | Data transmission method, device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112749163A CN112749163A (en) | 2021-05-04 |
| CN112749163B true CN112749163B (en) | 2023-08-01 |
Family
ID=75650768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011631154.2A Active CN112749163B (en) | 2020-12-30 | 2020-12-30 | Data transmission method, device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112749163B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102129478A (en) * | 2011-04-26 | 2011-07-20 | 广州从兴电子开发有限公司 | Database synchronization method and system thereof |
| CN102495910A (en) * | 2011-12-28 | 2012-06-13 | 畅捷通信息技术股份有限公司 | Device and method for data timing synchronization of heterogeneous system |
| CN106570086A (en) * | 2016-10-19 | 2017-04-19 | 上海携程商务有限公司 | Data migration system and method |
| CN107403012A (en) * | 2017-08-01 | 2017-11-28 | 山东浪潮通软信息科技有限公司 | A kind of method for interchanging data and device |
| CN111241192A (en) * | 2019-12-31 | 2020-06-05 | 航天信息软件技术有限公司 | Data synchronization method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9436724B2 (en) * | 2013-10-21 | 2016-09-06 | Sap Se | Migrating data in tables in a database |
-
2020
- 2020-12-30 CN CN202011631154.2A patent/CN112749163B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102129478A (en) * | 2011-04-26 | 2011-07-20 | 广州从兴电子开发有限公司 | Database synchronization method and system thereof |
| CN102495910A (en) * | 2011-12-28 | 2012-06-13 | 畅捷通信息技术股份有限公司 | Device and method for data timing synchronization of heterogeneous system |
| CN106570086A (en) * | 2016-10-19 | 2017-04-19 | 上海携程商务有限公司 | Data migration system and method |
| CN107403012A (en) * | 2017-08-01 | 2017-11-28 | 山东浪潮通软信息科技有限公司 | A kind of method for interchanging data and device |
| CN111241192A (en) * | 2019-12-31 | 2020-06-05 | 航天信息软件技术有限公司 | Data synchronization method |
Non-Patent Citations (1)
| Title |
|---|
| ETL工具Kettle（Spoon）跨库跨表迁移不同表结构的数据;宋发元;《CSDN》;20190220;第二部分 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112749163A (en) | 2021-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108228814B (en) | Data synchronization method and device | |
| CN111314479B (en) | Data processing method and equipment | |
| CN112487083B (en) | Data verification method and device | |
| US10726042B2 (en) | Replication control using eventually consistent meta-data | |
| CN110413634A (en) | Data query method, system, device and computer readable storage medium | |
| EP1725953A1 (en) | Apparatus and method for data consistency validation. | |
| CN111857981A (en) | Data processing method and device | |
| CN114416868A (en) | Data synchronization method, device, equipment and storage medium | |
| CN109471901B (en) | Data synchronization method and device | |
| CN112749163B (en) | Data transmission method, device and medium | |
| CN117336135A (en) | Data transmission method, device, storage medium and electronic equipment | |
| CN116414914A (en) | Data synchronization method and device, processor and electronic equipment | |
| CN115378823B (en) | Public cloud drop planning method and device, electronic equipment and storage medium | |
| CN116450691A (en) | Data resource management method, device, equipment and medium | |
| US20090210453A1 (en) | Service for verifying consistency of replicated data | |
| CN114328751A (en) | Method and device for synchronizing multi-source heterogeneous data, storage medium and electronic equipment | |
| CN111291127B (en) | Data synchronization method, device, server and storage medium | |
| CN111143469A (en) | Data reconciliation method and device, electronic equipment and storage medium | |
| CN106156043A (en) | A kind of off-line data processing method and processing device | |
| CN116436836B (en) | Domain name data synchronous detection method, device and equipment | |
| CN110990466B (en) | Data synchronization method and device | |
| CN117632227A (en) | Method, equipment and medium for managing product delivery version | |
| CN114138769A (en) | System and method for automatically checking and acquiring CMDB data | |
| CN107943942B (en) | Event-driven multi-turn file acquisition system | |
| CN117216154A (en) | Heterogeneous database data replication system, method and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230704 Address after: 250101 Inspur science and Technology Park, 1036 Inspur Road, hi tech Zone, Jinan City, Shandong Province Applicant after: Inspur Genersoft Co.,Ltd. Address before: 250101 Inspur science and Technology Park, 1036 Inspur Road, hi tech Zone, Jinan City, Shandong Province Applicant before: SHANDONG INSPUR GENESOFT INFORMATION TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |