CN112597175B - Data docking method, system, device and storage medium - Google Patents
Data docking method, system, device and storage medium Download PDFInfo
- Publication number
- CN112597175B CN112597175B CN202011476366.8A CN202011476366A CN112597175B CN 112597175 B CN112597175 B CN 112597175B CN 202011476366 A CN202011476366 A CN 202011476366A CN 112597175 B CN112597175 B CN 112597175B
- Authority
- CN
- China
- Prior art keywords
- data
- field
- configuration information
- provider
- view
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003032 molecular docking Methods 0.000 title claims abstract description 123
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000013507 mapping Methods 0.000 claims abstract description 44
- 238000012545 processing Methods 0.000 claims description 14
- 238000000605 extraction Methods 0.000 claims description 3
- 238000003780 insertion Methods 0.000 claims 1
- 230000037431 insertion Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 19
- 239000000463 material Substances 0.000 description 11
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 238000013075 data extraction Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008521 reorganization Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data docking method, a system, a device and a storage medium, which are used for solving the technical problem of low docking efficiency among different systems in the prior art, and the method comprises the following steps: according to the service identification provided by the data demand party, acquiring data docking configuration information between the data provider corresponding to the service identification and the data demand party from a preset database; the preset database stores data docking configuration information between a data provider configured for different service demands and a data demand party, and one service demand corresponds to one service identifier; according to the mapping relation contained in each piece of data docking configuration information, a first field is extracted from a first data table of a data provider from a main field to serve as a second field of a data demand party, so that a data view is formed; the main field is a field common to the respective data providers; and extracting the data contained in the first field in the data provider according to the data view, inserting the data into the data view, and sending the data to the data demander.
Description
Technical Field
The present invention relates to the field of databases, and in particular, to a method, a system, an apparatus, and a storage medium for data docking.
Background
With the increasing popularity of networks, a great deal of data interaction and integration are often required between different companies or different business departments within the same company, which is a commonly adopted solution implemented using service subscription.
However, service subscription generally requires that a service provider develop an interface first and publish the interface to a service platform, a service demander subscribes a required service on the service platform, only obtains a field communicated in advance after subscription is completed, and processes the obtained field and stores the field in a database of the service demander.
Obviously, this requires the service provider and the service demander to communicate and comb the business processes in advance, and develop related programs, which greatly reduces the docking efficiency.
Disclosure of Invention
The invention provides a data docking method, a system, a device and a storage medium, which are used for solving the technical problem of low docking efficiency among different systems in the prior art.
In order to solve the above technical problems, a technical solution of a data docking method provided by an embodiment of the present invention is as follows:
According to the service identification provided by the data demand party, acquiring data docking configuration information between the data provider corresponding to the service identification and the data demand party from a preset database; the preset database stores data docking configuration information between a data provider configured for different service requirements and a data demand party, and one service requirement is uniquely identified by one service identifier;
according to the mapping relation contained in each piece of data docking configuration information, a first field is extracted from a first data table of a data provider from a main field to serve as a second field of a data demand party, so that a data view is formed; wherein the main field is a field common to all data providers;
And extracting data contained in a first field in the data provider according to the data view, inserting the data into the data view, and sending the data to the data demander.
Before acquiring the data docking configuration information between the data provider corresponding to the service identifier and the data demander from the preset database, one possible implementation manner further includes:
According to user operation, determining a first field corresponding to each second field in the data provider;
establishing a mapping relation between the second field and the first field, and generating all mapping relations with the same data provider as one data docking configuration information;
And generating one service identifier for all the data docking configuration information.
One possible implementation manner, after generating one service identifier for all the data docking configuration information, further includes:
And modifying, adding or deleting the data docking configuration information contained in the service identifier.
According to a possible implementation manner, according to a mapping relation included in each piece of data docking configuration information, a first field is extracted from a first data table of a data provider from a main field as a second field of a data requiring party to form a data view, and the method includes:
sequentially extracting the main field and the corresponding first field from the first piece of data docking configuration information according to the mapping relation contained in the first piece of data docking configuration information, extracting the first field corresponding to the main field from the rest of data docking configuration information until the first field contained in the last piece of data docking configuration information is extracted, and forming the data view;
Wherein, when extracting the main field and each of the first fields, for each mapping rule: judging whether the field types of the second field and the extracted field are the same; and if the data types are different, converting the data types corresponding to the extracted fields into field types corresponding to the second fields.
In one possible implementation manner, extracting data contained in a first field in the data provider and inserting the data into the data view includes:
And according to each mapping relation, inserting the data of the first field in the data provider into the corresponding field in the data view.
In one possible implementation manner, after extracting the data included in the first field in the data provider and inserting the data into the data view, and sending the data to the data demander, the method further includes:
determining the intersection and difference set of the second data table of the data requiring party and the data in the latest data view when the data synchronization is carried out each time;
updating each piece of data contained in the intersection in the latest data view to the second data table according to the main field;
and sending each piece of data contained in the difference set in the latest data view to the data demander, so that any piece of data contained in the difference set is correspondingly inserted or deleted in the second data table.
A possible implementation manner, determining an intersection and a difference set of the data requiring party and the latest data view, includes:
Determining the data common to the latest data view and the second data table as the intersection;
And determining the non-shared data in the latest data view and the second data table as the difference set.
In a second aspect, an embodiment of the present invention provides a docking system, including:
The acquisition unit is used for acquiring data docking configuration information between the data provider corresponding to the service identifier and the data demand party from a preset database according to the service identifier provided by the data demand party; the preset database stores data docking configuration information between a data provider configured for different service requirements and a data demand party, and one service requirement is uniquely identified by one service identifier;
The extraction unit is used for extracting a first field from a first data table of the data provider from the main field as a second field of the data requiring party according to the mapping relation contained in each piece of data docking configuration information to form a data view; wherein the main field is a field common to all data providers;
And the processing unit is used for extracting the data contained in the first field in the data provider according to the data view, inserting the data into the data view and sending the data to the data demander.
In a possible embodiment, the acquisition unit is further configured to:
According to user operation, determining a first field corresponding to each second field in the data provider;
establishing a mapping relation between the second field and the first field, and generating all mapping relations with the same data provider as one data docking configuration information;
And generating one service identifier for all the data docking configuration information.
In a possible embodiment, the acquisition unit is further configured to:
And modifying, adding or deleting the data docking configuration information contained in the service identifier.
In a possible embodiment, the extraction unit is further configured to:
sequentially extracting the main field and the corresponding first field from the first piece of data docking configuration information according to the mapping relation contained in the first piece of data docking configuration information, extracting the first field corresponding to the main field from the rest of data docking configuration information until the first field contained in the last piece of data docking configuration information is extracted, and forming the data view;
Wherein, when extracting the main field and each of the first fields, for each mapping rule: judging whether the field types of the second field and the extracted field are the same; and if the data types are different, converting the data types corresponding to the extracted fields into field types corresponding to the second fields.
In a possible embodiment, the processing unit is further configured to:
And according to each mapping relation, inserting the data of the first field in the data provider into the corresponding field in the data view.
A possible implementation the processing unit is further configured to:
determining the intersection and difference set of the second data table of the data requiring party and the data in the latest data view when the data synchronization is carried out each time;
Updating each piece of data contained in the intersection in the latest data view into the second data table according to the main field;
And sending each piece of data contained in the difference set in the latest data view to the data demander, so that any piece of data contained in the difference set is correspondingly inserted or deleted in the second data table.
In a possible embodiment, the processing unit is further configured to:
Determining the data common to the latest data view and the second data table as the intersection;
And determining the non-shared data in the latest data view and the second data table as the difference set.
In a third aspect, an embodiment of the present invention further provides a device for data docking, including:
At least one processor, and
A memory coupled to the at least one processor;
Wherein the memory stores instructions executable by the at least one processor, the at least one processor performing the method of the first aspect described above by executing the instructions stored by the memory.
In a fourth aspect, an embodiment of the present invention further provides a readable storage medium, including:
the memory device is used for storing the data,
The memory is configured to store instructions that, when executed by the processor, cause an apparatus comprising the readable storage medium to perform the method as described in the first aspect above.
Drawings
FIG. 1 is a flow chart of a data docking method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of configuring data resources provided by a data provider according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a mapping relationship between fields between a data requester and a data provider according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of generating a service identifier according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of adding data docking configuration information according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of data docking according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of data extraction and reorganization according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a docking system according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a data docking method, a system, a device and a storage medium, which are used for solving the technical problem of low docking efficiency among different systems in the prior art.
In order to better understand the above technical solutions, the following detailed description of the technical solutions of the present invention is made by using the accompanying drawings and specific embodiments, and it should be understood that the specific features of the embodiments and the embodiments of the present invention are detailed descriptions of the technical solutions of the present invention, and not limiting the technical solutions of the present invention, and the technical features of the embodiments and the embodiments of the present invention may be combined with each other without conflict.
Referring to fig. 1, an embodiment of the present invention provides a method for data docking, and the processing procedure of the method is as follows.
Step 101: acquiring data docking configuration information between a plurality of data providers corresponding to the service identifiers and the data demander from a preset database according to the service identifiers provided by the data demander; the preset database stores data docking configuration information between a data provider configured for different service requirements and a data demand party, and one service requirement is uniquely identified by one service identifier.
The data docking method provided by the embodiment of the invention is applied to a docking system, wherein the docking system can comprise a data provider (namely an external system) which can be selected, a data table which can be provided by the data provider, a resource pool formed by fields in the data table and the like, a user configures data resources provided by the data provider through resource pool configuration operation, and generates a unique data provider identifier, so that the user can inquire the data resources which can be provided by the corresponding data provider according to the data provider identifier when the data docking configuration operation is carried out subsequently. In addition, the data provider can modify and store the data table, the field and the like which can be provided by the data provider in the docking system according to actual conditions so as to update the resource pool.
Fig. 2 is a schematic diagram of configuring data resources provided by a data provider according to an embodiment of the present invention. The user configures the data resources provided by the data provider through the resource pool configuration operation, which comprises the following steps: the IP and port of the data provider is configured, the login name (user name) of the data provider, the login password of the data provider, the data table of the data provider (which may be 1 or more data tables), the fields of the data table (one data table may include one or more fields), which constitute configuration information of the data provider, are stored in the docking system, and a unique data provider identification is also generated for the configuration information.
Before acquiring the data docking configuration information between the data provider and the data demander corresponding to the service identifier from the preset database, the service identifier needs to be generated, which can be achieved by the following steps:
According to user operation, determining a first field corresponding to each second field in the data requiring party in the data provider (a data table selected by a user from the data provider is called a first data table, and a field selected from a first writing table is a first field); establishing a mapping relation between the second field and the first field, and generating all mapping relations which are sourced from the same data provider into data docking configuration information; a service identification is generated for all data docking configuration information.
Referring to fig. 3, a schematic diagram of a mapping relationship between fields of a data consumer and a data provider according to an embodiment of the present invention, a second field included in a second data table to be created by the data consumer includes: order number, order description, approver, material description, budget department. Wherein, the order description and the approver are located in table 1 of the external system a, the material description and the budget department are located in table 2 of the external system B, and the above tables 1 and 2 have common field order numbers, so the order numbers can be set as the main field of the second data table to be established by the data demander in the docking system through user operation, and the first field is extracted from table 1: order number, order description and approver, extracting material description and budget department from the table 2, and establishing the corresponding relation between the second data table and the tables 1 and 2. For example, the corresponding relationship between the second data table and table 1 is a piece of data docking configuration information, and the piece of docking configuration information includes mapping relationships between three first fields (order number, order description, approver) in table 1 and three corresponding second fields (order number, order description, approver) in the second data table.
The data list and the fields which can be provided by the data provider can be displayed to the user in the form of the resource pool, the user can drag the first field in the first data list in the selected data provider to the second data list in a dragging mode on the display interface, the docking system automatically establishes data docking configuration information and mapping relation contained in each piece of configuration information according to the dragging operation of the user, one service for the data provider is formed after the second data list for the data provider is configured, and a corresponding service identifier is generated and stored, so that the data provider can acquire the data provided by the data provider from the docking system by using the service identifier.
Referring to fig. 4, a schematic diagram of generating service identifiers according to an embodiment of the present invention is shown, a user selects a first data table from a resource pool and a first field from the first data table with a data provider identifier, and drags the first data table to a second field of a second data table representing a data requiring party, a docking system creates a mapping relationship according to a dragging result, forms and stores data docking configuration information shown in fig. 4, generates a service identifier for the data docking configuration information, and stores a correspondence relationship between the service identifier and the data docking configuration information in a preset database. The data docking configuration information comprises a data provider identifier, a first data table of the data provider and a first field of the first data table, and a mapping relation between the data provider identifier, a second data table of the data provider and a second field of the second data table.
After the data configuration information of the data provider and the data demander is established, a service identifier is generated for all the data docking configuration information, and the data docking configuration information can be modified, added or deleted by the data contained in the service identifier.
Please refer to fig. 5, which is a schematic diagram of adding data docking configuration information provided in an embodiment of the present invention, when an order generation date corresponding to an order number in table 3 in the external system C needs to be added to a second data table of a data demander on the basis of fig. 3, the corresponding data docking configuration information is added, and the adding method is the same as the method established above, and will not be repeated.
When the data demander needs to acquire the service corresponding to the service identifier, the docking system can execute step 102 after finding the corresponding data docking configuration information from the preset database according to the service identifier provided by the demander only by sending a request message carrying the service identifier to the docking system.
Step 102: according to the mapping relation contained in each piece of data docking configuration information, a first field is extracted from a first data table of a data provider from a main field to serve as a second field of a data demand party, so that a data view is formed; wherein the main field is a field common to the respective data providers.
According to the mapping relation contained in each piece of data docking configuration information, a first field is extracted from a first data table of each data provider from a main field to serve as a second field of a data demand party, and a data view is formed, which can be realized by the following modes:
And sequentially extracting the main field and the corresponding first field from the first piece of data docking configuration information according to the mapping relation contained in the first piece of data docking configuration information, and extracting the first fields corresponding to the main field from the rest of data docking configuration information until the first fields contained in the last piece of data docking configuration information are extracted, so as to form a data view.
Wherein, when extracting the main field and each first field, for each mapping rule: judging whether the field types of the second field and the extracted field are the same; if the data types are different, converting the data types corresponding to the extracted fields into the field types corresponding to the second fields.
For example, taking the example in fig. 4 as an example, the data type corresponding to the second field order generation date in table 1 is date type data, and the data type of the first field (order generation date) corresponding to the second field (order generation date) in the data table of the data demander is required to be character type data, at this time, the data type of the second field (order generation date) acquired from table 3 may be converted into character type data, so that the data of the corresponding field may be converted when the data is subsequently extracted.
After the data view is formed, step 103 may be performed.
Step 103: and extracting the data contained in the first field in the data provider according to the data view, inserting the data into the data view, and sending the data to the data demander.
According to the service identification provided by the data demand party, acquiring data docking configuration information between the data provider corresponding to the service identification and the data demand party from a preset database; according to the mapping relation contained in each piece of data docking configuration information, a first field is extracted from a first data table of a data provider from a main field to serve as a second field of a data demand party, so that a data view is formed; and extracting the data contained in the first field in the data provider according to the data view, inserting the data into the data view, and sending the data to the data demander. The data docking is realized without development and release of service of a data provider, conversion and mapping between data are not required by programmers of a data demand party, re-development is not required when the demand is changed, and only the data docking configuration information is required to be modified on a docking system, so that the data docking efficiency between different systems can be effectively improved, and the development cost is saved.
Inserting data in a data provider into the data view may be accomplished by:
And according to each mapping relation, inserting the data of the first field in the data provider into the corresponding field in the data view.
Fig. 6 is a schematic diagram of data docking according to an embodiment of the present invention.
The data demand side requests the data docking system to provide data corresponding to the service identification through the service identification, the data docking system acquires all data docking configuration information corresponding to the service identification from a preset database according to the service identification, the data docking system is assumed to comprise n pieces of data docking configuration information, all first fields extracted from all data providers form a data view according to a main field according to a mapping relation contained in each piece of data docking configuration information, data corresponding to the first fields are acquired from the data provider according to the data view, data are recombined, and the recombined data are sent to the data demand side.
Fig. 7 is a schematic diagram of data extraction and reorganization according to an embodiment of the invention. Taking fig. 4 as an example, when data extraction is performed, the docking system sequentially extracts data corresponding to each first field from the data provider 1 to the data provider 3 according to the formed data view, and recombines the data of the first field with different types from the second field, converts the data into data with the same type as the second field, and then transmits the data to the data demander to form a second data table of the data demander.
After the data in the provider is inserted into the data view and sent to the data demander, the data in the second data table may be data synchronized by:
Determining the intersection and difference set of the second data table of the data requiring party and the data in the latest data view when the data synchronization is carried out each time; updating each piece of data contained in the intersection of the latest data view into a second data table of the data requiring party according to the main field; and sending each piece of data contained in the difference set to the data demand side, and correspondingly inserting or deleting any piece of data contained in the difference set into a second data table of the data demand side.
Determining the intersection and difference of the second field of the data demander and the field in the most recent data view may be achieved by: determining the data shared by the latest data view and a second data table of the data requiring party as an intersection; and determining the data which is not shared in the second data table of the latest data view and the data requiring party as a difference set.
For example, please refer to table 1 for the second data table of the data consumer, and table 2 for the data table corresponding to the latest data view.
TABLE 1
| Order number | Order description | Approval person | Description of materials | Budget department |
| 1 | Purchasing | Zhang San (Zhang San) | Material 1 | X1 |
| 2 | Purchasing | Liwu four-element bag | Material 3 | X2 |
| 3 | Purchasing | Zhang San (Zhang San) | Material 5 | X1 |
TABLE 2
| Order number | Order description | Approval person | Description of materials | Budget department |
| 2 | Purchasing | Zhang San (Zhang San) | Material 3 | X2 |
| 3 | Purchasing | Zhang San (Zhang San) | Material 5 | X1 |
| 4 | Sell for sale | Liwu four-element bag | Material 2 | X3 |
In table 1 (data demand side) and table 2 (data view), two pieces of data corresponding to order numbers 2 and 3 are data common to table 1 and table 2, and thus they are determined as intersections of the second data table of the data demand side and the data view corresponding data table, and two pieces of data corresponding to order numbers 1 and 4 are data not common to table 1 and table 2, and thus they are determined as differences of the second data table of the data demand side and the data view corresponding data table. Two pieces of data included in an intersection in table 2 (data view) are updated into a second data table of the data demander, each piece of data included in the difference set is transmitted to the data demander, and since one piece of data with an order number of 1 is in table 1 of the data demander and no piece of data is in table 2, the entry data needs to be deleted, and since one piece of data with an order number of 4 is in table 2 and no piece of data is in table 1, the one piece of data needs to be added in table 1 of the data demander, and finally the data in the data demander is consistent with the data in the latest data view.
Based on the same inventive concept, in an embodiment of the present invention, a docking system is provided, and a specific implementation of a data docking method of the docking system may be referred to in a description of an embodiment of the method, and details are not repeated, and referring to fig. 8, the docking system includes:
an obtaining unit 801, configured to obtain, from a preset database, data docking configuration information between a data provider corresponding to a service identifier and the data demander according to the service identifier provided by the data demander; the preset database stores data docking configuration information between a data provider configured for different service requirements and a data demand party, and one service requirement is uniquely identified by one service identifier;
An extracting unit 802, configured to extract, from the main field, a first field from a first data table of the data provider as a second field of the data demander according to the mapping relationship included in each piece of data interfacing configuration information, to form a data view; wherein the field is a field common to the data providers;
And the processing unit 803 is configured to extract, according to the data view, data included in the first field in the data provider, insert the data into the data view, and send the data to the data demander.
In a possible implementation manner, the obtaining unit 801 is further configured to:
According to user operation, determining a first field corresponding to each second field in the data provider;
establishing a mapping relation between the second field and the first field, and generating all mapping relations with the same data provider as one data docking configuration information;
And generating one service identifier for all the data docking configuration information.
In a possible implementation manner, the obtaining unit 801 is further configured to:
And modifying, adding or deleting the data docking configuration information contained in the service identifier.
In a possible implementation manner, the extracting unit 802 is further configured to:
sequentially extracting the main field and the corresponding first field from the first piece of data docking configuration information according to the mapping relation contained in the first piece of data docking configuration information, extracting the first field corresponding to the main field from the rest of data docking configuration information until the first field contained in the last piece of data docking configuration information is extracted, and forming the data view;
Wherein, when extracting the main field and each of the first fields, for each mapping rule: judging whether the field types of the second field and the extracted field are the same; and if the data types are different, converting the data types corresponding to the extracted fields into field types corresponding to the second fields.
In a possible implementation manner, the processing unit 803 is further configured to:
And according to each mapping relation, inserting the data of the first field in the data provider into the corresponding field in the data view.
One possible implementation the processing unit 803 is further configured to:
determining the intersection and difference set of the second data table of the data requiring party and the data in the latest data view when the data synchronization is carried out each time;
updating each item contained in the intersection in the latest data view to the second data table according to the main field;
And sending each piece of data contained in the difference set to the data requiring party, and enabling any piece of data contained in the difference set to be inserted into or deleted from the second data table correspondingly.
In a possible implementation manner, the processing unit 803 is further configured to:
Determining the data common to the latest data view and the second data table as the intersection;
And determining the non-shared data in the latest data view and the second data table as the difference set.
Based on the same inventive concept, an embodiment of the present invention provides a data docking device, including: at least one processor, and
A memory coupled to the at least one processor;
Wherein the memory stores instructions executable by the at least one processor, the at least one processor performing the data interfacing method as described above by executing the instructions stored by the memory.
Based on the same inventive concept, an embodiment of the present invention also provides a readable storage medium, including:
the memory device is used for storing the data,
The memory is for storing instructions that, when executed by the processor, cause an apparatus comprising the readable storage medium to perform the data interfacing method as described above.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (10)
1. A method of data interfacing, comprising:
According to the service identification provided by the data demand party, acquiring data docking configuration information between the data provider corresponding to the service identification and the data demand party from a preset database; the preset database stores data docking configuration information between a data provider configured for different service requirements and a data demand party, and one service requirement is uniquely identified by one service identifier;
according to the mapping relation contained in each piece of data docking configuration information, a first field is extracted from a first data table of a data provider from a main field to serve as a second field of a data demand party, so that a data view is formed; wherein the main field is a field common to all data providers;
And extracting data contained in a first field in the data provider according to the data view, inserting the data into the data view, and sending the data to the data demander.
2. The method of claim 1, further comprising, prior to obtaining data docking configuration information between a data provider corresponding to a service identification and the data demander from a preset database:
According to user operation, determining a first field corresponding to each second field in the data provider;
establishing a mapping relation between the second field and the first field, and generating all mapping relations with the same data provider as one data docking configuration information;
And generating one service identifier for all the data docking configuration information.
3. The method of claim 2, further comprising, after generating one of the service identities for all of the data docking configuration information:
And modifying, adding or deleting the data docking configuration information contained in the service identifier.
4. The method of claim 1, wherein extracting the first field from the first data table of the data provider as the second field of the data demander from the main field according to the mapping relation included in each piece of data interfacing configuration information, forming the data view, comprises:
sequentially extracting the main field and the corresponding first field from the first piece of data docking configuration information according to the mapping relation contained in the first piece of data docking configuration information, extracting the first field corresponding to the main field from the rest of data docking configuration information until the first field contained in the last piece of data docking configuration information is extracted, and forming the data view;
Wherein, when extracting the main field and each of the first fields, for each mapping rule: judging whether the field types of the second field and the extracted field are the same; and if the data types are different, converting the data types corresponding to the extracted fields into field types corresponding to the second fields.
5. The method of claim 1, wherein extracting the data contained in the first field of the data provider for insertion into the data view comprises:
And according to each mapping relation, inserting the data of the first field in the data provider into the corresponding field in the data view.
6. The method according to any one of claims 1-5, wherein after extracting the data contained in the first field in the data provider, inserting the data into the data view, and sending the data to the data demander, further comprises:
determining the intersection and difference set of the second data table of the data requiring party and the data in the latest data view when the data synchronization is carried out each time;
Updating each piece of data contained in the intersection in the latest data view into the second data table according to the main field;
And sending each piece of data contained in the difference set to the data requiring party, and enabling any piece of data contained in the difference set to be inserted into or deleted from the second data table correspondingly.
7. The method of claim 6, wherein determining the intersection and difference set of the second data packet of the data demander and the most recent data view comprises:
Determining the data common to the latest data view and the second data table as the intersection;
And determining the non-shared data in the latest data view and the second data table as the difference set.
8. A docking system, comprising:
The acquisition unit is used for acquiring data docking configuration information between the data provider corresponding to the service identifier and the data demand party from a preset database according to the service identifier provided by the data demand party; the preset database stores data docking configuration information between a data provider configured for different service requirements and a data demand party, and one service requirement is uniquely identified by one service identifier;
The extraction unit is used for extracting a first field from a first data table of the data provider from the main field as a second field of the data requiring party according to the mapping relation contained in each piece of data docking configuration information to form a data view; wherein the main field is a field common to all data providers;
And the processing unit is used for extracting the data contained in the first field in the data provider according to the data view, inserting the data into the data view and sending the data to the data demander.
9. An apparatus for data interfacing, comprising:
At least one processor, and
A memory coupled to the at least one processor;
Wherein the memory stores instructions executable by the at least one processor, the at least one processor performing the method of any of claims 1-7 by executing the instructions stored by the memory.
10. A readable storage medium comprising a memory,
The memory is configured to store instructions that, when executed by a processor, cause an apparatus comprising the readable storage medium to perform the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011476366.8A CN112597175B (en) | 2020-12-15 | 2020-12-15 | Data docking method, system, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011476366.8A CN112597175B (en) | 2020-12-15 | 2020-12-15 | Data docking method, system, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112597175A CN112597175A (en) | 2021-04-02 |
| CN112597175B true CN112597175B (en) | 2024-07-23 |
Family
ID=75196511
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011476366.8A Active CN112597175B (en) | 2020-12-15 | 2020-12-15 | Data docking method, system, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112597175B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109726235A (en) * | 2018-11-27 | 2019-05-07 | 东软集团股份有限公司 | Method for interchanging data, device, readable storage medium storing program for executing, electronic equipment and system |
| CN110807033A (en) * | 2019-10-12 | 2020-02-18 | 中思博安科技（北京）有限公司 | Data management method, device and system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851458B (en) * | 2019-11-15 | 2024-02-09 | 江苏国泰新点软件有限公司 | Resource acquisition method, device, system and storage medium |
| CN111291247A (en) * | 2020-01-20 | 2020-06-16 | 支付宝(杭州)信息技术有限公司 | Data service providing method, device and equipment |
| CN111897818B (en) * | 2020-07-31 | 2024-08-23 | 深圳市优联创达科技有限公司 | Data storage method, device, electronic equipment and storage medium |
-
2020
- 2020-12-15 CN CN202011476366.8A patent/CN112597175B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109726235A (en) * | 2018-11-27 | 2019-05-07 | 东软集团股份有限公司 | Method for interchanging data, device, readable storage medium storing program for executing, electronic equipment and system |
| CN110807033A (en) * | 2019-10-12 | 2020-02-18 | 中思博安科技（北京）有限公司 | Data management method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112597175A (en) | 2021-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10218657B2 (en) | Method and system for providing private chat within a group chat | |
| CN111182025B (en) | Message processing method, device, server and storage medium | |
| CN111666326A (en) | ETL scheduling method and device | |
| CN109189841A (en) | A kind of multi-data source access method and system | |
| CN113204598B (en) | Data synchronization method, system and storage medium | |
| CN110543469B (en) | Database version management method and server | |
| US20190114340A1 (en) | Normalizing user identification across disparate systems | |
| CN112818654A (en) | Message storage method, message generation method, message storage device, electronic equipment and computer readable medium | |
| CN114780982A (en) | Flow business circulation method, device and system | |
| CN112597175B (en) | Data docking method, system, device and storage medium | |
| CN107818117B (en) | Data table establishing method, online query method and related device | |
| CN111143426A (en) | Multi-system user information association method and device | |
| CN107679096B (en) | Method and device for sharing indexes among data marts | |
| CN108696549B (en) | Load balancing method, device and system | |
| CN111414566B (en) | Method and device for pushing information | |
| KR101700838B1 (en) | Method and system for managing business project step by step | |
| CN113868687A (en) | Task processing progress management method and device | |
| CN110766497A (en) | Trading method, platform, system and computer readable storage medium | |
| CN110781191A (en) | Processing method of layout data and server | |
| CN111784376A (en) | Method and apparatus for processing information | |
| CN110888883A (en) | Data storage method, device, system and storage medium | |
| CN112965740B (en) | Asset information export method and device | |
| CN115033647B (en) | Data synchronization method and device, electronic equipment and storage medium | |
| CN109840196B (en) | Method and device for testing business logic | |
| CN115242866B (en) | Micro-service calling method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |