CN115934736A - Data docking method, device, equipment and storage medium - Google Patents
Data docking method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN115934736A CN115934736A CN202211543204.0A CN202211543204A CN115934736A CN 115934736 A CN115934736 A CN 115934736A CN 202211543204 A CN202211543204 A CN 202211543204A CN 115934736 A CN115934736 A CN 115934736A
- Authority
- CN
- China
- Prior art keywords
- data
- heterogeneous
- field
- target
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a data docking method, a data docking device, equipment and a storage medium, and the method comprises the following steps: calling a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform; reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data; configuring the extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database; and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data. The dynamic adaptation of access and outgoing data is realized according to the service update, and the flexibility of data docking is improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data docking method, apparatus, device, and storage medium.
Background
At present, service enterprises such as existing finance enterprises and banks generally need to carry out data docking with a plurality of brand manufacturers during operation, the existing data docking mode is customized development according to the requirements of the brand manufacturers, and data and outgoing data are stored according to an outgoing field design table structure; the existing data processing mode cannot define the expansion function according to the requirements of the service scene, and the new service needs to be developed again when appearing, so that the workload of the version process is increased, and the scene application requirement of quick online butting of online timeliness is prolonged.
Disclosure of Invention
The embodiment of the application provides a data docking method, a data docking device, data docking equipment and a storage medium, and aims to solve the technical problem that the flexibility is poor due to the fact that the data docking process cannot be expanded in the prior art.
In one aspect, an embodiment of the present application provides a data docking method, where the data docking method includes the following steps:
calling a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform;
reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data;
configuring the extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database;
and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data.
In a possible implementation manner of the present application, the reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in the heterogeneous database to obtain an update field in the heterogeneous data includes:
reading data type parameters and data character quantity in data fields of the heterogeneous data and storage type parameters and storage character quantity of storage fields related to the heterogeneous data in the heterogeneous database;
if the data type parameter is matched with the storage type parameter and the data character quantity is matched with the storage character quantity, marking the data field as a conventional data field;
if the data type parameter does not match the storage type parameter or the data character size does not match the storage character size, the data field is marked as an update field.
In a possible implementation manner of the present application, the reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in the heterogeneous database to obtain an update field in the heterogeneous data further includes:
acquiring a service identifier and a terminal identifier of a data field in the heterogeneous data, and a storage field associated with the terminal identifier in the heterogeneous database;
and reading the preset service identification associated with the storage field, and if the service identification of the heterogeneous data is not matched with the preset service identification of each storage field, setting the heterogeneous data as an update field of the heterogeneous data.
In a possible implementation manner of the present application, the configuring, according to the updated field and a preset field update rule, an extended field of the heterogeneous database to obtain an updated heterogeneous database includes:
accessing a field database, and acquiring a field updating rule related to the updating field, and field description data and field type parameters in the field updating rule;
carrying out field configuration on the extension field associated with the update field according to the field type parameter to generate a target storage field of the update field;
rendering and setting the target storage field according to the field description data to obtain an updated storage field of the updated field;
and updating and configuring the heterogeneous database according to the updated storage field to obtain an updated heterogeneous database.
In a possible implementation manner of the present application, the responding to the data docking request to obtain target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data includes:
responding to the data docking request, and acquiring a terminal identifier and a service type of a target service terminal associated with the data docking request;
accessing a heterogeneous database, and acquiring heterogeneous data associated with the terminal identifier and the service type in the heterogeneous database;
setting the heterogeneous data associated with the terminal identifier and the service type as target heterogeneous data;
and acquiring a target outgoing interface of the target heterogeneous data, and transmitting the target heterogeneous data to the target service terminal based on the target outgoing interface.
In a possible implementation manner of the present application, the obtaining the target outgoing interface of the target heterogeneous data, and transmitting the target heterogeneous data to the target service terminal based on the target outgoing interface includes:
acquiring a target outgoing interface of the target heterogeneous data, transmitting the target heterogeneous data to the target outgoing interface, and sending the target heterogeneous data to a preset isolation gateway through the target outgoing interface;
and driving the isolation gateway to transmit the target heterogeneous data to a target service terminal pointed by the data docking request.
In a possible implementation manner of the present application, after the responding to the data docking request to obtain the target heterogeneous data in the heterogeneous database and transmitting the target heterogeneous data according to the target outgoing interface of the target heterogeneous data, the method further includes:
receiving a data transmission result fed back by the target service terminal;
if the data transmission result is transmission failure, acquiring a data reissue strategy of the target heterogeneous data;
and obtaining the retry outgoing times and retry outgoing time in the data reissue strategy, and performing data reissue on the target heterogeneous data according to the retry outgoing times and the retry outgoing time to obtain a data reissue result.
In another aspect, the present application provides a data interfacing apparatus, including:
the data acquisition module is configured to call a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform;
the field matching module is configured to read a data field of the heterogeneous data, compare the data field with a preset storage field in the heterogeneous database, and obtain an update field in the heterogeneous data;
the field configuration module is configured to configure the extended field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and store the heterogeneous data into the updated heterogeneous database;
and the data transmission module is configured to read the response data docking request, acquire the target heterogeneous data in the heterogeneous database, and transmit the target heterogeneous data according to the target outgoing interface of the target heterogeneous data.
In another aspect, the present application further provides a data docking device, including:
one or more processors;
a memory; and
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the steps of the data interfacing method.
In another aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, the computer program being loaded by a processor to execute the steps in the data docking method.
In the application, the preset data acquisition script is called to acquire the heterogeneous data cached by the preset service data platform; reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data; configuring an extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database; and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data. The dynamic adaptation of access and outgoing data according to the service update is realized, and the flexibility of data docking is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic view of a scenario of a data docking method according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating an embodiment of a data docking method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of an embodiment of determining an update field of heterogeneous data in a data docking method according to the present application;
fig. 4 is a schematic flowchart of an embodiment of performing data reissuing in the data docking method according to the embodiment of the present application;
fig. 5 is a schematic structural diagram of an embodiment of a data docking device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an embodiment of a data docking device provided in the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be considered as limiting the present invention. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
In this application, the word "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is presented to enable any person skilled in the art to make and use the invention. In the following description, details are set forth for the purpose of explanation. It will be apparent to one of ordinary skill in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and processes are not shown in detail to avoid obscuring the description of the invention with unnecessary detail. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
At present, service enterprises such as existing finance enterprises and banks generally need to carry out data docking with a plurality of brand manufacturers during operation, the existing data docking mode is customized development according to the requirements of the brand manufacturers, and data and outgoing data are stored according to an outgoing field design table structure; the existing data processing mode cannot define the expansion function according to the requirements of the service scene, and the new service needs to be developed again when appearing, so that the workload of the version process is increased, and the scene application requirement of quick online butting of online timeliness is prolonged.
Based on this, the application provides a data docking method, a data docking device, data docking equipment and a computer-readable storage medium, so as to solve the technical problem that the flexibility is poor due to the fact that the data docking process cannot be expanded in the prior art.
The data docking method in the embodiment of the invention is applied to a data docking device, the data docking device is arranged in data docking equipment, one or more processors, a memory and one or more application programs are arranged in the data docking equipment, wherein the one or more application programs are stored in the memory and are configured to be executed by the processor to implement the data docking method; the data docking equipment can be an intelligent terminal, such as a mobile phone, a tablet computer, network equipment, an intelligent computer and the like; optionally, the data docking device may also be a server or a service cluster formed by multiple servers.
As shown in fig. 1, fig. 1 is a schematic view of a data docking scenario according to an embodiment of the present application, where the data docking scenario includes a data docking device 100 (a data docking apparatus is integrated in the data docking device 100) and a target service terminal 200, and a computer-readable storage medium corresponding to the data docking method is run in the data docking device 100, so as to execute steps of the data docking method. The target service terminal 200 is a service terminal performing data interfacing with the data interfacing device 100.
It should be understood that, the data docking device in the scenario of the data docking method shown in fig. 1, or the apparatuses included in the data docking device, do not constitute a limitation to the embodiment of the present invention, that is, the number of devices and the types of devices of the data docking device included in the scenario of the data docking method, or the number of devices and the types of apparatuses included in each device do not affect the overall implementation of the technical solution in the embodiment of the present invention, and may be calculated as an equivalent replacement or a derivative of the technical solution claimed in the embodiment of the present invention.
The data docking device 100 in the embodiment of the present invention is mainly used for: calling a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform; reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data; configuring an extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database; and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data.
The data docking device 100 in the embodiment of the present invention may be an independent data docking device, such as an intelligent terminal like a mobile phone, a tablet computer, a network device, a server, and an intelligent computer, or may be a data docking network or a data docking cluster composed of a plurality of data docking devices.
The embodiments of the present application provide a data interfacing method, apparatus, device, and computer readable storage medium, which are respectively described in detail below.
Those skilled in the art can understand that the application environment shown in fig. 1 is only one of the application scenarios related to the present application scheme, and does not constitute a limitation on the application scenario of the present application scheme, and that other application environments may further include more or less data docking devices than those shown in fig. 1, or a data docking network connection relationship, for example, only one data docking device is shown in fig. 1, and it is understood that the scenario of the data docking method may further include one or more data docking devices, which is not limited herein; the data docking device 100 may also include a memory for storing heterogeneous data and other data.
It should be noted that the scene schematic diagram of the data docking method shown in fig. 1 is only an example, and the scene of the data docking method described in the embodiment of the present invention is for more clearly explaining the technical solution of the embodiment of the present invention, and does not constitute a limitation to the technical solution provided in the embodiment of the present invention.
Based on the above scenario of the data docking method, various embodiments of the data docking method disclosed by the present invention are proposed.
As shown in fig. 2, fig. 2 is a schematic flow chart of an embodiment of a data docking method in the embodiment of the present application, where the data docking method includes the following steps 201 to 204:
201. calling a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform;
the data docking method in this embodiment is applied to the data docking device, and the type and the number of the data docking device are not particularly limited, that is, the data docking device may be one or more intelligent terminals or servers, and in a specific embodiment, the data docking device is an intelligent computer.
The data docking method in this embodiment is applied to data docking equipment, and the type and number of the data docking equipment are not specifically limited, that is, the data docking equipment may be one or more intelligent terminals or servers that monitor the operation conditions of the logistics nodes, and in a specific embodiment, the data docking equipment is an intelligent computer.
The data docking device is configured to establish a communication connection with each vendor, acquire heterogeneous data of each vendor and store the heterogeneous data, and transmit target heterogeneous data to a corresponding vendor. Specifically, the data docking device receives a data docking request during an operation process, where the data docking request may be actively triggered by a user, for example, the user is a data docking person of a financial enterprise or a banking enterprise, and actively triggers a data docking request to one or more docked manufacturers by clicking a data docking button of the data docking device. The data docking request is an operation instruction for requesting the data docking equipment to acquire heterogeneous data of each manufacturer and/or sending target heterogeneous data to a corresponding manufacturer.
After receiving the data docking request, the data docking equipment calls a preset data acquisition script to acquire heterogeneous data to be docked by a target manufacturer. Specifically, the intelligent terminal and the data docking equipment of each manufacturer are connected with a preset service data platform for data docking, the intelligent terminal corresponding to each manufacturer transmits heterogeneous data to be docked to the service data platform, the data docking equipment establishes communication connection with the service data platform, and calls a preset data acquisition script to acquire the heterogeneous data to be docked of a target manufacturer from the service data platform at regular time.
Specifically, after receiving the data docking request, the data docking device acquires the data type of the heterogeneous data to be acquired, configures a preset script template file according to the data type, and generates a data acquisition script for acquiring the heterogeneous data to be acquired.
After the data docking equipment completes configuration of the heterogeneous data, the heterogeneous data is called to dock with a preset service data platform, and a plurality of heterogeneous data of the service data platform are collected. Optionally, the data acquisition script may further set a timing docking command in the data acquisition script, and configure the data acquisition script to acquire data from the service data platform at a timing. Optionally, the data acquisition script may be a DSP big data script.
Optionally, in a specific embodiment, the service data platform is in communication connection with the vapor fusion core system and the vapor fusion channel system, the vapor fusion core system and the vapor fusion channel system upload the heterogeneous data to the service data platform, the data docking device generates a data acquisition script corresponding to the heterogeneous data of the vapor fusion core system and the vapor fusion channel system, and acquires the heterogeneous data of the vapor fusion core system and the vapor fusion channel system through the data acquisition script.
202. Reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data;
after the data docking equipment obtains various heterogeneous data through the data acquisition script, the data fields of the heterogeneous data are read, and the data fields are compared with the preset storage fields in the heterogeneous database, so that the updating fields in the heterogeneous data are obtained.
Specifically, after the data docking device is powered on and started, a heterogeneous database for storing various heterogeneous data is preset, wherein the heterogeneous database comprises a storage field which is configured and an expansion field which is not configured.
Specifically, the data docking device analyzes the obtained heterogeneous data to obtain at least one data field in the heterogeneous data, and obtains data type parameters and data character quantity of each data field in the heterogeneous data. The data type parameter is a parameter for representing a heterogeneous data type corresponding to the data field; the data character amount is the actual number of characters of the heterogeneous parameters in the data field.
The data docking equipment also acquires all storage fields related to the heterogeneous data in the heterogeneous database, and storage type parameters and storage character quantity of the storage fields, wherein the storage type parameters represent heterogeneous data types to be stored or stored in the storage fields; the storage character amount is a preset number of characters representing heterogeneous data defined in the storage field.
After acquiring the data type parameter and the data character quantity of the heterogeneous data, the data docking equipment compares the data type parameter with the storage type parameter of the storage field, and compares the data character quantity of the heterogeneous data with the storage character quantity of the storage field, so as to judge whether the data field of the heterogeneous data is an updated field after the service is changed.
Optionally, if the data type parameter matches the storage type parameter, that is, the actual storage type corresponding to the data type parameter is the same as the preset storage type corresponding to the storage type parameter, and the data character amount matches the storage character amount, that is, the data character amount is less than or equal to the storage character amount, the data docking device determines that the data field is a conventional data field.
Optionally, if the data type parameter is not matched with the storage type, that is, the actual storage type corresponding to the data type parameter is different from the preset storage type corresponding to the storage type parameter, or the data character amount exceeds the storage character amount, the data docking device determines that the data field is an updated field after the service is updated.
Optionally, the data docking device may further determine whether the data field is an update field by obtaining a service identifier of each data field in the heterogeneous data.
203. Configuring an extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database;
after the data docking equipment acquires the update fields in the heterogeneous data, the data docking equipment also acquires field update rules related to the update fields, configures preset extension fields in the heterogeneous database through the update fields and the field update rules, so as to obtain an updated heterogeneous database, and stores the heterogeneous data in the updated heterogeneous database.
Specifically, the data docking device presets a field database, where field update rules of data fields of different heterogeneous databases are stored in the field database, and the field update rules are operation instructions representing configuration of extension fields in the heterogeneous databases.
The data docking equipment accesses the field database, so as to obtain the field updating rule related to the updating field, and analyzes the field updating rule to obtain the field description data and the field type parameter in the field updating rule.
Specifically, after the data docking device obtains the field description data and the field type parameter, the data docking device configures the extension field in the heterogeneous database according to the field description data and the field type parameter, so as to obtain the updated storage field of the heterogeneous data storing the updated field.
Specifically, after the data docking device obtains the field type parameter, field configuration is performed on the extended field corresponding to the updated field according to the field type parameter, and the data storage type of the extended field is set as the data storage type corresponding to the field type parameter, so as to generate the target storage field of the updated field.
After the data docking device generates the target storage field of the update field, the data docking device further performs rendering setting on the target storage field according to the field description data, so as to obtain the update storage field of the update field, and specifically, the data docking device inputs the field description data into the storage rule of the target storage field, so as to configure the target storage field, so as to obtain the update storage field.
And the data docking equipment updates the extension field in the heterogeneous database to obtain an updated storage field, and updates and configures the heterogeneous database according to the updated storage field to obtain the updated heterogeneous database.
After the data docking equipment updates the heterogeneous database, the heterogeneous data is stored in the updated heterogeneous database for storage.
204. And responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data.
And the data docking equipment receives a data docking request in the operation process, accesses the heterogeneous database after receiving the data docking request, acquires target heterogeneous data, and matches a corresponding outgoing docking interface according to the target heterogeneous data.
Specifically, after receiving a data docking request transmitted by a corresponding manufacturer, the data docking device obtains a terminal identifier associated with the data docking request.
Optionally, after acquiring the terminal identifier of the data docking request, the data docking device performs security verification on the terminal identifier, and determines validity of the data docking request, specifically, the data docking device acquires verification data in the terminal identifier, and identifies the verification data and verification data stored in the data docking device, and if the verification data matches the verification data, determines that the data docking request is a valid data docking request. Optionally, the data docking device may also use other verification methods that can achieve the validity verification effect.
After the data docking equipment acquires the data docking request, the terminal identification and the service type of a target service terminal of the data docking request are acquired, and target heterogeneous data to be acquired by the data docking request are determined according to the terminal identification and the service type. Tool for measuring
Specifically, the data docking device presets different outgoing docking interfaces for different manufacturers 'terminals and different target heterogeneous data in advance, and the different outgoing docking interfaces respectively dock the different manufacturers' terminals and the different data types of the target heterogeneous data. And after the data docking equipment determines the target heterogeneous data and the terminal identification, the data docking equipment performs outgoing matching according to the target heterogeneous data and the terminal identification of the data docking request, so that an outgoing docking interface of the target heterogeneous data is determined.
And after matching the outgoing butt joint interface of the target heterogeneous data according to the data type of the target heterogeneous data and the terminal identification, the data butt joint equipment is in butt joint with a preset isolation gateway according to the outgoing butt joint interface, and transmits the target heterogeneous data to the terminal corresponding to the terminal identification. The isolation gateway is a protocol converter which is preset by the data docking equipment and used for being connected with terminals of different manufacturers, and transmits target heterogeneous data to corresponding terminals according to different outgoing docking interfaces.
Specifically, the data docking device drives the isolation gateway to establish communication connection with the terminal corresponding to the terminal identifier according to the terminal identifier, drives the isolation gateway to switch an outgoing docking interface corresponding to the outgoing data after the isolation gateway establishes communication connection with the terminal, transmits target heterogeneous data to the outgoing docking interface, docks with the isolation gateway based on the outgoing docking interface, and drives the isolation gateway to transmit the target heterogeneous data to the terminal corresponding to the terminal identifier after docking is completed, so that data docking is achieved.
In this embodiment, the data docking device acquires heterogeneous data cached by a preset service data platform by calling a preset data acquisition script; reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data; configuring an extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database; and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data. The dynamic adaptation of access and outgoing data is realized according to the service update, and the flexibility of data docking is improved.
As shown in fig. 3, fig. 3 is a flowchart illustrating an embodiment of determining an update field of heterogeneous data in a data docking method according to the embodiment of the present application, and specifically includes steps 301 to 302:
301. acquiring a service identifier and a terminal identifier of a data field in the heterogeneous data, and a storage field associated with the terminal identifier in the heterogeneous database;
302. and reading the preset service identification associated with the storage field, and if the service identification of the heterogeneous data is not matched with the preset service identification of each storage field, setting the heterogeneous data as an update field of the heterogeneous data.
Based on the foregoing embodiment, in this embodiment, after acquiring heterogeneous data, the data docking device further acquires a service identifier and a terminal identifier of each data field in the heterogeneous data, and determines whether the data field is an update field generated due to service update according to the service identifier and the terminal identifier. The terminal identifier is the device identifier of the service terminal transmitting the heterogeneous data.
Specifically, the data docking device associates each storage field in the heterogeneous database with a terminal identifier of different heterogeneous data in advance, and after acquiring the terminal identifier of the heterogeneous data, the data docking device inputs the terminal identifier into the heterogeneous database to acquire the storage field associated with the terminal identifier in the heterogeneous database.
After acquiring the storage field associated with the terminal identifier of the heterogeneous data, the data docking equipment reads the preset service identifier of the storage field, and compares the service identifier of each data field in the heterogeneous data with the preset service identifier, thereby judging whether the data field is an update field.
Optionally, if a preset service identifier that is the same as the service identifier of the data field exists in the storage field associated with the heterogeneous data in the heterogeneous database, determining that the service identifier of the data field matches the preset service identifier, and determining that the data field is a conventional data field.
Optionally, if a preset service identifier that is the same as the service identifier of the data field does not exist in the storage field associated with the heterogeneous data in the heterogeneous database, that is, the service field of the heterogeneous data is not matched with the preset service identifiers of the associated storage fields, it is determined that the service identifier of the data field is not matched with the preset service identifier, and the data field is determined to be an updated field.
After the data docking equipment acquires the update field in the heterogeneous data, the field update rule associated with the update field is acquired, the preset extension field in the heterogeneous database is configured through the update field and the field update rule, the updated heterogeneous database is obtained, and the heterogeneous data is stored in the updated heterogeneous database.
In this embodiment, the data docking device obtains the service identifier and the terminal identifier of the data field in the heterogeneous data, and the storage field associated with the terminal identifier in the heterogeneous database;
and reading the preset service identification associated with the storage field, and if the service identification of the heterogeneous data is not matched with the preset service identification of each storage field, setting the heterogeneous data as an update field of the heterogeneous data.
As shown in fig. 4, fig. 4 is a schematic flow chart of an embodiment of performing data reissuing in the data docking method provided in the embodiment of the present application, specifically including steps 401 to 403:
401. receiving a data transmission result fed back by the target service terminal;
402. if the data transmission result is transmission failure, acquiring a data reissue strategy of the target heterogeneous data;
403. and obtaining the retry outgoing times and retry outgoing time in the data reissue strategy, and performing data reissue on the target heterogeneous data according to the retry outgoing times and the retry outgoing time to obtain a data reissue result.
Based on the foregoing embodiment, in this embodiment, after the data docking device transmits the target heterogeneous data, it further detects whether the target heterogeneous data is successfully sent out, and performs data reissue on the target heterogeneous data that fails to be sent out.
Specifically, after transmitting the target heterogeneous data to the target service terminal, the data docking device also receives a data transmission result fed back by the target service terminal within a preset time, analyzes the data transmission result, and obtains a sending status code in the data transmission result, thereby determining the data sending condition of the target heterogeneous data.
Optionally, if the data docking device receives the data transmission result within the preset time and the sending status code carried in the data transmission result is that the sending is successful, the data docking device determines that the data transmission result of the target heterogeneous data is that the sending is successful.
Optionally, if the data docking device does not receive the data transmission result fed back by the target service terminal within the preset time, or the data docking device receives a status code that fails to be sent in the sending status code, the data docking device determines that the data transmission result of the target heterogeneous data is a sending failure.
Specifically, when the data docking device is powered on and started, the heterogeneous database is accessed in advance, and various heterogeneous data stored in the heterogeneous database is acquired. The data docking equipment acquires the service and the data type of each heterogeneous data, and configures the retry outgoing times and the retry outgoing time of the heterogeneous data according to the service type, the data type and a preset reissue rule. The preset reissue rule is a reissue rule representing heterogeneous data corresponding to different service types and different data types.
And the data docking equipment records the configured retry outgoing times and retry outgoing time into a preset strategy template so as to obtain a data reissue strategy of the heterogeneous data, and stores the data reissue strategy and the equipment to be reissued associated with the heterogeneous data into a preset reissue strategy database in an associated manner.
After detecting that the data transmission result is target heterogeneous data which is failed to be sent, the data docking equipment acquires a data reissue strategy corresponding to the target heterogeneous data, analyzes the data reissue strategy, obtains retry outgoing times and retry outgoing time in the data reissue strategy, and performs data reissue on the target heterogeneous data according to the retry outgoing times and the retry outgoing time to obtain a data reissue result.
In this embodiment, the data docking device receives the data transmission result fed back by the target service terminal; if the data transmission result is transmission failure, acquiring a data reissue strategy of the target heterogeneous data; and obtaining the retry outgoing times and retry outgoing time in the data reissue strategy, and performing data reissue on the target heterogeneous data according to the retry outgoing times and the retry outgoing time to obtain a data reissue result. The data which is failed to be sent is sent in a complementary mode, and the integrity and the accuracy of data transmission are guaranteed.
In order to better implement the data docking method in the embodiment of the present application, based on the data docking method, an embodiment of the present application further provides a data docking device, as shown in fig. 5, fig. 5 is a schematic structural diagram of the data docking device provided in the embodiment of the present application, specifically, the data docking device 500 includes:
the data acquisition module 501 is configured to invoke a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform;
a field matching module 502 configured to read a data field of the heterogeneous data, compare the data field with a preset storage field in the heterogeneous database, and obtain an updated field in the heterogeneous data;
a field configuration module 503 configured to configure the extended field of the heterogeneous database according to the updated field and a preset field update rule to obtain an updated heterogeneous database, and store the heterogeneous data in the updated heterogeneous database;
the data transmission module 504 is configured to read the response data docking request, obtain the target heterogeneous data in the heterogeneous database, and transmit the target heterogeneous data according to the target outgoing interface of the target heterogeneous data.
In some embodiments of the present application, the reading, by the data docking device, a data field of the heterogeneous data, and comparing the data field with a preset storage field in the heterogeneous database to obtain an updated field in the heterogeneous data includes:
reading data type parameters and data character quantity in data fields of the heterogeneous data and storage type parameters and storage character quantity of each storage field associated with the heterogeneous data in the heterogeneous database;
if the data type parameter is matched with the storage type parameter and the data character quantity is matched with the storage character quantity, marking the data field as a conventional data field;
if the data type parameter does not match the storage type parameter or the data character size does not match the storage character size, the data field is marked as an update field.
In some embodiments of the present application, the data docking apparatus reads a data field of the heterogeneous data, compares the data field with a preset storage field in the heterogeneous database to obtain an update field in the heterogeneous data, and further includes:
acquiring a service identifier and a terminal identifier of a data field in the heterogeneous data, and a storage field associated with the terminal identifier in the heterogeneous database;
and reading the preset service identification associated with the storage field, and if the service identification of the heterogeneous data is not matched with the preset service identification of each storage field, setting the heterogeneous data as an update field of the heterogeneous data.
In some embodiments of the present application, the data docking device configures an extension field of the heterogeneous database according to the update field and a preset field update rule, to obtain an updated heterogeneous database, including:
accessing a field database, and acquiring a field updating rule related to the updating field, and field description data and field type parameters in the field updating rule;
carrying out field configuration on the extension field associated with the update field according to the field type parameter to generate a target storage field of the update field;
rendering and setting the target storage field according to the field description data to obtain an updated storage field of the updated field;
and updating and configuring the heterogeneous database according to the updated storage field to obtain an updated heterogeneous database.
In some embodiments of the present application, the data docking apparatus, in response to a data docking request, acquires target heterogeneous data in the heterogeneous database, and transmits the target heterogeneous data according to a target outgoing interface of the target heterogeneous data, including:
responding to the data docking request, and acquiring a terminal identifier and a service type of a target service terminal associated with the data docking request;
accessing a heterogeneous database, and acquiring heterogeneous data associated with the terminal identifier and the service type in the heterogeneous database;
setting heterogeneous data associated with the terminal identifier and the service type as target heterogeneous data;
and acquiring a target outgoing interface of the target heterogeneous data, and transmitting the target heterogeneous data to the target service terminal based on the target outgoing interface.
In some embodiments of the present application, the obtaining, by the data docking device, a target outgoing interface of the target heterogeneous data, and transmitting the target heterogeneous data to the target service terminal based on the target outgoing interface includes:
acquiring a target outgoing interface of the target heterogeneous data, transmitting the target heterogeneous data to the target outgoing interface, and sending the target heterogeneous data to a preset isolation gateway through the target outgoing interface;
and driving the isolation gateway to transmit the target heterogeneous data to the target service terminal pointed by the data docking request.
In some embodiments of the present application, the data docking apparatus, in response to the data docking request, acquires target heterogeneous data in the heterogeneous database, and after transmitting the target heterogeneous data according to the target outgoing interface of the target heterogeneous data, further includes:
receiving a data transmission result fed back by the target service terminal;
if the data transmission result is transmission failure, acquiring a data reissue strategy of the target heterogeneous data;
and obtaining the retry outgoing times and retry outgoing time in the data reissue strategy, and performing data reissue on the target heterogeneous data according to the retry outgoing times and the retry outgoing time to obtain a data reissue result.
An embodiment of the present invention further provides a data docking device, as shown in fig. 6, fig. 6 is a schematic structural diagram of an embodiment of the data docking device provided in the embodiment of the present application.
The data docking device integrates any one of the data docking apparatuses provided by the embodiments of the present invention, and the data docking device includes:
one or more processors;
a memory; and
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor for performing the steps of the data docking method in any of the above-described embodiments of the data docking method.
Specifically, the method comprises the following steps: the data docking device may include components such as a processor 601 of one or more processing cores, memory 602 of one or more computer-readable storage media, a power supply 603, and an input unit 604. Those skilled in the art will appreciate that the data docking device configuration shown in fig. 6 does not constitute a limitation of the data docking device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the processor 601 is a control center of the data docking apparatus, connects various parts of the entire data docking apparatus using various interfaces and lines, performs various functions of the data docking apparatus and processes data by operating or executing software programs and/or modules stored in the memory 602 and calling data stored in the memory 602, thereby performing overall monitoring of the data docking apparatus. Optionally, processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 601.
The memory 602 may be used to store software programs and modules, and the processor 601 executes various functional applications and data processing by operating the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the data docking apparatus, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 access to the memory 602.
The data docking device further comprises a power supply 603 for supplying power to each component, and preferably, the power supply 603 may be logically connected to the processor 601 through a power management system, so that functions of managing charging, discharging, power consumption management and the like are realized through the power management system. The power supply 603 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The data docking device may further include an input unit 604, and the input unit 604 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the data docking device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 601 in the data docking device loads the executable file corresponding to the process of one or more application programs into the memory 602 according to the following instructions, and the processor 601 runs the application program stored in the memory 602, thereby implementing various functions as follows:
calling a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform;
reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data;
configuring the extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database;
and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data.
To this end, an embodiment of the present invention provides a computer-readable storage medium, which may include: read Only Memory (ROM), random Access Memory (RAM), magnetic or optical disks, and the like. Stored thereon, is a computer program, which is loaded by a processor to execute the steps of any one of the data interfacing methods provided by the embodiments of the present invention. For example, the computer program may be loaded by a processor to perform the steps of:
calling a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform;
reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data;
configuring an extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database;
and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed descriptions of other embodiments, and are not described herein again.
In a specific implementation, each unit or structure may be implemented as an independent entity, or may be combined arbitrarily to be implemented as one or several entities, and the specific implementation of each unit or structure may refer to the foregoing method embodiment, which is not described herein again.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
The data docking method provided by the embodiment of the present application is described in detail above, and the principle and the implementation of the present invention are explained in this document by applying specific embodiments, and the description of the above embodiment is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in view of the above, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A data docking method, comprising:
calling a preset data acquisition script to acquire heterogeneous data cached by a preset service data platform;
reading a data field of the heterogeneous data, and comparing the data field with a preset storage field in a heterogeneous database to obtain an update field in the heterogeneous data;
configuring an extension field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and storing the heterogeneous data into the updated heterogeneous database;
and responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data.
2. The data docking method as claimed in claim 1, wherein the reading the data field of the heterogeneous data, and comparing the data field with a preset storage field in the heterogeneous database to obtain an updated field in the heterogeneous data comprises:
reading data type parameters and data character quantity in data fields of the heterogeneous data and storage type parameters and storage character quantity of each storage field associated with the heterogeneous data in the heterogeneous database;
if the data type parameter is matched with the storage type parameter and the data character quantity is matched with the storage character quantity, marking the data field as a conventional data field;
if the data type parameter does not match the storage type parameter or the data character size does not match the storage character size, the data field is marked as an update field.
3. The data docking method as claimed in claim 1, wherein the reading of the data field of the heterogeneous data and the comparison of the data field with the preset storage field in the heterogeneous database result in the updated field in the heterogeneous data further comprises:
acquiring a service identifier and a terminal identifier of a data field in the heterogeneous data, and a storage field associated with the terminal identifier in the heterogeneous database;
and reading the preset service identification associated with the storage field, and if the service identification of the heterogeneous data is not matched with the preset service identification of each storage field, setting the heterogeneous data as an update field of the heterogeneous data.
4. The data docking method according to claim 1, wherein the configuring the extended field of the heterogeneous database according to the updated field and a preset field update rule to obtain an updated heterogeneous database comprises:
accessing a field database, and acquiring a field updating rule related to the updating field, and field description data and field type parameters in the field updating rule;
carrying out field configuration on the extension field associated with the update field according to the field type parameter to generate a target storage field of the update field;
rendering and setting the target storage field according to the field description data to obtain an updated storage field of the updated field;
and updating and configuring the heterogeneous database according to the updated storage field to obtain an updated heterogeneous database.
5. The data docking method according to claim 1, wherein the responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and transmitting the target heterogeneous data according to a target outgoing interface of the target heterogeneous data includes:
responding to the data docking request, and acquiring a terminal identifier and a service type of a target service terminal associated with the data docking request;
accessing a heterogeneous database, and acquiring heterogeneous data associated with the terminal identifier and the service type in the heterogeneous database;
setting heterogeneous data associated with the terminal identifier and the service type as target heterogeneous data;
and acquiring a target outgoing interface of the target heterogeneous data, and transmitting the target heterogeneous data to the target service terminal based on the target outgoing interface.
6. The data docking method according to claim 5, wherein the step of transmitting the target heterogeneous data to the target service terminal based on the target outbound interface for obtaining the target heterogeneous data comprises:
acquiring a target outgoing interface of the target heterogeneous data, transmitting the target heterogeneous data to the target outgoing interface, and sending the target heterogeneous data to a preset isolation gateway through the target outgoing interface;
and driving the isolation gateway to transmit the target heterogeneous data to the target service terminal pointed by the data docking request.
7. The data docking method according to any one of claims 1 to 6, wherein the responding to the data docking request, acquiring target heterogeneous data in the heterogeneous database, and after transmitting the target heterogeneous data according to the target outgoing interface of the target heterogeneous data, further comprises:
receiving a data transmission result fed back by the target service terminal;
if the data transmission result is transmission failure, acquiring a data reissue strategy of the target heterogeneous data;
and obtaining the retry outgoing times and retry outgoing time in the data reissue strategy, and performing data reissue on the target heterogeneous data according to the retry outgoing times and the retry outgoing time to obtain a data reissue result.
8. A data interfacing apparatus, comprising:
the data acquisition module is configured to call a preset data acquisition script to acquire the heterogeneous data cached by the preset service data platform;
the field matching module is configured to read a data field of the heterogeneous data, and compare the data field with a preset storage field in the heterogeneous database to obtain an update field in the heterogeneous data;
the field configuration module is configured to configure the extended field of the heterogeneous database according to the updated field and a preset field updating rule to obtain an updated heterogeneous database, and store the heterogeneous data into the updated heterogeneous database;
and the data transmission module is configured to read the response data docking request, acquire the target heterogeneous data in the heterogeneous database, and transmit the target heterogeneous data according to the target outgoing interface of the target heterogeneous data.
9. A data docking device, characterized in that the data docking device comprises:
one or more processors;
a memory; and
one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the steps of the data docking method of any of claims 1 to 7.
10. A computer-readable storage medium, having stored thereon a computer program which is loaded by a processor to perform the steps of the data interfacing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211543204.0A CN115934736A (en) | 2022-12-02 | 2022-12-02 | Data docking method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211543204.0A CN115934736A (en) | 2022-12-02 | 2022-12-02 | Data docking method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115934736A true CN115934736A (en) | 2023-04-07 |
Family
ID=86698677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211543204.0A Pending CN115934736A (en) | 2022-12-02 | 2022-12-02 | Data docking method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115934736A (en) |
-
2022
- 2022-12-02 CN CN202211543204.0A patent/CN115934736A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113746821A (en) | Intelligent device control method and device, storage medium and electronic device | |
| CN114201197A (en) | Firmware upgrading method and device, electronic equipment and readable storage medium | |
| WO2021232651A1 (en) | Method and apparatus for upgrading multi-level management system, and device and medium | |
| CN109600254A (en) | The generation method and related system of full link log | |
| CN116015561A (en) | Data reissue method, device, equipment and storage medium | |
| CN115190044B (en) | Device connection state checking method, device and storage medium | |
| CN115934736A (en) | Data docking method, device, equipment and storage medium | |
| CN109189629B (en) | Method for realizing terminal remote control based on USB device and storage medium | |
| CN117056198A (en) | Mock test method, mock test device, medium and computer equipment | |
| CN115695073A (en) | Communication method, device, equipment and storage medium | |
| CN115987786A (en) | Configuration change method, system, terminal equipment and storage medium | |
| CN116225832A (en) | Automatic detection method, storage medium and equipment for automatic deployment of database cluster | |
| CN114218041A (en) | Dynamic process monitoring method, device, equipment and storage medium | |
| CN114221985A (en) | Device control method, device, electronic device and computer-readable storage medium | |
| CN110321251B (en) | Data backup method, device, equipment and storage medium based on network block equipment | |
| CN113407403B (en) | Cloud host management method and device, computer equipment and storage medium | |
| CN113849356A (en) | Equipment testing method and device, electronic equipment and storage medium | |
| CN114095343A (en) | Disaster recovery method, device, equipment and storage medium based on double-active system | |
| CN112667512A (en) | Data drive test method, device, equipment and computer readable storage medium | |
| CN114764379A (en) | Access switching method and device for application software and computer readable storage medium | |
| CN115202717A (en) | Data docking method, device, equipment and storage medium | |
| US20190286599A1 (en) | Dual way communication method, system, and master device thereof | |
| CN115102924B (en) | Cluster address switching method and device, computer equipment and storage medium | |
| TWI709037B (en) | Bios setting method | |
| CN114827302B (en) | Communication protocol adaptation method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |