CN113297218B - Multi-system data interaction method, device and system - Google Patents

Multi-system data interaction method, device and system Download PDF

Info

Publication number
CN113297218B
CN113297218B CN202110553240.4A CN202110553240A CN113297218B CN 113297218 B CN113297218 B CN 113297218B CN 202110553240 A CN202110553240 A CN 202110553240A CN 113297218 B CN113297218 B CN 113297218B
Authority
CN
China
Prior art keywords
data
target
target data
cloud server
identification code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110553240.4A
Other languages
Chinese (zh)
Other versions
CN113297218A (en
Inventor
许可
李嘉荣
李伟健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Guangdian Information Technology Co.,Ltd.
Original Assignee
Guangzhou Good Idea Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Good Idea Information Technology Co ltd filed Critical Guangzhou Good Idea Information Technology Co ltd
Priority to CN202110553240.4A priority Critical patent/CN113297218B/en
Publication of CN113297218A publication Critical patent/CN113297218A/en
Application granted granted Critical
Publication of CN113297218B publication Critical patent/CN113297218B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application

Abstract

The invention discloses a multi-system data interaction method, a device and a system, wherein the technical scheme is that target data extracted by a plurality of third-party data platforms are transmitted to a cloud server, the target data from different third-party data platforms are integrated into a data set by using a data transmission flow task and then are uniformly transmitted to a data center platform, and data interaction is completed by using one-to-one transmission interfaces between the cloud server and the data center platform, so that the defect of low elaboration efficiency caused by incompatibility in the data interaction process between the data center platform and the plurality of third-party data platforms in the current stage is solved, and the data transmission rate between the data center platform and the plurality of third-party data platforms is improved so as to adapt to the development requirement of a large data period in the current stage.

Description

Multi-system data interaction method, device and system
Technical Field
The invention relates to the technical field of data interaction, in particular to a multi-system data interaction method, device and system.
Background
The data center platform is used for settling the business and data of each business unit in the process of government-enterprise digital transformation, and constructing a data construction, management and use system comprising data technology, data management, data operation and the like so as to realize data energization; it is the core in a novel information application framework system.
In practical application, a worker needs to perform data interaction with a plurality of third-party data platforms by using a data center. For example, behavior data of different objects is downloaded in a plurality of third-party data platforms and is used for tag generation of different objects in the data. However, due to the incompatibility between the data center platform and the plurality of third-party data platforms, when a worker acquires data by using the data center platform, the worker can only perform data interaction with a single third-party data platform in the current time period of the data center platform, and then switch to another third-party data platform for data transmission after the data transmission of the current third-party data platform is completed, so that the worker needs to switch tasks back and forth between the data center platform and the plurality of third-party data platforms and repeatedly import and export data for data processing during big data development, the transmission efficiency of the data interaction between the data center platform and the third-party data platforms is low, and the worker cannot meet the development requirements of the big data time period in the current time period.
Therefore, a multisystem data interaction strategy is urgently needed in the market at present, and the problem of low elaboration efficiency caused by incompatibility in the data interaction process of a middle station and a plurality of third-party data platforms in the prior art can be solved.
Disclosure of Invention
The invention provides a multi-system data interaction method which can improve the data transmission rate between a data center and a plurality of third-party data platforms so as to meet the development requirement of a large data period at the present stage.
In order to solve the technical problem, an embodiment of the present invention provides a multi-system data interaction method, which is applied to a data center, where the data center performs data interaction with a cloud server and a plurality of third-party data platforms, and the multi-system data interaction method includes:
receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address;
generating a data acquisition instruction according to the target address and the address information of the cloud server, and sending the data acquisition instruction to the third-party data platform, so that the third-party data platform responds to the data acquisition instruction, extracts first target data and sends the first target data to the cloud server;
and receiving a data transmission stream task generated by the cloud server in response to the first target data, and acquiring the first target data as required data.
Preferably, the step of receiving a data transport stream task generated by the cloud server in response to the first target data, and acquiring the first target data as required data includes:
receiving a sent unique identification code generated by the cloud server in response to the first target data, and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code;
if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; otherwise, receiving first target data sent by the cloud server and taking the first target data as required data.
Preferably, the step of receiving first target data sent by the cloud server and taking the first target data as required data includes:
if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server, so that the cloud server responds to the data issuing instruction and sends the first target data to the data center station;
receiving first target data sent by the cloud server and taking the first target data as required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
Correspondingly, an embodiment of the present invention further provides a multi-system data interaction device, which is applied to a data center, wherein the data center is in communication connection with a cloud server and a plurality of third-party data platforms, and the multi-system data interaction device includes:
the trigger instruction module is used for receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address;
the acquisition instruction module is used for generating a data acquisition instruction according to the target address and the address information of the cloud server and sending the data acquisition instruction to the third-party data platform so that the third-party data platform can respond to the data acquisition instruction, extract first target data and send the first target data to the cloud server;
and the data receiving module is used for receiving a data transmission stream task generated by the cloud server in response to the first target data and acquiring the first target data as required data.
As a preferred scheme, the data receiving module is specifically configured to: receiving a sent unique identification code generated by the cloud server in response to the first target data, and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code; if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; otherwise, receiving first target data sent by the cloud server and taking the first target data as required data.
As a preferred scheme, the data receiving module is configured to receive first target data sent by the cloud server and take the first target data as required data, and includes:
if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server, so that the cloud server responds to the data issuing instruction and sends the first target data to the data center station;
receiving first target data sent by the cloud server and taking the first target data as required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
The embodiment of the invention also provides a multi-system data interaction method, which is applied to a cloud server, wherein the cloud server respectively performs data interaction with a data center and a plurality of third-party data platforms, and the multi-system data interaction method comprises the following steps:
receiving first target data sent by a plurality of third-party data platforms to obtain a target data set;
establishing a data transmission stream task, and associating the target data set with the data transmission stream task;
and starting the data transmission stream task by taking the data center station as a transmission address, and sequentially sending the first target data in the target data set to the data center station.
Preferably, the step of sequentially sending the first target data in the target data set to the data center station includes:
generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data;
sending the unique identification code corresponding to the first target data to the data center station, so that the data center station responds to the unique identification code, searches whether second target data corresponding to the unique identification code exists in a data repository, and if the second target data corresponding to the unique identification code exists in the data repository, extracts the second target data as required data; if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction;
and sending the first target data which is not stored in the data repository in the target data set to a data center according to the data issuing instruction.
Preferably, the step of sending the first target data in the target data set that is not stored in the data repository to a data center includes:
and receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction so that the data center station responds to the first target data, takes the first target data as required data, and stores the first target data and the unique identification code corresponding to the first target data into the data repository.
Correspondingly, an embodiment of the present invention further provides a multi-system data interaction device, which is applied to a cloud server, wherein the cloud server is in communication connection with a data center and a plurality of third-party data platforms, and the multi-system data interaction device includes:
the target data module is used for receiving first target data sent by a plurality of third-party data platforms to obtain a target data set;
the task association module is used for establishing a data transmission stream task and associating the target data set with the data transmission stream task;
and the data sending module is used for starting the data transmission stream task for the data center station as a transmission address, and sequentially sending the first target data in the target data set to the data center station.
As a preferred scheme, the step of the data sending module being configured to send the first target data in the target data set to the data center station in sequence includes:
generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data;
sending the unique identification code corresponding to the first target data to the data center station, so that the data center station responds to the unique identification code, searches whether second target data corresponding to the unique identification code exists in a data repository, and if the second target data corresponding to the unique identification code exists in the data repository, extracts the second target data as required data; if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction;
and sending the first target data which is not stored in the data repository in the target data set to a data center according to the data issuing instruction.
Preferably, the data sending module is configured to send the first target data in the target data set that is not stored in the data repository to a data center, and includes:
and receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction so that the data center station responds to the first target data, takes the first target data as required data, and stores the first target data and the unique identification code corresponding to the first target data into the data repository.
The embodiment of the invention also provides a multi-system data interaction system, which comprises: the system comprises a data center platform, a cloud server and a plurality of third-party data platforms; the data center is in communication connection with a cloud server and a plurality of third-party data platforms respectively, and the cloud server is in communication connection with the plurality of third-party data platforms respectively;
the data center station is used for: receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address;
the data center station is used for: generating a data acquisition instruction according to the target address and the address information of the cloud server, and sending the data acquisition instruction to the third-party data platform;
the third party data platform is to: receiving a data acquisition instruction sent by a data center station, and extracting first target data according to a target address in the data acquisition instruction; sending the first target data to the cloud server according to the address information of the cloud server in the data acquisition instruction;
the cloud server is used for: receiving first target data sent by a plurality of third-party data platforms to obtain a target data set;
the cloud server is used for: establishing a data transmission stream task, and associating the target data set with the data transmission stream task;
the cloud server is used for: starting the data transmission stream task for the data center station as a transmission address, and sequentially sending first target data in the target data set to the data center station;
the data center station is used for: and receiving a data transmission stream task generated by the cloud server in response to the first target data, and acquiring the first target data as required data.
As a preferred scheme, the multisystem data interaction system further comprises:
the cloud server is further configured to: generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data, and sending the unique identification code corresponding to the first target data to the data center station;
the data center is further configured to: receiving the unique identification code sent by the cloud server, and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code; if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server;
the cloud server is further configured to: receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction;
the data center is further configured to: receiving first target data sent by the cloud server and taking the first target data as required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
according to the technical scheme, the target data extracted by the multiple third-party data platforms are transmitted to the cloud server, the target data from different third-party data platforms are integrated into a data set by using a data transmission flow task and then are transmitted to the data center station in a unified mode, and data interaction is completed by using one-to-one transmission interfaces between the cloud server and the data center station, so that the problem that the elaboration efficiency is low due to incompatibility in the data interaction process between the data center station and the multiple third-party data platforms in the prior art is solved, the data transmission rate between the data center station and the multiple third-party data platforms is improved, and the development requirement of a large data period in the prior art is met.
The technical scheme of the invention can also generate the unique identification code for the target data in the cloud server, the data center station can search the historical downloaded data in the data repository according to the unique identification code corresponding to the historical stored required data, the required data is directly called in the data repository without repeated downloading, the useless behavior of repeatedly downloading the same data in the data transmission process of the data center station and a third-party data platform is avoided, the data transmission rate between the data center station and a plurality of third-party data platforms is further improved, and the practicability of the technical scheme is improved.
Drawings
FIG. 1: the method for interacting the data of the multiple systems provided by the embodiment of the invention comprises the following steps of a flow chart;
FIG. 2: the structural diagram of the multisystem data interaction device provided by the second embodiment of the invention is shown;
FIG. 3: the step flow chart of the multisystem data interaction method provided by the third embodiment of the invention is shown;
FIG. 4: the structure diagram of the multisystem data interaction device provided by the fourth embodiment of the invention is shown;
FIG. 5: the fifth embodiment of the present invention provides a schematic structural diagram of a multi-system data interaction system.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Referring to fig. 1, a flowchart of steps of a multi-system data interaction method according to an embodiment of the present invention is shown. The multi-system data interaction method is applied to a data center, the data center performs data interaction with a cloud server and a plurality of third-party data platforms respectively, the multi-system data interaction method comprises steps 101 to 103, and each step specifically comprises the following steps:
step 101, receiving a trigger instruction, determining a target address according to the trigger instruction, and determining a third-party data platform corresponding to the target address.
Specifically, the trigger instruction may be an action instruction for a worker to click in the data center console, or may be a task flow newly created in the data center console. In the first embodiment, when a worker uses the data center to collect data, the worker clicks the required target data through a mouse, the target address associated with the target data is extracted, and the target address is confirmed by I P, so that the corresponding third-party data platform can be determined.
And 102, generating a data acquisition instruction according to the target address and the address information of the cloud server, and sending the data acquisition instruction to the third-party data platform, so that the third-party data platform responds to the data acquisition instruction, extracts first target data and sends the first target data to the cloud server.
Specifically, in order to enable the third-party data platform to forward the target data to the cloud server, the data center station combines the target address and the address information of the cloud server to generate a data acquisition instruction, and sends the data acquisition instruction to the third-party data platform. The data acquisition instruction can be encapsulated according to the instruction header, the target address, the address information of the cloud server and the instruction tail. As long as the third-party data platform recognizes the data acquisition instruction, corresponding target data can be extracted from the third-party data platform and sent to the cloud server according to the address information of the cloud server.
Step 103, receiving a data transport stream task generated by the cloud server in response to the first target data, and acquiring the first target data as required data.
Specifically, after receiving the target data, the cloud server gathers the target data sent by the plurality of third-party data platforms into a data set, and transmits the target data in the data set to the data center station by establishing a data transmission stream task, so that one-to-one data transmission is realized, and the problem of incompatibility between the data center station and different third-party data platforms is avoided.
According to the technical scheme, the target data extracted by the multiple third-party data platforms are transmitted to the cloud server, the target data from different third-party data platforms are integrated into a data set by using a data transmission flow task and then are transmitted to the data center station in a unified mode, and data interaction is completed by using one-to-one transmission interfaces between the cloud server and the data center station, so that the problem that the elaboration efficiency is low due to incompatibility in the data interaction process between the data center station and the multiple third-party data platforms in the prior art is solved, the data transmission rate between the data center station and the multiple third-party data platforms is improved, and the development requirement of a large data period in the prior art is met.
In another modified version of this embodiment, the step 103 includes steps 1031 and 1032, which are specifically as follows:
step 1031, receiving the sent unique identification code generated by the cloud server in response to the first target data, and searching whether second target data corresponding to the unique identification code exists in a data repository; the data repository stores the required data of the history and the corresponding unique identification code.
Specifically, in order to further improve the data transmission rate, the cloud server splits the data acquisition instruction after receiving the target data, extracts the data of the target address in the instruction, and then performs unique identifier conversion on the extracted data according to the type of the instruction header to generate a unique identifier corresponding to the extracted data. After the cloud server sends the unique identification code to the data center, the data center searches a data repository in the data center for second target data corresponding to the unique identification code.
Step 1032, if the second target data corresponding to the unique identification code is determined to exist in the data repository, extracting the second target data as required data; otherwise, receiving first target data sent by the cloud server and taking the first target data as required data.
In the first aspect of the foregoing embodiment, the step 1032 specifically includes the step 10321 and the step 10322, and specifically includes the following steps: step 10321, if it is determined that the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server, so that the cloud server responds to the data issuing instruction and sends the first target data to the data center. Step 10322, receiving the first target data sent by the cloud server and taking the first target data as the required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
Specifically, if the data exists, the data is indicated to have been downloaded before, and in order to increase the data transmission rate, the data does not need to be downloaded again, and the broadband data is occupied; only the corresponding data need be extracted directly in the data repository. If the unique identification code and the target data corresponding to the unique identification code cannot be searched in the data repository, the fact that the required data is not downloaded before is proved, and the data needs to be downloaded and acquired in the cloud server. At this time, the data center station sends an instruction to the cloud server again, and the cloud server downloads the required data. After receiving the target data sent by the cloud server, the data center station can determine the data as required data to be used, and meanwhile, in order to improve the requirement of the data center station for downloading the data next time, the data center station can store the required data and the corresponding unique identification code in a data repository in an associated mode so as to be used next time.
The technical scheme of the invention can also generate the unique identification code for the target data in the cloud server, the data center station can search the historical downloaded data in the data repository according to the unique identification code corresponding to the historical stored required data, the required data is directly called in the data repository without repeated downloading, the useless behavior of repeatedly downloading the same data in the data transmission process of the data center station and a third-party data platform is avoided, the data transmission rate between the data center station and a plurality of third-party data platforms is further improved, and the practicability of the technical scheme is improved.
Example two
Accordingly, please refer to fig. 2, which is a schematic structural diagram of a multi-system data interaction device according to an embodiment of the present invention. The utility model provides a multi-system data interaction device is applied to the data center platform, the data center platform carries out communication connection with high in the clouds server and a plurality of third party data platform respectively, multi-system data interaction device includes: the device comprises a trigger instruction module, an acquisition instruction module and a data receiving module; wherein:
and the trigger instruction module is used for receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address.
And the acquisition instruction module is used for generating a data acquisition instruction according to the target address and the address information of the cloud server and sending the data acquisition instruction to the third-party data platform, so that the third-party data platform responds to the data acquisition instruction, extracts the first target data and sends the first target data to the cloud server.
And the data receiving module is used for receiving a data transmission stream task generated by the cloud server in response to the first target data and acquiring the first target data as required data.
In another improvement of this embodiment, the data receiving module is specifically configured to: receiving a sent unique identification code generated by the cloud server in response to the first target data, and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code; if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; otherwise, receiving first target data sent by the cloud server and taking the first target data as required data.
In a first aspect of the foregoing embodiment, the step of the data receiving module being configured to receive first target data sent by the cloud server and use the first target data as required data includes: if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server, so that the cloud server responds to the data issuing instruction and sends the first target data to the data center station; receiving first target data sent by the cloud server and taking the first target data as required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
EXAMPLE III
Referring to fig. 3, a flowchart of steps of a multi-system data interaction method according to an embodiment of the present invention is shown. The multi-system data interaction method is applied to a cloud server, the cloud server performs data interaction with a data center and a plurality of third-party data platforms respectively, the multi-system data interaction method comprises steps 201 to 203, and each step specifically comprises the following steps:
step 201, receiving first target data sent by a plurality of third-party data platforms to obtain a target data set.
Specifically, a worker uses a data center to collect data, clicks required target data through a mouse, extracts address information associated with the target data, and encapsulates the address information and the command tail of the cloud server into a data acquisition command according to a command header, a target address, and the address information and the command tail of the cloud server. After the data center platform sends the generated data acquisition instruction to the third-party data platform, the third-party data platform splits the data acquisition instruction, and extracts the data of the target address in the instruction to obtain the first target data. As long as the third-party data platform recognizes the data acquisition instruction, corresponding target data can be extracted from the third-party data platform and sent to the cloud server according to the address information of the cloud server. After receiving the target data, the cloud server gathers the target data sent by the third-party data platforms into a data set so as to conveniently send tasks in a follow-up unified manner.
Step 202, a data transport stream task is established, and the target data set is associated with the data transport stream task.
Specifically, in order to uniformly send a plurality of third-party data platforms to a data center station and avoid the incompatibility problem, the cloud server transmits target data in a data set to the data center station by establishing a data transmission stream task.
And 203, starting the data transmission stream task for the data center station as a transmission address, and sequentially sending the first target data in the target data set to the data center station.
Specifically, the established data transmission stream task is started according to the address of the data center station obtained before, and the target data uniformly integrated into the data set are sequentially transmitted to the data center station, so that one-to-one data transmission is realized, and the problem of incompatibility between the data center station and different third-party data platforms is solved.
According to the technical scheme, the target data extracted by the multiple third-party data platforms are transmitted to the cloud server, the target data from different third-party data platforms are integrated into a data set by using a data transmission flow task and then are transmitted to the data center station in a unified mode, and data interaction is completed by using one-to-one transmission interfaces between the cloud server and the data center station, so that the problem that the elaboration efficiency is low due to incompatibility in the data interaction process between the data center station and the multiple third-party data platforms in the prior art is solved, the data transmission rate between the data center station and the multiple third-party data platforms is improved, and the development requirement of a large data period in the prior art is met.
In another modified embodiment of this embodiment, step 203 includes step 2031 to step 2033, and each step is as follows:
step 2031, generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data.
Specifically, in order to further improve the data transmission rate, after receiving the target data, the cloud server performs unique identifier conversion on the extracted data according to the type of the instruction header, and generates a unique identifier corresponding to the extracted data, where in the generation process of the unique identifier, the unique identifier may be converted into the unique identifier by using address information, data attribute, and data content of the first target data as basic data and using a code conversion algorithm. The conversion process can refer to related algorithm conversion strategies in the field, and the specific conversion process belongs to the conventional means in the field and is not described in too much detail in the scheme. After the cloud server sends the unique identification code to the data center, the data center searches a data repository in the data center for second target data corresponding to the unique identification code.
Step 2032, sending the unique identification code corresponding to the first target data to the data center station, so that the data center station searches whether second target data corresponding to the unique identification code exists in the data repository in response to the unique identification code, and if it is determined that the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; and if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction.
Specifically, after the cloud server sends the unique identification code to the data center, the data center searches a data repository inside the data center for second target data corresponding to the unique identification code. If the data exists, the data is indicated to be downloaded before, and in order to improve the data transmission rate, the data does not need to be downloaded again, and the broadband data is occupied uselessly; only the corresponding data need be extracted directly in the data repository. If the unique identification code and the target data corresponding to the unique identification code cannot be searched in the data repository, the fact that the required data is not downloaded before is proved, and the data needs to be downloaded and acquired in the cloud server. At this time, the data center station sends an instruction to the cloud server again, and the cloud server downloads the required data.
Step 2033, according to the data sending command, sending the first target data not stored in the data repository in the target data set to a data center.
In the first aspect of the above embodiment, the step 2033 comprises: and receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction so that the data center station responds to the first target data, takes the first target data as required data, and stores the first target data and the unique identification code corresponding to the first target data into the data repository.
Specifically, after receiving the target data sent by the cloud server, the data center station may determine the data as the required data to be used, and meanwhile, in order to increase the requirement of the data center station for downloading the data next time, the data center station may store the required data and the corresponding unique identification code in the data repository in an associated manner, so as to facilitate the next use.
The technical scheme of the invention can also generate the unique identification code for the target data in the cloud server, the data center station can search the historical downloaded data in the data repository according to the unique identification code corresponding to the historical stored required data, the required data is directly called in the data repository without repeated downloading, the useless behavior of repeatedly downloading the same data in the data transmission process of the data center station and a third-party data platform is avoided, the data transmission rate between the data center station and a plurality of third-party data platforms is further improved, and the practicability of the technical scheme is improved.
Example four
Correspondingly, please refer to fig. 4, which is a schematic structural diagram of a multi-system data interaction device according to an embodiment of the present invention, where the multi-system data interaction device according to the embodiment is applied to a cloud server, the cloud server is in communication connection with a data center and a plurality of third-party data platforms, respectively, and the multi-system data interaction device includes: the system comprises a target data module, a task association module and a data sending module; wherein:
and the target data module is used for receiving the first target data sent by the plurality of third-party data platforms to obtain a target data set.
And the task association module is used for establishing a data transmission stream task and associating the target data set with the data transmission stream task.
And the data sending module is used for starting the data transmission stream task for the data center station as a transmission address, and sequentially sending the first target data in the target data set to the data center station.
In another improvement of this embodiment, the step of the data sending module being configured to send the first target data in the target data set to the data center station in sequence includes: generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data; sending the unique identification code corresponding to the first target data to the data center station, so that the data center station responds to the unique identification code, searches whether second target data corresponding to the unique identification code exists in a data repository, and if the second target data corresponding to the unique identification code exists in the data repository, extracts the second target data as required data; if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction; and sending the first target data which is not stored in the data repository in the target data set to a data center according to the data issuing instruction.
In a first aspect of the foregoing embodiment, the data sending module is configured to send a first target data in the target data set that is not stored in the data repository to a data center, and includes: and receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction so that the data center station responds to the first target data, takes the first target data as required data, and stores the first target data and the unique identification code corresponding to the first target data into the data repository.
EXAMPLE five
Referring to fig. 5, a schematic structural diagram of a multi-system data interaction system according to an embodiment of the present invention includes: the system comprises a data center platform, a cloud server and a plurality of third-party data platforms; the data center platform is in communication connection with the cloud server and the plurality of third-party data platforms respectively, and the cloud server is in communication connection with the plurality of third-party data platforms respectively.
The data center station is used for: receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address.
The data center station is used for: and generating a data acquisition instruction according to the target address and the address information of the cloud server, and sending the data acquisition instruction to the third-party data platform.
The third party data platform is to: receiving a data acquisition instruction sent by a data center station, and extracting first target data according to a target address in the data acquisition instruction; and sending the first target data to the cloud server according to the address information of the cloud server in the data acquisition instruction.
The cloud server is used for: and receiving first target data sent by a plurality of third-party data platforms to obtain a target data set.
The cloud server is used for: and establishing a data transmission stream task, and associating the target data set with the data transmission stream task.
The cloud server is used for: and starting the data transmission stream task by taking the data center station as a transmission address, and sequentially sending the first target data in the target data set to the data center station.
The data center station is used for: and receiving a data transmission stream task generated by the cloud server in response to the first target data, and acquiring the first target data as required data.
According to the technical scheme, the target data extracted by the multiple third-party data platforms are transmitted to the cloud server, the target data from different third-party data platforms are integrated into a data set by using a data transmission flow task and then are transmitted to the data center station in a unified mode, and data interaction is completed by using one-to-one transmission interfaces between the cloud server and the data center station, so that the problem that the elaboration efficiency is low due to incompatibility in the data interaction process between the data center station and the multiple third-party data platforms in the prior art is solved, the data transmission rate between the data center station and the multiple third-party data platforms is improved, and the development requirement of a large data period in the prior art is met.
In another improvement of this embodiment, the multisystem data interaction system further includes:
the cloud server is further configured to: and generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data, and sending the unique identification code corresponding to the first target data to the data center station.
The data center is further configured to: receiving the unique identification code sent by the cloud server, and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code; if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; and if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server.
The cloud server is further configured to: and receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction.
The data center is further configured to: receiving first target data sent by the cloud server and taking the first target data as required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
The technical scheme of the invention can also generate the unique identification code for the target data in the cloud server, the data center station can search the historical downloaded data in the data repository according to the unique identification code corresponding to the historical stored required data, the required data is directly called in the data repository without repeated downloading, the useless behavior of repeatedly downloading the same data in the data transmission process of the data center station and a third-party data platform is avoided, the data transmission rate between the data center station and a plurality of third-party data platforms is further improved, and the practicability of the technical scheme is improved.
The above-mentioned embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, and it should be understood that the above-mentioned embodiments are only examples of the present invention and are not intended to limit the scope of the present invention. It should be understood that any modifications, equivalents, improvements and the like, which come within the spirit and principle of the invention, may occur to those skilled in the art and are intended to be included within the scope of the invention.

Claims (7)

1. A multi-system data interaction method is applied to a data center, the data center performs data interaction with a cloud server and a plurality of third-party data platforms respectively, and the multi-system data interaction method comprises the following steps:
receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address;
generating a data acquisition instruction according to the target address and the address information of the cloud server, and sending the data acquisition instruction to the third-party data platform, so that the third-party data platform responds to the data acquisition instruction, extracts first target data and sends the first target data to the cloud server;
receiving a sent unique identification code generated by the cloud server in response to the first target data, and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code;
if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; otherwise, receiving first target data sent by the cloud server and taking the first target data as required data.
2. The method for multi-system data interaction of claim 1, wherein the step of receiving the first target data sent by the cloud server and using the first target data as the required data comprises:
if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server, so that the cloud server responds to the data issuing instruction and sends the first target data to the data center station;
receiving first target data sent by the cloud server and taking the first target data as required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
3. The utility model provides a multisystem data interaction device, its characterized in that is applied to the data center, the data center carries out communication connection with high in the clouds server and a plurality of third party data platform respectively, multisystem data interaction device includes:
the trigger instruction module is used for receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address;
the acquisition instruction module is used for generating a data acquisition instruction according to the target address and the address information of the cloud server and sending the data acquisition instruction to the third-party data platform so that the third-party data platform can respond to the data acquisition instruction, extract first target data and send the first target data to the cloud server;
the data receiving module is used for receiving the sent unique identification code generated by the cloud server in response to the first target data and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code;
if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; otherwise, receiving first target data sent by the cloud server and taking the first target data as required data.
4. A multi-system data interaction method is applied to a cloud server, the cloud server performs data interaction with a data center and a plurality of third-party data platforms respectively, and the multi-system data interaction method comprises the following steps:
receiving first target data sent by a plurality of third-party data platforms to obtain a target data set;
establishing a data transmission stream task, and associating the target data set with the data transmission stream task;
starting the data transmission stream task for the data middling station as a transmission address;
generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data;
sending the unique identification code corresponding to the first target data to the data center station, so that the data center station responds to the unique identification code, searches whether second target data corresponding to the unique identification code exists in a data repository, and if the second target data corresponding to the unique identification code exists in the data repository, extracts the second target data as required data; if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction;
and sending the first target data which is not stored in the data repository in the target data set to a data center according to the data issuing instruction.
5. The method of multi-system data interaction of claim 4, wherein said step of sending to a data center a first target data in said target data set that is not stored in said data repository comprises:
and receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction so that the data center station responds to the first target data, takes the first target data as required data, and stores the first target data and the unique identification code corresponding to the first target data into the data repository.
6. The utility model provides a multi-system data interaction device, its characterized in that is applied to the high in the clouds server, the high in the clouds server carries out communication connection with data center and a plurality of third party data platform respectively, multi-system data interaction device includes:
the target data module is used for receiving first target data sent by a plurality of third-party data platforms to obtain a target data set;
the task association module is used for establishing a data transmission stream task and associating the target data set with the data transmission stream task;
the data transmission module is used for starting the data transmission stream task for the data middle station as a transmission address; generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data;
sending the unique identification code corresponding to the first target data to the data center station, so that the data center station responds to the unique identification code, searches whether second target data corresponding to the unique identification code exists in a data repository, and if the second target data corresponding to the unique identification code exists in the data repository, extracts the second target data as required data; if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction;
and sending the first target data which is not stored in the data repository in the target data set to a data center according to the data issuing instruction.
7. A multi-system data interaction system, comprising: the system comprises a data center platform, a cloud server and a plurality of third-party data platforms; the data center is in communication connection with a cloud server and a plurality of third-party data platforms respectively, and the cloud server is in communication connection with the plurality of third-party data platforms respectively;
the data center station is used for: receiving a trigger instruction, determining a target address according to the trigger instruction and determining a third-party data platform corresponding to the target address;
the data center station is used for: generating a data acquisition instruction according to the target address and the address information of the cloud server, and sending the data acquisition instruction to the third-party data platform;
the third party data platform is to: receiving a data acquisition instruction sent by a data center station, and extracting first target data according to a target address in the data acquisition instruction; sending the first target data to the cloud server according to the address information of the cloud server in the data acquisition instruction;
the cloud server is used for: receiving first target data sent by a plurality of third-party data platforms to obtain a target data set;
the cloud server is used for: establishing a data transmission stream task, and associating the target data set with the data transmission stream task;
the cloud server is used for: starting the data transmission stream task for the data center station as a transmission address, and sequentially sending first target data in the target data set to the data center station;
the data center station is used for: receiving a data transmission stream task generated by the cloud server in response to the first target data, and acquiring the first target data as required data;
the cloud server is further configured to: generating a corresponding unique identification code according to the address information, the data attribute and the data content of the first target data, and sending the unique identification code corresponding to the first target data to the data center station;
the data center is further configured to: receiving the unique identification code sent by the cloud server, and searching whether second target data corresponding to the unique identification code exists in a data repository; wherein, the data storage bank stores the required data of the history and the corresponding unique identification code; if the second target data corresponding to the unique identification code exists in the data repository, extracting the second target data as required data; if the second target data corresponding to the unique identification code does not exist in the data repository, generating a data issuing instruction, and sending the data issuing instruction to the cloud server;
the cloud server is further configured to: receiving a data issuing instruction sent by the data center station, and sending the first target data to the data center station according to the data issuing instruction;
the data center is further configured to: receiving first target data sent by the cloud server and taking the first target data as required data; and simultaneously, storing the first target data and the corresponding unique identification code into the data repository.
CN202110553240.4A 2021-05-20 2021-05-20 Multi-system data interaction method, device and system Active CN113297218B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110553240.4A CN113297218B (en) 2021-05-20 2021-05-20 Multi-system data interaction method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110553240.4A CN113297218B (en) 2021-05-20 2021-05-20 Multi-system data interaction method, device and system

Publications (2)

Publication Number Publication Date
CN113297218A CN113297218A (en) 2021-08-24
CN113297218B true CN113297218B (en) 2022-01-07

Family

ID=77323240

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110553240.4A Active CN113297218B (en) 2021-05-20 2021-05-20 Multi-system data interaction method, device and system

Country Status (1)

Country Link
CN (1) CN113297218B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116684437B (en) * 2023-08-04 2023-10-03 江苏量界数据科技有限公司 Distributed data management method based on natural language analysis

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202795458U (en) * 2012-07-09 2013-03-13 高艳玲 Network device based on customer identity verification system
CN103581279A (en) * 2012-08-10 2014-02-12 百度在线网络技术(北京)有限公司 Access system, method and device for third-party developer
CN108023921A (en) * 2016-11-03 2018-05-11 平安科技(深圳)有限公司 The cut-in method and device of a kind of third-party platform
CN109559213A (en) * 2018-12-20 2019-04-02 航天信息股份有限公司 The processing method and processing device of taxation informatization
CN109660574A (en) * 2017-10-10 2019-04-19 阿里巴巴集团控股有限公司 Data offering method and device
EP3531670A1 (en) * 2018-02-26 2019-08-28 Servicenow, Inc. Proxy application supporting multiple collaboration channels
EP3561712A1 (en) * 2016-02-01 2019-10-30 Google LLC Systems and methods for deploying countermeasures against unauthorized scripts interfering with the rendering of content elements on information resources
CN110798490A (en) * 2020-01-06 2020-02-14 广州欧赛斯信息科技有限公司 Method and device for accessing third-party system based on data center and data center
CN111061623A (en) * 2019-07-12 2020-04-24 华控清交信息科技(北京)有限公司 Method, device, middle platform server, storage medium and system for debugging program
CN111881204A (en) * 2020-07-24 2020-11-03 海南中金德航科技股份有限公司 Big data visualization platform
CN112073366A (en) * 2020-07-23 2020-12-11 中国铁道科学研究院集团有限公司电子计算技术研究所 Data processing method for railway financial system and data center
CN112363845A (en) * 2020-10-23 2021-02-12 珠海市卓轩科技有限公司 Data synchronization method of system integration middling station and integration middling station system
CN112699118A (en) * 2020-12-25 2021-04-23 京东方科技集团股份有限公司 Data synchronization method, corresponding device, system and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015117068A1 (en) * 2014-01-31 2015-08-06 Sparcq, Inc. Media content marking and tracking methods and apparatus
CN110032576B (en) * 2019-03-12 2023-06-16 平安科技(深圳)有限公司 Service processing method and device
CN110413918B (en) * 2019-08-01 2023-09-22 腾讯科技(深圳)有限公司 Data transmission method, device, equipment and storage medium
CN112511606B (en) * 2020-11-17 2021-07-20 北京三维天地科技股份有限公司 Intelligent online industrial data acquisition method and system

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202795458U (en) * 2012-07-09 2013-03-13 高艳玲 Network device based on customer identity verification system
CN103581279A (en) * 2012-08-10 2014-02-12 百度在线网络技术(北京)有限公司 Access system, method and device for third-party developer
EP3561712A1 (en) * 2016-02-01 2019-10-30 Google LLC Systems and methods for deploying countermeasures against unauthorized scripts interfering with the rendering of content elements on information resources
CN108023921A (en) * 2016-11-03 2018-05-11 平安科技(深圳)有限公司 The cut-in method and device of a kind of third-party platform
CN109660574A (en) * 2017-10-10 2019-04-19 阿里巴巴集团控股有限公司 Data offering method and device
EP3531670A1 (en) * 2018-02-26 2019-08-28 Servicenow, Inc. Proxy application supporting multiple collaboration channels
CN109559213A (en) * 2018-12-20 2019-04-02 航天信息股份有限公司 The processing method and processing device of taxation informatization
CN111061623A (en) * 2019-07-12 2020-04-24 华控清交信息科技(北京)有限公司 Method, device, middle platform server, storage medium and system for debugging program
CN110798490A (en) * 2020-01-06 2020-02-14 广州欧赛斯信息科技有限公司 Method and device for accessing third-party system based on data center and data center
CN112073366A (en) * 2020-07-23 2020-12-11 中国铁道科学研究院集团有限公司电子计算技术研究所 Data processing method for railway financial system and data center
CN111881204A (en) * 2020-07-24 2020-11-03 海南中金德航科技股份有限公司 Big data visualization platform
CN112363845A (en) * 2020-10-23 2021-02-12 珠海市卓轩科技有限公司 Data synchronization method of system integration middling station and integration middling station system
CN112699118A (en) * 2020-12-25 2021-04-23 京东方科技集团股份有限公司 Data synchronization method, corresponding device, system and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
An Anonymous and Efficient Multiserver Authenticated Key Agreement With Offline Registration Centre;Irshad Azeem等;《IEEE SYSTEMS JOURNAL》;20190331;第436-446页 *
云计算信息技术在市场监管领域的实现路径研究;庞文迪等;《电脑知识与技术》;20201130;第244-246页 *
智能电站数据中台建设与应用;王毅等;《中国电力》;20210331;第61-67+176页 *

Also Published As

Publication number Publication date
CN113297218A (en) 2021-08-24

Similar Documents

Publication Publication Date Title
CN109768623A (en) Monitoring method, device, computer equipment and the storage medium of electric system
CN103095819A (en) Data information pushing method and data information pushing system
CN107105009A (en) Job scheduling method and device based on Kubernetes system docking workflow engines
CN105760272B (en) Monitoring backstage business customizing method and its system based on plug-in unit
CN103150324A (en) Chained processing-based data collecting system and method
CN110162387A (en) Thread scheduling method, device, computer equipment and computer readable storage medium
CN113297218B (en) Multi-system data interaction method, device and system
CN105471700A (en) Information processing method, information processing device and information processing system
CN103678522A (en) Method for acquiring and converting data of metering system of intelligent transformer substation
CN113900810A (en) Distributed graph processing method, system and storage medium
CN107870982A (en) Data processing method, system and computer-readable recording medium
CN103944957A (en) Off-line data collection method for industrial monitoring system and collection system thereof
CN113626512A (en) Data processing method, device, equipment and readable storage medium
CN110932393B (en) Substation information protection master station system and data initialization method thereof
CN104270272B (en) A kind of electric energy quality monitoring data management scheme based on mobile Agent
CN111343269A (en) Data downloading method and device, computer equipment and storage medium
CN113297217B (en) Data transmission method, device and system
CN105245579A (en) Power distribution network system massive data communication processing method and system
CN103176454B (en) The cluster method of multi-robot system and system
CN113095785B (en) Business expansion business platform
CN109190969A (en) Weighing-appliance management-control method, system, weighing-appliance management middleware and medium
CN111401819B (en) Intersystem data pushing method and system
CN104794124A (en) Intelligent implementation method and system for data missing supplementation
CN107562914B (en) Resource mask based demand response resource rapid positioning method
CN105446651B (en) Memory mirror method and system and data sending device and data sink

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 510000 room 1502, No. 18, siyouyima Road, Yuexiu District, Guangzhou City, Guangdong Province

Patentee after: Guangzhou Guangdian Information Technology Co.,Ltd.

Address before: 510000 room 1502, No. 18, siyouyima Road, Yuexiu District, Guangzhou City, Guangdong Province

Patentee before: GUANGZHOU GOOD IDEA INFORMATION TECHNOLOGY Co.,Ltd.

PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: A multi system data interaction method, device and system

Effective date of registration: 20220609

Granted publication date: 20220107

Pledgee: Development Zone sub branch of Bank of Guangzhou Co.,Ltd.

Pledgor: Guangzhou Guangdian Information Technology Co.,Ltd.

Registration number: Y2022980007416

PC01 Cancellation of the registration of the contract for pledge of patent right
PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20231011

Granted publication date: 20220107

Pledgee: Development Zone sub branch of Bank of Guangzhou Co.,Ltd.

Pledgor: Guangzhou Guangdian Information Technology Co.,Ltd.

Registration number: Y2022980007416