CN108268607B - Data circulation system and method, storage medium, and terminal - Google Patents
Data circulation system and method, storage medium, and terminal Download PDFInfo
- Publication number
- CN108268607B CN108268607B CN201711467016.3A CN201711467016A CN108268607B CN 108268607 B CN108268607 B CN 108268607B CN 201711467016 A CN201711467016 A CN 201711467016A CN 108268607 B CN108268607 B CN 108268607B
- Authority
- CN
- China
- Prior art keywords
- data
- supplier
- query
- demander
- service module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/273—Asynchronous replication or reconciliation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A data circulation system and method, storage medium, terminal, the data circulation system includes: the data file service module of the demander is suitable for receiving the data file provided by the demander, and the data file comprises a plurality of inquiry IDs; the on-demand data circulation service module is suitable for carrying a plurality of inquiry IDs in the inquiry request to be sent out on line; the supplier data collision service modules are suitable for receiving the query request, comparing the query ID in the query request with the data ID provided by the supplier to form a collision result and feeding back the collision result, wherein the collision result comprises indication information to indicate whether the query ID is consistent with the data ID; and the plurality of supplier collision data storage service modules are suitable for recording the final data ID consistent with the query ID according to the collision result so that the supplier prepares the data corresponding to the final data ID and sends the prepared data. By the technical scheme of the invention, the timeliness of data circulation can be improved, and the requirement of low delay is met.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data circulation system and method, a storage medium, and a terminal.
Background
Under the application scene of asynchronous circulation of the ultra-large-scale multi-source data on demand, the method requires more data distribution amount. The characteristics of the on-demand asynchronous flow of the super-large-scale multi-source data are embodied in the following aspects: the distribution data volume is huge, and the magnitude order is always in the hundred million level; the demand circulation is required, namely the actual demand side puts forward the distribution demand, the supplier prepares data with the best effort, and then delivers the data to the demand side with the best effort; a single supplier is basically unable to meet the high coverage requirements of the demanders, requiring multiple suppliers to cooperate in maximizing efforts to deliver the delivery volume required by the demanders.
In the prior art, a data circulation system generally distributes data in a real-time online manner. After the data is requested by the demander, the supplier needs to send the data to the demander in real time as it is able to provide the data requested by the demander.
However, the existing data circulation method cannot meet the preset time requirement in a large-scale multi-source data asynchronous circulation scene.
Disclosure of Invention
The invention solves the technical problem of how to improve the timeliness of data circulation and meet the requirement of low delay.
To solve the above technical problem, an embodiment of the present invention provides a data circulation system, including: a data circulation system, comprising: the system comprises a demander data file service module, a demander data file service module and a demander data file service module, wherein the demander data file service module is suitable for receiving a data file provided by a demander, and the data file comprises a plurality of inquiry IDs; the demander data on-demand circulation service module is suitable for carrying the plurality of inquiry IDs in the inquiry request to be sent out on line; the supplier data collision service modules are suitable for receiving the query request, comparing the query ID in the query request with the data ID provided by the supplier to form a collision result and feeding back the collision result, wherein the collision result comprises indication information to indicate whether the query ID is consistent with the data ID; and the supplier collision data storage service modules are suitable for recording a final data ID consistent with the query ID according to the collision result so that the supplier prepares data corresponding to the final data ID and sends the prepared data.
Optionally, the supplier sends the prepared data in an asynchronous manner.
Optionally, the demander data on-demand circulation service module carries a single query ID with the query request, and sends the query ID to the supplier data collision service modules in a polling manner; or the demander data on-demand circulation service module divides the data file into subfiles with set number, and sends the subfiles to different supplier data collision service modules respectively by carrying the query requests, wherein the set number is consistent with the number of suppliers.
Optionally, the data circulation system further includes a cache; the cache stores a data ID and identification information, wherein the identification information is used for indicating that the supplier can provide data corresponding to the data ID.
Optionally, the data circulation system further includes: and the data loading service module is suitable for importing the data ID provided by the supplier into the cache in a multi-protocol concurrent mode.
Optionally, the demander data file service module merges the prepared data sent by multiple suppliers, and forwards the merged data to the demander.
Optionally, the demander data file service module discards the prepared data when receiving the prepared data provided by the provider after a set time period after the sending time of the query request.
Optionally, the data circulation system further includes a supplier data file service module, and the supplier data file service module sends the prepared data.
Optionally, the demander data file service module performs security verification on the data file, and after the verification is passed, the demander data is sent out through the demander data on-demand circulation service module.
In order to solve the above technical problem, an embodiment of the present invention further discloses a data circulation method, where the data circulation method includes: receiving a data file provided by a demand party, wherein the data file comprises a plurality of inquiry IDs; carrying the plurality of query IDs in a query request and sending out the query IDs on line; receiving the query request, comparing the query ID in the query request with the data ID provided by a supplier to form a collision result, and feeding back the collision result, wherein the collision result comprises indication information to indicate whether the query ID is consistent with the data ID; and recording a final data ID consistent with the query ID according to the collision result so that the supplier can prepare data corresponding to the final data ID and send the prepared data.
Optionally, the supplier sends the prepared data in an asynchronous manner.
Optionally, the carrying of the plurality of query IDs in the query request for online sending includes: carrying a single query ID on the query request, and sending out the query ID in a polling mode; or, the data file is divided into subfiles with set number, and the subfiles are carried with the query requests and are respectively sent out, wherein the set number is consistent with the number of suppliers.
Optionally, the data ID and the identification information are stored in a cache, where the identification information is used to indicate that the supplier can provide the data corresponding to the data ID.
Optionally, before receiving the query request, the method further includes: and importing the data ID provided by the supplier into the cache in a multi-protocol concurrent mode.
Optionally, the data circulation method further includes: and merging the prepared data sent by a plurality of suppliers, and forwarding the merged data to the demander.
Optionally, the data circulation method further includes: and when the prepared data provided by the supplier is received after a set time period after the sending time of the query request, discarding the prepared data.
Optionally, after receiving the data file provided by the demander, the method further includes: and the data file service of the demand party carries out security verification on the data file, and after the verification is passed, the data file is sent out through the data circulation service of the demand party according to the demand.
The embodiment of the invention also discloses a storage medium, wherein a computer instruction is stored on the storage medium, and the steps of the data circulation method are executed when the computer instruction runs.
The embodiment of the invention also discloses a terminal which comprises a memory and a processor, wherein the memory is stored with a computer instruction capable of running on the processor, and the processor executes the steps of the data circulation method when running the computer instruction.
Compared with the prior art, the technical scheme of the embodiment of the invention has the following beneficial effects:
the data circulation system of the technical scheme of the invention can comprise a demander data file service module, which is suitable for receiving data files provided by a demander, wherein the data files comprise a plurality of inquiry IDs; the demander data on-demand circulation service module is suitable for carrying the plurality of inquiry IDs in the inquiry request to be sent out on line; the supplier data collision service modules are suitable for receiving the query request, comparing the query ID in the query request with the data ID provided by the supplier to form a collision result and feeding back the collision result, wherein the collision result comprises indication information to indicate whether the query ID is consistent with the data ID; and the supplier collision data storage service modules are suitable for recording a final data ID consistent with the query ID according to the collision result so that the supplier prepares data corresponding to the final data ID and sends the prepared data. According to the technical scheme, the supplier data collision service module feeds back the indication information according to the query request, and the supplier collision data storage service module records the final data ID for the supplier to prepare the data to the demander, so that high delay of feeding back the request data in real time in the prior art is avoided, and the user experience is improved; in addition, the demand side can obtain the requested data, and meanwhile, the circulating data scale of the data circulating system is expanded, and the performance of the data circulating system is improved.
Further, the supplier sends the prepared data in an asynchronous manner. The technical scheme of the invention further improves the data scale of data circulation by combining online data query and adopting an asynchronous mode to send data on the basis of ensuring the timely response of the query request.
Further, the demander data on-demand circulation service module carries a single inquiry ID on the inquiry request and sends the inquiry request to the supplier data collision service modules in a polling mode; or the demander data on-demand circulation service module divides the data file into subfiles with set number, and sends the subfiles to different supplier data collision service modules respectively by carrying the query requests, wherein the set number is consistent with the number of suppliers. The request mode in the technical scheme of the invention can avoid repeatedly requesting data from the supplier; the data query request is carried out in various modes, diversification of circulation modes is achieved, different requirements of demanders can be met, and user experience is improved.
Further, the cache stores a data ID and identification information, where the identification information is used to indicate that the supplier can provide data corresponding to the data ID. According to the technical scheme, the identification information is stored in the cache, the identification information occupies a small storage space, for example, only occupies a single byte, so that the problem that a large amount of data is stored in the cache in the prior art is avoided, the storage space is saved, and the response speed of data circulation is improved.
Further, the data loading service module is suitable for importing the data ID provided by the supplier into the cache in a multi-protocol concurrent mode. The technical scheme of the invention can realize faster data loading, thereby providing data query service more quickly and improving the data circulation efficiency.
Drawings
FIG. 1 is a schematic structural diagram of a data flow system according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of another data flow system according to an embodiment of the present invention;
fig. 3 is a flowchart of a data circulation method according to an embodiment of the present invention.
Detailed Description
As described in the background art, the conventional data circulation method cannot meet the preset time requirement in a large-scale multi-source data asynchronous circulation scene.
According to the technical scheme, the supplier data collision service module feeds back the indication information according to the query request, and the supplier collision data storage service module records the final data ID for the supplier to prepare the data to the demander, so that high delay of feeding back the request data in real time in the prior art is avoided, and the user experience is improved; in addition, the demand side can obtain the requested data, and meanwhile, the circulating data scale of the data circulating system is expanded, and the performance of the data circulating system is improved.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
Fig. 1 is a schematic structural diagram of a data circulation system according to an embodiment of the present invention.
The data circulation system 10 shown in fig. 1 may include an on-demand data file service module 101, an on-demand data circulation-on-demand service module 102, a plurality of supplier data collision service modules 103, and a plurality of supplier collision data storage service modules 104.
In this embodiment, the demander data file service module 101 and the demander data on-demand circulation service module 102 may be used as a front-end processor of a demander and perform data interaction with the demander. For example, receiving a data file provided by a requesting party, sending data requested by the requesting party to the requesting party, etc.
The demander data file service module 101 is adapted to receive a data file provided by a demander, where the data file includes a plurality of query IDs, i.e., query identifiers (identities). The on-demand data circulation service module 102 is adapted to send the query IDs in the query request on line.
In specific implementation, when a demand side needs data, the ID of the data needed by the demand side can be used as a query ID, and a data file is formed. The acquirer data file service module 101 may receive the data file. The on-demand data circulation service module 102 forms a query request based on the data file and sends out the query request.
Specifically, the acquirer data file service module 101 may pull the data file by: and extracting corresponding data files in a local File system by adopting a File Transfer Protocol (File Transfer Protocol) mode.
In a preferred embodiment of the present invention, the demander data file service module 101 performs security check on the data file, and after the data file passes the security check, the data file is sent out through the demander data on-demand circulation service module 102.
In particular, a Message Digest Algorithm (MD) may be employed for security checking. More specifically, the demander data file service module 101 may further receive a check file of the data file sent by the demander in advance, where the check file may include a content after the data file is subjected to message digest algorithm processing; the demander data file service module 101 performs message digest algorithm processing on the received data file, compares the processed data file with the check file, and if the comparison result is consistent, the data file passes security check, otherwise, the demander data file service module determines that the data file does not pass security check, and the demander data file service module needs to resend the data file.
In this embodiment, the supplier data collision service module 103 and the supplier collision data storage service module 104 may be used as a supplier front-end processor to perform data interaction with a supplier. For example, receiving data provided by a provider, forwarding a query request to the provider, etc.
Specifically, the multiple supplier data collision service modules 103 and the multiple supplier collision data storage service modules 104 perform data interaction with different suppliers, respectively.
The multiple supplier data collision service modules 103 are adapted to receive the query request, compare the query ID in the query request with the data ID provided by the supplier, form a collision result, and feed back the collision result, where the collision result includes indication information to indicate whether the query ID is consistent with the data ID.
In this embodiment, the supplier data collision service module 103 may compare the query ID with the data ID provided by the supplier to form a collision result.
In a specific implementation, the supplier data collision service module 103 may query, one by one, whether the supplier can provide data corresponding to the current query ID. And if the query ID is consistent with the data ID, forming indication information to indicate that the supplier can provide the data corresponding to the current query ID. Otherwise, forming indication information to indicate that the supplier cannot provide the data corresponding to the query ID. Donor data collision service module 103 may continue to compare the query ID to the data ID provided by the next donor until there is no next donor. More specifically, the supplier data collision service module 103 queries, one by one, whether the supplier can provide data corresponding to the query ID in a hypertext Transfer Protocol (HTTP) manner.
The supplier collision data storage service modules 104 are adapted to record a final data ID consistent with the query ID according to the collision result, so that the supplier prepares data corresponding to the final data ID and sends the prepared data.
In particular implementations, supplier crash data storage service module 104 enables the supplier to prepare data based on the final data ID by recording the final data ID. The format of the prepared data may be a file.
In another preferred embodiment of the present invention, the data circulation system 10 shown in fig. 1 may further include a cache; the cache stores a data ID and identification information, wherein the identification information is used for indicating that the supplier can provide data corresponding to the data ID. Specifically, the supplier data collision service module 103 may compare the data ID in the cache with the query ID, thereby avoiding frequent reading and writing of the memory and improving the writing and reading efficiency.
According to the technical scheme, the identification information is stored in the cache, the identification information occupies a small storage space, for example, only occupies a single byte, so that the problem that a large amount of data is stored in the cache in the prior art is avoided, the storage space is saved, and the response speed of data circulation is improved.
In a specific implementation, the data ID is a primary Key (Key), and the identification information is a tag value (value). Since the tag value is not actual data but identification information, memory space can be saved. In order to further save the storage space, a life cycle (for example, 30 days) may be set for each primary key, and the data ID and the identification information may be deleted periodically.
In order to increase the query speed and provide high-speed collision requests, a local memory (redis) can also be used to store data IDs that a supplier can provide data.
In the embodiment of the invention, the supplier data collision service module feeds back the indication information according to the query request, and records the final data ID in the supplier collision data storage service module for the supplier to prepare the data to the demander, thereby avoiding the high delay of feeding back the request data in real time in the prior art and improving the user experience; in addition, the demand side can obtain the requested data, and meanwhile, the circulating data scale of the data circulating system is expanded, and the performance of the data circulating system is improved.
In a specific application scenario of the present invention, there may be multiple suppliers, and each supplier receives the query request and provides data through the corresponding supplier data collision service module 103 and supplier collision data storage service module 104. The data are supplied by multiple responders, so that the probability of the demander acquiring the required data can be improved, and the data circulation efficiency is improved.
In yet another preferred embodiment of the present invention, the supplier sends the prepared data in an asynchronous manner.
In the embodiment, after the collision result is fed back, the supplier capable of providing the data sends the prepared data in an asynchronous mode after the data is prepared, thereby avoiding occupying real-time resources of the demander and ensuring quick response to the query request.
The embodiment of the invention further improves the data scale of data circulation by combining online data query and adopting an asynchronous mode to send data on the basis of ensuring the timely response of the query request.
In an embodiment of the present invention, with reference to fig. 1, the on-demand data circulation service module 102 carries a single query ID with the query request, and sends the query ID to the multiple supplier data collision service modules 103 in a polling manner.
Or, the demander data on-demand circulation service module 102 divides the data file into subfiles of a set number, and sends the subfiles carrying the query request to different supplier data collision service modules 103, where the set number is consistent with the number of suppliers.
Specifically, whether the piece of data can be provided can be confirmed to the supplier item by polling through a single query ID; the plurality of subfiles is transmitted one of the shares to each of the donor data collision service modules 103.
The embodiment of the invention can avoid repeated data request by a single ID polling mode or a mode of sending a plurality of subfiles, thereby improving the data circulation efficiency.
In another embodiment of the present invention, with continued reference to fig. 2, the data circulation system may include an on-demand data file service module 201, an on-demand data circulation service module 202, a cache 203, a supplier data collision service module 206, and a collision data storage service module 205.
For specific implementation of the demander data file service module 201, the demander data on-demand circulation service module 202, the cache 203, the supplier data collision service module 206, and the collision data storage service module 205, reference may be made to the foregoing embodiments, which are not described herein again.
The data circulation system of this embodiment may further include a data loading service module 204, which is adapted to import the data ID provided by the supplier into the cache in a multi-protocol concurrent manner. In one implementation, the data loading service module 204 obtains the data ID from the data source and loads the data ID into the cache 203. To reduce the loading time, the data ID may be imported in a multiprogramming concurrent manner.
Further, the demander data file service module 201 merges the prepared data sent by multiple suppliers, and forwards the merged data to the demander.
Further, the acquirer data file service module 201 discards the prepared data when receiving the prepared data provided by the supplier after a set period of time after the transmission time of the inquiry request.
The data circulation system of this embodiment may further include a supplier data file service module 207, where the supplier data file service module 207 sends the prepared data.
Continuing with fig. 2, in chronological order, the demander data on-demand circulation service module 202 sends an inquiry request, forwards the inquiry request to the supplier data collision service module 206 via the network, and the supplier data collision service module 206 feeds back a collision result. After the vendor prepares the data, the vendor data file service module 207 asynchronously pushes the prepared data. The feedback data is sent to the demander data file service module 201 for forwarding to the demander.
Referring to fig. 3, the data circulation method may include the following steps:
step S301: receiving a data file provided by a demand party, wherein the data file comprises a plurality of inquiry IDs;
step S302: carrying the plurality of query IDs in a query request and sending out the query IDs on line;
step S303: receiving the query request, comparing the query ID in the query request with the data ID provided by a supplier to form a collision result, and feeding back the collision result, wherein the collision result comprises indication information to indicate whether the query ID is consistent with the data ID;
step S304: and recording a final data ID consistent with the query ID according to the collision result so that the supplier can prepare data corresponding to the final data ID and send the prepared data.
According to the embodiment of the invention, the indication information is fed back according to the query request, and the final data ID is recorded for the supplier to prepare the data to the demander, so that the high delay of feeding back the request data in real time in the prior art is avoided, and the user experience is improved; in addition, the demand side can obtain the requested data, and meanwhile, the circulation data scale of data circulation is expanded, and the data circulation performance is improved.
Preferably, the supplier sends the prepared data in an asynchronous manner.
The embodiment of the invention further improves the data scale of data circulation by combining online data query and adopting an asynchronous mode to send data on the basis of ensuring the timely response of the query request.
In a preferred embodiment of the present invention, step S302 shown in fig. 3 may include the following steps: carrying a single query ID on the query request, and sending out the query ID in a polling mode;
or, the data file is divided into subfiles with set number, and the subfiles are carried with the query requests and are respectively sent out, wherein the set number is consistent with the number of suppliers.
In another preferred embodiment of the present invention, a cache is used to store the data ID and the identification information, where the identification information is used to indicate that the supplier can provide the data corresponding to the data ID.
In an embodiment of the present invention, before step S303 shown in fig. 3, the following steps are further included: and importing the data ID provided by the supplier into the cache in a multi-protocol concurrent mode.
In another specific embodiment of the present invention, the data circulation method further includes the following steps: and merging the prepared data sent by a plurality of suppliers, and forwarding the merged data to the demander.
Further, the data circulation method may further include the steps of: and when the prepared data provided by the supplier is received after a set time period after the sending time of the query request, discarding the prepared data.
In another embodiment of the present invention, the step S301 shown in fig. 3 may further include the following steps: and the data file service of the demand party carries out security verification on the data file, and after the verification is passed, the data file is sent out through the data circulation service of the demand party according to the demand.
For more specific embodiments of the data circulation method, reference may be made to the relevant descriptions in fig. 1 to fig. 2, and details are not described here.
The embodiment of the invention also discloses a storage medium, on which computer instructions are stored, and when the computer instructions are operated, the steps of the data circulation method shown in fig. 3 can be executed. The storage medium may include ROM, RAM, magnetic or optical disks, etc. The storage medium may further include a non-volatile memory (non-volatile) or a non-transitory memory (non-transient), and the like.
The embodiment of the invention also discloses a terminal which can comprise a memory and a processor, wherein the memory is stored with computer instructions capable of running on the processor. The processor, when executing the computer instructions, may perform the steps of the graph data flow-through method. The terminal includes, but is not limited to, a mobile phone, a computer, a tablet computer and other terminal devices.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (17)
1. A data circulation system, comprising:
the system comprises a demander data file service module, a demander data file service module and a demander data file service module, wherein the demander data file service module is suitable for receiving a data file provided by a demander, and the data file comprises a plurality of inquiry IDs;
the demander data on-demand circulation service module is suitable for carrying the plurality of inquiry IDs in the inquiry request to be sent out on line; the demander data on-demand circulation service module carries a single inquiry ID on the inquiry request and sends the inquiry request to a plurality of supplier data collision service modules in a polling mode; or the demander data on-demand circulation service module divides the data file into subfiles with set number, and sends the subfiles to different supplier data collision service modules respectively with the query request, wherein the set number is consistent with the number of suppliers;
the supplier data collision service modules are suitable for receiving the query request, comparing the query ID in the query request with the data ID provided by the supplier to form a collision result and feeding back the collision result, wherein the collision result comprises indication information to indicate whether the query ID is consistent with the data ID;
and the supplier collision data storage service modules are suitable for recording a final data ID consistent with the query ID according to the collision result so that the supplier prepares data corresponding to the final data ID and sends the prepared data.
2. A data flow system according to claim 1, wherein the supplier sends the prepared data in an asynchronous manner.
3. A data flow system according to claim 1, further comprising a cache; the cache stores a data ID and identification information, wherein the identification information is used for indicating that the supplier can provide data corresponding to the data ID.
4. A data flow system according to claim 3, further comprising:
and the data loading service module is suitable for importing the data ID provided by the supplier into the cache in a multi-protocol concurrent mode.
5. The data circulation system of claim 1, wherein the demander data file service module combines the prepared data sent by multiple suppliers and forwards the combined data to the demander.
6. The data circulation system of claim 1, wherein the demander data file service module discards the prepared data when receiving the prepared data provided by a supplier after a set period of time after the transmission time of the inquiry request.
7. The data circulation system of claim 1, further comprising a supplier data file service module, wherein the supplier data file service module sends the prepared data.
8. The data circulation system of claim 1, wherein the demander data file service module performs security verification on the data file and sends the data file through the demander data on-demand circulation service module after the verification is passed.
9. A method for data circulation, comprising:
receiving a data file provided by a demand party, wherein the data file comprises a plurality of inquiry IDs;
carrying the plurality of query IDs in a query request to be sent out online, and the method comprises the following steps: carrying a single query ID on the query request, and sending out the query ID in a polling mode; or, dividing the data file into subfiles with set quantity, and respectively sending out the subfiles carried with the query request, wherein the set quantity is consistent with the quantity of suppliers;
receiving the query request, comparing the query ID in the query request with the data ID provided by a supplier to form a collision result, and feeding back the collision result, wherein the collision result comprises indication information to indicate whether the query ID is consistent with the data ID;
and recording a final data ID consistent with the query ID according to the collision result so that the supplier can prepare data corresponding to the final data ID and send the prepared data.
10. A data flow method according to claim 9, wherein the supplier sends the prepared data asynchronously.
11. The data circulation method according to claim 9, wherein a cache is used to store the data ID and the identification information, and the identification information is used to indicate that the supplier can provide the data corresponding to the data ID.
12. A data flow method according to claim 11, wherein the receiving the query request further comprises:
and importing the data ID provided by the supplier into the cache in a multi-protocol concurrent mode.
13. A data flow method according to claim 9, further comprising:
and merging the prepared data sent by a plurality of suppliers, and forwarding the merged data to the demander.
14. A data flow method according to claim 9, further comprising:
and when the prepared data provided by the supplier is received after a set time period after the sending time of the query request, discarding the prepared data.
15. The data circulation method according to claim 9, wherein after receiving the data file provided by the demander, the method further comprises:
and the data file service of the demand party carries out security verification on the data file, and after the verification is passed, the data file is sent out through the data circulation service of the demand party according to the demand.
16. A storage medium having stored thereon computer instructions, wherein the computer instructions when executed perform the steps of the data flow method of any one of claims 9 to 15.
17. A terminal comprising a memory and a processor, the memory having stored thereon computer instructions executable on the processor, wherein the processor, when executing the computer instructions, performs the steps of the data flow method of any one of claims 9 to 15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711467016.3A CN108268607B (en) | 2017-12-28 | 2017-12-28 | Data circulation system and method, storage medium, and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711467016.3A CN108268607B (en) | 2017-12-28 | 2017-12-28 | Data circulation system and method, storage medium, and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108268607A CN108268607A (en) | 2018-07-10 |
| CN108268607B true CN108268607B (en) | 2021-05-04 |
Family
ID=62772770
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711467016.3A Active CN108268607B (en) | 2017-12-28 | 2017-12-28 | Data circulation system and method, storage medium, and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108268607B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110457937A (en) * | 2019-07-02 | 2019-11-15 | 上海数据交易中心有限公司 | Data circulation method and device, system, storage medium, server |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6415321B1 (en) * | 1998-12-29 | 2002-07-02 | Cisco Technology, Inc. | Domain mapping method and system |
| CN102137088A (en) * | 2010-09-27 | 2011-07-27 | 华为技术有限公司 | Message exchanging method for service delivery platform (SDP) system, SDP system and device |
| CN103167017A (en) * | 2013-01-09 | 2013-06-19 | 北京奇虎科技有限公司 | Method, device and system for Web polling |
| CN106203140A (en) * | 2016-07-15 | 2016-12-07 | 上海数据交易中心有限公司 | Data circulation method based on data structure, device and terminal |
-
2017
- 2017-12-28 CN CN201711467016.3A patent/CN108268607B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6415321B1 (en) * | 1998-12-29 | 2002-07-02 | Cisco Technology, Inc. | Domain mapping method and system |
| CN102137088A (en) * | 2010-09-27 | 2011-07-27 | 华为技术有限公司 | Message exchanging method for service delivery platform (SDP) system, SDP system and device |
| CN103167017A (en) * | 2013-01-09 | 2013-06-19 | 北京奇虎科技有限公司 | Method, device and system for Web polling |
| CN106203140A (en) * | 2016-07-15 | 2016-12-07 | 上海数据交易中心有限公司 | Data circulation method based on data structure, device and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108268607A (en) | 2018-07-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103248645B (en) | BT off-line datas download system and method | |
| CN106559677B (en) | Terminal, cache server and method and device for acquiring video fragments | |
| US20180365254A1 (en) | Method and apparatus for processing information flow data | |
| CN106021315B (en) | Log management method and system for application program | |
| CN106874334B (en) | Data processing method and device and information processing system | |
| CN110941598A (en) | Data deduplication method, device, terminal and storage medium | |
| CN110113381A (en) | The method and device of theme is subscribed in a kind of block chain | |
| CN103561100A (en) | Cloud uploading method, cloud uploading system, dispatching device and client terminal | |
| CN102523290B (en) | Data processing method, device and system | |
| CN106603711B (en) | Communication method, system and message server | |
| CN108573026B (en) | Data circulation method and device, storage medium and server | |
| CN104794190A (en) | Method and device for effectively storing big data | |
| CA3131954A1 (en) | Information synchronization method, system, apparatus, computer device and storage medium | |
| CN105786629A (en) | Data processing method based on message queue | |
| CN105491078A (en) | Data processing method and device in SOA system, and SOA system | |
| CN111541555A (en) | Group chat optimization method and related product | |
| CN108228432A (en) | A kind of distributed link tracking, analysis method and server, global scheduler | |
| CN104899278A (en) | Method and apparatus for generating data operation logs of Hbase database | |
| CN103731492A (en) | Page transmission processing method, device and system | |
| CN108268607B (en) | Data circulation system and method, storage medium, and terminal | |
| CN110943876B (en) | URL state detection method, device, equipment and system | |
| CN102724301B (en) | Cloud database system and method and equipment for reading and writing cloud data | |
| US9245048B1 (en) | Parallel sort with a ranged, partitioned key-value store in a high perfomance computing environment | |
| EP2690560B1 (en) | Method of benchmarking the behaviour of a replacement information system with the old system | |
| CN107666431B (en) | Bookmark communication message acquisition method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |