CN105843966A - Data processing system and method - Google Patents
Data processing system and method Download PDFInfo
- Publication number
- CN105843966A CN105843966A CN201610252966.3A CN201610252966A CN105843966A CN 105843966 A CN105843966 A CN 105843966A CN 201610252966 A CN201610252966 A CN 201610252966A CN 105843966 A CN105843966 A CN 105843966A
- Authority
- CN
- China
- Prior art keywords
- data
- processing module
- source
- incoming end
- handling system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing system. The data processing system comprises a communication interaction module, a receiving and processing module, a sending and processing module and a task scheduling module, wherein the communication interaction module is used for being coupled with a source access end and a target access end and receiving first data in a first format from the source access end; the receiving and processing module is used for receiving the first data in the first format from the communication interaction module, obtaining source data by verifying, decompressing and reducing the first data and storing the source data, passing the verification and subjected to decompression and reduction, into a data cache in a separate data segment manner according to the type of the source data; the sending and processing module is used for converting to-be-sent data into second data in a second format and sending the second data to the target access end through the communication interaction module; the task scheduling module is arranged between the receiving and processing module and the sending and processing module and is used for scheduling the to-be-sent data to the sending and processing module in a data segment manner. The invention further discloses a data releasing and extracting method.
Description
Technical field
The application relates to data handling system, and the method carrying out data publication and extraction between source incoming end and target incoming end.
Background technology
Currently carrying out data pick-up method between source database and target database is substantially based on the function of relational database, substantially has following several: (
1
) direct data on query source storehouse by inserted or updated to target database for the result of inquiry；(
2
) by methods such as database journal, mirror image, filings, the change on source database is synchronized to target database；(
3
) pass through
ETL
Realize Deng specific purpose tool.
The method of above-mentioned prior art can not meet current needs, when being especially in the presence of frequent data item extraction.The method of prior art is easily caused a data and is repeatedly transmitted to target database from source database, needs repeatedly access originator data base.Although this ensure that the relative precision of data, but needs to have a greatly reduced quality as cost with process performance.It addition, prior art there is also data base is relied on greatly, abstracting method is big on source database impact, dispose the problems such as dispersion and security exceptions.
Accordingly, it would be desirable to the data publication of a kind of improvement and the method for extraction.
Summary of the invention
In order to solve the problems referred to above, a kind of method that present applicant proposes data publication and extraction, source incoming end is separated with target incoming end.Specifically, communication protocol identical with target incoming end employing for source incoming end can be accessed data handling system, source incoming end carries out data publication according to the data form (such as, the first form) arranged with data handling system and published method.Target incoming end carries out data pick-up according to the data form (such as, the second form) arranged with data handling system and subscribing manner.Source incoming end and target incoming end be not owing to being directly coupled together, because of without influencing each other.It addition, the present processes also supports that multiple source, multiple target are concurrently accessed, support that a data repeatedly extract, support Data Format Transform, it is possible in the case of high transaction volume, it is achieved steadily issuing and extraction of data.
An aspect according to the application, it is provided that a kind of data handling system.This data handling system comprises the steps that communication interaction module, is configured to couple with source incoming end and target incoming end, and receives first data with the first form from described source incoming end；Receiving processing module, it is configured to receive described first data with described first form from described communication interaction module, described first data are verified and are decompressed reduction thus obtain source data, and will verification by and described source data after decompressing reduction be stored in data buffer storage according to section according to its type scores；Sending processing module, data to be sent are converted to second data with the second form, and are sent to described target incoming end via described communication interaction module by described transmission processing module；And task scheduling modules, described task scheduling modules is arranged between described receiving processing module and described transmission processing module, and it is configured to data in data section to be sent to be scheduled to described transmission processing module.
In above-mentioned data handling system, when described receiving processing module finds that the first data segment being stored in data buffer storage has been write full, described receiving processing module is configured to notify described task scheduling modules.
In above-mentioned data handling system, after the notice receiving described receiving processing module, described task scheduling modules is configured to, based on the subscription task information from described target incoming end, described first data segment is scheduled to described transmission processing module.
In above-mentioned data handling system, described task scheduling modules is configured to each data segment that periodic polling is stored in described data buffer storage.
In above-mentioned data handling system, determine the first data segment exceed schedule time the most not full in the case of, described task scheduling modules is configured to be scheduled to this first data segment described transmission processing module.
In above-mentioned data handling system, described first data have check value at head, verify integrity and the correctness of described first data for described receiving processing module.
In above-mentioned data handling system, described second data also have check value at head, verify integrity and the correctness of described second data for described target incoming end.
According to further aspect of the application, it is provided that a kind of method carrying out data publication and extraction between source incoming end and target incoming end.The method includes: receive the first data (step with the first form from described source incoming end
A
)；Described first data are verified and decompressed reduction thus obtain source data (step
B
)；Described source data after verifying by and decompress reduction is stored in (step in data buffer storage according to its type scores according to section
C
)；Data in data section to be sent is scheduling (step
D
)；And described data to be sent are converted to second data with the second form, and it is sent to described target incoming end (step
E
).
In the above-mentioned methods, step
D
Comprise the steps that when determining that the first data segment being stored in data buffer storage has been write full, based on the subscription task information from described target incoming end, described first data segment is scheduling.
In the above-mentioned methods, step
D
May also include that each data segment that periodic polling is stored in described data buffer storage.Determine the first data segment exceed schedule time the most not full in the case of, this first data segment is scheduling.
In the above-mentioned methods, described first data have check value at head, verify integrity and the correctness of described first data for described receiving processing module.
In the above-mentioned methods, described second data also have check value at head, verify integrity and the correctness of described second data for described target incoming end.
Relative to prior art, the application achieves source incoming end and decouples with target incoming end so that do not directly rely on relation between two incoming ends.Meanwhile, source incoming end, target incoming end can be heterogeneous systems, and handled data can also be the data that non-relational database produces, and the type of data is the most various.By configuring data publication and the abstracting method of one-to-many, the pressure to source incoming end can be alleviated, save the transmission of substantial amounts of data.
Accompanying drawing explanation
After the detailed description of the invention having read the application referring to the drawings, those skilled in the art will become apparent the various aspects of the application.Skilled person would appreciate that: these accompanying drawings are used only for the technical scheme coordinating detailed description of the invention that the application is described, and are not intended to be construed as limiting the protection domain of the application.
Figure
1
It it is the schematic flow sheet of the data publication according to embodiments herein and the method for extraction；
Figure
2
It it is the structural representation of the data handling system according to embodiments herein；And
Figure
3
It it is the data buffer storage schematic diagram according to embodiments herein.
Detailed description of the invention
Be described below is that the multiple of the application may some in embodiments, it is desirable to provide the basic understanding to the application, it is no intended to confirms the crucial of the application or conclusive key element or limits scope of the claimed.Easy to understand, according to the technical scheme of the application, under the connotation not changing the application, one of ordinary skill in the art can propose other implementation that can mutually replace.Therefore, detailed description below and accompanying drawing are only the exemplary illustrations of the technical scheme to the application, and are not to be construed as the whole of the application or are considered as defining or limiting technical scheme.
An embodiment according to the application, such as figure
1
Shown in, it is shown that a kind of data publication and data pick-up method.Such as figure
1
Shown in, in step 1., source incoming end (abbreviation source) carries out data publication, sends message to data handling system according to the data form arranged with data handling system and published method.In step 2., the situation of process is fed back to source by data handling system, according to the situation of feedback, source then determines that follow-up data process.In step 3., the data that target incoming end is subscribed to, according to the data form arranged with target incoming end and extraction mode, are sent to target incoming end by data handling system.In step 4., the situation of process is fed back to data handling system by target incoming end (abbreviation destination end), according to the situation of feedback, data handling system determines that follow-up data process.
Figure
2
Further illustrate the structural representation of the data handling system of an embodiment according to the application.Such as figure
2
Shown in, data handling system includes communication interaction module, data cache module, receiving processing module, task scheduling modules and sends processing module.Hereinafter, will be introduced respectively with regard to modules.
1.
Communication interaction module
At figure
2
In, communication interaction module is the intermediary of data source and destination end.Data to be released can be sent to communication interaction module by source incoming end, and target incoming end also can carry out data pick-up from communication interaction module.In one embodiment, communication interaction module is externally responsible for connecting source and destination end, is internally responsible for calling subsequent module, and the situation of process is sent to source, destination end.
In one embodiment, all of data source (system), datum target end (system), when being connected with data handling system, need to use unified access standard.Such as, data handling system support uses
TCP/IP
, file,
IPC
Communicate etc. mode and source data end or target data end, but the content of communication must comply with unified standard and form.
In one embodiment, message
/
The content of file can comprise two ingredients, successively: head, data field.Its structure is as shown in the table:
Table
1
:
Message
/
The content structure figure of file
| Head | Data field |
Head is message
/
First data element of file, the essential record essential information such as data type, data length, data strip number, data source mark, datum target end mark, check code.One or more data record can be carried in data field.
Such as, source (is designated
PUB
) arrange its internal every with data handling system
100
(type definition is the data of individual byte
A001
), by the way of compression is packed, it is published to data handling system (is designated
GDDS
), then source can be passed through
TCP/IP
Mode transmits following message:
| Domain name | Content |
| Head-type of message | Data message |
| Head-message source mark | PUB |
| Head-message sink mark | GDDS |
| Head-compression mark | 1 |
| Head-data type | A001(the first form) |
| Head-action type | Mark insertion/renewal etc. processes the action of data |
| Head-check value | 16 hexadecimal numbers, such as MD5 |
| Head-retention | Preserve the self-defined information of source end system |
| Head-serial number | 10 bit digital |
| Head-data length | 6 bit digital |
| Data | Maximum 10, every 100 bytes are deposited rear successively and are compressed |
And destination end (is designated
SUB
) with data handling system agreement need extract source data type be
A1
In partial content
(
Assuming that a length of after Zhuan Huan
30
Byte
)
, then data handling system will be passed through to destination end
TCP/IP
Mode transmits following message:
| Domain name | Content |
| Head-type of message | Data message |
| Head-message source mark | GDDS |
| Head-message sink mark | SUB |
| Head-compression mark | 1 |
| Head-data type | B001(the second form) |
| Head-action type | Mark insertion/renewal etc. processes the action of data |
| Head-check value | 16 hexadecimal numbers, such as MD5 |
| Head-retention | Preserve the self-defined information (such as, data cached positional information) of data distribution reason system |
| Head-serial number | 10 bit digital |
| Head-data length | 6 bit digital |
| Data | Maximum 10, every 30 bytes are deposited rear successively and are compressed |
2
, data cache module
After source and data handling system appoint the essential informations such as data type, data handling system can be source data genaration volume of data caching.The main purpose of data buffer storage is the treatment effeciency in order to coordinate upstream and downstream system, improves the performance that data process.
In one embodiment, caching uses the processing mode that segmentation rolls.Such as figure
3
Shown in, the data that upstream source sends are to receive to leave in order in data buffer storage later, and the data that downstream targets end receives send from data buffer storage in order.When the data of upstream source and downstream targets end are received
/
Send out disposal ability similar time, data buffer storage is in a poised state and plays the effect of buffering.When the data-handling capacity of downstream destination end is unable to catch up with the data transmission capabilities of upstream source, data buffer storage may be blocked full over time, and at this moment data handling system can indicate upstream source end system to postpone sending (certain time of such as requesting timeout retransmits or reduces the instructions such as speed transmission).
Data customized in downstream targets end, derive from the data of the first form that source is arranged with data handling system sometimes at form, sequentially may be not necessarily the same, it is thus desirable to the data of storage in data buffer storage are carried out certain working cut, generate the data of the second form meeting downstream targets end requirement.Data handling system achieves conventional location-based data mart modeling tailoring rule, such as, replicate, increase newly, revise, deletion etc., just can be obtained the data content that downstream targets end is customized by configuration parameter.
Requirement according to rationality complete to data, it is distinguished into two kinds with nonuniformity requirement of coherence request: for there being the data of coherence request, only when destination end sequential processing these data complete and after returning successful respond, these data in data buffer storage section just can be released；The data required for nonuniformity, after data handling system calling communication interactive module successfully sends, these data in data buffer storage section just can be released, thus the segmentation realizing whole data buffer area rolls and recycles.
3
, receiving processing module
Receiving processing module is for receiving the message sent in communication interaction module.Owing to communication interaction module is merely responsible for the transmission of data, therefore receiving processing module needs the data sent on outside are carried out dissection process.In one embodiment, receiving processing module, for the data sent in source, needs to carry out the operation such as source data verification, source data decompression reduction, data buffer storage process.
Source data verification verifies for the data content (pending data) sent in source, it is ensured that above send integrity and the correctness of data.In a specific embodiment, generate one for each incoming end (including source and target)
KEY
Value, incoming end is according to this
KEY
Value, uses and the algorithm of data handling system agreement, such as, can use
MD5/DES
Scheduling algorithm, calculates the data field (after compressed) above delivered newspaper in literary composition, and the result of calculating is inserted in the verification codomain in header.Data handling system is refused (one response message of loopback, data field therein instruction Reason For Denial) for verifying failed source data.
Source data decompression reduction decompresses for the source data packet sent in source, and decompression uses the compression appointed with incoming end
/
Decompression algorithm, such as, can use
zlib/lzma
Scheduling algorithm.Compression energy significantly reduces the data transmission scale of construction, and the overall performance of data handling system is substantially improved.
Source data caching process by verification by and decompress the source data after reduction and leave in data buffer storage, data handling system according to the data type above sent in the write of data buffer storage presently written sequence of positions.When finding that place section has been write full, these data that follow-up task scheduling modules processes in this section can be called immediately；When finding there is no available segments, then can return, to source, the instruction postponing sending, after source receives this response, after break-off to appointment time, resend current data.
4
, task scheduling modules
Task scheduling modules is responsible for the data after processing receiving processing module write caching, its major function is the agreement according to destination end Yu data handling system, the subscription task information of destination end is route, pending data segment (not being each data) is scheduled to follow-up transmission processing module and carries out the distribution of data.
In one embodiment, data buffer storage section can be scheduled away in both cases, one is that receiving processing module finds that this section has been write to have expired and is notified that task scheduling modules is scheduling, another kind is that task scheduling modules poll finds to there are data in this section but exceeded stipulated time the most not full situation, and so design is to make the data distribution that is scheduled in time go out.
It is distributed to multiple destination end owing to the data of one source of existence may be extracted, in order to task concurrent is better achieved, devises this task scheduling modules, for processing this one-to-many, the data task route of multi-to-multi and conversion.According to subscription task information table, task scheduling modules determines which intended recipient end pending data segment to be sent to, carry out the transmission of destination end data by calling transmission processing module.
| Sequence number | Source data type | Target data type | Data subscription rule |
| 1 | A001 | B001 | Rule 1 |
| 2 | A001 | B002 | Rule 2 |
| 3 | A002 | B003 | Rule 3 |
In addition, in one embodiment, task scheduling modules also can monitor the disposition specifying data segment to be sent to all associated objects ends having integrity demands to these data, when the data on finding certain section the most do not feed back response, the processing module that sends re invocation continues the data distribution of this section of caching, prevents from sending the abnormal situation about exiting for the treatment of progress.
5
, send processing module
In one embodiment, sending processing module and can have two functions, one is responsible for processing the process request of task scheduling modules instruction, carries out conversion process according to rule by specifying the data in data buffer storage section and is sent to destination end；Two be responsible for process destination end return responses, if for last time send data receive unsuccessfully reply or time-out nonreply time will again send.
In one embodiment, transmission processing module, for the feedback response sent in destination end, needs to carry out the operations such as target data verification, caching process.
Target data verification verifies for the feedback response content sent in destination end, it is ensured that response is consistent with request, it is ensured that the integrity of data and correctness, and method of calibration is consistent with source data verification, and discard processing is done in the response that verification is not passed through.
In one embodiment, target data caching process processes for the feedback response content sent in destination end, if the feedback response sent in destination end is to be successfully processed, then represent that data handling system can continue with remaining pending data in this section, until all data are all processed and complete this destination end just can be set to " completing " state in this section.When all destination end states that have subscribed these data all become " completing " state, it is possible to discharge this section from data buffer storage.If the feedback response sent in destination end is exception response, then according to and the abnormality eliminating method of destination end agreement carry out subsequent treatment (like skipping, resend several times or isolate and specify the strategy such as destination end).
In one embodiment, send processing module and only process data cached section specified, for the data in section, send processing module according to transformational rule, be converted to the target data type specified one by one, Deng ED pending in this section or reach with destination end agreement the maximum data bar number of each packet time, calling communication interactive module is sent.Deformation transformational rule therein, current data handling system support simple location-based copy, replace, increase newly, the function such as information filtering, and can support to extend deformation transformational rule neatly by development behavior storehouse.
| Number of regulation | Rule step | Behavior | Particular content |
| Rule 1 | 1 | Filter | 141 143 equal to ' S20' |
| Rule 2 | 1 | Copy | 1–20 |
| Rule 2 | 2 | Copy | 40–50 |
| Rule 2 | 3 | Replace | 60 65 are changed to * * * |
| Rule 3 | 1 | Copy | 1–20 |
| Rule 3 | 2 | Replace | 40 50 are changed to ABCD |
To sum up, it is provided that a kind of data handling system.This data handling system comprises the steps that communication interaction module, is configured to couple with source incoming end and target incoming end, and receives first data with the first form from described source incoming end；Receiving processing module, it is configured to receive described first data with described first form from described communication interaction module, described first data are verified and are decompressed reduction thus obtain source data, and will verification by and described source data after decompressing reduction be stored in data buffer storage according to section according to its type scores；Sending processing module, data to be sent are converted to second data with the second form, and are sent to described target incoming end via described communication interaction module by described transmission processing module；And task scheduling modules, described task scheduling modules is arranged between described receiving processing module and described transmission processing module, and it is configured to data in data section to be sent to be scheduled to described transmission processing module.
According to the another aspect of the application, additionally provide a kind of method (specifically, in a data processing system) carrying out data publication and extraction between source incoming end and target incoming end.The method comprises the steps that and receives first data with the first form from described source incoming end；Described first data are verified and decompressed reduction thus obtain source data；Described source data after verifying by and decompress reduction is stored in data buffer storage according to section according to its type scores；Data in data section to be sent is scheduling；Described data to be sent are converted to second data with the second form, and are sent to described target incoming end.
Above, the detailed description of the invention of the application is described with reference to the accompanying drawings.But, those skilled in the art are it is understood that in the case of without departing from spirit and scope, it is also possible to the detailed description of the invention of the application is made various change and replacement.These changes and replacement all fall in the application claims limited range.
Claims (11)
1. a data handling system, including:
Communication interaction module, described communication interaction module is configured to couple with source incoming end and target incoming end, and receives first data with the first form from described source incoming end；
Receiving processing module, described receiving processing module is configured to receive described first data with described first form from described communication interaction module, described first data are verified and are decompressed reduction thus obtain source data, and will verification by and described source data after decompressing reduction be stored in data buffer storage according to section according to its type scores；
Sending processing module, data to be sent are converted to second data with the second form, and are sent to described target incoming end via described communication interaction module by described transmission processing module；And
Task scheduling modules, described task scheduling modules is arranged between described receiving processing module and described transmission processing module, and it is configured to data in data section to be sent to be scheduled to described transmission processing module.
2. data handling system as claimed in claim 1, wherein, when described receiving processing module finds that the first data segment being stored in data buffer storage has been write full, described receiving processing module is configured to notify described task scheduling modules.
3. data handling system as claimed in claim 2, wherein, after the notice receiving described receiving processing module, described task scheduling modules is configured to, based on the subscription task information from described target incoming end, described first data segment is scheduled to described transmission processing module.
4. data handling system as claimed in claim 1, wherein, described task scheduling modules is configured to each data segment that periodic polling is stored in described data buffer storage.
5. data handling system as claimed in claim 4, wherein, determine the first data segment exceed schedule time the most not full in the case of, described task scheduling modules is configured to be scheduled to this first data segment described transmission processing module.
6. data handling system as claimed in claim 1, wherein, described first data have check value at head, verify integrity and the correctness of described first data for described receiving processing module.
7. the method carrying out data publication and extraction between source incoming end and target incoming end, described method includes:
Step A: receive first data with the first form from described source incoming end；
Step B: described first data are verified and decompressed reduction thus obtain source data,
Step C: the described source data after verifying by and decompress reduction is stored in data buffer storage according to section according to its type scores；
Step D: data in data section to be sent is scheduling；And
Step E: described data to be sent are converted to second data with the second form, and are sent to described target incoming end.
8. method as claimed in claim 7, wherein, step D includes: when determining that the first data segment being stored in data buffer storage has been write full, is scheduling described first data segment based on the subscription task information from described target incoming end.
9. method as claimed in claim 7, wherein, step D includes: periodic polling is stored in each data segment in described data buffer storage.
10. method as claimed in claim 9, wherein, step D also includes: determine the first data segment exceed schedule time the most not full in the case of, this first data segment is scheduling.
11. methods as claimed in claim 7, wherein, described first data have check value at head, verify integrity and the correctness of described first data for described receiving processing module.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610252966.3A CN105843966A (en) | 2016-04-22 | 2016-04-22 | Data processing system and method |
| PCT/CN2017/080093 WO2017181872A1 (en) | 2016-04-22 | 2017-04-11 | Data processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610252966.3A CN105843966A (en) | 2016-04-22 | 2016-04-22 | Data processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105843966A true CN105843966A (en) | 2016-08-10 |
Family
ID=56588673
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610252966.3A Pending CN105843966A (en) | 2016-04-22 | 2016-04-22 | Data processing system and method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105843966A (en) |
| WO (1) | WO2017181872A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106775977A (en) * | 2016-12-09 | 2017-05-31 | 北京小米移动软件有限公司 | Method for scheduling task, apparatus and system |
| WO2017181872A1 (en) * | 2016-04-22 | 2017-10-26 | 中国银联股份有限公司 | Data processing system and method |
| CN107368370A (en) * | 2017-07-04 | 2017-11-21 | 合肥市乐腾科技咨询有限公司 | A kind of high efficiency data handling system |
| CN108243146A (en) * | 2016-12-23 | 2018-07-03 | 航天星图科技（北京）有限公司 | A kind of efficient information submits method |
| CN109558448A (en) * | 2018-10-10 | 2019-04-02 | 北京海数宝科技有限公司 | Data processing method, device, computer equipment and storage medium |
| CN110572373A (en) * | 2019-08-20 | 2019-12-13 | 北京安盟信息技术股份有限公司 | Data exchange platform and file data stream processing method |
| CN111629026A (en) * | 2020-04-07 | 2020-09-04 | 青岛奥利普自动化控制系统有限公司 | MES-based data interaction method and equipment |
| CN112148782A (en) * | 2020-09-24 | 2020-12-29 | 建信金融科技有限责任公司 | Market data access method and device |
| CN112925557A (en) * | 2021-01-28 | 2021-06-08 | 长沙市到家悠享网络科技有限公司 | Container assembly, processing method and computing equipment |
| CN114928576A (en) * | 2022-05-19 | 2022-08-19 | 广东电网有限责任公司 | Data exchange apparatus, data exchange method, and computer-readable storage medium |
| CN115150466A (en) * | 2022-06-29 | 2022-10-04 | 北京百度网讯科技有限公司 | Method and device for realizing data distribution, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102917020A (en) * | 2011-09-24 | 2013-02-06 | 国网电力科学研究院 | Mobile terminal based on data packet and method for synchronizing business system data |
| CN104809200A (en) * | 2015-04-24 | 2015-07-29 | 联动优势科技有限公司 | Database synchronization method and device |
| CN104809201A (en) * | 2015-04-24 | 2015-07-29 | 联动优势科技有限公司 | Database synchronization method and device |
| CN104809202A (en) * | 2015-04-24 | 2015-07-29 | 联动优势科技有限公司 | Database synchronization method and device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7376675B2 (en) * | 2005-02-18 | 2008-05-20 | International Business Machines Corporation | Simulating multi-user activity while maintaining original linear request order for asynchronous transactional events |
| CN102541942B (en) * | 2010-12-31 | 2014-09-17 | 中国银联股份有限公司 | Data bulk transfer system and method thereof |
| CN103944875A (en) * | 2014-02-21 | 2014-07-23 | 中国人民解放军装甲兵工程学院 | Data exchanging method and data exchanging system |
| CN104933173B (en) * | 2015-06-30 | 2019-01-15 | 北京京东尚科信息技术有限公司 | It is a kind of for the data processing method of isomery multi-data source, device and server |
| CN105843966A (en) * | 2016-04-22 | 2016-08-10 | 中国银联股份有限公司 | Data processing system and method |
-
2016
- 2016-04-22 CN CN201610252966.3A patent/CN105843966A/en active Pending
-
2017
- 2017-04-11 WO PCT/CN2017/080093 patent/WO2017181872A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102917020A (en) * | 2011-09-24 | 2013-02-06 | 国网电力科学研究院 | Mobile terminal based on data packet and method for synchronizing business system data |
| CN104809200A (en) * | 2015-04-24 | 2015-07-29 | 联动优势科技有限公司 | Database synchronization method and device |
| CN104809201A (en) * | 2015-04-24 | 2015-07-29 | 联动优势科技有限公司 | Database synchronization method and device |
| CN104809202A (en) * | 2015-04-24 | 2015-07-29 | 联动优势科技有限公司 | Database synchronization method and device |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017181872A1 (en) * | 2016-04-22 | 2017-10-26 | 中国银联股份有限公司 | Data processing system and method |
| CN106775977A (en) * | 2016-12-09 | 2017-05-31 | 北京小米移动软件有限公司 | Method for scheduling task, apparatus and system |
| CN106775977B (en) * | 2016-12-09 | 2020-06-02 | 北京小米移动软件有限公司 | Task scheduling method, device and system |
| CN108243146A (en) * | 2016-12-23 | 2018-07-03 | 航天星图科技（北京）有限公司 | A kind of efficient information submits method |
| CN108243146B (en) * | 2016-12-23 | 2020-01-24 | 中科星图股份有限公司 | Information submitting method |
| CN107368370A (en) * | 2017-07-04 | 2017-11-21 | 合肥市乐腾科技咨询有限公司 | A kind of high efficiency data handling system |
| CN109558448A (en) * | 2018-10-10 | 2019-04-02 | 北京海数宝科技有限公司 | Data processing method, device, computer equipment and storage medium |
| CN110572373A (en) * | 2019-08-20 | 2019-12-13 | 北京安盟信息技术股份有限公司 | Data exchange platform and file data stream processing method |
| CN111629026A (en) * | 2020-04-07 | 2020-09-04 | 青岛奥利普自动化控制系统有限公司 | MES-based data interaction method and equipment |
| CN112148782A (en) * | 2020-09-24 | 2020-12-29 | 建信金融科技有限责任公司 | Market data access method and device |
| CN112148782B (en) * | 2020-09-24 | 2023-01-20 | 建信金融科技有限责任公司 | Market data access method and device |
| CN112925557A (en) * | 2021-01-28 | 2021-06-08 | 长沙市到家悠享网络科技有限公司 | Container assembly, processing method and computing equipment |
| CN112925557B (en) * | 2021-01-28 | 2023-09-05 | 长沙市到家悠享网络科技有限公司 | Data processing device, method and computing equipment |
| CN114928576A (en) * | 2022-05-19 | 2022-08-19 | 广东电网有限责任公司 | Data exchange apparatus, data exchange method, and computer-readable storage medium |
| CN115150466A (en) * | 2022-06-29 | 2022-10-04 | 北京百度网讯科技有限公司 | Method and device for realizing data distribution, electronic equipment and storage medium |
| CN115150466B (en) * | 2022-06-29 | 2023-08-15 | 北京百度网讯科技有限公司 | Method and device for realizing data distribution, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017181872A1 (en) | 2017-10-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105843966A (en) | Data processing system and method | |
| US10320899B2 (en) | Peer-to-peer communication of non-common data | |
| CN101313495B (en) | Method, system and apparatus for data synchronization | |
| CN102355426B (en) | Method for transmitting off-line file and system | |
| KR101864813B1 (en) | Method and device for processing operation request in storage system | |
| CN106055698A (en) | Data migration method, agent node and database instance | |
| CN101075879B (en) | Method for downloading data | |
| CN104615391A (en) | File previewing method, device and system | |
| JP6193492B2 (en) | Financial product transaction system and financial product transaction control method | |
| CN104239310A (en) | Distributed database data synchronizing method and device | |
| CN101103331A (en) | Implementing application specific management policies on a content addressed storage device | |
| CN105959346A (en) | Data processing system and data processing method based on server cluster | |
| CN107577700B (en) | Database disaster tolerance processing method and device | |
| CN101521606A (en) | Log information processing method, log server and communication system | |
| CN103248636B (en) | The system and method downloaded offline | |
| CN101257461A (en) | Method and apparatus for filtering content based on classification | |
| CN101605301A (en) | A kind of group system and request message distribution method that carries out the multinode transaction | |
| CN115086380B (en) | Data transmission system and method based on energy management platform | |
| JP2007164535A (en) | Business integration method, business integration apparatus, business integration system, and business integration program | |
| JP6364727B2 (en) | Information processing system, distributed processing method, and program | |
| CN110417892A (en) | Data Replication Link optimization method and device based on packet parsing | |
| JP2007299019A (en) | Data communication system, server device, data communication method used therefor, and program thereof | |
| CN107563942B (en) | Logistics data batch processing method, logistics processing system and processing device | |
| US20150100545A1 (en) | Distributed database system and a non-transitory computer readable medium | |
| CN109688204B (en) | File downloading method, node and terminal based on NDN (named data networking) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160810 |