CN108241637A - A kind of multi-user's internodal data Transmission system - Google Patents
A kind of multi-user's internodal data Transmission system Download PDFInfo
- Publication number
- CN108241637A CN108241637A CN201611207009.5A CN201611207009A CN108241637A CN 108241637 A CN108241637 A CN 108241637A CN 201611207009 A CN201611207009 A CN 201611207009A CN 108241637 A CN108241637 A CN 108241637A
- Authority
- CN
- China
- Prior art keywords
- module
- user
- unstructured data
- data
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to a kind of multi-user's internodal data Transmission systems, the system carries out consistency judgement according to timestamp to the unstructured data of intermediate node, and it is transmitted again after being handled according to User Defined preset rules inconsistent unstructured data, the real-time and transmission speed of data have been taken into account, has been more in line with user's particular demands.
Description
【Technical field】
The invention belongs to field of data transmission more particularly to multi-user's internodal data Transmission systems.
【Background technology】
Under normal circumstances, forwarding of the unstructured data between node does not consider the update of data, unstructured data from
After source node is sent to intermediate node, the unstructured data at source node is updated again, and the number of intermediate nodes cache
According to not timely updating, the data for being transmitted to third node are not usually newest, it is impossible to ensure the real-time of forwarding data
Property and consistency.In addition, data transmission rule is typically that default is good, it is impossible to carry out personalization according to the demand of user and set
It puts, and different users has different demands with real-time property several times for data transmission.
Based on the above problem, now there is an urgent need for a kind of new multi-user multi-user's internodal data Transmission system, according to the time
It stabs and consistency judgement is carried out to the unstructured data of intermediate node, and according to User Defined preset rules to inconsistent non-
Structural data transmits again after being handled, and has taken into account the real-time and transmission speed of data, has been more in line with user's particular demands.
【Invention content】
In order to solve the above problem of the prior art, the present invention proposes a kind of multi-user's internodal data transmission system
System.
The technical solution adopted by the present invention is as follows：
A kind of multi-user's internodal data Transmission system, which is characterized in that the system includes multiple user nodes, often
A user node is provided with front-end module, protocol module, message module, data transmission module, memory module, cache module,
Middle front-end module, unstructured data acquires, interacts and presents on user node；Protocol module, it is described for encapsulating
User node and message module, the communication protocol of transmission module；Message module, for multi-thread concurrent processing message reception,
Processing；Data transmission module, for the transmission of unstructured data file content；Memory module, for front-end module to be acquired
The storage of unstructured data content in the local database, the unstructured data content packet is deposited for data group
Storage, each unstructured data group correspond to a timestamp；Update module, when the unstructured data acquired by front-end module
When data update occurs, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to keep data
Unanimously, and renewal time stabs；Cache module, for that will be stored in the buffer by the unstructured data that transmission module receives；
Judgment module, for carrying out the whether consistent judgement of timestamp.
Beneficial effects of the present invention include：Consistency is carried out according to timestamp to the unstructured data of intermediate node to sentence
It is disconnected, and transmitted again after being handled according to User Defined preset rules inconsistent unstructured data, take into account data
Real-time and transmission speed, be more in line with user's particular demands.
【Description of the drawings】
Attached drawing described herein is to be used to provide further understanding of the present invention, and forms the part of the application, but
It does not constitute improper limitations of the present invention, in the accompanying drawings：
Fig. 1 is the flow of the transmission method applied in unstructured data Transmission system between multi-user's node of the present invention
Figure.
【Specific embodiment】
Come that the present invention will be described in detail below in conjunction with attached drawing and specific embodiment, illustrative examples therein and say
It is bright to be only used for explaining the present invention, but not as a limitation of the invention.
Embodiment 1, a kind of multi-user's internodal data Transmission system, the system include multiple user nodes, each
User node is provided with front-end module, protocol module, message module, data transmission module, memory module, cache module, wherein
Front-end module, unstructured data acquires, interacts and presents on user node；Protocol module, for encapsulating the use
Family node and message module, the communication protocol of transmission module；Message module, reception, place for multi-thread concurrent processing message
Reason；Data transmission module, for the transmission of unstructured data file content；Memory module, for acquire front-end module
Unstructured data content stores in the local database, and the unstructured data content packet is stored for data group,
Each unstructured data group corresponds to a timestamp；Update module, when the unstructured data hair acquired by front-end module
During raw data update, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to keep data one
It causes, and renewal time stabs；Cache module, for that will be stored in the buffer by the unstructured data that transmission module receives；Sentence
Disconnected module, for carrying out the whether consistent judgement of timestamp.
Embodiment 2, referring to attached drawing 1, the transmission between a kind of multi-user's node applied in unstructured data Transmission system
Method,
In one embodiment, multi-user's node is in distributed system, described in other embodiments
Multiple user nodes are also in cloud system.Front-end module, protocol module, message mould are provided on each user node
Block, data transmission module, memory module, cache module.
Wherein front-end module, unstructured data acquires, interacts and presents on user node；Protocol module is used
In the encapsulation user node and message module, the communication protocol of transmission module；Message module disappears for multi-thread concurrent processing
Reception, the processing of breath；Data transmission module, for the transmission of unstructured data file content；Memory module, for by front end
In the local database, the unstructured data content packet is data group for the unstructured data content storage of module acquisition
It is stored, each unstructured data group corresponds to a timestamp；Update module, it is non-structural when being acquired by front-end module
When changing data generation data update, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to protect
It is consistent to hold data, and renewal time stabs；Cache module, it is slow for will be stored in by the unstructured data that transmission module receives
In depositing；Judgment module, for carrying out the whether consistent judgement of timestamp；This method comprises the following steps：
The specified unstructured data that (1) first user node is sent by message module reception from second user node
The data request information of group；
(2) first user nodes obtain the specified unstructured data asked in data request information from local data base
Group is simultaneously once replicated, and the unstructured data group carries corresponding timestamp；
The specified unstructured data group of above-mentioned duplication is transferred to the second use by (3) first user nodes by transmission module
Family node；
(4) non-knot is specified in the above-mentioned duplication that second user node receives and caching first node equipment is sent in the buffer
Structure data group；
(5) second user node receives the specified non-of the above-mentioned duplication sent from third user node by message module
The data request information of structural data group；
(6) second user node is by judgment module, to the specified non-structural of the above-mentioned duplication of second user nodal cache
Change entrained by the above-mentioned specified unstructured data group that timestamp and the first user node entrained by data group are locally stored
Timestamp is compared, and judges whether two timestamps are consistent；
After (6-1) is if specify unstructured data group to copy to second user node, to upper in the first user node
It states specified unstructured data group and does not carry out data update, timestamp is not also updated, then specifies unstructured data
Group corresponding timestamp and the unstructured data group of duplication corresponding timestamp in second node in the first user node
Unanimously, then the specified unstructured data group of above-mentioned duplication is directly carried out secondary duplication by second user node by transmission module
And the unstructured data group of secondary duplication is transferred to third user node；
After (6-2) is if specify unstructured data group to copy to second user node, to upper in the first user node
It states specified unstructured data group and data update has been carried out by update module again, timestamp is also updated, then specifies non-knot
Structure data group corresponding timestamp and unstructured data group replicated in the first user node is corresponding in second node
Timestamp it is inconsistent, then second user node according to User Defined preset rules to above-mentioned duplication specify unstructured number
It is saved according to the specified unstructured data group of treated duplication is transferred to third user by transmission module after group processing
Point；
In one embodiment, the User Defined preset rules include：(a) second user nodal cache is above-mentioned
The data of above-mentioned specified unstructured data group that the specified unstructured data group replicated is locally stored with the first user node
Difference is if it exceeds predetermined threshold value, then the specified unstructured data group of the above-mentioned duplication of second user nodal cache is according to first
The above-mentioned specified unstructured data group that user node is locally stored carries out full dose update；(b) second user nodal cache is upper
State the specified unstructured data group of duplication and the number of above-mentioned specified unstructured data group that the first user node is locally stored
According to difference if it exceeds predetermined threshold value, then the specified unstructured data group of the above-mentioned duplication of second user nodal cache is according to
The above-mentioned specified unstructured data group that one user node is locally stored carries out incremental update；(3) second user nodal cache
The above-mentioned specified unstructured data group that the specified unstructured data group of above-mentioned duplication is locally stored with the first user node
If data difference is not above predetermined threshold value, the specified unstructured data group of the above-mentioned duplication of second user nodal cache
It does not update.
By the setting of data difference amount threshold value in above-mentioned User Defined preset rules, data transmission bauds has been taken into account
And real-time property, when data difference is not above predetermined threshold value, certain real-time property is sacrificed to improve data
Transmission speed, and when data difference is more than predetermined threshold value, still ensure that real-time property, therefore improving data transmission number
The real-time of data is maintained while spending to a high degree.
Other than above-mentioned User Defined preset rules, can also other users be set according to the actual demand of user
Self-defined preset rules.Since different users has different demands, some use with real-time property several times for data transmission
Family wishes that transmission speed is fast, of less demanding to real-time property, and the accuracy of some user's trend datas, can be according to user
Demand carry out personal settings.
(7) the unstructured data group that third user node receives and caching second node equipment is sent in the buffer.
The present invention carries out consistency judgement, and make by oneself according to user according to timestamp to the unstructured data of intermediate node
Adopted preset rules are transmitted again after handling inconsistent unstructured data, have taken into account the real-time of data and transmission speed
Degree, is more in line with user's particular demands.
The above is only the better embodiment of the present invention, therefore all constructions according to described in present patent application range,
The equivalent change or modification that feature and principle are done, is included in the range of present patent application.
Claims (3)
1. a kind of multi-user's internodal data Transmission system, which is characterized in that the system includes multiple user nodes, each
User node is provided with front-end module, protocol module, message module, data transmission module, memory module, cache module, wherein
Front-end module, unstructured data acquires, interacts and presents on user node；Protocol module, for encapsulating the use
Family node and message module, the communication protocol of transmission module；Message module, reception, place for multi-thread concurrent processing message
Reason；Data transmission module, for the transmission of unstructured data file content；Memory module, for acquire front-end module
Unstructured data content stores in the local database, and the unstructured data content packet is stored for data group,
Each unstructured data group corresponds to a timestamp；Update module, when the unstructured data hair acquired by front-end module
During raw data update, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to keep data one
It causes, and renewal time stabs；Cache module, for that will be stored in the buffer by the unstructured data that transmission module receives；Sentence
Disconnected module, for carrying out the whether consistent judgement of timestamp.
2. unstructured data Transmission system between multi-user's node according to claim 1, which is characterized in that described multi-purpose
Family node is in distributed system.
3. unstructured data Transmission system between multi-user's node according to claim 1, which is characterized in that described multi-purpose
Family node is in cloud system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611207009.5A CN108241637A (en) | 2016-12-23 | 2016-12-23 | A kind of multi-user's internodal data Transmission system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611207009.5A CN108241637A (en) | 2016-12-23 | 2016-12-23 | A kind of multi-user's internodal data Transmission system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108241637A true CN108241637A (en) | 2018-07-03 |
Family
ID=62704023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611207009.5A Pending CN108241637A (en) | 2016-12-23 | 2016-12-23 | A kind of multi-user's internodal data Transmission system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108241637A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127783A (en) * | 2007-09-28 | 2008-02-20 | 北京金山软件有限公司 | A website buffering method and device |
| CN102054035A (en) * | 2010-12-29 | 2011-05-11 | 北京播思软件技术有限公司 | Data range-based method for synchronizing data in database |
| CN102227142A (en) * | 2011-06-10 | 2011-10-26 | 复旦大学 | Synchronization playing method based on video data block distribution |
| CN103379159A (en) * | 2012-04-24 | 2013-10-30 | 阿里巴巴集团控股有限公司 | Distributed web site data synchronization method |
| CN106059825A (en) * | 2016-07-08 | 2016-10-26 | 福建天晴数码有限公司 | Distributed system and configuration method |
-
2016
- 2016-12-23 CN CN201611207009.5A patent/CN108241637A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127783A (en) * | 2007-09-28 | 2008-02-20 | 北京金山软件有限公司 | A website buffering method and device |
| CN102054035A (en) * | 2010-12-29 | 2011-05-11 | 北京播思软件技术有限公司 | Data range-based method for synchronizing data in database |
| CN102227142A (en) * | 2011-06-10 | 2011-10-26 | 复旦大学 | Synchronization playing method based on video data block distribution |
| CN103379159A (en) * | 2012-04-24 | 2013-10-30 | 阿里巴巴集团控股有限公司 | Distributed web site data synchronization method |
| CN106059825A (en) * | 2016-07-08 | 2016-10-26 | 福建天晴数码有限公司 | Distributed system and configuration method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017097011A1 (en) | Session synchronization method based on instant copy between cluster nodes | |
| CN106790112B (en) | Node operating system integrating lightweight block chains and data updating method | |
| CN106533970B (en) | Difference towards cloud computing data center network spreads transmission control method and device | |
| CN101170517B (en) | Method for aging of control session table | |
| CN104519130B (en) | A kind of data sharing caching method across IDC | |
| CN103888934B (en) | A kind of mobile terminal cache management device and management method | |
| CN103780682B (en) | A kind of information sharing system towards Ad Hoc network | |
| CN107222412B (en) | SDN mixed mode flow table issuing method and device based on network topology judgment | |
| CN102456052A (en) | Method for data synchronization between embedded device and database | |
| CN101651709A (en) | Method for calibrating integrity of P2P download files | |
| CN106571991A (en) | Method and data for transmitting data | |
| CN103152191A (en) | Processing method and system of service gateway data of internet of things | |
| CN108241637A (en) | A kind of multi-user's internodal data Transmission system | |
| CN106603687B (en) | Unstructured data transmission method between a kind of multi-user's node | |
| CN109607341A (en) | Elevator operation information management system based on block chain | |
| CN108241636A (en) | Unstructured data clone method between a kind of multi-user's node | |
| CN108241635A (en) | Unstructured data retransmission method between a kind of multi-user's node | |
| CN106855869A (en) | A kind of methods, devices and systems for realizing database High Availabitity | |
| CN109194759B (en) | Network access method and system for degrading at front end | |
| CN105323112B (en) | A kind of fast method of the consistency treatment of Packet Transport Network pipe | |
| CN107846328B (en) | Network rate real-time statistical method based on concurrent lock-free ring queue | |
| CN106254540B (en) | A kind of node serve monitoring system and implementation method suitable for distributed system | |
| CN109889562A (en) | A kind of offline access method and system of the advanced application platform of Enterprise Mobile | |
| CN107656992A (en) | Towards the snapshot method for edition management in more insertion sources | |
| CN110109871A (en) | A kind of cross-site high-energy physics data access method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information |
Address after: 101399 No. 2 East Airport Road, Shunyi Airport Economic Core Area, Beijing (1st, 5th and 7th floors of Industrial Park 1A-4) Applicant after: Zhongke Star Map Co.,Ltd. Address before: 101399 Building 1A-4, National Geographic Information Technology Industrial Park, Guomen Business District, Shunyi District, Beijing Applicant before: GEOVIS TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180703 |
|
| RJ01 | Rejection of invention patent application after publication |