CN108241636A - Unstructured data clone method between a kind of multi-user's node - Google Patents
Unstructured data clone method between a kind of multi-user's node Download PDFInfo
- Publication number
- CN108241636A CN108241636A CN201611207008.0A CN201611207008A CN108241636A CN 108241636 A CN108241636 A CN 108241636A CN 201611207008 A CN201611207008 A CN 201611207008A CN 108241636 A CN108241636 A CN 108241636A
- Authority
- CN
- China
- Prior art keywords
- user
- node
- unstructured data
- data group
- specified
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to unstructured data clone method between a kind of multi-user's node, this method carries out consistency judgement according to timestamp to the unstructured data of intermediate node, has taken into account the real-time and transmission speed of data, has been more in line with user's particular demands.
Description
【Technical field】
The invention belongs to unstructured data clone methods between field of data transmission more particularly to multi-user's node.
【Background technology】
Under normal circumstances, forwarding of the unstructured data between node does not consider the update of data, unstructured data from
After source node is sent to intermediate node, the unstructured data at source node is updated again, and the number of intermediate nodes cache
According to not timely updating, the data for being transmitted to third node are not usually newest, it is impossible to ensure the real-time of forwarding data
Property and consistency.In addition, data transmission rule is typically that default is good, it is impossible to carry out personalization according to the demand of user and set
It puts, and different users has different demands with real-time property several times for data transmission.
Based on the above problem, now there is an urgent need for unstructured data clone method between a kind of new multi-user's node, according to when
Between stamp consistency judgement is carried out to the unstructured data of intermediate node, taken into account the real-time and transmission speed of data, more
Meet user's particular demands.
【Invention content】
In order to solve the above problem of the prior art, the present invention proposes unstructured data between a kind of multi-user's node
Clone method.
The technical solution adopted by the present invention is as follows：
Unstructured data clone method between a kind of multi-user's node, which is characterized in that this method comprises the following steps：
The specified unstructured data that (1) first user node is sent by message module reception from second user node
The data request information of group；
(2) first user nodes obtain the specified unstructured data asked in data request information from local data base
Group is simultaneously once replicated, and the unstructured data group carries corresponding timestamp；
The specified unstructured data group of above-mentioned duplication is transferred to the second use by (3) first user nodes by transmission module
Family node；
(4) non-knot is specified in the above-mentioned duplication that second user node receives and caching first node equipment is sent in the buffer
Structure data group；
(5) second user node is by judgment module, to the specified non-structural of the above-mentioned duplication of second user nodal cache
Change entrained by the above-mentioned specified unstructured data group that timestamp and the first user node entrained by data group are locally stored
Timestamp is compared, and judges whether two timestamps are consistent；
(6) if two timestamps are inconsistent, second user node is to the specified unstructured data group of above-mentioned duplication
Carry out full dose update processing.
Beneficial effects of the present invention include：Consistency is carried out according to timestamp to the unstructured data of intermediate node to sentence
It is disconnected, and transmitted again after being handled according to User Defined preset rules inconsistent unstructured data, take into account data
Real-time and transmission speed, be more in line with user's particular demands.
【Description of the drawings】
Attached drawing described herein is to be used to provide further understanding of the present invention, and forms the part of the application, but
It does not constitute improper limitations of the present invention, in the accompanying drawings：
Fig. 1 is the flow chart of unstructured data clone method between multi-user's node of the present invention.
【Specific embodiment】
Come that the present invention will be described in detail below in conjunction with attached drawing and specific embodiment, illustrative examples therein and say
It is bright to be only used for explaining the present invention, but not as a limitation of the invention.
Referring to attached drawing 1, unstructured data clone method between a kind of multi-user's node,
In one embodiment, multi-user's node is in distributed system, described in other embodiments
Multiple user nodes are also in cloud system.Front-end module, protocol module, message mould are provided on each user node
Block, data transmission module, memory module, cache module.
Wherein front-end module, unstructured data acquires, interacts and presents on user node；Protocol module is used
In the encapsulation user node and message module, the communication protocol of transmission module；Message module disappears for multi-thread concurrent processing
Reception, the processing of breath；Data transmission module, for the transmission of unstructured data file content；Memory module, for by front end
In the local database, the unstructured data content packet is data group for the unstructured data content storage of module acquisition
It is stored, each unstructured data group corresponds to a timestamp；Update module, it is non-structural when being acquired by front-end module
When changing data generation data update, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to protect
It is consistent to hold data, and renewal time stabs；Cache module, it is slow for will be stored in by the unstructured data that transmission module receives
In depositing；Judgment module, for carrying out the whether consistent judgement of timestamp；This method comprises the following steps：
The specified unstructured data that (1) first user node is sent by message module reception from second user node
The data request information of group；
(2) first user nodes obtain the specified unstructured data asked in data request information from local data base
Group is simultaneously once replicated, and the unstructured data group carries corresponding timestamp；
The specified unstructured data group of above-mentioned duplication is transferred to the second use by (3) first user nodes by transmission module
Family node；
(4) non-knot is specified in the above-mentioned duplication that second user node receives and caching first node equipment is sent in the buffer
Structure data group；
(5) second user node is by judgment module, to the specified non-structural of the above-mentioned duplication of second user nodal cache
Change entrained by the above-mentioned specified unstructured data group that timestamp and the first user node entrained by data group are locally stored
Timestamp is compared, and judges whether two timestamps are consistent；
(6) if two timestamps are inconsistent, second user node is to the specified unstructured data group of above-mentioned duplication
Carry out full dose update processing.
Embodiment 2, this method comprises the following steps：
The specified unstructured data that (1) first user node is sent by message module reception from second user node
The data request information of group；
(2) first user nodes obtain the specified unstructured data asked in data request information from local data base
Group is simultaneously once replicated, and the unstructured data group carries corresponding timestamp；
The specified unstructured data group of above-mentioned duplication is transferred to the second use by (3) first user nodes by transmission module
Family node；
(4) non-knot is specified in the above-mentioned duplication that second user node receives and caching first node equipment is sent in the buffer
Structure data group；
(5) second user node receives the specified non-of the above-mentioned duplication sent from third user node by message module
The data request information of structural data group；
(6) second user node is by judgment module, to the specified non-structural of the above-mentioned duplication of second user nodal cache
Change entrained by the above-mentioned specified unstructured data group that timestamp and the first user node entrained by data group are locally stored
Timestamp is compared, and judges whether two timestamps are consistent；
After (6-1) is if specify unstructured data group to copy to second user node, to upper in the first user node
It states specified unstructured data group and does not carry out data update, timestamp is not also updated, then specifies unstructured data
Group corresponding timestamp and the unstructured data group of duplication corresponding timestamp in second node in the first user node
Unanimously, then the specified unstructured data group of above-mentioned duplication is directly carried out secondary duplication by second user node by transmission module
And the unstructured data group of secondary duplication is transferred to third user node；
After (6-2) is if specify unstructured data group to copy to second user node, to upper in the first user node
It states specified unstructured data group and data update has been carried out by update module again, timestamp is also updated, then specifies non-knot
Structure data group corresponding timestamp and unstructured data group replicated in the first user node is corresponding in second node
Timestamp it is inconsistent, then second user node according to User Defined preset rules to above-mentioned duplication specify unstructured number
It is saved according to the specified unstructured data group of treated duplication is transferred to third user by transmission module after group processing
Point；
In one embodiment, the User Defined preset rules include：(a) second user nodal cache is above-mentioned
The data of above-mentioned specified unstructured data group that the specified unstructured data group replicated is locally stored with the first user node
Difference is if it exceeds predetermined threshold value, then the specified unstructured data group of the above-mentioned duplication of second user nodal cache is according to first
The above-mentioned specified unstructured data group that user node is locally stored carries out full dose update；(b) second user nodal cache is upper
State the specified unstructured data group of duplication and the number of above-mentioned specified unstructured data group that the first user node is locally stored
According to difference if it exceeds predetermined threshold value, then the specified unstructured data group of the above-mentioned duplication of second user nodal cache is according to
The above-mentioned specified unstructured data group that one user node is locally stored carries out incremental update；(3) second user nodal cache
The above-mentioned specified unstructured data group that the specified unstructured data group of above-mentioned duplication is locally stored with the first user node
If data difference is not above predetermined threshold value, the specified unstructured data group of the above-mentioned duplication of second user nodal cache
It does not update.
By the setting of data difference amount threshold value in above-mentioned User Defined preset rules, data transmission bauds has been taken into account
And real-time property, when data difference is not above predetermined threshold value, certain real-time property is sacrificed to improve data
Transmission speed, and when data difference is more than predetermined threshold value, still ensure that real-time property, therefore improving data transmission number
The real-time of data is maintained while spending to a high degree.
Other than above-mentioned User Defined preset rules, can also other users be set according to the actual demand of user
Self-defined preset rules.Since different users has different demands, some use with real-time property several times for data transmission
Family wishes that transmission speed is fast, of less demanding to real-time property, and the accuracy of some user's trend datas, can be according to user
Demand carry out personal settings.
(7) the unstructured data group that third user node receives and caching second node equipment is sent in the buffer.
The present invention carries out consistency judgement according to timestamp to the unstructured data of intermediate node, has taken into account the reality of data
When property and transmission speed are more in line with user's particular demands.
The above is only the better embodiment of the present invention, therefore all constructions according to described in present patent application range,
The equivalent change or modification that feature and principle are done, is included in the range of present patent application.
Claims (3)
1. unstructured data clone method between a kind of multi-user's node, which is characterized in that this method comprises the following steps：
(1) first user node receives the specified unstructured data group sent from second user node by message module
Data request information；
(2) first user nodes obtain the specified unstructured data group asked in data request information simultaneously from local data base
It is once replicated, the unstructured data group carries corresponding timestamp；
The specified unstructured data group of above-mentioned duplication is transferred to second user section by (3) first user nodes by transmission module
Point；
(4) specifying for the above-mentioned duplication that second user node receives and caching first node equipment is sent in the buffer is unstructured
Data group；
(5) second user node is by judgment module, to the specified unstructured number of the above-mentioned duplication of second user nodal cache
The time entrained by above-mentioned specified unstructured data group being locally stored according to the entrained timestamp of group and the first user node
Stamp is compared, and judges whether two timestamps are consistent；
(6) if two timestamps are inconsistent, second user node carries out the specified unstructured data group of above-mentioned duplication
Full dose update is handled.
2. unstructured data transmission method between multi-user's node according to claim 1, which is characterized in that described multi-purpose
Family node is in distributed system.
3. unstructured data transmission method between multi-user's node according to claim 1, which is characterized in that described multi-purpose
Family node is in cloud system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611207008.0A CN108241636A (en) | 2016-12-23 | 2016-12-23 | Unstructured data clone method between a kind of multi-user's node |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611207008.0A CN108241636A (en) | 2016-12-23 | 2016-12-23 | Unstructured data clone method between a kind of multi-user's node |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108241636A true CN108241636A (en) | 2018-07-03 |
Family
ID=62704029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611207008.0A Pending CN108241636A (en) | 2016-12-23 | 2016-12-23 | Unstructured data clone method between a kind of multi-user's node |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108241636A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127783A (en) * | 2007-09-28 | 2008-02-20 | 北京金山软件有限公司 | A website buffering method and device |
| CN102054035A (en) * | 2010-12-29 | 2011-05-11 | 北京播思软件技术有限公司 | Data range-based method for synchronizing data in database |
| CN102227142A (en) * | 2011-06-10 | 2011-10-26 | 复旦大学 | Synchronization playing method based on video data block distribution |
| CN103379159A (en) * | 2012-04-24 | 2013-10-30 | 阿里巴巴集团控股有限公司 | Distributed web site data synchronization method |
| CN106059825A (en) * | 2016-07-08 | 2016-10-26 | 福建天晴数码有限公司 | Distributed system and configuration method |
-
2016
- 2016-12-23 CN CN201611207008.0A patent/CN108241636A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127783A (en) * | 2007-09-28 | 2008-02-20 | 北京金山软件有限公司 | A website buffering method and device |
| CN102054035A (en) * | 2010-12-29 | 2011-05-11 | 北京播思软件技术有限公司 | Data range-based method for synchronizing data in database |
| CN102227142A (en) * | 2011-06-10 | 2011-10-26 | 复旦大学 | Synchronization playing method based on video data block distribution |
| CN103379159A (en) * | 2012-04-24 | 2013-10-30 | 阿里巴巴集团控股有限公司 | Distributed web site data synchronization method |
| CN106059825A (en) * | 2016-07-08 | 2016-10-26 | 福建天晴数码有限公司 | Distributed system and configuration method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017097011A1 (en) | Session synchronization method based on instant copy between cluster nodes | |
| CN106790112B (en) | Node operating system integrating lightweight block chains and data updating method | |
| CN104519130B (en) | A kind of data sharing caching method across IDC | |
| CN103888934B (en) | A kind of mobile terminal cache management device and management method | |
| CN105740248B (en) | A kind of method of data synchronization, apparatus and system | |
| CN1937536A (en) | Network management topological data synchronous refreshing method and system | |
| CN105553636B (en) | A kind of remaining model F C sendaisles vertical sync circuit and method | |
| CN104734915A (en) | Composite multiprocess and multithread multi-network concurrence dynamic simulation method | |
| CN107222412B (en) | SDN mixed mode flow table issuing method and device based on network topology judgment | |
| CN101651709A (en) | Method for calibrating integrity of P2P download files | |
| CN102263698A (en) | Method for establishing virtual channel, method of data transmission and line card | |
| WO2016197458A1 (en) | Traffic control method and apparatus | |
| CN106571991A (en) | Method and data for transmitting data | |
| CN106534249A (en) | File transmission system based on file straight-through technology | |
| CN103152191A (en) | Processing method and system of service gateway data of internet of things | |
| CN106603687B (en) | Unstructured data transmission method between a kind of multi-user's node | |
| CN108241636A (en) | Unstructured data clone method between a kind of multi-user's node | |
| CN108241635A (en) | Unstructured data retransmission method between a kind of multi-user's node | |
| CN100499637C (en) | Method for obtaining information in communication system | |
| CN106855869A (en) | A kind of methods, devices and systems for realizing database High Availabitity | |
| CN108241637A (en) | A kind of multi-user's internodal data Transmission system | |
| CN104717258B (en) | A kind of data transmission method for uplink and system | |
| CN109194759B (en) | Network access method and system for degrading at front end | |
| CN101834914A (en) | Method for realizing mapping relation between identity and position | |
| CN107846328B (en) | Network rate real-time statistical method based on concurrent lock-free ring queue |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 101399 No. 2 East Airport Road, Shunyi Airport Economic Core Area, Beijing (1st, 5th and 7th floors of Industrial Park 1A-4) Applicant after: Zhongke Star Map Co.,Ltd. Address before: 101399 Building 1A-4, National Geographic Information Technology Industrial Park, Guomen Business District, Shunyi District, Beijing Applicant before: GEOVIS TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180703 |