CN108241637A - A kind of multi-user's internodal data Transmission system - Google Patents

A kind of multi-user's internodal data Transmission system Download PDF

Info

Publication number
CN108241637A
CN108241637A CN201611207009.5A CN201611207009A CN108241637A CN 108241637 A CN108241637 A CN 108241637A CN 201611207009 A CN201611207009 A CN 201611207009A CN 108241637 A CN108241637 A CN 108241637A
Authority
CN
China
Prior art keywords
module
user
unstructured data
data
node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611207009.5A
Other languages
Chinese (zh)
Inventor
李子星
刘斌
楚涌泉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Space Star Technology (beijing) Co Ltd
Original Assignee
Space Star Technology (beijing) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Space Star Technology (beijing) Co Ltd filed Critical Space Star Technology (beijing) Co Ltd
Priority to CN201611207009.5A priority Critical patent/CN108241637A/en
Publication of CN108241637A publication Critical patent/CN108241637A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present invention relates to a kind of multi-user's internodal data Transmission systems, the system carries out consistency judgement according to timestamp to the unstructured data of intermediate node, and it is transmitted again after being handled according to User Defined preset rules inconsistent unstructured data, the real-time and transmission speed of data have been taken into account, has been more in line with user's particular demands.

Description

A kind of multi-user's internodal data Transmission system
【Technical field】
The invention belongs to field of data transmission more particularly to multi-user's internodal data Transmission systems.
【Background technology】
Under normal circumstances, forwarding of the unstructured data between node does not consider the update of data, unstructured data from After source node is sent to intermediate node, the unstructured data at source node is updated again, and the number of intermediate nodes cache According to not timely updating, the data for being transmitted to third node are not usually newest, it is impossible to ensure the real-time of forwarding data Property and consistency.In addition, data transmission rule is typically that default is good, it is impossible to carry out personalization according to the demand of user and set It puts, and different users has different demands with real-time property several times for data transmission.
Based on the above problem, now there is an urgent need for a kind of new multi-user multi-user's internodal data Transmission system, according to the time It stabs and consistency judgement is carried out to the unstructured data of intermediate node, and according to User Defined preset rules to inconsistent non- Structural data transmits again after being handled, and has taken into account the real-time and transmission speed of data, has been more in line with user's particular demands.
【Invention content】
In order to solve the above problem of the prior art, the present invention proposes a kind of multi-user's internodal data transmission system System.
The technical solution adopted by the present invention is as follows:
A kind of multi-user's internodal data Transmission system, which is characterized in that the system includes multiple user nodes, often A user node is provided with front-end module, protocol module, message module, data transmission module, memory module, cache module, Middle front-end module, unstructured data acquires, interacts and presents on user node;Protocol module, it is described for encapsulating User node and message module, the communication protocol of transmission module;Message module, for multi-thread concurrent processing message reception, Processing;Data transmission module, for the transmission of unstructured data file content;Memory module, for front-end module to be acquired The storage of unstructured data content in the local database, the unstructured data content packet is deposited for data group Storage, each unstructured data group correspond to a timestamp;Update module, when the unstructured data acquired by front-end module When data update occurs, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to keep data Unanimously, and renewal time stabs;Cache module, for that will be stored in the buffer by the unstructured data that transmission module receives; Judgment module, for carrying out the whether consistent judgement of timestamp.
Beneficial effects of the present invention include:Consistency is carried out according to timestamp to the unstructured data of intermediate node to sentence It is disconnected, and transmitted again after being handled according to User Defined preset rules inconsistent unstructured data, take into account data Real-time and transmission speed, be more in line with user's particular demands.
【Description of the drawings】
Attached drawing described herein is to be used to provide further understanding of the present invention, and forms the part of the application, but It does not constitute improper limitations of the present invention, in the accompanying drawings:
Fig. 1 is the flow of the transmission method applied in unstructured data Transmission system between multi-user's node of the present invention Figure.
【Specific embodiment】
Come that the present invention will be described in detail below in conjunction with attached drawing and specific embodiment, illustrative examples therein and say It is bright to be only used for explaining the present invention, but not as a limitation of the invention.
Embodiment 1, a kind of multi-user's internodal data Transmission system, the system include multiple user nodes, each User node is provided with front-end module, protocol module, message module, data transmission module, memory module, cache module, wherein Front-end module, unstructured data acquires, interacts and presents on user node;Protocol module, for encapsulating the use Family node and message module, the communication protocol of transmission module;Message module, reception, place for multi-thread concurrent processing message Reason;Data transmission module, for the transmission of unstructured data file content;Memory module, for acquire front-end module Unstructured data content stores in the local database, and the unstructured data content packet is stored for data group, Each unstructured data group corresponds to a timestamp;Update module, when the unstructured data hair acquired by front-end module During raw data update, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to keep data one It causes, and renewal time stabs;Cache module, for that will be stored in the buffer by the unstructured data that transmission module receives;Sentence Disconnected module, for carrying out the whether consistent judgement of timestamp.
Embodiment 2, referring to attached drawing 1, the transmission between a kind of multi-user's node applied in unstructured data Transmission system Method,
In one embodiment, multi-user's node is in distributed system, described in other embodiments Multiple user nodes are also in cloud system.Front-end module, protocol module, message mould are provided on each user node Block, data transmission module, memory module, cache module.
Wherein front-end module, unstructured data acquires, interacts and presents on user node;Protocol module is used In the encapsulation user node and message module, the communication protocol of transmission module;Message module disappears for multi-thread concurrent processing Reception, the processing of breath;Data transmission module, for the transmission of unstructured data file content;Memory module, for by front end In the local database, the unstructured data content packet is data group for the unstructured data content storage of module acquisition It is stored, each unstructured data group corresponds to a timestamp;Update module, it is non-structural when being acquired by front-end module When changing data generation data update, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to protect It is consistent to hold data, and renewal time stabs;Cache module, it is slow for will be stored in by the unstructured data that transmission module receives In depositing;Judgment module, for carrying out the whether consistent judgement of timestamp;This method comprises the following steps:
The specified unstructured data that (1) first user node is sent by message module reception from second user node The data request information of group;
(2) first user nodes obtain the specified unstructured data asked in data request information from local data base Group is simultaneously once replicated, and the unstructured data group carries corresponding timestamp;
The specified unstructured data group of above-mentioned duplication is transferred to the second use by (3) first user nodes by transmission module Family node;
(4) non-knot is specified in the above-mentioned duplication that second user node receives and caching first node equipment is sent in the buffer Structure data group;
(5) second user node receives the specified non-of the above-mentioned duplication sent from third user node by message module The data request information of structural data group;
(6) second user node is by judgment module, to the specified non-structural of the above-mentioned duplication of second user nodal cache Change entrained by the above-mentioned specified unstructured data group that timestamp and the first user node entrained by data group are locally stored Timestamp is compared, and judges whether two timestamps are consistent;
After (6-1) is if specify unstructured data group to copy to second user node, to upper in the first user node It states specified unstructured data group and does not carry out data update, timestamp is not also updated, then specifies unstructured data Group corresponding timestamp and the unstructured data group of duplication corresponding timestamp in second node in the first user node Unanimously, then the specified unstructured data group of above-mentioned duplication is directly carried out secondary duplication by second user node by transmission module And the unstructured data group of secondary duplication is transferred to third user node;
After (6-2) is if specify unstructured data group to copy to second user node, to upper in the first user node It states specified unstructured data group and data update has been carried out by update module again, timestamp is also updated, then specifies non-knot Structure data group corresponding timestamp and unstructured data group replicated in the first user node is corresponding in second node Timestamp it is inconsistent, then second user node according to User Defined preset rules to above-mentioned duplication specify unstructured number It is saved according to the specified unstructured data group of treated duplication is transferred to third user by transmission module after group processing Point;
In one embodiment, the User Defined preset rules include:(a) second user nodal cache is above-mentioned The data of above-mentioned specified unstructured data group that the specified unstructured data group replicated is locally stored with the first user node Difference is if it exceeds predetermined threshold value, then the specified unstructured data group of the above-mentioned duplication of second user nodal cache is according to first The above-mentioned specified unstructured data group that user node is locally stored carries out full dose update;(b) second user nodal cache is upper State the specified unstructured data group of duplication and the number of above-mentioned specified unstructured data group that the first user node is locally stored According to difference if it exceeds predetermined threshold value, then the specified unstructured data group of the above-mentioned duplication of second user nodal cache is according to The above-mentioned specified unstructured data group that one user node is locally stored carries out incremental update;(3) second user nodal cache The above-mentioned specified unstructured data group that the specified unstructured data group of above-mentioned duplication is locally stored with the first user node If data difference is not above predetermined threshold value, the specified unstructured data group of the above-mentioned duplication of second user nodal cache It does not update.
By the setting of data difference amount threshold value in above-mentioned User Defined preset rules, data transmission bauds has been taken into account And real-time property, when data difference is not above predetermined threshold value, certain real-time property is sacrificed to improve data Transmission speed, and when data difference is more than predetermined threshold value, still ensure that real-time property, therefore improving data transmission number The real-time of data is maintained while spending to a high degree.
Other than above-mentioned User Defined preset rules, can also other users be set according to the actual demand of user Self-defined preset rules.Since different users has different demands, some use with real-time property several times for data transmission Family wishes that transmission speed is fast, of less demanding to real-time property, and the accuracy of some user's trend datas, can be according to user Demand carry out personal settings.
(7) the unstructured data group that third user node receives and caching second node equipment is sent in the buffer.
The present invention carries out consistency judgement, and make by oneself according to user according to timestamp to the unstructured data of intermediate node Adopted preset rules are transmitted again after handling inconsistent unstructured data, have taken into account the real-time of data and transmission speed Degree, is more in line with user's particular demands.
The above is only the better embodiment of the present invention, therefore all constructions according to described in present patent application range, The equivalent change or modification that feature and principle are done, is included in the range of present patent application.

Claims (3)

1. a kind of multi-user's internodal data Transmission system, which is characterized in that the system includes multiple user nodes, each User node is provided with front-end module, protocol module, message module, data transmission module, memory module, cache module, wherein Front-end module, unstructured data acquires, interacts and presents on user node;Protocol module, for encapsulating the use Family node and message module, the communication protocol of transmission module;Message module, reception, place for multi-thread concurrent processing message Reason;Data transmission module, for the transmission of unstructured data file content;Memory module, for acquire front-end module Unstructured data content stores in the local database, and the unstructured data content packet is stored for data group, Each unstructured data group corresponds to a timestamp;Update module, when the unstructured data hair acquired by front-end module During raw data update, above-mentioned data update is carried out to the corresponding unstructured data stored before memory module to keep data one It causes, and renewal time stabs;Cache module, for that will be stored in the buffer by the unstructured data that transmission module receives;Sentence Disconnected module, for carrying out the whether consistent judgement of timestamp.
2. unstructured data Transmission system between multi-user's node according to claim 1, which is characterized in that described multi-purpose Family node is in distributed system.
3. unstructured data Transmission system between multi-user's node according to claim 1, which is characterized in that described multi-purpose Family node is in cloud system.
CN201611207009.5A 2016-12-23 2016-12-23 A kind of multi-user's internodal data Transmission system Pending CN108241637A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611207009.5A CN108241637A (en) 2016-12-23 2016-12-23 A kind of multi-user's internodal data Transmission system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611207009.5A CN108241637A (en) 2016-12-23 2016-12-23 A kind of multi-user's internodal data Transmission system

Publications (1)

Publication Number Publication Date
CN108241637A true CN108241637A (en) 2018-07-03

Family

ID=62704023

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611207009.5A Pending CN108241637A (en) 2016-12-23 2016-12-23 A kind of multi-user's internodal data Transmission system

Country Status (1)

Country Link
CN (1) CN108241637A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127783A (en) * 2007-09-28 2008-02-20 北京金山软件有限公司 A website buffering method and device
CN102054035A (en) * 2010-12-29 2011-05-11 北京播思软件技术有限公司 Data range-based method for synchronizing data in database
CN102227142A (en) * 2011-06-10 2011-10-26 复旦大学 Synchronization playing method based on video data block distribution
CN103379159A (en) * 2012-04-24 2013-10-30 阿里巴巴集团控股有限公司 Distributed web site data synchronization method
CN106059825A (en) * 2016-07-08 2016-10-26 福建天晴数码有限公司 Distributed system and configuration method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127783A (en) * 2007-09-28 2008-02-20 北京金山软件有限公司 A website buffering method and device
CN102054035A (en) * 2010-12-29 2011-05-11 北京播思软件技术有限公司 Data range-based method for synchronizing data in database
CN102227142A (en) * 2011-06-10 2011-10-26 复旦大学 Synchronization playing method based on video data block distribution
CN103379159A (en) * 2012-04-24 2013-10-30 阿里巴巴集团控股有限公司 Distributed web site data synchronization method
CN106059825A (en) * 2016-07-08 2016-10-26 福建天晴数码有限公司 Distributed system and configuration method

Similar Documents

Publication Publication Date Title
WO2017097011A1 (en) Session synchronization method based on instant copy between cluster nodes
CN106790112B (en) Node operating system integrating lightweight block chains and data updating method
CN106533970B (en) Difference towards cloud computing data center network spreads transmission control method and device
CN101170517B (en) Method for aging of control session table
CN104519130B (en) A kind of data sharing caching method across IDC
CN103888934B (en) A kind of mobile terminal cache management device and management method
CN103780682B (en) A kind of information sharing system towards Ad Hoc network
CN107222412B (en) SDN mixed mode flow table issuing method and device based on network topology judgment
CN102456052A (en) Method for data synchronization between embedded device and database
CN101651709A (en) Method for calibrating integrity of P2P download files
CN106571991A (en) Method and data for transmitting data
CN103152191A (en) Processing method and system of service gateway data of internet of things
CN108241637A (en) A kind of multi-user's internodal data Transmission system
CN106603687B (en) Unstructured data transmission method between a kind of multi-user's node
CN109607341A (en) Elevator operation information management system based on block chain
CN108241636A (en) Unstructured data clone method between a kind of multi-user's node
CN108241635A (en) Unstructured data retransmission method between a kind of multi-user's node
CN106855869A (en) A kind of methods, devices and systems for realizing database High Availabitity
CN109194759B (en) Network access method and system for degrading at front end
CN105323112B (en) A kind of fast method of the consistency treatment of Packet Transport Network pipe
CN107846328B (en) Network rate real-time statistical method based on concurrent lock-free ring queue
CN106254540B (en) A kind of node serve monitoring system and implementation method suitable for distributed system
CN109889562A (en) A kind of offline access method and system of the advanced application platform of Enterprise Mobile
CN107656992A (en) Towards the snapshot method for edition management in more insertion sources
CN110109871A (en) A kind of cross-site high-energy physics data access method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
CB02 Change of applicant information

Address after: 101399 No. 2 East Airport Road, Shunyi Airport Economic Core Area, Beijing (1st, 5th and 7th floors of Industrial Park 1A-4)

Applicant after: Zhongke Star Map Co.,Ltd.

Address before: 101399 Building 1A-4, National Geographic Information Technology Industrial Park, Guomen Business District, Shunyi District, Beijing

Applicant before: GEOVIS TECHNOLOGY (BEIJING) Co.,Ltd.

CB02 Change of applicant information
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180703

RJ01 Rejection of invention patent application after publication