CN104753815A - Flow cache based transparent transmission acceleration network and method - Google Patents

Flow cache based transparent transmission acceleration network and method Download PDF

Info

Publication number
CN104753815A
CN104753815A CN201510131557.3A CN201510131557A CN104753815A CN 104753815 A CN104753815 A CN 104753815A CN 201510131557 A CN201510131557 A CN 201510131557A CN 104753815 A CN104753815 A CN 104753815A
Authority
CN
China
Prior art keywords
data
key value
node server
fragmentation
disappearance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510131557.3A
Other languages
Chinese (zh)
Inventor
洪珂
黄玉羡
程豪
谢玉燕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wangsu Science and Technology Co Ltd
Original Assignee
Wangsu Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wangsu Science and Technology Co Ltd filed Critical Wangsu Science and Technology Co Ltd
Priority to CN201510131557.3A priority Critical patent/CN104753815A/en
Publication of CN104753815A publication Critical patent/CN104753815A/en
Pending legal-status Critical Current

Links

Abstract

The invention provides a flow cache based transparent transmission acceleration method. The method comprises the steps of fragmenting data flow from a client or a source station through a data access node server to obtain a plurality of data fragments; treating each data fragment through the data access node server to obtain key values which can reflect the data fragments; sending all key values to the data access node server through the data access node server; restoring the key values into the corresponding data fragments through the data access node server; splicing the plurality of data fragments into complete data and sending to the source station or the client through the data access node server.

Description

A kind of transparent transmission accelerating network based on stream buffer memory and method
Technical field
The present invention relates to network data transparent transmission speed technology, particularly relate to the speed technology of the tcp data transmission of various application protocol.
Background technology
Network data transparent transmission technology refers in transmitting procedure, transmission network is transparent to external world, and the business no matter transmitted how, and transparent transmission network is only responsible for needing the business transmitted to be sent to destination node, ensure the quality transmitted simultaneously, and the business of transmission is not processed.
Therefore, there is following major drawbacks in existing transparent transmission technology:
One, when client is repeatedly uploaded or downloaded same file, due to the relation of transparent transmission network, application acceleration network does not resolve application layer protocol, only carry out transparent transmission, therefore, and do not know what the data that client asks are, so all need to transmit complete data at every turn, make the transmission time long.Fig. 1 shows the transparent transmission network frame of prior art.As can be seen from the figure, what transmit between client and fringe node, between each node or between node and source station server is all complete data.
Even two HTTP buffer memorys, if client-requested is the file of different URL, although and these files URL is different, but essence only has a fraction of data variation, there is a lot of repeating data, and so buffer memory still cannot hit.That is, although there is a large amount of Data duplications, due to different URL, make client still cannot obtain data from buffer memory, source station must be gone back to and go to fetch data, and transmit complete data.
Three, existing stream buffer memory application, is generally applied to bilateral acceleration, such as, is accelerated by increase client gateways and source gateway.For this bilateral acceleration, need client and source two ends synchronous data flow warehouse in advance.But for application acceleration network, owing to there is the network environment of multi-to-multi, synchronous data flow warehouse then may wasting space, consumes resources in advance.Data flow cache newly-increased in addition must wait to be synchronized after, just can hit, and must manage which data of which platform buffer memory, management complexity is high.
Therefore, a kind of transparent accelerated method that can solve the above-mentioned drawback in existing network data transparent transmission technology is needed badly.
Summary of the invention
In order to reduce the data transmission period in transparent transmission network, the data volume reducing transmitting procedure, the saving network bandwidth, the invention provides a kind of transparent transmission accelerating network based on stream buffer memory and method.
The invention provides a kind of transparent transmission accelerated method based on stream buffer memory, the method comprises the following steps:
Data entries node server carries out burst to the data flow receiving client or source station transmission, obtains multiple data fragmentation;
This Data entries node server processes this data fragmentation each, obtains the key value that can represent this data fragmentation;
All key values are sent to data outlet node server by this Data entries node server;
This data outlet node server is reduced into corresponding data fragmentation according to those key values;
The plurality of data fragmentation is spliced into complete data and sends to source station or client by this data outlet node server.
In one embodiment, the plurality of data fragmentation is spliced into complete data and sends to the step of terminal also to comprise by this data outlet node server:
This data outlet node server judges whether this locality is cached with the data fragmentation corresponding with this key value;
If this data outlet node server judges that this locality is not cached with the data fragmentation corresponding with this key value, then return the information representing this key value of disappearance to this Data entries node, described Data entries node server after the information receiving this expression delete critical value to described data outlet node server send this disappearance key value and to the data fragmentation corresponding to the key value of this disappearance; Described data outlet node server utilizes the data fragmentation corresponding to the key value of this disappearance to send to terminal to splice complete data, and the data fragmentation corresponding to key value of simultaneously this disappearance of buffer memory;
If this data outlet node server judges that local cache has the data fragmentation corresponding with this key value, then the plurality of data fragmentation is spliced into complete data and sends to terminal.
In one embodiment, this Data entries node server processes this data fragmentation each, and the step obtaining the key value that can represent this data fragmentation comprises:
This Data entries node server is encoded to this data fragmentation each.
In one embodiment, each data fragmentation can be random length.
In one embodiment, be reduced into the step of the data fragmentation of correspondence according to those key values at this data outlet node server before, further comprising the steps of:
Received by this data outlet node server judges is only this key value, or the data fragmentation corresponding to key value of the key value of this disappearance and this disappearance.
Present invention also offers a kind of transparent transmission accelerating network based on stream buffer memory, comprise Data entries node server and data outlet node server, wherein,
This Data entries node server, the data flow be configured to receiving client or source station transmission carries out burst, obtains multiple data fragmentation; This data fragmentation each is processed, obtains the key value that can represent this data fragmentation; All key values are sent to data outlet node server;
This data outlet node server, is configured to be reduced into corresponding data fragmentation according to those key values; The plurality of data fragmentation is spliced into complete data and sends to source station or client.
In one embodiment, this Data entries node server comprises:
Data reception module, is configured to the data flow receiving client or source station transmission;
Data processing module, is configured to carry out burst to the data flow received according to certain algorithm, obtains multiple data fragmentation, and each data fragmentation is encoded to the key value that obtains representing this data fragmentation;
Data cache module, is configured to this data fragmentation of buffer memory;
Key value sending module, is configured to send all key values to this data outlet node server.
Delete critical value receiver module, is configured to judge whether to receive the information that expression that this data outlet node server returns lacks this key value;
Key value and corresponding data fragmentation sending module, be configured to, if receive the information that expression that this data outlet node server returns lacks this key value, then the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance is sent to this data outlet node server.
In one embodiment, this data outlet node server comprises:
Data reception module, is configured to receive this key value that this Data entries node sends, and/or the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance;
Data separation module, what be configured to that district office receives is this key value, or the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance; If what this data separation module judged that this receives is only this key value, then this key value is sent to data resolution module; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then the data fragmentation corresponding to the key value of this disappearance is sent to data concatenation module, simultaneously, by the data fragmentation buffer memory corresponding to the key value of this disappearance to data cache module, if so that transmission next time identical data, data can be resend by this Data entries node server again, but directly obtain from local cache;
Data Analysis and cache lookup module, be configured to resolve this key value and from this data cache module, search this locality by this key value whether be cached with the data fragmentation corresponding with this key value;
Data concatenation module, is configured to, if this locality finds the buffer memory of data fragmentation corresponding to this key value, then utilizes the data fragmentation of those buffer memorys to be spliced into complete data and sends to terminal; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then this data concatenation module is also configured to utilize the data fragmentation corresponding to the key value of this disappearance to splice complete data and sends to terminal;
Delete critical value sending module, is configured to, if this Data Analysis and cache lookup module do not find the buffer memory of this data fragmentation in this locality, then sends and represents that the information of this key value of disappearance is to this Data entries node server.
Present invention also offers a kind of based on the Data entries node server in the transparent transmission accelerating network of stream buffer memory, the data flow that this Data entries node server is configured to receiving client or source station transmission carries out burst, obtains multiple data fragmentation; This data fragmentation each is processed, obtains the key value that can represent this data fragmentation; All key values are sent to data outlet node server.
In one embodiment, this Data entries node server comprises:
Data reception module, is configured to the data flow receiving client or source station transmission;
Data processing module, is configured to carry out burst to the data flow received according to certain algorithm, obtains multiple data fragmentation, and each data fragmentation is encoded to the key value that obtains representing this data fragmentation;
Data cache module, is configured to this data fragmentation of buffer memory;
Key value sending module, is configured to send all key values to this data outlet node server.
Delete critical value receiver module, is configured to judge whether to receive the information that expression that this data outlet node server returns lacks this key value;
Key value and corresponding data fragmentation sending module, be configured to, if receive the information that expression that this data outlet node server returns lacks this key value, then the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance is sent to this data outlet node server.
Present invention also offers a kind of based on the data outlet node server in the transparent transmission accelerating network of stream buffer memory, this data outlet node server is configured to the key value receiving the transmission of above-mentioned Data entries node server, and is reduced into corresponding data fragmentation according to those key values; The plurality of data fragmentation is spliced into complete data and sends to source station or client.
In one embodiment, this data outlet node server comprises:
1502481CNCN
Data reception module, is configured to receive this key value that this Data entries node sends, and/or the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance;
Data separation module, what be configured to that district office receives is this key value, or the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance; If what this data separation module judged that this receives is only this key value, then this key value is sent to data resolution module; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then the data fragmentation corresponding to the key value of this disappearance is sent to data concatenation module, simultaneously, by the data fragmentation buffer memory corresponding to the key value of this disappearance to data cache module, if so that transmission next time identical data, data can be resend by this Data entries node server again, but directly obtain from local cache;
Data Analysis and cache lookup module, be configured to resolve this key value and from this data cache module, search this locality by this key value whether be cached with the data fragmentation corresponding with this key value;
Data concatenation module, is configured to, if this locality finds the buffer memory of data fragmentation corresponding to this key value, then utilizes the data fragmentation of those buffer memorys to be spliced into complete data and sends to terminal; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then this data concatenation module is also configured to utilize the data fragmentation corresponding to the key value of this disappearance to splice complete data and sends to terminal;
Delete critical value sending module, is configured to, if this Data Analysis and cache lookup module do not find the buffer memory of this data fragmentation in this locality, then sends and represents that the information of this key value of disappearance is to this Data entries node server.
Accompanying drawing explanation
Above summary of the invention of the present invention and embodiment below can be better understood when reading by reference to the accompanying drawings.It should be noted that, accompanying drawing is only as the example of claimed invention.In the accompanying drawings, identical Reference numeral represents same or similar element.
Fig. 1 illustrates the transparent transmission network frame of prior art;
Fig. 2 illustrates the general illustration according to one embodiment of the invention;
Fig. 3 illustrates the overview flow chart according to one embodiment of the invention;
Fig. 4 illustrates the handling process of the Data entries node server according to one embodiment of the invention;
Fig. 5 illustrates the handling process of the data outlet node server according to one embodiment of the invention;
Fig. 6 illustrates the architecture block diagram of the Data entries node server according to one embodiment of the invention; And
Fig. 7 illustrates the architecture block diagram of the data outlet node server according to one embodiment of the invention.
Embodiment
Below detailed features of the present invention and advantage is described in a specific embodiment in detail, its content is enough to make any those skilled in the art understand technology contents of the present invention and implement according to this, and specification, claim and the accompanying drawing disclosed by this specification, those skilled in the art can understand the object and advantage that the present invention is correlated with easily.
The invention provides a kind of transparent transmission accelerated method based on stream buffer memory.Its basic thought is, by the process of application acceleration network internal to transport service, reaches the effect of saving bandwidth, plays acceleration effect simultaneously to the transmission of customer data.When customer data is through application acceleration network, utilize the feature of application acceleration network multi-level framework, first application acceleration node of data process carries out coding transmission to data, last application acceleration node carries out decoded back initial data, and does not affect the actual data obtained of client.If client allows last application acceleration node to be erected in the net of client, then can save the outlet bandwidth of client.If be not erected at client's Intranet, then by reducing the data volume of intermediate node transmission, the effect of speeding up data transmission speed can be reached.
Fig. 2 illustrates the general illustration according to one embodiment of the invention.As shown in Figure 2, except being except partial data between client and fringe node, from what transmit between the nearest node in source station and source station server, fringe node and are the critical datas after data processing from the data that the application acceleration network between the nearest node in source station transmits.In the present invention, so-called critical data refers to the representative value (that is, Key value) that can represent these data obtained through certain algorithm.In one embodiment, critical data can be encoded or after compressing data.
The processing mode of transparent accelerating network to data has following two kinds:
One, client is to fringe node uploading data, edge data through application acceleration Internet Transmission to source station.
Two, source station sends response data to the application acceleration node nearest from source, and this node returns to client data by former road.
Therefore, for uploading data, fringe node corresponds to Data entries node server, and the node nearest from source station corresponds to data outlet node server.For downloading data, fringe node corresponds to data outlet node server, and the node nearest from source station corresponds to data outlet node server.
Fig. 3 illustrates the overview flow chart according to one embodiment of the invention.This flow chart comprises following step.
Step S301, Data entries node server carries out burst to the data flow receiving client or source station transmission, obtains multiple data fragmentation.
Step S302, this Data entries node server processes this data fragmentation each, obtains the key value that can represent this data fragmentation.In one embodiment, this Data entries node server carries out encoding compression processing according to certain algorithm to this data fragmentation.
Step S303, all key values are sent to data outlet node server by this Data entries node server.
Step S304, this data outlet node server is reduced into corresponding data fragmentation according to those key values.In one embodiment, this data outlet node server carries out decoding process according to certain algorithm to this data fragmentation.
Step S305, the plurality of data fragmentation is spliced into complete data and sends to source station or client by this data outlet node server.
The plurality of data fragmentation is spliced into complete data and sends to the step of terminal also to comprise following sub-step by this data outlet node server.
This data outlet node server judges whether this locality is cached with the data fragmentation corresponding with this key value.
If this data outlet node server judges that this locality is not cached with the data fragmentation corresponding with this key value, then return the information representing this key value of disappearance to this Data entries node, described Data entries node server after the information receiving this expression delete critical value to described data outlet node server send this disappearance key value and to the data fragmentation corresponding to the key value of this disappearance; Described data outlet node server utilizes the data fragmentation corresponding to the key value of this disappearance to send to terminal to splice complete data, and the data fragmentation corresponding to key value of simultaneously this disappearance of buffer memory.
If this data outlet node server judges that local cache has the data fragmentation corresponding with this key value, then the plurality of data fragmentation is spliced into complete data and sends to terminal.
Fig. 4 illustrates the handling process of the Data entries node server according to one embodiment of the invention.
Step S401, Data entries node receives the data flow of client or source station transmission.
Step S402, carries out burst to the data flow received according to certain algorithm, obtains some data fragmentations, and data cached burst.In one embodiment, this data fragmentation is random length.
Step S403, processes each data fragmentation, obtains the key value (Key value) that can represent this data fragmentation.This key value refers to the critical data (Key value) that can represent this data fragmentation obtained through certain algorithm.
Step S404, sends all key values to data outlet node.
Step S405, judges whether to receive the information that expression that data outlet node returns lacks this key value.
Step S406, if the information receiving that expression that data outlet node returns lacks this key value, then sends to data outlet node the data fragmentation corresponding to the Key value of the key value of this disappearance and this disappearance.Specifically, if data outlet node finds that there is not this Key value this locality, then represent in data outlet node and be not cached with the data corresponding with this Key value, therefore, can send and represent that the information of disappearance Key value is to Data entries node, Data entries node is needed to send the data to data outlet node, and transmit this data to need not repeat next time, Data entries node need Key value corresponding for these data is sent to data outlet node so that next time request msg time can directly obtain from data out node.
Step S407, if the information not receiving the key value of the expression disappearance that data outlet node returns, then terminates this data transfer.
Fig. 5 illustrates the handling process of the data outlet node server according to one embodiment of the invention.
Step S501, data outlet node receives the key value that Data entries node sends, or receives the combination of the key value that the lacks data fragmentation corresponding with the key value of this disappearance.
Step S502, received by judgement is the combination of the key value data fragmentation corresponding with the key value of this disappearance of key value or disappearance.
Step S503, if judge it is only key value, then resolves this key value and searches data outlet node this locality by this key value whether be cached with the data fragmentation corresponding with this key value.
Step S504, if there is the buffer memory of data fragmentation this locality, is then spliced into complete data by some data fragmentations and sends to terminal.
Step S505, if the buffer memory of this locality not this data fragmentation, then sends and represents that the information of this key value of disappearance is to Data entries node.
Step S506, if judge in step S502, received is the combination of the key value of the disappearance data fragmentation corresponding with the key value of this disappearance, the data fragmentation splicing partial data then utilizing the key value of this disappearance corresponding is to terminal, the data fragmentation that the key value of this disappearance is corresponding is kept at buffer area simultaneously, if so that transmission next time identical data, initial data can be resend by Data entries node again, but directly obtain from local cache.
Fig. 6 illustrates the framework map of Data entries node server according to an embodiment of the invention.
As described in Figure 6, Data entries node server of the present invention comprises the data fragmentation sending module 606 of data reception module 601, data processing module 602, data cache module 603, key value sending module 604, delete critical value receiver module 605 and key value and correspondence.
This data reception module 601 is configured to the data receiving client or source station transmission.
This data processing module 602 is configured to carry out burst to the data flow received according to certain algorithm, obtains some data fragmentations, and each data fragmentation is encoded to the key value that obtains representing this data fragmentation.
Further, this data processing module 602 comprises data fragmentation module and data coding module.Wherein, this data fragmentation module is configured to carry out burst to the data flow received according to certain algorithm, obtains some data fragmentations.In one embodiment, this data fragmentation is random length.This data coding module is configured to process each data fragmentation, obtains the key value (Key value) that can represent this data fragmentation.This key value refers to the critical data (Key value) that can represent this data fragmentation obtained through certain algorithm.
This data cache module 603 is configured to this data fragmentation of buffer memory.
This key value sending module 604 is configured to send all key values to data outlet node.
This delete critical value receiver module 605 is configured to judge whether to receive the information that expression that data outlet node returns lacks this key value.
This key value and corresponding data fragmentation sending module 606 are configured to, if receive the information that expression that data outlet node returns lacks this key value, then the data fragmentation corresponding to the Key value of the key value of this disappearance and this disappearance is sent to data outlet node.
Fig. 7 illustrates the framework map of data outlet node server according to an embodiment of the invention.
As shown in Figure 7, data outlet node server of the present invention comprises data reception module 701, data separation module 702, data resolution module 703, data concatenation module 704, delete critical value sending module 705 and data cache module 706.
This data reception module 701 is configured to the key value receiving the transmission of Data entries node, or the combination of the key value of disappearance and the data fragmentation corresponding to key value of this disappearance.
This data separation module 702 is configured to, the combination of the key value of key value that what district office received is or disappearance and the data fragmentation corresponding to key value of this disappearance.If data separation module 702 judges received by this data reception module 701 to be only key value, then this key value is sent to this data resolution module 703.If data separation module 702 judges received by data reception module 701 to be the key value of disappearance and the combination of the data fragmentation corresponding to key value of this disappearance, then the data fragmentation corresponding to the key value of this disappearance is sent to this data concatenation module 704.Meanwhile, also by the data fragmentation buffer memory corresponding to the key value of this disappearance to data cache module 706, if so that next time transmission identical data, initial data can be resend by Data entries node again, but directly obtain from local cache.
This Data Analysis and cache lookup module 703 are configured to resolve this key value and from this data cache module 706, search this locality by this key value whether be cached with the data fragmentation corresponding with this key value.In one embodiment, this Data Analysis and cache lookup module 703 are configured to obtain initial data burst corresponding to this key value according to certain algorithm.
This data concatenation module 704 is configured to, if this locality finds the buffer memory of data fragmentation corresponding to this key value, then utilizes the data fragmentation of those buffer memorys to be spliced into complete data and sends to terminal.In addition, if data separation module 702 judges received by data reception module 701 to be the key value of disappearance and the combination of the data fragmentation corresponding to key value of this disappearance, this data concatenation module described is also configured to utilize the data fragmentation corresponding to key value of this disappearance to splice complete data to send to terminal.
This delete critical value sending module 705 is configured to, if the buffer memory of this locality not this data fragmentation, then sends and represents that the information of this key value of disappearance is to Data entries node.
This data cache module 706 is configured to data cached burst.
In sum, transparent transmission speeding scheme based on stream buffer memory of the present invention is by processing at data access node, extract data critical value, arrive data outlet node and reduce partial data according to key value, the data volume of transmitting procedure is reduced, thus reaches the effect reducing data transmission period.Transparent transmission speeding scheme based on stream buffer memory of the present invention solves above-mentioned three drawbacks that network data transparent transmission technology of the prior art exists.
For above-mentioned first drawback, solution according to the present invention is, during client's first time downloading data, on fringe node, block or burst are that unit carries out buffer memory to logarithm according to this, when second time downloads same data, only need the key value transmit of data block to fringe node from the node close to source, fringe node finds corresponding data block from local cache, is spliced into complete data and returns to client.
For above-mentioned second drawback, because buffer memory is in units of data block, for different URL, only need to transmit different data divisions, identical data block still only can transmit key value, and the data volume therefore transmitted also is cut down, and improves response speed.
For the above-mentioned the 3rd drawback, solution first carries out buffer memory to data block at Data entries node, and transmit key value to data outlet node, if data outlet node has had this data block, then can direct splicing data respond, if data outlet node also not this data block, then to Data entries node feeding back, the data of this data block of request transmission.
Here the term adopted and form of presentation are just for describing, and the present invention also should not be limited to these terms and statement.Use these terms and statement and do not mean that the equivalent features getting rid of any signal and description (or wherein part), will be appreciated that the various amendments that may exist also should be included in right.Other amendments, change and replacement also may exist.Accordingly, claim should be considered as covering all these equivalents.
Equally, it is to be noted, although the present invention describes with reference to current specific embodiment, but those of ordinary skill in the art will be appreciated that, above embodiment is only used to the present invention is described, change or the replacement of various equivalence also can be made, therefore, as long as all will drop in the scope of claims of the application the change of above-described embodiment, modification in spirit of the present invention when not departing from spirit of the present invention.

Claims (10)

1., based on a transparent transmission accelerated method for stream buffer memory, it is characterized in that, comprising:
Data entries node server carries out burst to the data flow receiving client or source station transmission, obtains multiple data fragmentation;
This Data entries node server processes this data fragmentation each, obtains the key value that can represent this data fragmentation;
All key values are sent to data outlet node server by this Data entries node server;
This data outlet node server is reduced into corresponding data fragmentation according to those key values;
The plurality of data fragmentation is spliced into complete data and sends to source station or client by this data outlet node server.
2. transparent transmission accelerated method as claimed in claim 1, it is characterized in that, the plurality of data fragmentation is spliced into complete data and sends to the step of terminal also to comprise by this data outlet node server:
This data outlet node server judges whether this locality is cached with the data fragmentation corresponding with this key value;
If this data outlet node server judges that this locality is not cached with the data fragmentation corresponding with this key value, then return the information representing this key value of disappearance to this Data entries node, described Data entries node server after the information receiving this expression delete critical value to described data outlet node server send this disappearance key value and to the data fragmentation corresponding to the key value of this disappearance; Described data outlet node server utilizes the data fragmentation corresponding to the key value of this disappearance to send to terminal to splice complete data, and the data fragmentation corresponding to key value of simultaneously this disappearance of buffer memory;
If this data outlet node server judges that local cache has the data fragmentation corresponding with this key value, then the plurality of data fragmentation is spliced into complete data and sends to terminal.
3. transparent transmission accelerated method as claimed in claim 2, is characterized in that:
This Data entries node server processes this data fragmentation each, obtains representing that the key value of this data fragmentation comprises the following steps:
This Data entries node server is encoded to this data fragmentation each, and this data fragmentation each is random length
Be reduced into the step of the data fragmentation of correspondence according to those key values at this data outlet node server before, further comprising the steps of:
Received by this data outlet node server judges is only this key value, or the data fragmentation corresponding to key value of the key value of this disappearance and this disappearance.
4., based on a transparent transmission accelerating network for stream buffer memory, it is characterized in that, comprising: described transparent transmission accelerating network comprises Data entries node server and data outlet node server, wherein,
This Data entries node server, the data flow be configured to receiving client or source station transmission carries out burst, obtains multiple data fragmentation; This data fragmentation each is processed, obtains the key value that can represent this data fragmentation; All key values are sent to data outlet node server;
This data outlet node server, is configured to be reduced into corresponding data fragmentation according to those key values; The plurality of data fragmentation is spliced into complete data and sends to source station or client.
5., as claimed in claim 4 based on the transparent transmission accelerating network of stream buffer memory, it is characterized in that, this Data entries node server comprises:
Data reception module, is configured to the data flow receiving client or source station transmission;
Data processing module, is configured to carry out burst to the data flow received according to certain algorithm, obtains multiple data fragmentation, and each data fragmentation is encoded to the key value that obtains representing this data fragmentation;
Data cache module, is configured to this data fragmentation of buffer memory;
Key value sending module, is configured to send all key values to this data outlet node server.
Delete critical value receiver module, is configured to judge whether to receive the information that expression that this data outlet node server returns lacks this key value;
Key value and corresponding data fragmentation sending module, be configured to, if receive the information that expression that this data outlet node server returns lacks this key value, then the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance is sent to this data outlet node server.
6., as claimed in claim 5 based on the transparent transmission accelerating network of stream buffer memory, it is characterized in that, this data outlet node server comprises:
Data reception module, is configured to receive this key value that this Data entries node sends, and/or the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance;
Data separation module, what be configured to that district office receives is this key value, or the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance; If what this data separation module judged that this receives is only this key value, then this key value is sent to data resolution module; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then the data fragmentation corresponding to the key value of this disappearance is sent to data concatenation module, simultaneously, by the data fragmentation buffer memory corresponding to the key value of this disappearance to data cache module, if so that transmission next time identical data, data can be resend by this Data entries node server again, but directly obtain from local cache;
Data Analysis and cache lookup module, be configured to resolve this key value and from this data cache module, search this locality by this key value whether be cached with the data fragmentation corresponding with this key value;
Data concatenation module, is configured to, if this locality finds the buffer memory of data fragmentation corresponding to this key value, then utilizes the data fragmentation of those buffer memorys to be spliced into complete data and sends to terminal; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then this data concatenation module is also configured to utilize the data fragmentation corresponding to the key value of this disappearance to splice complete data and sends to terminal;
Delete critical value sending module, is configured to, if this Data Analysis and cache lookup module do not find the buffer memory of this data fragmentation in this locality, then sends and represents that the information of this key value of disappearance is to this Data entries node server.
7. based on the Data entries node server in the transparent transmission accelerating network of stream buffer memory, it is characterized in that, the data flow that this Data entries node server is configured to receiving client or source station transmission carries out burst, obtains multiple data fragmentation; This data fragmentation each is processed, obtains the key value that can represent this data fragmentation; All key values are sent to data outlet node server.
8. Data entries node server as claimed in claim 7, it is characterized in that, this Data entries node server comprises:
Data reception module, is configured to the data flow receiving client or source station transmission;
Data processing module, is configured to carry out burst to the data flow received according to certain algorithm, obtains multiple data fragmentation, and each data fragmentation is encoded to the key value that obtains representing this data fragmentation;
Data cache module, is configured to this data fragmentation of buffer memory;
Key value sending module, is configured to send all key values to this data outlet node server.
Delete critical value receiver module, is configured to judge whether to receive the information that expression that this data outlet node server returns lacks this key value;
Key value and corresponding data fragmentation sending module, be configured to, if receive the information that expression that this data outlet node server returns lacks this key value, then the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance is sent to this data outlet node server.
9. one kind based on stream buffer memory transparent transmission accelerating network in data outlet node server, it is characterized in that, this data outlet node server is configured to the key value receiving Data entries node server as claimed in claim 8 transmission, and is reduced into corresponding data fragmentation according to those key values; The plurality of data fragmentation is spliced into complete data and sends to source station or client.
10. data outlet node server as claimed in claim 9, it is characterized in that, this data outlet node server comprises:
Data reception module, is configured to receive this key value that this Data entries node sends, and/or the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance;
Data separation module, what be configured to that district office receives is this key value, or the data fragmentation corresponding to the key value of the key value of this disappearance and this disappearance; If what this data separation module judged that this receives is only this key value, then this key value is sent to data resolution module; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then the data fragmentation corresponding to the key value of this disappearance is sent to data concatenation module, simultaneously, by the data fragmentation buffer memory corresponding to the key value of this disappearance to data cache module, if so that transmission next time identical data, data can be resend by this Data entries node server again, but directly obtain from local cache;
Data Analysis and cache lookup module, be configured to resolve this key value and from this data cache module, search this locality by this key value whether be cached with the data fragmentation corresponding with this key value;
Data concatenation module, is configured to, if this locality finds the buffer memory of data fragmentation corresponding to this key value, then utilizes the data fragmentation of those buffer memorys to be spliced into complete data and sends to terminal; If this data separation module judges that received is the key value of this disappearance and the data fragmentation corresponding to the key value of this disappearance, then this data concatenation module is also configured to utilize the data fragmentation corresponding to the key value of this disappearance to splice complete data and sends to terminal;
Delete critical value sending module, is configured to, if this Data Analysis and cache lookup module do not find the buffer memory of this data fragmentation in this locality, then sends and represents that the information of this key value of disappearance is to this Data entries node server.
CN201510131557.3A 2015-03-24 2015-03-24 Flow cache based transparent transmission acceleration network and method Pending CN104753815A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510131557.3A CN104753815A (en) 2015-03-24 2015-03-24 Flow cache based transparent transmission acceleration network and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510131557.3A CN104753815A (en) 2015-03-24 2015-03-24 Flow cache based transparent transmission acceleration network and method

Publications (1)

Publication Number Publication Date
CN104753815A true CN104753815A (en) 2015-07-01

Family

ID=53592944

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510131557.3A Pending CN104753815A (en) 2015-03-24 2015-03-24 Flow cache based transparent transmission acceleration network and method

Country Status (1)

Country Link
CN (1) CN104753815A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337155A (en) * 2018-05-10 2018-07-27 网宿科技股份有限公司 A kind of e-mail transmission method, server and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1859115A (en) * 2006-01-24 2006-11-08 华为技术有限公司 Distributing storage downloading system, device and method for network data
CN101945103A (en) * 2010-08-09 2011-01-12 中国电子科技集团公司第五十四研究所 IP (Internet Protocol) network application accelerating system
US8190874B2 (en) * 2004-12-21 2012-05-29 Nec Corporation Data transmission system and data transmission method
CN103944969A (en) * 2014-03-31 2014-07-23 中国电子科技集团公司第三十研究所 Secure transmission optimization method and device for narrow-band network
CN104270454A (en) * 2014-10-14 2015-01-07 无锡云捷科技有限公司 CDN dynamic application acceleration method based on data transmission optimizing system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8190874B2 (en) * 2004-12-21 2012-05-29 Nec Corporation Data transmission system and data transmission method
CN1859115A (en) * 2006-01-24 2006-11-08 华为技术有限公司 Distributing storage downloading system, device and method for network data
CN101945103A (en) * 2010-08-09 2011-01-12 中国电子科技集团公司第五十四研究所 IP (Internet Protocol) network application accelerating system
CN103944969A (en) * 2014-03-31 2014-07-23 中国电子科技集团公司第三十研究所 Secure transmission optimization method and device for narrow-band network
CN104270454A (en) * 2014-10-14 2015-01-07 无锡云捷科技有限公司 CDN dynamic application acceleration method based on data transmission optimizing system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108337155A (en) * 2018-05-10 2018-07-27 网宿科技股份有限公司 A kind of e-mail transmission method, server and system
WO2019214012A1 (en) * 2018-05-10 2019-11-14 网宿科技股份有限公司 Mail transmission method, server and system
EP3591907A4 (en) * 2018-05-10 2020-04-22 Wangsu Science & Technology Co., Ltd. Mail transmission method, server and system

Similar Documents

Publication Publication Date Title
CN106559677B (en) Terminal, cache server and method and device for acquiring video fragments
US10630758B2 (en) Method and system for fulfilling server push directives on an edge proxy
EP3396924B1 (en) Real-time processing of iot data
US8468262B2 (en) Method and apparatus for updating http content descriptions
CN111050361B (en) Message transmission method, device and system
CN103988458A (en) Method for network coding packets in content-centric networking based networks
CN101459571B (en) Method, system and apparatus for website mirroring
CA2950326C (en) Protocol stack adaptation method and apparatus
CN110581812A (en) Data message processing method and device
US9479607B2 (en) Content caching and delivering system with traffic of repetitively requested content reduced
CN108932277B (en) Webpage loading method, webpage loading system and server
CN103731493A (en) Page transmission method, device and system
CN104796439A (en) Webpage pushing method, webpage pushing client, webpage pushing server and webpage pushing system
CN102708192A (en) Method, system and device for sharing documents
CN103532984A (en) Data transmission method, device and system of websocket protocol
KR20160022255A (en) System and method for reconstructable all-in-one content stream
CN103139252B (en) The implementation method that a kind of network proxy cache is accelerated and device thereof
CN107251529B (en) Method and apparatus for transmitting and receiving information between servers in content transmission network system
US8856445B2 (en) Byte caching with chunk sizes based on data type
CN117596232A (en) Method, device and system for fast starting streaming media
CN104303471A (en) Method and apparatus for providing content by selecting data acceleration algorithm
CN109274720B (en) Method and system for transmitting data
CN104753815A (en) Flow cache based transparent transmission acceleration network and method
CN115378855A (en) Data packet testing method and device, communication device and storage medium
CN106713317A (en) Method and device for transmitting streaming media file

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150701

RJ01 Rejection of invention patent application after publication