CN108933835A - A kind of CDN distribution method for saving bandwidth resources - Google Patents
A kind of CDN distribution method for saving bandwidth resources Download PDFInfo
- Publication number
- CN108933835A CN108933835A CN201810811579.8A CN201810811579A CN108933835A CN 108933835 A CN108933835 A CN 108933835A CN 201810811579 A CN201810811579 A CN 201810811579A CN 108933835 A CN108933835 A CN 108933835A
- Authority
- CN
- China
- Prior art keywords
- file
- content
- edge
- packet
- load
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/185—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with management of multicast group membership
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1859—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast adapted to provide push services, e.g. data channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/164—Adaptation or special uses of UDP protocol
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present invention relates to technical field of network communication, a kind of specific CDN distribution method for saving bandwidth resources, including central host content distribution to edge machine M, edge machine M by content reception and special package, finally be transmitted to an edge group of planes, other edge machines receive edge machine M transmission data after, decapsulation analysis is carried out to data packet, then removal repeats UDP packet, resequences to UDP bag data, then store into single file.Central host content is distributed to edge machine M by reliable http protocol by core network by the present invention, the ways of distribution that edge machine M passes through UDP multicast again distributes content to an edge group of planes, content single in this way, an entire edge group of planes can quickly be issued the same time, core network bandwidth resources are greatly saved；Due to using UDP multicast mode when an edge group of planes forwards content, because of its unreliable transmission characteristic, by the way of HTTP error correction, reliability reparation is carried out to the fraction content for mistake occur.
Description
Technical field
The present invention relates to technical field of network communication, a kind of specific CDN distribution method for saving bandwidth resources.
Background technique
It with high definition, super clear video development and popularizes, big data, large capacity content distribution become mainstream gradually, thus right
Network bandwidth requirement is also increasing；And traditional CDN dissemination system seems more in terms of bandwidth conservation and content quickly distribution
It feels sleepy difficulty.
Traditional CDN dissemination system mainly has following two types:
1, the vertical distribution model in center: such distribution mode relies primarily on core network and is carried out reliably by http protocol
Distribution is distributed to an edge group of planes in data high-volume, is easy to cause core network congestion, exhausts core network bandwidth resources, point
The problems such as hair inefficiency, the distribution time is long；
2, tree-shaped distribution model: such mode alleviates central backbone network bandwidth pressure to a certain degree, but is distributing
In journey it to be easy to cause distribution inefficiency, distributes slow-footed problem by multistage Feeder Network.
Summary of the invention
It is an object of the invention to overcome problems of the prior art, a kind of the CDN for saving bandwidth resources points is provided
Forwarding method, it may be implemented to distribute by a kind of central host to edge host using reliable HTTP, at edge using more
The mode that the UDP distribution mode and HTTP error correction for saving bandwidth resources combine, to solve two kinds of distribution modes of tradition CDN
Disadvantage.
To realize above-mentioned technical purpose and the technique effect, the present invention is achieved by the following technical solutions:
A kind of CDN distribution method for saving bandwidth resources, includes the following steps:
Step 1, central host core network in a manner of http protocol content distribution to by edge machine 1, edge
Any one edge of table in an edge group of planes for machine 2 ... edge machine N composition is defined as edge machine M along machine；
Step 2, edge machine M finish content reception, then again content by special package, finally use UDP multicast
Mode is transmitted to an edge group of planes, wherein the group of planes is made of edge machine 1, edge machine 2 ... edge machine N；
After step 3, other edge machines receive the data of edge machine M transmission, decapsulation analysis is carried out to data packet, then
Removal repeats UDP packet, resequences to UDP bag data, then store into single file, is surrounded by loss if received, marks
Remember that the content malfunctions；
Any one edge of table is defined as edge machine a, the edge machine a reception content, to interior along machine in step 4, the group of planes
Hold after receiving, if having error in content UDP distribution procedure, HTTP request is sent to edge machine M and carries out error correction, it is right
Error file, which re-downloads, to be repaired.
Further, special package includes following mode in the step 2:
Loadtype, 1 byte representation of the loadtype, if it is header information that value, which is 0 expression load, if value is 1
It is expressed as the content of load；
Payload length, 2 byte representations of the payload length indicate the length of load；
File index, 4 byte representations of the file index indicate file unique identification, wherein the mark is by 32
Position MD5 encrypts file name and generates；
Packet index, the packet index 4 byte representations, indicate that the packet is the distribution serial number of the content；
File size, 8 byte representations of the file size indicate this document size, and a file includes Y negative
It carries, wherein Y is greater than or equal to 1；
Load, 1316 byte representations of the load, each encapsulation package maximum carry 1316 byte load contents, such as
Fruit loadtype is 0, then load contents are file name；If loadtype is 1, load is file content.
Further, analysis is decapsulated in the step 3, is specifically included: the packet category received is determined according to loadtype
It determines which file the load received belongs in header information or load contents, while according to file index, passes through packet
Index determines whether the data received lead to the problem of repetition, packet loss, random ordering.
Further, the step 2 edge machine M is transmitted in an edge group of planes, is specifically comprised the following steps:
Step 2.1 obtains the file information: mainly obtaining file name, file size；
Step 2.2, encapsulation head packet, comprising:
Loadtype: being worth is 0；
Payload length: file name length；
File index: file name is encrypted by 32 MD5 and is generated；
Packet index: being worth is 0；
File size: the file size of acquisition；
Load: file name, maximum length is no more than 1316 bytes；
Step 2.3, encapsulated content packet, comprising:
Loadtype: being worth is 1；
Payload length: the actual length of content；
File index: file name is encrypted by 32 MD5 and is generated；
Packet index: incremented by successively since 1；
File size: the file size of acquisition；
Load: file content, maximum length is no more than 1316 bytes；
Step 2.4, UDP send header information, and sending and successfully then reading 1316 bytes is load, otherwise return step
2.3；
Step 2.5, encapsulation load contents packet；
Step 2.6, UDP send load contents packet, terminate if less than 1316 bytes of content packet, otherwise return step
2.4。
Further, the step 4 sends HTTP request to edge machine M and carries out specifically comprising the following steps: root in error correction
Downloading file is requested by http protocol to edge machine M according to header information；Terminate if error correction success, otherwise retries three times, if
Continue failure and then shows that error correction fails.
Beneficial effects of the present invention: central host content is distributed to by reliable http protocol by core network by side
Along machine M, the ways of distribution that edge machine M passes through UDP multicast again distributes content to an edge group of planes, content single in this way, Ke Yitong
One time quickly issued an entire edge group of planes, core network bandwidth resources was greatly saved, while in high-volume data distribution,
Make to distribute more efficient, speed is faster；Due to using UDP multicast mode when an edge group of planes forwards content, because of its unreliable transmission
Characteristic carries out reliability reparation to the fraction content for mistake occur by the way of HTTP error correction.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, will be described below to embodiment required
Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments invented, for this field
For those of ordinary skill, without creative efforts, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of flow diagram for the CDN distribution method for saving bandwidth resources of the present invention；
Fig. 2 is the process that edge machine M is transmitted to an edge group of planes in a kind of CDN distribution method for saving bandwidth resources of the present invention
Schematic diagram；
Fig. 3 is that edge machine M sends HTTP request progress error correction in a kind of CDN distribution method for saving bandwidth resources of the present invention
Flow diagram.
Specific embodiment
In order to be easy to understand the technical means, the creative features, the aims and the efficiencies achieved by the present invention, below will
In conjunction with attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
It is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill
Personnel's all other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
A kind of CDN distribution method of saving bandwidth resources as shown in Figure 1, includes the following steps:
Step 1, central host core network in a manner of http protocol content distribution to by edge machine 1, edge
Any one edge of table in an edge group of planes for machine 2 ... edge machine N composition is defined as edge machine M along machine；
Step 2, edge machine M finish content reception, then again content by special package, finally use UDP multicast
Mode is transmitted to an edge group of planes, wherein the group of planes is made of edge machine 1, edge machine 2 ... edge machine N；
After step 3, other edge machines receive the data of edge machine M transmission, decapsulation analysis is carried out to data packet, then
Removal repeats UDP packet, resequences to UDP bag data, then store into single file, is surrounded by loss if received, marks
Remember that the content malfunctions；
Any one edge of table is defined as edge machine a, the edge machine a reception content, to interior along machine in step 4, the group of planes
Hold after receiving, if having error in content UDP distribution procedure, HTTP request is sent to edge machine M and carries out error correction, it is right
Error file, which re-downloads, to be repaired.
Special package includes following mode in the step 2:
Loadtype, 1 byte representation of the loadtype, if it is header information that value, which is 0 expression load, if value is 1
It is expressed as the content of load；
Payload length, 2 byte representations of the payload length indicate the length of load；
File index, 4 byte representations of the file index indicate file unique identification, wherein the mark is by 32
Position MD5 encrypts file name and generates；
Packet index, the packet index 4 byte representations, indicate that the packet is the distribution serial number of the content；
File size, 8 byte representations of the file size indicate this document size, and a file includes Y negative
It carries, wherein Y is greater than or equal to 1；
Load, 1316 byte representations of the load, each encapsulation package maximum carry 1316 byte load contents, such as
Fruit loadtype is 0, then load contents are file name；If loadtype is 1, load is file content.
Analysis is decapsulated in the step 3, is specifically included: determining that the packet received belongs to header information according to loadtype
Or load contents, while determining which file the load received belongs to according to file index, it is connect by packet index determination
Whether the data received lead to the problem of repetition, packet loss, random ordering.
The step 2 edge machine M as shown in Figure 2 is transmitted in an edge group of planes, is specifically comprised the following steps:
Step 2.1 obtains the file information: mainly obtaining file name, file size；
Step 2.2, encapsulation head packet, comprising:
Loadtype: being worth is 0；
Payload length: file name length；
File index: file name is encrypted by 32 MD5 and is generated；
Packet index: being worth is 0；
File size: the file size of acquisition；
Load: file name, maximum length is no more than 1316 bytes；
Step 2.3, encapsulated content packet, comprising:
Loadtype: being worth is 1；
Payload length: the actual length of content；
File index: file name is encrypted by 32 MD5 and is generated；
Packet index: incremented by successively since 1；
File size: the file size of acquisition；
Load: file content, maximum length is no more than 1316 bytes；
Step 2.4, UDP send header information, and sending and successfully then reading 1316 bytes is load, otherwise return step
2.3；
Step 2.5, encapsulation load contents packet；
Step 2.6, UDP send load contents packet, terminate if less than 1316 bytes of content packet, otherwise return step
2.4。
The step 4 as shown in Figure 3 sends HTTP request to edge machine M and specifically comprise the following steps: in error correction
Downloading file is requested by http protocol to edge machine M according to header information；Terminate if error correction success, otherwise retry three times,
Show that error correction fails if continuing failure.
Wherein about term: CDN is content distributing network, and HTTP is hyper text protocol, and UDP is User Datagram Protocol,
It is industry universal term, no longer describes herein.
Present invention disclosed above preferred embodiment is only intended to help to illustrate the present invention.There is no detailed for preferred embodiment
All details are described, are not limited the invention to the specific embodiments described.Obviously, according to the content of this specification,
It can make many modifications and variations.These embodiments are chosen and specifically described to this specification, is in order to better explain the present invention
Principle and practical application, so that skilled artisan be enable to better understand and utilize the present invention.The present invention is only
It is limited by claims and its full scope and equivalent.
Claims (5)
1. a kind of CDN distribution method for saving bandwidth resources, which comprises the steps of:
Step 1, central host core network in a manner of http protocol content distribution to by edge machine 1, edge machine
Any one edge of table in an edge group of planes for 2 ... edge machine N composition is defined as edge machine M along machine；
Step 2, edge machine M finish content reception, then again content by special package, finally use UDP multicast mode
It is transmitted to an edge group of planes；
After step 3, other edge machines receive the data of edge machine M transmission, decapsulation analysis is carried out to data packet, is then removed
UDP packet is repeated, is resequenced to UDP bag data, then store into single file, is surrounded by loss if received, label should
Content error；
Any one edge of table is defined as edge machine a along machine in step 4, the group of planes, and the edge machine a reception content connects to content
After receipts, if having error in content UDP distribution procedure, HTTP request is sent to edge machine M and carries out error correction, to error
File, which re-downloads, to be repaired.
2. a kind of CDN distribution method for saving bandwidth resources according to claim 1, which is characterized in that in the step 2
Special package includes following mode:
Loadtype, 1 byte representation of the loadtype, if it is header information that value, which is 0 expression load, if value indicates for 1
For the content of load；
Payload length, 2 byte representations of the payload length indicate the length of load；
File index, 4 byte representations of the file index indicate file unique identification, wherein the mark is by 32 MD5
File name is encrypted and is generated；
Packet index, the packet index 4 byte representations, indicate that the packet is the distribution serial number of the content；
File size, 8 byte representations of the file size indicate this document size, and a file includes Y load,
Middle Y is greater than or equal to 1；
Load, 1316 byte representations of the load, each encapsulation package maximum carry 1316 byte load contents, if negative
Carrying type is 0, then load contents are file name；If loadtype is 1, load is file content.
3. a kind of CDN distribution method for saving bandwidth resources according to claim 1, which is characterized in that in the step 3
Decapsulation analysis, specifically includes: determining that the packet received belongs to header information or load contents, while root according to loadtype
It determines which file the load received belongs to according to file index, determines whether the data received generate weight by packet index
Multiple, packet loss, out-of-order problem.
4. a kind of CDN distribution method for saving bandwidth resources according to claim 1, which is characterized in that step 2 side
It is transmitted in an edge group of planes, specifically comprises the following steps: along machine M
Step 2.1 obtains the file information: mainly obtaining file name, file size；
Step 2.2, encapsulation head packet, comprising:
Loadtype: being worth is 0；
Payload length: file name length；
File index: file name is encrypted by 32 MD5 and is generated；
Packet index: being worth is 0；
File size: the file size of acquisition；
Load: file name, maximum length is no more than 1316 bytes；
Step 2.3, encapsulated content packet, comprising:
Loadtype: being worth is 1；
Payload length: the actual length of content；
File index: file name is encrypted by 32 MD5 and is generated；
Packet index: incremented by successively since 1；
File size: the file size of acquisition；
Load: file content, maximum length is no more than 1316 bytes；
Step 2.4, UDP send header information, and sending and successfully then reading 1316 bytes is load, otherwise return step 2.3；
Step 2.5, encapsulation load contents packet；
Step 2.6, UDP send load contents packet, terminate if less than 1316 bytes of content packet, otherwise return step 2.4.
5. a kind of CDN distribution method for saving bandwidth resources according to claim 1, which is characterized in that the step 4 is right
Edge machine M sends HTTP request and carries out specifically comprising the following steps: to pass through HTTP to edge machine M according to header information in error correction
Agreement request downloads file；Terminate if error correction success, otherwise retry three times, shows that error correction fails if continuing failure.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810811579.8A CN108933835A (en) | 2018-07-23 | 2018-07-23 | A kind of CDN distribution method for saving bandwidth resources |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810811579.8A CN108933835A (en) | 2018-07-23 | 2018-07-23 | A kind of CDN distribution method for saving bandwidth resources |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108933835A true CN108933835A (en) | 2018-12-04 |
Family
ID=64444120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810811579.8A Pending CN108933835A (en) | 2018-07-23 | 2018-07-23 | A kind of CDN distribution method for saving bandwidth resources |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108933835A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112738149A (en) * | 2019-10-29 | 2021-04-30 | 贵州白山云科技股份有限公司 | Data transmission system and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1697354A (en) * | 2005-06-17 | 2005-11-16 | 顾红波 | Method for reliable transmitting data through multicast and unicast protocol, and host of receiving data |
| CN102404648A (en) * | 2011-12-05 | 2012-04-04 | 深圳市同洲视讯传媒有限公司 | Content distribution system and method |
| CN105468685A (en) * | 2015-11-16 | 2016-04-06 | 东软集团股份有限公司 | Message processing method and device |
| US20160241629A1 (en) * | 2015-02-17 | 2016-08-18 | Aver Information Inc. | File transfer method |
| CN106034140A (en) * | 2015-03-10 | 2016-10-19 | 中兴通讯股份有限公司 | Pushing processing method and pushing processing device |
| CN107105013A (en) * | 2017-03-28 | 2017-08-29 | 北京洋浦伟业科技发展有限公司 | Processing method, server, terminal and the system of file |
| CN108155999A (en) * | 2017-12-27 | 2018-06-12 | 罗建平 | The intelligent UDP Multicast Files dissemination system and method for machine contracting system are mended with TCP |
-
2018
- 2018-07-23 CN CN201810811579.8A patent/CN108933835A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1697354A (en) * | 2005-06-17 | 2005-11-16 | 顾红波 | Method for reliable transmitting data through multicast and unicast protocol, and host of receiving data |
| CN102404648A (en) * | 2011-12-05 | 2012-04-04 | 深圳市同洲视讯传媒有限公司 | Content distribution system and method |
| US20160241629A1 (en) * | 2015-02-17 | 2016-08-18 | Aver Information Inc. | File transfer method |
| CN106034140A (en) * | 2015-03-10 | 2016-10-19 | 中兴通讯股份有限公司 | Pushing processing method and pushing processing device |
| CN105468685A (en) * | 2015-11-16 | 2016-04-06 | 东软集团股份有限公司 | Message processing method and device |
| CN107105013A (en) * | 2017-03-28 | 2017-08-29 | 北京洋浦伟业科技发展有限公司 | Processing method, server, terminal and the system of file |
| CN108155999A (en) * | 2017-12-27 | 2018-06-12 | 罗建平 | The intelligent UDP Multicast Files dissemination system and method for machine contracting system are mended with TCP |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112738149A (en) * | 2019-10-29 | 2021-04-30 | 贵州白山云科技股份有限公司 | Data transmission system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017012510A1 (en) | Method and device for transmitting flexible ethernet service flow | |
| US9154587B2 (en) | RoCE packet sequence acceleration | |
| CN103428226B (en) | Method and system for communication of user state and inner core | |
| US20060274788A1 (en) | System-on-a-chip (SoC) device with integrated support for ethernet, TCP, iSCSI, RDMA, and network application acceleration | |
| CN104580011B (en) | A kind of data forwarding device and method | |
| CN106790675A (en) | Load-balancing method, equipment and system in a kind of cluster | |
| US9356863B2 (en) | Communications over multiple protocol interfaces in a computing environment | |
| CN100469002C (en) | Data block transmission method | |
| CN105099938B (en) | The determination method and apparatus of congestion window in network | |
| WO2012083654A1 (en) | Method and distributed system for processing internet protocol packet fragments | |
| US8179795B2 (en) | Communication terminal apparatus, distribution apparatus, error notification method, and error notification program | |
| EP2439890A1 (en) | Method and system for processing mobile multimedia data broadcasting service | |
| CN108933835A (en) | A kind of CDN distribution method for saving bandwidth resources | |
| CN102780633A (en) | Device and method for transmitting data based on CAPWAP (control and provisioning of wireless access points) protocol | |
| CN103051738B (en) | A kind of dhcp address distribution method and system | |
| CN106686410B (en) | HLS flow-medium transmission method and device | |
| WO2019034061A1 (en) | Data transmission method, device and system | |
| US20040267960A1 (en) | Force master capability during multicast transfers | |
| WO2014190843A1 (en) | Input parameter generation method and device | |
| US8661173B2 (en) | USB data striping | |
| CN105263165B (en) | A kind of network data based on FPGA connects packet method for splitting | |
| CN117579555A (en) | Data transmission method, computing device and system | |
| CN105763480B (en) | A kind of device and method for realizing stream sampling based on FPGA | |
| CN106102101A (en) | Processing method that a kind of WAP is connected with Radio Access Controller and system | |
| CN101252526B (en) | Flow control method as well as VPWS network system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181204 |