CN104104727A - Raptor code based large file transmission method - Google Patents
Raptor code based large file transmission method Download PDFInfo
- Publication number
- CN104104727A CN104104727A CN201410353459.XA CN201410353459A CN104104727A CN 104104727 A CN104104727 A CN 104104727A CN 201410353459 A CN201410353459 A CN 201410353459A CN 104104727 A CN104104727 A CN 104104727A
- Authority
- CN
- China
- Prior art keywords
- redundancy
- transmission
- raptor code
- transmitting
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a raptor code based large file transmission method. According to the raptor code based large file transmission method, according to transmission characteristics of large files, the files to be transmission are subjected to partitioning processing and pre-coding by means of raptor codes, head information is re-designed, and transmission of the files with the capacity of 1000GB at the most can be supported by means of the 8-bit head information. According to the raptor code based large file transmission method, by means of a dynamic transmission redundancy generation mechanism, real-time dynamic regulation is performed according to changes of channels; the influence of channel delay and channel packet loss probability on large file transmission in a bidirectional feedback channel is eliminated, and transmission stability and efficiency of large files are improved.
Description
Technical field
The present invention relates to a kind of large document transmission method of communication technical field, particularly a kind of large document transmission method based on Raptor code.
Background technology
File is as the citation form of people's storage and swap data, development along with multimedia technology, several important change have been there are, by text, picture, to audio frequency and video, changed in terms of content, by low resolution, to high-resolution, changed qualitatively, on capacity, by small documents, to large file, changed, the result of bringing is thus that the switching requirement of the large capacity documents such as high definition picture, video and audio is growing.Different from small documents transmission is, the probability that large file (file of the capacity that refers generally to more than 1GB) transmission is subject to channel error interference significantly increases, and because transmission latency is longer, for efficiency of transmission, have relatively high expectations, therefore, how taking into account efficiency of transmission and transmission reliability, is the problem that large file transfer must solve.
The large related transmission channel of file can be divided into wire message way (the Internet, special line etc.) and wireless channel (satellite, terrestrial wireless transmission etc.) from transmission medium, from Transport endpoint, quantitatively can be divided into point-to-point transmission and point-to-multipoint transmission, from transmission direction, can be divided into one-way transmission and transmitted in both directions.Traditional file transfer adopts Transmission Control Protocol to transmit on the internet, thereby guarantees transmission reliability, but because conditions such as being subject to transmission delay and packet loss affects, easily occurs the unsettled situation of transmission when large file transfer, and efficiency of transmission is lower.In the broadcasting unidirectional transmission such as satellite, terrestrial wireless, conventionally adopt the mode that repeats to send to carry out transmission reliability assurance, to each file, send more than at least 2 times, transmission rate is stable but efficiency of transmission is low, especially in the broadcast mode of point-to-multipoint, because the situation of each receiving node lost data packets is different, cannot meet the transmission differentiated demand under different channels quality.
Raptor code is a kind of digital fountain code of being developed by people such as Shokrollahi, with respect to traditional forward error correction coding, there is the characteristic without code check, can from the raw data symbols of regular length, encode and produce the channel symbol of random length, realize the dynamic adjustments of transmitting redundancy, through optimization process, can obtain the efficiency of transmission close to channel capacity.At present, Raptor code is mainly used in the multicast application of low volume data in wireless transmitting system, has been included in the standards such as 3GPP, as the forward error correction of data multicast service.
In large file transfer, introduce Raptor code, can effectively improve efficiency of transmission, but the initial design of Raptor code is only aimed at small documents and (is generally no more than 10MB, as picture file in wireless data multicast service etc.), for large file transfer, lack well and support, thereby need to encryption algorithm be revised accordingly and be optimized, adopt suitable Transmission Control Strategy, transmission reliability and efficiency of transmission when improving large file transfer.
Summary of the invention
The present invention is directed to the deficiency of existing large document transmission method efficiency of transmission, proposed a kind of efficient, large document transmission method based on Raptor code.
For achieving the above object, the present invention adopts following technical scheme.
A kind of large document transmission method based on Raptor code of the present invention comprises the following steps:
The first step, according to transmission channel characteristics, sets initial transmitting redundancy degree value.
Second step, transmitting terminal is according to data packet length parameter T, the block count of calculation document, and file is carried out to piecemeal processing, for the data block of inadequate monoblock length, at afterbody, carry out zero filling and supplement.
The 3rd step, transmitting terminal reads the initial data of a piecemeal, carries out Raptor code coding and processes, and reads initial data successively, and fill header information by bag simultaneously, then sends.
The 4th step, after the initial data of each piecemeal is sent completely, continues to send the redundant data packets that this block encoding produces.
The 5th step, receiving terminal, after receiving the total data of each piecemeal (comprising raw data packets and redundant data packets), carries out the decoding of Raptor code and processes, and for there being feedback channel, receiving terminal feeds back to status monitoring end by the block data bag sum receiving.
The 6th step, for there being feedback channel, status monitoring end is collected the back information of each receiving node (one or more), carries out integrated treatment, to transmitting terminal feedback redundancy adjusted value.
The 7th step, transmitting terminal, after each piecemeal is sent, checks the redundancy adjusted value being fed back by status monitoring end, carries out the dynamic adjustment of transmitting redundancy degree parameter, adopts the redundant data packets of new transmitting redundancy parameter generating respective numbers when new piece transmission.
The 8th step, transmitting terminal sends after all piecemeals of file, checks the transmission integrity of whole file, if transmission success is carried out the transmission of next file.
Through above-mentioned eight steps, completed a transmitting procedure of the large document transmission method based on Raptor code.
The beneficial effect that the present invention produces is:
1, the present invention is by introducing Raptor code in large file transfer, two-way, channel latency and channel packet loss dropped in having feedback channel minimumly on the impact of efficiency of transmission, improved the large file transfer stability under long-distance transmissions and sound cross network transmission condition.
2, the present invention assesses the quality of reception by introducing status monitoring end, has realized the dynamic optimization configuration of transmitting redundancy degree, has improved the efficiency of transmission of large file transfer.
3, the present invention is by having added the piecemeal of file to process, and supports the large file transfer that heap(ed) capacity is 100GB, by the optimizing and revising of data packet header information, reduces head expense simultaneously.
Accompanying drawing explanation
Fig. 1 is the connection diagram of each transmission node in the present invention;
Fig. 2 is the theory diagram of transmitting procedure in the present invention;
Fig. 3 is channel transmission data pack arrangement schematic diagram in the present invention;
Fig. 4 is the flow chart of status monitoring end redundancy adjusted value production process in the present invention;
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in further details, but does not limit in any form the present invention.Embodiment based in the present invention, those of ordinary skills carry out other embodiment that some distortion and improvement obtain not making under creative work prerequisite, all belong to the scope of protection of the invention.
Fig. 1 is the connection schematic diagram of each transmission node of relating in the present invention, wherein transmitting terminal carries out one-way transmission to one or more receiving nodes, in satellite transmission and terrestrial wireless transmission, adopt broadcast mode to transmit, in the Internet, adopt udp protocol to carry out multicast or unicast transmission, it should be noted that, in other two-way channels, even if exist receiving terminal to the return path of transmitting terminal, also should avoid employing as the reliable connected mode of Transmission Control Protocol, and only should adopt the mode of one-way transmission.In having the receiving terminal of feedback channel, each receiving terminal is reliably connected with status monitoring end by feedback channel, and meanwhile, status monitoring end also needs to set up reliable connection with transmitting terminal.
After completing as the connected mode of Fig. 1, the present embodiment completes large file transfer by the transmitting procedure shown in Fig. 2.Before transmitting procedure starts, first transformation parameter is carried out to initial configuration, comprise packet payload length T and transmitting redundancy degree parameter etc.Wherein transmitting redundancy degree parameter choose the average packet loss ratio p that Main Basis transmission channel is known, establishing transmitting redundancy degree parameter is d, the initialization value of d is
the redundancy packet quantity that coding produces is
symbol wherein
expression rounds up.When transmission starts, first calculate the block count n of large file, computing formula is
wherein s is file size, and unit is byte.After completing deblocking, for the identical processing procedure for data acquisition of each piece.First reading length is the data of of 8192 * T byte, consider the scramble time expense of Raptor code, now carry out two operations simultaneously, first operation is the data of this piece to be carried out to the encoding operation of Raptor code, and according to the redundant data packets of redundancy value generation respective numbers, be stored in and send in buffer memory; Second operation is the initial data that reads successively T byte, and the corresponding packet head information of adding, and forms raw data packets, then carries out Packet Generation, after sending all raw data packets, then carries out the transmission of redundant data packets.In order further to reduce the expense of Raptor coding, in the present invention, the configuration of the header information of packet as shown in Figure 3, totally 8 bytes, wherein 2 byte file number are the numbering of transfer files, 2 piecemeal quantity that byte block count is each file, maximum support piecemeal is 65535, and 2 block of bytes number are the piecemeal under packet, 2 numberings that byte Bale No. is each packet.The length of payload can be selected arbitrarily, generally gets 1400 bytes, and coding head expense is now about 0.6%.After transferring a blocks of data, transmitting terminal detects redundancy adjusted value, and calculates the new redundancy parameter of generation.
Receiving terminal, after receiving a blocks of data, carries out the decode operation of Raptor code, and the evaluation information using the overall budget number receiving as reception condition feeds back to status monitoring end simultaneously.Status monitoring end, after collecting all feedback informations, carries out the calculating of redundancy adjusted value.The computational process of redundancy adjusted value as shown in Figure 4, after collecting feedback information, first calculate maximum number of dropped packets and the average number of dropped packets of all nodes, and obtain the ratio of maximum number of dropped packets and average number of dropped packets, then compare with predefined abnormal ratio value, if be less than abnormal ratio value, select maximum number of dropped packets as redundancy adjusted basis, make the adjustment of redundancy can cover all receiving nodes, if surpass abnormal ratio value, illustrate that paroxysmal packet loss mistake has appearred in certain node, select average number of dropped packets as redundancy adjusted basis, abnormal ratio value generally elects 3 as, be that maximum number of dropped packets is thought while surpassing 3 times of average number of dropped packets and occurred paroxysmal packet loss.Finally according to give out a contract for a project quantity and redundancy adjusted basis of transmitting terminal, calculate the ratio that redundancy is adjusted, generate corresponding redundancy adjusted value.
Claims (3)
1. the large document transmission method based on Raptor code, is characterized in that, comprises the following steps:
The first step, according to transmission channel characteristics, sets initial transmitting redundancy degree value.
Second step, transmitting terminal is according to data packet length parameter T, the block count of calculation document, and file is carried out to piecemeal processing, for the data block of inadequate monoblock length, at afterbody, carry out zero filling and supplement.
The 3rd step, transmitting terminal reads the initial data of a piecemeal, carries out Raptor code coding and processes, and reads initial data successively, and fill header information by bag simultaneously, then sends.
The 4th step, after the initial data of each piecemeal is sent completely, continues to send the redundant data packets that this block encoding produces.
The 5th step, receiving terminal, after receiving the total data of each piecemeal (comprising raw data packets and redundant data packets), carries out the decoding of Raptor code and processes, and for there being feedback channel, receiving terminal feeds back to status monitoring end by the block data bag sum receiving.
The 6th step, for there being feedback channel, status monitoring end is collected the back information of each receiving node (one or more), carries out integrated treatment, to transmitting terminal feedback redundancy adjusted value.
The 7th step, transmitting terminal, after each piecemeal is sent, checks the redundancy adjusted value being fed back by status monitoring end, carries out the dynamic adjustment of transmitting redundancy degree parameter, adopts the redundant data packets of new transmitting redundancy parameter generating respective numbers when new piece transmission.
The 8th step, transmitting terminal sends after all piecemeals of file, checks the transmission integrity of whole file, if transmission success is carried out the transmission of next file.
2. the large document transmission method based on Raptor code according to claim 1, is characterized in that, adopts the packet head of 8 bytes, and wherein 2 bytes are document number, and 2 bytes are block count, and 2 bytes are piecemeal number, and 2 bytes are Bale No..
3. the large document transmission method based on Raptor code according to claim 1, it is characterized in that, adopt the parameter adjustment of dynamic transmitting redundancy degree, by status monitoring end, gather receiving node information, and calculate redundancy adjusted value and feed back to transmitting terminal, the computational process of redundancy adjusted value is as follows:
The first step, calculates maximum number of dropped packets and the average number of dropped packets of all nodes, and obtains the ratio value of maximum number of dropped packets and average number of dropped packets;
Second step, compares the ratio value calculating and predefined abnormal ratio value, if be less than abnormal ratio value, selects maximum number of dropped packets as redundancy adjusted basis, if surpass abnormal ratio value, selects average number of dropped packets as redundancy adjusted basis;
The 3rd step, calculates according to give out a contract for a project quantity and redundancy adjusted basis of transmitting terminal the ratio that redundancy is adjusted, and generates redundancy adjusted value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410353459.XA CN104104727B (en) | 2014-07-24 | 2014-07-24 | Raptor code based large file transmission method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410353459.XA CN104104727B (en) | 2014-07-24 | 2014-07-24 | Raptor code based large file transmission method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104104727A true CN104104727A (en) | 2014-10-15 |
| CN104104727B CN104104727B (en) | 2017-05-17 |
Family
ID=51672526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410353459.XA Active CN104104727B (en) | 2014-07-24 | 2014-07-24 | Raptor code based large file transmission method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104104727B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105827700A (en) * | 2016-03-15 | 2016-08-03 | 北京金山安全软件有限公司 | Dynamic file transmission method and device and electronic equipment |
| CN105897382A (en) * | 2016-06-08 | 2016-08-24 | 乐视控股（北京）有限公司 | Data synchronization method and device |
| CN105959085A (en) * | 2016-06-29 | 2016-09-21 | 北京工业大学 | Short-wave communication two-way transmission mode based on fountain code |
| CN108882026A (en) * | 2018-06-15 | 2018-11-23 | 深圳市茁壮网络股份有限公司 | A kind of big document transmission method and device based on TS stream |
| CN110740135A (en) * | 2019-10-21 | 2020-01-31 | 湖南新云网科技有限公司 | Same-screen data transmission method, device and system for multimedia classrooms |
| CN110856144A (en) * | 2019-10-22 | 2020-02-28 | 西安交通大学 | LT code-based atomization caching method in mobile edge computing network |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350699B (en) * | 2008-09-05 | 2012-02-08 | 清华大学 | Method for distributing information based on increment fountain |
| CN101814923B (en) * | 2009-02-20 | 2013-09-11 | 华为技术有限公司 | Method and device for decoding fountain codes |
| CN102013951A (en) * | 2010-12-22 | 2011-04-13 | 北京理工大学 | Wireless communication network coding method using fountain codes |
-
2014
- 2014-07-24 CN CN201410353459.XA patent/CN104104727B/en active Active
Non-Patent Citations (2)
| Title |
|---|
| YAHUI XUE, FEIFEI WANG AND JIAN WANG: "An Efficient Network Transmission Design Based on Raptor Code", 《IEEE THIRD INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY》 * |
| 石东新等: "3GPP MBMS中Raptor编解码研究", 《数据采集与处理》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105827700A (en) * | 2016-03-15 | 2016-08-03 | 北京金山安全软件有限公司 | Dynamic file transmission method and device and electronic equipment |
| CN105897382A (en) * | 2016-06-08 | 2016-08-24 | 乐视控股（北京）有限公司 | Data synchronization method and device |
| CN105959085A (en) * | 2016-06-29 | 2016-09-21 | 北京工业大学 | Short-wave communication two-way transmission mode based on fountain code |
| CN105959085B (en) * | 2016-06-29 | 2019-06-14 | 北京工业大学 | Short wave communication transmitted in both directions mode based on fountain codes |
| CN108882026A (en) * | 2018-06-15 | 2018-11-23 | 深圳市茁壮网络股份有限公司 | A kind of big document transmission method and device based on TS stream |
| CN110740135A (en) * | 2019-10-21 | 2020-01-31 | 湖南新云网科技有限公司 | Same-screen data transmission method, device and system for multimedia classrooms |
| CN110856144A (en) * | 2019-10-22 | 2020-02-28 | 西安交通大学 | LT code-based atomization caching method in mobile edge computing network |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104104727B (en) | 2017-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104104727A (en) | Raptor code based large file transmission method | |
| CN101359981B (en) | Method, apparatus and system for data packet redundant encoding and decoding | |
| CN101686107B (en) | Streaming and buffering using variable FEC overhead and protection periods | |
| CN101714915B (en) | Data retransmission method and system | |
| CN101562781B (en) | Self-adapting fountain code multicast transmission system based on modulation | |
| EP2766995B1 (en) | Encoding apparatus and encoding method in data communication system | |
| CN100592670C (en) | System and method for controlling self-adaptive forward error dynamically in IPTV network | |
| CN101938334B (en) | Adaptive error control method combining random network coding and automatic repeat request | |
| CN103023813B (en) | Wobble buffer | |
| CN104081702A (en) | Device and method for transmitting/receiving packet in communication system | |
| CN102638331B (en) | Wireless reliable broadcasting method based on random linear network code | |
| CN108183774A (en) | The forward error correction and system of a kind of streaming media | |
| CN103858370A (en) | Apparatus and method for transmitting/receiving forward error correction packet in mobile communication system | |
| CN106656422A (en) | Streaming media transmission method capable of dynamically regulating redundancy of FEC (Forward Error Correction) | |
| CN109510687A (en) | A kind of fountain code encoding method based on satellite communication | |
| CN1479976A (en) | Apparatus and method for providing optimal self-adaptive forward error correction in communication system | |
| CN103201976A (en) | Packet-level erasure protection coding in aggregated packet transmissions | |
| US10020914B2 (en) | Methods and apparatus for maximum utilization of a dynamic varying digital data channel | |
| US20140019830A1 (en) | Joint application-layer forward error/erasure correction (FEC) and video coding | |
| CN102804661A (en) | Block aggregation of objects in a communication system | |
| CN106603192A (en) | Adaptive FEC mechanism based on media content | |
| CN106416154A (en) | Method and apparatus for transmitting and receiving packets in broadcast and communication system | |
| CN103944676A (en) | MLT code coding and decoding method based on deep space communication environment | |
| CN109274462B (en) | Image transmission method based on improved online fountain codes | |
| US10833710B2 (en) | Bandwidth efficient FEC scheme supporting uneven levels of protection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |