CN104104727B - Raptor code based large file transmission method - Google Patents
Raptor code based large file transmission method Download PDFInfo
- Publication number
- CN104104727B CN104104727B CN201410353459.XA CN201410353459A CN104104727B CN 104104727 B CN104104727 B CN 104104727B CN 201410353459 A CN201410353459 A CN 201410353459A CN 104104727 B CN104104727 B CN 104104727B
- Authority
- CN
- China
- Prior art keywords
- redundancy
- transmission
- raptor
- piecemeal
- yards
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 79
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000012544 monitoring process Methods 0.000 claims description 13
- 238000004364 calculation method Methods 0.000 claims description 2
- 239000013589 supplement Substances 0.000 claims description 2
- 238000007689 inspection Methods 0.000 claims 1
- 239000000047 product Substances 0.000 claims 1
- 238000012545 processing Methods 0.000 abstract description 3
- 230000002457 bidirectional effect Effects 0.000 abstract 1
- 238000000638 solvent extraction Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000001314 paroxysmal effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a raptor code based large file transmission method. According to the raptor code based large file transmission method, according to transmission characteristics of large files, the files to be transmission are subjected to partitioning processing and pre-coding by means of raptor codes, head information is re-designed, and transmission of the files with the capacity of 1000GB at the most can be supported by means of the 8-bit head information. According to the raptor code based large file transmission method, by means of a dynamic transmission redundancy generation mechanism, real-time dynamic regulation is performed according to changes of channels; the influence of channel delay and channel packet loss probability on large file transmission in a bidirectional feedback channel is eliminated, and transmission stability and efficiency of large files are improved.
Description
Technical field
It is more particularly to a kind of based on Raptor yards the present invention relates to a kind of big document transmission method of communication technical field
Big document transmission method.
Background technology
File, with continuing to develop for multimedia technology, there occurs as people's storage and the citation form of exchange data
Several important changes, are changed from text, picture to audio frequency and video in terms of content, are turned from low resolution to high-resolution in quality
Become, changed from small documents to big file on capacity, the result thus brought is the Large Copacity file such as high definition picture, video and audio
Switching requirement is growing.From unlike small documents transmission, big file (referring generally to file of the capacity in more than 1GB) transmission is received
Probability to channel error interference is significantly increased, and because transmission latency is more long, it is higher for efficiency of transmission requirement, because
How this, take into account efficiency of transmission and transmission reliability, is the problem that big file transmission has to solve.
Transmission channel involved by big file can be divided into wire message way (internet, special line etc.) and nothing from transmission medium
Line channel (satellite, ground-based wireless transmissions etc.), can be divided into point-to-point transmission and point-to-multipoint transmission from Transport endpoint quantity,
One-way transmission and transmitted in both directions can be divided into from transmission direction.Traditional file transmission is entered using Transmission Control Protocol on the internet
Row transmission, so as to ensure transmission reliability, but due to being influenceed by conditions such as transmission delay and packet loss, holds when big file is transmitted
Easily there is the unstable situation of transmission, efficiency of transmission is relatively low.In the transmission of the broadcasting unidirectionals such as satellite, terrestrial wireless, generally use
The mode for repeating to send is transmitted Reliability Assurance, and each file is sent at least more than 2 times, and transmission rate is stable but transmits
Inefficiency, especially in the broadcast mode of point-to-multipoint, because the situation of each receiving node lost data packets is different, it is impossible to full
Transmission differentiated demand under sufficient different channels quality.
Raptor yards is a kind of digital fountain code developed by Shokrollahi et al., is entangled relative to traditional forward direction
Miscoding, with the characteristic without code check, you can random length is produced with the coding from the raw data symbols of regular length
Channel symbol, realizes the dynamic regulation of transmitting redundancy, and by optimization processing, the transmission that can be obtained close to channel capacity is imitated
Rate.At present, the Raptor yards of multicast application for being mainly used in low volume data in wireless transmitting system, has been included into the mark such as 3GPP
In standard, as the forward error correction of data multicast business.
Raptor yards is introduced in the transmission of big file, efficiency of transmission can be effectively improved, but Raptor yards initial sets
Meter is literary for big just in small documents (being usually no more than 10MB, such as picture file in wireless data multicast service)
Part transmission lacks to be supported well, so that changed accordingly encryption algorithm and optimized, is controlled using suitable transmission
System strategy, to improve the transmission reliability and efficiency of transmission when big file is transmitted.
The content of the invention
Deficiency of the present invention for existing big document transmission method efficiency of transmission, it is proposed that a kind of efficient, be based on
Raptor yards of big document transmission method.
To achieve the above object, the present invention is adopted the following technical scheme that.
It is of the invention a kind of to be comprised the following steps based on Raptor yards of big document transmission method：
The first step, according to transmission channel characteristics, sets initial transmitting redundancy angle value.
Second step, transmitting terminal is carried out at piecemeal according to data packet length parameter T, the block count of calculation document to file
Reason, the data block for inadequate monoblock length carries out zero filling supplement in afterbody.
3rd step, transmitting terminal reads an initial data for piecemeal, carries out Raptor yards of coded treatment, while successively by bag
Initial data is read, and fills header information, be then transmitted.
4th step, after the initial data of each piecemeal is sent completely, continues to send the redundant digit that the block encoding is produced
According to bag.
5th step, receiving terminal is receiving the total data of each piecemeal (including raw data packets and redundant data packets)
Afterwards, Raptor yards of decoding process is carried out, for there is feedback channel, the block data bag sum that receiving terminal will be received feeds back to shape
State monitoring side.
6th step, for there is feedback channel, the back information of each receiving node (one-point or multi-point) is collected at status monitoring end,
Integrated treatment is carried out, redundancy adjusted value is fed back to transmitting terminal.
7th step, transmitting terminal checks the redundancy adjusted value fed back by status monitoring end after each piecemeal is sent,
The dynamic adjustment of redundancy parameter is transmitted, respective numbers are produced using new transmitting redundancy parameter when new block is transmitted
Redundant data packets.
8th step, after transmitting terminal has sent all piecemeals of file, checks the transmission integrity of whole file, if transmitting into
Work(then carries out the transmission of next file.
It is to complete a transmitting procedure based on Raptor yards of big document transmission method by above-mentioned eight steps.
The beneficial effect comprise that：
1st, the present invention by big file transmit in introduce Raptor yard, it is two-way have feedback channel in by channel latency with
Influence of the channel packet loss to efficiency of transmission is preferably minimized, and improves the big file under the conditions of long-distance transmissions and sound cross network transmission and passes
Defeated stability.
2nd, the present invention is estimated by introducing status monitoring end to the quality of reception, and the dynamic for realizing transmitting redundancy degree is excellent
Change configuration, improve the efficiency of transmission of big file transmission.
3rd, the present invention is processed by adding the piecemeal of file, supports that maximum capacity is transmitted for the big file of 100GB, while
Optimized and revised by data packet header information, reduce header overhead.
Brief description of the drawings
Fig. 1 is the connection diagram of each transmission node in the present invention；
Fig. 2 is the theory diagram of transmitting procedure in the present invention；
Fig. 3 is channel transmission data pack arrangement schematic diagram in the present invention；
Fig. 4 is the flow chart of status monitoring end redundancy adjusted value generation process in the present invention；
Specific embodiment
The present invention is described in further details with specific embodiment below in conjunction with the accompanying drawings, but does not limit this in any form
Invention.Based on the embodiment in the present invention, if those of ordinary skill in the art are carried out under the premise of creative work is not made
Dry deformation and the obtained other embodiment of improvement, belong to the scope of protection of the invention.
Fig. 1 is the connection schematic diagram of each transmission node being related in the present invention, and wherein transmitting terminal is to one or more
Receiving node carries out one-way transmission, is transmitted using broadcast mode in satellite transmission and ground-based wireless transmissions, in internet
In multicast or unicast transmission are then carried out using udp protocol, it is necessary to explanation, in other two-way channels, even if in the presence of reception
The return path of transmitting terminal is held, should also be avoided using the mode that is reliably connected such as Transmission Control Protocol, and only should be using one-way transmission
Mode.In the receiving terminal for having feedback channel, each receiving terminal is reliably connected by feedback channel with status monitoring end, together
When, status monitoring end is also required to foundation and is reliably connected with transmitting terminal.
After the connected mode such as Fig. 1 is completed, the present embodiment completes big file and transmits by the transmitting procedure shown in Fig. 2.
Before transmitting procedure starts, initial configuration, including data packet payload length T and transmitting redundancy degree are carried out to configured transmission first
Parameter etc..Average packet loss ratio p wherein known to the selection Main Basiss transmission channel of transmitting redundancy degree parameter, if transmitting redundancy degree
Parameter is d, then the initialization value of d isEncoding the redundancy packet quantity for producing isWherein
SymbolExpression rounds up.When transmission starts, the block count n of big file is first calculated, computing formula isWherein s is file size, and unit is byte.After deblocking is completed, the data for each piece are adopted
Use identical processing procedure.The data that length is for one piece of 8192 × T bytes are read first, it is contemplated that during Raptor yards of coding
Between expense, two operations are now carried out simultaneously, Section 1 operation is that the data of the block are carried out with Raptor yards of encoding operation, and
The redundant data packets of respective numbers are produced according to redundancy angle value, storage is in caching is sent；Section 2 operation is to be successively read T words
The initial data of section, and the corresponding data packet header information added, form raw data packets, then carry out packet transmission,
After all of raw data packets have been sent, then the transmission for carrying out redundant data packets.In order to further reduce Raptor codings
Expense, in the present invention header information configuration of packet as shown in figure 3, totally 8 byte, wherein 2 byte files number are transmission text
The numbering of part, 2 byte block counts are the piecemeal quantity of each file, and maximum supports that piecemeal is 65535 pieces, 2 block of bytes number
Piecemeal belonging to packet, 2 byte Bale No.s are the numbering of each packet.The length of payload can be selected arbitrarily, typically
1400 bytes are taken, coding header overhead now is about 0.6%.A block number is being transferred after, transmitting terminal detection redundancy is adjusted
Whole value, and calculate the new redundancy parameter of generation.
Receiving terminal is receiving a block number after, Raptor yards of decoding operate is carried out, while the total bag number that will be received
Status monitoring end is fed back to as the evaluation information of reception condition.Status monitoring end is entered after all of feedback information is collected into
The calculating of row redundancy adjusted value.The calculating process of redundancy adjusted value as shown in figure 4, after feedback information has been collected, calculate first
The maximum number of dropped packets and average number of dropped packets of all nodes, and obtain the ratio of maximum number of dropped packets and average number of dropped packets, then with advance
The unnatural proportions value for first setting is compared, and selects maximum number of dropped packets to adjust base as redundancy if less than unnatural proportions value
Number, enables the adjustment of redundancy to cover all of receiving node, illustrates that certain node is occurred in that if more than unnatural proportions value
Paroxysmal packet loss mistake, selects average number of dropped packets to adjust radix as redundancy, and unnatural proportions value is typically chosen as 3, i.e., maximum
Number of dropped packets then thinks to occur in that paroxysmal packet loss when exceeding 3 times of average number of dropped packets.Finally according to transmitting terminal give out a contract for a project quantity and
Redundancy adjustment radix carrys out the ratio of computing redundancy adjustment, generates corresponding redundancy adjusted value.
Claims (3)
1. it is a kind of based on Raptor yards of big document transmission method, it is characterised in that to comprise the following steps：
The first step, according to transmission channel characteristics, sets initial transmitting redundancy angle value；
Second step, transmitting terminal carries out piecemeal treatment according to data packet length parameter T, the block count of calculation document to file, right
In the data block of inadequate monoblock length zero filling supplement is carried out in afterbody；
3rd step, transmitting terminal reads an initial data for piecemeal, carries out Raptor yards of coded treatment, while being read by bag successively
Initial data, and header information generation raw data packets are filled, then raw data packets are transmitted；
4th step, after the raw data packets of each piecemeal are sent completely, continues to send the piecemeal by Raptor yards of coding product
Raw redundant data packets；
5th step, receiving terminal carries out Raptor yards of decoding after the raw data packets and redundant data packets for receiving each piecemeal
Treatment, for there is feedback channel, the block data bag sum that receiving terminal will be received feeds back to status monitoring end；
6th step, for there is feedback channel, status monitoring end is collected the back information of each receiving node, carries out integrated treatment, to
Transmitting terminal feeds back redundancy adjusted value；
7th step, after each piecemeal is sent, the redundancy adjusted value that inspection is fed back by status monitoring end is carried out transmitting terminal
The dynamic adjustment of transmitting redundancy degree parameter, the redundancy of respective numbers is produced when new block is transmitted using new transmitting redundancy parameter
Packet；
8th step, after transmitting terminal has sent all piecemeals of file, checks the transmission integrity of whole file, if transmission success
Carry out the transmission of next file.
2. it is according to claim 1 based on Raptor yards of big document transmission method, it is characterised in that to use 8 bytes
Data packet header, wherein 2 bytes be document number, 2 bytes be block count, 2 bytes be piecemeal number, 2 bytes be Bale No..
3. it is according to claim 1 based on Raptor yards of big document transmission method, it is characterised in that using dynamic biography
Defeated redundancy parameter adjustment, receiving node information is gathered by status monitoring end, and is calculated redundancy adjusted value and fed back to transmitting terminal,
The calculating process of redundancy adjusted value is as follows：
The first step, calculates the maximum number of dropped packets and average number of dropped packets of all nodes, and obtains maximum number of dropped packets with average number of dropped packets
Ratio value；
Second step, the ratio value that will be calculated is compared with unnatural proportions value set in advance, if less than unnatural proportions value
The maximum number of dropped packets of selection adjusts radix as redundancy, selects average number of dropped packets to be adjusted as redundancy if more than unnatural proportions value
Integral basis number；
3rd step, gives out a contract for a project quantity and the redundancy adjustment ratio that adjust come computing redundancy of radix, generation redundancy tune according to transmitting terminal
Whole value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410353459.XA CN104104727B (en) | 2014-07-24 | 2014-07-24 | Raptor code based large file transmission method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410353459.XA CN104104727B (en) | 2014-07-24 | 2014-07-24 | Raptor code based large file transmission method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104104727A CN104104727A (en) | 2014-10-15 |
| CN104104727B true CN104104727B (en) | 2017-05-17 |
Family
ID=51672526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410353459.XA Active CN104104727B (en) | 2014-07-24 | 2014-07-24 | Raptor code based large file transmission method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104104727B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105827700A (en) * | 2016-03-15 | 2016-08-03 | 北京金山安全软件有限公司 | Dynamic file transmission method and device and electronic equipment |
| CN105897382A (en) * | 2016-06-08 | 2016-08-24 | 乐视控股（北京）有限公司 | Data synchronization method and device |
| CN105959085B (en) * | 2016-06-29 | 2019-06-14 | 北京工业大学 | Short wave communication transmitted in both directions mode based on fountain codes |
| CN108882026A (en) * | 2018-06-15 | 2018-11-23 | 深圳市茁壮网络股份有限公司 | A kind of big document transmission method and device based on TS stream |
| CN110740135A (en) * | 2019-10-21 | 2020-01-31 | 湖南新云网科技有限公司 | Same-screen data transmission method, device and system for multimedia classrooms |
| CN110856144B (en) * | 2019-10-22 | 2021-09-07 | 西安交通大学 | LT code-based atomization caching method in mobile edge computing network |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350699A (en) * | 2008-09-05 | 2009-01-21 | 清华大学 | Method for distributing information based on increment fountain |
| CN101814923A (en) * | 2009-02-20 | 2010-08-25 | 华为技术有限公司 | Method and device for decoding fountain codes |
| CN102013951A (en) * | 2010-12-22 | 2011-04-13 | 北京理工大学 | Wireless communication network coding method using fountain codes |
-
2014
- 2014-07-24 CN CN201410353459.XA patent/CN104104727B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350699A (en) * | 2008-09-05 | 2009-01-21 | 清华大学 | Method for distributing information based on increment fountain |
| CN101814923A (en) * | 2009-02-20 | 2010-08-25 | 华为技术有限公司 | Method and device for decoding fountain codes |
| CN102013951A (en) * | 2010-12-22 | 2011-04-13 | 北京理工大学 | Wireless communication network coding method using fountain codes |
Non-Patent Citations (2)
| Title |
|---|
| 3GPP MBMS中Raptor编解码研究;石东新等;《数据采集与处理》;20101231;第25卷;第120-124页 * |
| An Efficient Network Transmission Design Based on Raptor Code;Yahui Xue, Feifei Wang and Jian Wang;《IEEE Third International Conference on Information Science and Technology》;20120325;第1193-1196页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104104727A (en) | 2014-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104104727B (en) | Raptor code based large file transmission method | |
| CN101359981B (en) | Method, apparatus and system for data packet redundant encoding and decoding | |
| CN101686107B (en) | Streaming and buffering using variable FEC overhead and protection periods | |
| CN101714915B (en) | Data retransmission method and system | |
| CN101562781B (en) | Self-adapting fountain code multicast transmission system based on modulation | |
| CN104081702A (en) | Device and method for transmitting/receiving packet in communication system | |
| CN102638331B (en) | Wireless reliable broadcasting method based on random linear network code | |
| CN103023813B (en) | Wobble buffer | |
| CN109510687A (en) | A kind of fountain code encoding method based on satellite communication | |
| CN101902296A (en) | Coding/decoding method and device for fountain codes | |
| CN102783074A (en) | Application layer FEC framework for WIGIG | |
| CN103858370A (en) | Apparatus and method for transmitting/receiving forward error correction packet in mobile communication system | |
| CN101826937B (en) | Link layer error control system suitable for next generation mobile Internet and method thereof | |
| CN106603192B (en) | A kind of adaptive FEC method based on media content | |
| US10020914B2 (en) | Methods and apparatus for maximum utilization of a dynamic varying digital data channel | |
| CN112422235B (en) | Network packet loss recovery method based on redundancy algorithm | |
| CN103607255A (en) | Wireless channel video communication packet loss rate control method | |
| US10833710B2 (en) | Bandwidth efficient FEC scheme supporting uneven levels of protection | |
| CN105409151B (en) | Information processing unit and information processing method | |
| CN103220086A (en) | High throughput network coding method in wireless network | |
| CN102546096A (en) | Real-time multicasting self-adaptation optimization method based on unequal error protection | |
| CN102065289B (en) | Reliable video transmission method and device based on network coding | |
| CN105827361A (en) | Media content-based FEC (Forward Error Correction) mechanism | |
| CN106603193A (en) | Media content-based FEC mechanism | |
| CN109687934A (en) | Adaptable System code FEC method, apparatus and system based on media content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240814 Address after: 313000 1213-229, floor 12, building 3, No. 1366, Hongfeng Road, Kangshan street, Huzhou City, Zhejiang Province Patentee after: Zhejiang Jichuan Information Technology Co.,Ltd. Country or region after: China Address before: 100024 Beijing City, Chaoyang District, No. 1 East Street Patentee before: COMMUNICATION University OF CHINA Country or region before: China |