CN107302523A - A kind of transport stream packet loss causes the solution of mosaic - Google Patents

A kind of transport stream packet loss causes the solution of mosaic Download PDF

Info

Publication number
CN107302523A
CN107302523A CN201710384358.2A CN201710384358A CN107302523A CN 107302523 A CN107302523 A CN 107302523A CN 201710384358 A CN201710384358 A CN 201710384358A CN 107302523 A CN107302523 A CN 107302523A
Authority
CN
China
Prior art keywords
frame
data
packet loss
frames
idr
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710384358.2A
Other languages
Chinese (zh)
Other versions
CN107302523B (en
Inventor
张辉
宋晓东
刘广森
冯佳
谢庆胜
张海峰
黄继江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
XiAn Institute of Optics and Precision Mechanics of CAS
Original Assignee
XiAn Institute of Optics and Precision Mechanics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by XiAn Institute of Optics and Precision Mechanics of CAS filed Critical XiAn Institute of Optics and Precision Mechanics of CAS
Priority to CN201710384358.2A priority Critical patent/CN107302523B/en
Publication of CN107302523A publication Critical patent/CN107302523A/en
Application granted granted Critical
Publication of CN107302523B publication Critical patent/CN107302523B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/764—Media network packet handling at the destination 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS

Abstract

The present invention relates to the solution that a kind of transport stream packet loss causes mosaic.This method is all based on data receiver and handled, and comprises the following steps：1st, receiving terminal receives host-host protocol and data encapsulation format and is demultiplexing as ES；2nd, judge that data whether there is packet loss；3rd, frame type judges；4th, non-packet loss data processing；5th, packet loss data processing；The method of the present invention can effectively prevent video data mosaic caused by packet loss in transmitting procedure, no matter packet loss occurs in every IDR frame or other frame types, recovery data of the decoding end by the use of nearest decoding normal video data as anomalous video are as video frequency output, so as to evade the generation of mosaic.

Description

A kind of transport stream packet loss causes the solution of mosaic
Technical field
The invention belongs to technical field of video coding, and in particular to a kind of transport stream packet loss causes the solution party of mosaic Method.
Background technology
Video coding technique is widely used in the application scenarios such as video conference, net cast, video monitoring, its application flow Usually：
Transmitting terminal：Video acquisition->Video coding->Form encapsulation->Agreement is transmitted
Receiving terminal：Agreement reception->Video decoding->Video playback
Transmitting terminal<--- -- transmission channel --- -->Receiving terminal
It can be seen that, the medium that transmitting terminal is transmitted with receiving terminal is transmission channel, and transmission channel is divided into wireless channel and wired Channel, wireless channel is easily disturbed by environment etc., causes channel unstable, and wire message way is easily by other transmission in channel Medium influences, and causes the phenomenons such as flow spilling, so as to cause the loss of transmitting terminal video data, receiving terminal is in the incomplete video of decoding During data, picture produces the phenomenons such as mosaic, ash screen, and bad visual experience is caused to above-mentioned application scenarios.
In receiving terminal in order to solve the mosaic that data transmission exception is brought, generally there is following several method：
First method is：
For specific video encoding standard, fault-tolerant processing, such as Patent No. are added in decoding end 200810063554.0, patent name is：《The error detection and concealing method of AVS videos decoding》, the core concept of the patent It is：Video Decoder analyzes decoding data, obtains decoding the position of abnormal mosaic area, using its periphery just in decoding The macro block often decoded is recovered and substituted to mosaic area, i.e.,：Non- mosaic area recovers mosaic area, so as to reach To the purpose for eliminating and weakening mosaic.
The defect of this method is：H.264, MPEG2, AVS, H.265 this method is to rely on specific coding standard, such as Deng doing data fault-tolerant processing for the decoder of each coding standard, the technical sophistication degree of realization is higher；Further, since its Non- mosaic block replacement mosaic block is used to evading for mosaic, when video data abnormal amount is larger, due to decoding Mosaic area is larger, and this scheme can not evade mosaic, visually from the point of view of will to have bulk video area abnormal；
Second method is：
The concrete technical scheme of this method is referred to：Chinese patent, Patent No.：200680028962.1, patent name is 《Forward error correction (FEC) is encoded and streamed》, the core concept of the patent is：Transmitting terminal adds error correction after video protocols encapsulation Coding techniques, adds a certain proportion of tolerant code, data are in transmission channel during packet loss, and decoding end removes tolerant code, by video Data recovery comes out, so as to reach purpose of the decoding without mosaic.
The defect of this method is：The emphasis of this method is to rely on error correction coding, because error correction coding has necessarily Serious forgiveness, i.e., when transmission channel is excessively abnormal, Error Correction of Coding will fail；In addition, in error correction coding, for error correction What error correction code word was provided in transmitting terminal, in the case of transmitting terminal is unclear for transmission channel characteristic, using less Error correction code word is not enough to error correction, using more error correction code word, then channel width can be caused to waste.
The content of the invention
The problem of in order to solve in background technology, various video encoding standards and not are applied to the invention provides one kind The transport stream packet loss that need to rely on channel causes the solution of mosaic.
The concrete technical scheme of the present invention：
The invention provides the solution that a kind of transport stream packet loss causes mosaic, comprise the following steps：
Step 1) receiving terminal is directed to host-host protocol and data encapsulation format that transmitting terminal is transmitted, and by host-host protocol and Data encapsulation format is demultiplexing as ES；
Step 2) receiving terminal according to host-host protocol identifier, judges that each frame data that transmitting terminal transmission comes whether there is Packet loss, if packet loss data markers is designated as 1, is then first carried out step 3), then perform step 5)；If not packet loss data are then labeled as 0, then step 3 is first carried out), then perform step 4)；
Step 3) receiving terminal for demultiplexing video ES data carry out frame type judgement；The frame type comprising every IDR frame, I frames, B frames, P frames；
Step 4) non-packet loss data processing；
Step 4.1) if the frame type of present frame is every IDR frame, normally decode and cache the frame for normal decoding data；
Step 4.2) if the frame type of present frame is I frames, B frames or P frames, normally decode and update caching frame；Video is broadcast Put, and return to step 1) operations of next frame data is carried out, until all frame data are all finished；
Step 5) packet loss data processing；
If the frame type of present frame is every IDR frame, and present frame is the first frame data, then the frame does not do decoding process, marks All frames after current every IDR frame are packet loss data, until the every IDR frame of next non-packet loss performs step 4 after occurring)；
If the frame type of present frame is every IDR frame, and present frame is not the first frame data, then determines whether the IDR of caching Frame, if so, the every IDR frame data that then directly output is cached；If all frames after no, marking current every IDR frame are packet loss data, Until the every IDR frame of next non-packet loss performs step 4 after occurring)；
If the frame type of present frame is I frames, B frames or P frames, and present frame is the first frame data, then the frame is not done at decoding Reason, until the every IDR frame of next non-packet loss performs step 4 after occurring)；
If the frame type of present frame is I frames, B frames or P frames, and present frame is not the first frame data, then determines whether to delay The every IDR frame deposited, if so, the every IDR frame data that then directly output is cached；If no, present frame does not do decoding process, until next The every IDR frame of non-packet loss performs step 4 after occurring).
The beneficial effects of the invention are as follows：
1st, the invention provides a whole set of method and specification, video data packet loss in transmitting procedure can effectively be prevented Caused mosaic, no matter packet loss occurs in every IDR frame or other frame types, and decoding end utilizes nearest decoding normal video number According to the recovery data as anomalous video as video frequency output, so as to evade the generation of mosaic.
2nd, the invention is widely used in various video encoding standards relative to the first method of prior art, it is not necessary to pin Fault-tolerant processing is done to special decoder
3rd, the invention will not cause redundant data relative to the second method of prior art independent of channel to channel Load.
4. the invention relative to prior art the first, second method, can be suitably used for various decoding process scenes, wrap Containing result of broadcast improvement, secondary decoding in coding etc., applicable scene is more diversified.
Brief description of the drawings
Fig. 1 is flow chart of the method for the present invention；
Fig. 2 is the flow chart that there is packet loss processing in GOP.
Embodiment
The effect of the present invention is to be directed in video coding process to occur how handling the image that mosaic is brought after mosaic Excalation or unsharp problem, the flow of Video processing are as follows：
The main flow that transmitting terminal is performed includes：
Step 1) transmitting terminal is acquired to video data；
Step 2) transmitting terminal collection video data encoded；
Step 3) transmitting terminal enters row format encapsulation to the video data after coding and agreement is transmitted
The main flow that receiving terminal is performed includes：
Step 4) receiving terminal passes host-host protocol and data encapsulation format for transmitting terminal, and by host-host protocol and data Encapsulation format is demultiplexing as ES；
Step 5) receiving terminal according to host-host protocol identifier, judges that each frame data that transmitting terminal transmission comes whether there is Packet loss, if packet loss data markers is designated as 1, is then first carried out step 6), then perform step 8)；If not packet loss data are then labeled as 0, then step 6 is first carried out), then perform step 7)；
Step 6) receiving terminal for demultiplexing video ES data carry out frame type judgement；The frame type comprising every IDR frame, I frames, B frames, P frames；
Step 7) non-packet loss data processing；
Step 7.1) if the frame type of present frame is every IDR frame, normally decode and cache the frame for normal decoding data；
Step 7.2) if the frame type of present frame is I frames, B frames or P frames, normally decode and update caching frame；Video is broadcast Put, and return to step 4) operations of next frame data is carried out, until all frame data are all finished；
Step 8) packet loss data processing；
If the frame type of present frame is every IDR frame, and present frame is the first frame data, then the frame does not do decoding process, marks All frames after current every IDR frame are packet loss data, until the every IDR frame of next non-packet loss performs step 7 after occurring)；
If the frame type of present frame is every IDR frame, and present frame is not the first frame data, then determines whether the IDR of caching Frame, if so, the every IDR frame data that then directly output is cached；If all frames after no, marking current every IDR frame are packet loss data, Until the every IDR frame of next non-packet loss performs step 7 after occurring)；
If the frame type of present frame is I frames, B frames or P frames, and present frame is the first frame data, then the frame is not done at decoding Reason, until the every IDR frame of next non-packet loss performs step 7 after occurring)；
If the frame type of present frame is I frames, B frames or P frames, and present frame is not the first frame data, then determines whether to delay The every IDR frame deposited, if so, the every IDR frame data that then directly output is cached；If no, present frame does not do decoding process, until next The every IDR frame of non-packet loss performs step 7 after occurring).

Claims (1)

1. a kind of transport stream packet loss causes the solution of mosaic, it is characterised in that comprise the following steps：
Step 1) receiving terminal is directed to host-host protocol and data encapsulation format that transmitting terminal is transmitted, and by host-host protocol and data Encapsulation format is demultiplexing as ES；
Step 2) receiving terminal according to host-host protocol identifier, judges each frame data that transmitting terminal transmission comes with the presence or absence of losing Bag, if packet loss data markers is designated as 1, is then first carried out step 3), then perform step 5)；If not packet loss data are then labeled as 0, Step 3 is then first carried out), then perform step 4)；
Step 3) receiving terminal for demultiplexing video ES data carry out frame type judgement；The frame type comprising every IDR frame, I frames, B frames, P frames；
Step 4) non-packet loss data processing；
Step 4.1) if the frame type of present frame is every IDR frame, normally decode and cache the frame for normal decoding data；
Step 4.2) if the frame type of present frame is I frames, B frames or P frames, normally decode and update caching frame；Video playback, and Return to step 1) operations of next frame data is carried out, until all frame data are all finished；
Step 5) packet loss data processing；
If the frame type of present frame is every IDR frame, and present frame is the first frame data, then the frame does not do decoding process, and mark is current All frames after every IDR frame are packet loss data, until the every IDR frame of next non-packet loss performs step 4 after occurring)；
If the frame type of present frame is every IDR frame, and present frame is not the first frame data, then determines whether the every IDR frame of caching, if Have, then the every IDR frame data that directly output is cached；If all frames after no, marking current every IDR frame are packet loss data, until The every IDR frame of next non-packet loss performs step 4 after occurring)；
If the frame type of present frame is I frames, B frames or P frames, and present frame is the first frame data, then the frame does not do decoding process, directly Step 4 is performed after to the every IDR frame appearance of next non-packet loss)；
If the frame type of present frame is I frames, B frames or P frames, and present frame is not the first frame data, then determines whether caching Every IDR frame, if so, the every IDR frame data that then directly output is cached；If no, present frame does not do decoding process, non-lost until next The every IDR frame of bag performs step 4 after occurring).
CN201710384358.2A 2017-05-26 2017-05-26 A kind of transport stream packet loss causes the solution of mosaic Active CN107302523B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710384358.2A CN107302523B (en) 2017-05-26 2017-05-26 A kind of transport stream packet loss causes the solution of mosaic

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710384358.2A CN107302523B (en) 2017-05-26 2017-05-26 A kind of transport stream packet loss causes the solution of mosaic

Publications (2)

Publication Number Publication Date
CN107302523A true CN107302523A (en) 2017-10-27
CN107302523B CN107302523B (en) 2019-08-27

Family

ID=60137826

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710384358.2A Active CN107302523B (en) 2017-05-26 2017-05-26 A kind of transport stream packet loss causes the solution of mosaic

Country Status (1)

Country Link
CN (1) CN107302523B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108924574A (en) * 2018-08-01 2018-11-30 广州视源电子科技股份有限公司 Loss treating method, device, equipment and storage medium in recording and broadcasting system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007281766A (en) * 2006-04-05 2007-10-25 Alpine Electronics Inc Image transmitter and transmission method thereof
CN101072344A (en) * 2007-03-30 2007-11-14 腾讯科技（深圳）有限公司 Video coding method, decoding method and device
CN101127918A (en) * 2007-09-25 2008-02-20 腾讯科技（深圳）有限公司 A video error tolerance control system and method
CN101389036A (en) * 2008-10-14 2009-03-18 广东威创视讯科技股份有限公司 Error correcting device suitable for video conference and method thereof
CN101420605A (en) * 2008-11-28 2009-04-29 武汉虹信通信技术有限责任公司 Video transmission control algorithm based on public digital mobile communication network
CN101547369A (en) * 2008-03-26 2009-09-30 盛大计算机（上海）有限公司 Fault tolerance method for removing mosaic phenomenon in playing network video
CN102025687A (en) * 2009-09-10 2011-04-20 浙江省公众信息产业有限公司 Method for preventing mosaic at client under condition of insufficient video decoding capability

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007281766A (en) * 2006-04-05 2007-10-25 Alpine Electronics Inc Image transmitter and transmission method thereof
CN101072344A (en) * 2007-03-30 2007-11-14 腾讯科技（深圳）有限公司 Video coding method, decoding method and device
CN101127918A (en) * 2007-09-25 2008-02-20 腾讯科技（深圳）有限公司 A video error tolerance control system and method
CN101547369A (en) * 2008-03-26 2009-09-30 盛大计算机（上海）有限公司 Fault tolerance method for removing mosaic phenomenon in playing network video
CN101389036A (en) * 2008-10-14 2009-03-18 广东威创视讯科技股份有限公司 Error correcting device suitable for video conference and method thereof
CN101420605A (en) * 2008-11-28 2009-04-29 武汉虹信通信技术有限责任公司 Video transmission control algorithm based on public digital mobile communication network
CN102025687A (en) * 2009-09-10 2011-04-20 浙江省公众信息产业有限公司 Method for preventing mosaic at client under condition of insufficient video decoding capability

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108924574A (en) * 2018-08-01 2018-11-30 广州视源电子科技股份有限公司 Loss treating method, device, equipment and storage medium in recording and broadcasting system
CN108924574B (en) * 2018-08-01 2021-07-06 广州视源电子科技股份有限公司 Packet loss processing method, device, equipment and storage medium in recording and broadcasting system

Also Published As

Publication number Publication date
CN107302523B (en) 2019-08-27

Similar Documents

Publication Publication Date Title
EP2815529B1 (en) Data packet transmission/reception apparatus and method
KR100941336B1 (en) A decoder architecture for optimized error management in streaming multimedia
CN105704580B (en) A kind of video transmission method
US10778257B2 (en) Of invention. fees transmitted by check or draft are
KR101739821B1 (en) Methods for error concealment due to enhancement layer packet loss in scalable video coding (svc) decoding
CN106656422A (en) Streaming media transmission method capable of dynamically regulating redundancy of FEC (Forward Error Correction)
WO2006111087A1 (en) H.264-based error eliminating method for compressed video transmission
US20160219318A1 (en) Information presentation device and method
CN101389036B (en) Error correcting device suitable for video conference and method thereof
CN103152576A (en) Video coding and decoding device suitable for multicast packet loss resistance
CN107147916A (en) A kind of method for transmitting H.265 encoded video data on the level of the transport layer
CN102025993A (en) Video transmission method and system based on H.264
WO2017000836A1 (en) Message transmission method and device
CN111935485A (en) RS code forward error correction method and device
CN106792247A (en) Reduce the live TV stream method for pushing and device, live broadcast system of time delay
CN101312536A (en) Video coding method and apparatus for video transmission error control
JPH02162887A (en) Correcting system for picture transmission error
CN102223544B (en) Method for processing error after detecting error in H264 video stream
CN107302523A (en) A kind of transport stream packet loss causes the solution of mosaic
US10075196B2 (en) Information processing apparatus, information processing method, and program
CN101296166B (en) Method for measuring multimedia data based on index
CN101238731A (en) Method and system for video copyright protection
US7165207B2 (en) Robust signal coding
US20130111302A1 (en) Method and apparatus for recovering burst data loss by duplicating block code symbols
CN113542804A (en) Method for detecting static frame sequence based on code stream statistical characteristics

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant