CN103124380A - Real time streaming media packet loss processing scheme based on H264 - Google Patents
Real time streaming media packet loss processing scheme based on H264 Download PDFInfo
- Publication number
- CN103124380A CN103124380A CN2012104885081A CN201210488508A CN103124380A CN 103124380 A CN103124380 A CN 103124380A CN 2012104885081 A CN2012104885081 A CN 2012104885081A CN 201210488508 A CN201210488508 A CN 201210488508A CN 103124380 A CN103124380 A CN 103124380A
- Authority
- CN
- China
- Prior art keywords
- packet loss
- packet
- key frame
- real time
- processing scheme
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a real time streaming media packet loss processing scheme based on H264. The real time streaming media packet loss processing scheme comprises the processing of a receiving end and a sending end, and is mainly applied to the field of video call. The receiving end gains data and judges whether the current data is an H264 key packet. If the current data is not the key packet, whether packet loss happens between the data packet and the last analytical data packet is judged. If packet loss happens, the sending end is informed of sending a key frame immediately. The sending end sends data and simultaneously monitors the data returned by the receiving end to judge whether the returned data is a request of sending an H264 key frame, if the returned data is judged to be a request of sending an H264 key frame, coding and sending are executed immediately. According to the real time streaming media packet loss processing scheme, when pocket loss happens in an unsatisfactory network, blurred screen and appearing mosaic caused by pocket loss in the process of network transmission by timely sending the key frame can be solved to achieve a real-time and fluent video call.
Description
Technical field
The present invention relates to field of mobile communication, particularly relate to a kind of real time flow medium packet loss processing scheme based on H264.
Background technology
H.264 be the new-generation digital video compression format, it has namely kept, and advantage and the elite of compress technique had again the incomparable many advantages of other compress techniques in the past.Comprised: low code check, the employing of its compress technique will be saved user's download time and data traffic charge greatly; H.264, high-quality image can provide continuous, smooth high quality image; Fault-tolerant ability is strong, H.264 provides to solve in wrong essential tool such as the incidental packet losses of unstable net environment; Network adaptability is strong, and H.264 network abstract layer (Network Abstraction Layer) is provided, and makes file H.264 easily to transmit on heterogeneous networks.
Based on the characteristics of H264, make this technology be widely applied in the video calling field, but be subject to mobile network's bandwidth and stability problem, often Network Packet Loss can appear, and make picture in actual applications the phenomenon of flower screen and mosaic occur.Therefore the demand of real-time video call can be to realize by mobile phone terminal in order satisfying in the mobile network, in the situation that the quality that network congestion guarantees video calling occurs, a kind of new real time flow medium packet loss processing scheme based on H264 need to be to provide.
Summary of the invention
Technical problem to be solved by this invention is to provide a kind of real time flow medium packet loss processing scheme based on H264, and is undesirable at network to solve, and occurs the problem of flower screen and mosaic in Internet Transmission during packet loss, realizes the video calling of real-time smoothness.
For achieving the above object, the invention provides a kind of real time flow medium packet loss processing scheme based on H264, described scheme comprises:
Whether the bag that the receiving terminal judgement gets is the H264 key frame;
The bag that wherein gets is the real time flow medium bag of H264, and the basis for estimation of key frame is that I frame or data NAL type are sequence parameter set (SPS), picture parameter set (PPS), enhancing information (SEI), if the H264 critical packet is transferred to decoder and is decoded and show, if the bag that gets is not key frame, whether judgement exists packet loss before receiving this bag;
Wherein, if packet loss does not occur, the data of receiving are transferred to decoder and decode and show, notify transmitting terminal to send immediately key frame if packet loss has occured;
Wherein key frame is the IDR frame;
After transmitting terminal sent data, the request of monitoring reception end had judged whether to receive the request that sends immediately key frame;
If received the request that needs to send key frame, sent immediately the IDR frame.
In sum, by the real time flow medium packet loss processing scheme based on H264 provided by the invention, can be undesirable at network, when packet loss occurring, solve by timely transmission key frame the phenomenon of shielding and mosaic occurring of spending that packet loss causes in Internet Transmission, realize the video calling of real-time smoothness.
Description of drawings
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, the below will do simple the introduction to the accompanying drawing of required use in embodiment or description of the Prior Art, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Figure is schematic flow sheet in the embodiment of the present invention one.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, the present invention is further detailed explanation below in conjunction with the drawings and specific embodiments.Obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Based on the embodiment in the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
The invention provides a kind of real time flow medium packet loss processing scheme based on H264, comprise the processing of receiving terminal and transmitting terminal, be mainly used in the video calling field.Solve by timely transmission key frame the phenomenon of shielding and mosaic occurring of spending that packet loss causes in Internet Transmission, realize the video calling of real-time smoothness.
Embodiment one, referring to accompanying drawing, the method can for:
Step 101: receiving terminal obtains data by the data channel of having set up;
Step 102: judge whether to get the H264 data, if do not get execution in step 101, if get execution in step 103;
Step 103: whether the data obtained of judgement are the H264 critical packet, if execution in step 106, if not execution in step 104;
Critical packet basis for estimation in this step is that I frame or data NAL type are the packet of sequence parameter set (SPS), picture parameter set (PPS), enhancing information (SEI);
Step 104: judgement gets between this packet and last packet of resolving whether have packet loss, if there is execution in step 105 of packet loss, if packet loss execution in step 106 not;
Whether the packet loss basis for estimation in this step is identical with the sequence number of the bag of receiving at present after the sequence number of last bag of resolving increases by 1;
Step 105: abandon this packet, and the notice transmitting terminal sends key frame immediately;
Key frame in this step is the IDR frame, and the notice form is the reception report of FIR;
Step 106: resolve the H264 packet and show;
Step 201: transmitting terminal obtains data by the data channel of having set up;
Step 202: whether the data obtained of judgement are the request that sends key frame, if execution in step 203, if not execution in step 201;
Whether the request basis for estimation in this step is the reception report of FIR;
Step 203: produce key frame and send to immediately receiving terminal;
Key frame in this step is I DR frame.
Therefore, a kind of real time flow medium packet loss processing scheme based on H264 provided by the invention, solve by timely transmission key frame the phenomenon of shielding and mosaic occurring of spending that packet loss causes in Internet Transmission, network environment is undesirable quick Recovery image when having packet loss improves real-time and the fluency of video.
Those having ordinary skill in the art will appreciate that, realize that all or part of step in above-described embodiment 1 method can complete by the program command related hardware, described program can be stored in computer read/write memory medium, and described storage medium can be ROM, RAM, disk, CD etc.
The above is only the specific embodiment of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (6)
1. the real time flow medium packet loss processing scheme based on H264, is characterized in that, described method comprises:
Whether the bag that the receiving terminal judgement gets is the H264 critical packet;
If not the H264 critical packet judges between this packet and last packet of resolving whether have packet loss;
Exist packet loss to notify transmitting terminal to send immediately key frame if determine;
The request of judgement receiving terminal when transmitting terminal sends the H264 bag;
If determining is the request that the receiving terminal requirement sends key frame immediately, send immediately key frame.
2. the real time flow medium packet loss processing scheme based on H264 according to claim 1, it is characterized in that, the basis for estimation of critical packet is that I frame or data NAL type are the packet of sequence parameter set (SPS), picture parameter set (PPS), enhancing information (SEI).
3. the real time flow medium packet loss processing scheme based on H264 according to claim 1, is characterized in that, transfers to decoder and decode and show if the bag that gets is the H264 key frame.
4. the real time flow medium packet loss processing scheme based on H264 according to claim 1, is characterized in that, whether the basis for estimation of packet loss is identical with the sequence number of the bag of receiving at present after the sequence number of last bag of resolving increases by 1.
5. the real time flow medium packet loss processing scheme based on H264 according to claim 1, is characterized in that, if receiving terminal determines the data of reception not to be the H264 key frame and packet loss occurred before, these data abandon and do not carry out decoding.
6. the real time flow medium packet loss processing scheme based on H264 according to claim 1, is characterized in that, transmitting terminal receives that the receiving terminal requirement sends the request of key frame, and the key frame that transmitting terminal sends is the IDR type.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012104885081A CN103124380A (en) | 2012-11-16 | 2012-11-16 | Real time streaming media packet loss processing scheme based on H264 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012104885081A CN103124380A (en) | 2012-11-16 | 2012-11-16 | Real time streaming media packet loss processing scheme based on H264 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103124380A true CN103124380A (en) | 2013-05-29 |
Family
ID=48455205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012104885081A Pending CN103124380A (en) | 2012-11-16 | 2012-11-16 | Real time streaming media packet loss processing scheme based on H264 |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103124380A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104270594A (en) * | 2014-09-24 | 2015-01-07 | 大唐移动通信设备有限公司 | Data packet sending and receiving method and device |
| CN104703053A (en) * | 2015-03-11 | 2015-06-10 | 青岛海尔智能家电科技有限公司 | Packet loss processing method, device and system of video transmission process |
| CN104754334A (en) * | 2015-03-02 | 2015-07-01 | 深圳市金立通信设备有限公司 | Video processing method |
| CN106303693A (en) * | 2015-05-25 | 2017-01-04 | 北京视联动力国际信息技术有限公司 | A kind of method and device of video data decoding |
| CN108924574A (en) * | 2018-08-01 | 2018-11-30 | 广州视源电子科技股份有限公司 | Loss treating method, device, equipment and storage medium in recording and broadcasting system |
| CN110876091A (en) * | 2020-01-20 | 2020-03-10 | 翱捷科技(上海)有限公司 | Method and device for solving video frame packet loss by using RTP (real-time transport protocol) extension header |
| CN112367543A (en) * | 2020-10-27 | 2021-02-12 | 海信视像科技股份有限公司 | Display device, mobile terminal, screen projection method and screen projection system |
| CN112437345A (en) * | 2020-11-20 | 2021-03-02 | 北京字跳网络技术有限公司 | Video speed doubling playing method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101651815A (en) * | 2009-09-01 | 2010-02-17 | 中兴通讯股份有限公司 | Visual telephone and method for enhancing video quality by utilizing same |
| CN101656747A (en) * | 2009-09-25 | 2010-02-24 | 深圳创维数字技术股份有限公司 | Method and system for transmitting streaming media data |
| CN102104486A (en) * | 2009-12-17 | 2011-06-22 | 日立电线株式会社 | Switching hub, line card and frame relay method |
-
2012
- 2012-11-16 CN CN2012104885081A patent/CN103124380A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101651815A (en) * | 2009-09-01 | 2010-02-17 | 中兴通讯股份有限公司 | Visual telephone and method for enhancing video quality by utilizing same |
| CN101656747A (en) * | 2009-09-25 | 2010-02-24 | 深圳创维数字技术股份有限公司 | Method and system for transmitting streaming media data |
| CN102104486A (en) * | 2009-12-17 | 2011-06-22 | 日立电线株式会社 | Switching hub, line card and frame relay method |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104270594A (en) * | 2014-09-24 | 2015-01-07 | 大唐移动通信设备有限公司 | Data packet sending and receiving method and device |
| CN104754334A (en) * | 2015-03-02 | 2015-07-01 | 深圳市金立通信设备有限公司 | Video processing method |
| CN104703053A (en) * | 2015-03-11 | 2015-06-10 | 青岛海尔智能家电科技有限公司 | Packet loss processing method, device and system of video transmission process |
| CN106303693A (en) * | 2015-05-25 | 2017-01-04 | 北京视联动力国际信息技术有限公司 | A kind of method and device of video data decoding |
| CN108924574A (en) * | 2018-08-01 | 2018-11-30 | 广州视源电子科技股份有限公司 | Loss treating method, device, equipment and storage medium in recording and broadcasting system |
| CN108924574B (en) * | 2018-08-01 | 2021-07-06 | 广州视源电子科技股份有限公司 | Packet loss processing method, device, equipment and storage medium in recording and broadcasting system |
| CN110876091A (en) * | 2020-01-20 | 2020-03-10 | 翱捷科技(上海)有限公司 | Method and device for solving video frame packet loss by using RTP (real-time transport protocol) extension header |
| CN112367543A (en) * | 2020-10-27 | 2021-02-12 | 海信视像科技股份有限公司 | Display device, mobile terminal, screen projection method and screen projection system |
| CN112367543B (en) * | 2020-10-27 | 2023-08-15 | 海信视像科技股份有限公司 | Display device, mobile terminal, screen projection method and screen projection system |
| CN112437345A (en) * | 2020-11-20 | 2021-03-02 | 北京字跳网络技术有限公司 | Video speed doubling playing method and device, electronic equipment and storage medium |
| CN112437345B (en) * | 2020-11-20 | 2023-03-14 | 北京字跳网络技术有限公司 | Video double-speed playing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103124380A (en) | Real time streaming media packet loss processing scheme based on H264 | |
| US8875208B1 (en) | High quality multimedia transmission from a mobile device for live and on-demand viewing | |
| CN102223201B (en) | Negotiation method of codec capability and terminal | |
| CN102480618B (en) | Realize H264 video code model and play the method and system optimized | |
| CN101185333A (en) | Method of transmitting picture information when encoding video signal and method of using the same when decoding video signal | |
| CN101971618A (en) | Method for implementing rich video on mobile terminals | |
| CN102752670B (en) | Reduce method, the Apparatus and system of mosaic phenomenon in Network Video Transmission | |
| CN109618170B (en) | D2D real-time video streaming transmission method based on network coding | |
| CN103096054B (en) | Video image filtering processing method and device thereof | |
| CN105812711A (en) | Method and system for optimizing image quality during video call | |
| CN111263192A (en) | Video processing method and related equipment | |
| CN104427286A (en) | Method and system for making video call | |
| WO2021057697A1 (en) | Video encoding and decoding methods and apparatuses, storage medium, and electronic device | |
| CN110876066A (en) | Adaptive forward error correction method, apparatus, medium and device | |
| WO2017000836A1 (en) | Message transmission method and device | |
| CN107801049A (en) | A kind of real-time video transmission, player method and device | |
| CN108429921B (en) | Video coding and decoding method and device | |
| CN103929682A (en) | Method and device for setting key frames in video live broadcast system | |
| CN110996035A (en) | Information sending method and device | |
| CN110708569A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN103685314A (en) | Method for achieving seamless switching of unicast and multicast of stream media playing | |
| KR20180031673A (en) | Switching display devices in video telephony | |
| CN103139528B (en) | The processing method of a kind of audio, video data and device | |
| CN101179353A (en) | Method and system of monitoring multimedia service performance | |
| EP3145187B1 (en) | Method and apparatus for response of feedback information during video call |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130529 |