CN109348265A - 基于hls多码流模式下的直播方法及系统 - Google Patents

基于hls多码流模式下的直播方法及系统 Download PDF

Info

Publication number
CN109348265A
CN109348265A CN201811426307.2A CN201811426307A CN109348265A CN 109348265 A CN109348265 A CN 109348265A CN 201811426307 A CN201811426307 A CN 201811426307A CN 109348265 A CN109348265 A CN 109348265A
Authority
CN
China
Prior art keywords
time
code stream
quality
played
hls
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811426307.2A
Other languages
English (en)
Inventor
张洪宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan Goke Microelectronics Co Ltd
Original Assignee
Hunan Goke Microelectronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan Goke Microelectronics Co Ltd filed Critical Hunan Goke Microelectronics Co Ltd
Priority to CN201811426307.2A priority Critical patent/CN109348265A/zh
Publication of CN109348265A publication Critical patent/CN109348265A/zh
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开了一种基于HLS多码流模式下的直播方法及系统，在直播过程中，服务器实时提供多种质量级别的媒体流，并对其切片；客户端首先从服务器获取码流表，根据网络类型估算一个码流，配合网络测速的结果选择从中选择一个当前最合适的媒体码流进行传输。当可以播放的时间连续3次大于最长播放片的下载时间，就向上调整一个质量级别，直到最高级别；如果出现单片下载时间超过单片播放时间，即刻调低一个质量级别，直到最低质量级别。本发明克服了网络抖动，充分利用了带宽。

Description

基于HLS多码流模式下的直播方法及系统
技术领域
本发明涉及直播技术，特别是一种基于HLS多码流模式下的直播方法及系统。
背景技术
HLS(全称 HTTP Live Streaming)，是由苹果公司提出的基于HTTP的流媒体网络传输协议。利用该协议，客户端可以接收持续的多媒体流来自于一个普通的web服务器。并且支持客户端在不同的网络带宽环境下，播放不同码率、分辨率的视频。
HLS的实现原理是把整个多媒体文件切成一个个小的基于HTTP的资源(MPEG-2Transport Stream格式的文件)，生成一个包含元数据的扩展 M3U (M3U8) Playlist 文件，每次只下载列表中的一些资源，客户端根据带宽环境可以选择不同的资源。M3U8是一种播放多媒体列表的文件格式，可以指定一个或多个多媒体资源的位置，并且M3U8 Playlist中可以包含多个子M3U8文件。
在视频分发之前，内容提供者生成多个码率的视频文件，这一定程度上保证了视频的流畅性，但是这会带来一定的问题。
虽然服务器端提供多个码率，但由于客户端上播放的是其中某种码率的视频，在网络带宽满足的情况下，用户无法选择更高清晰度的码率，没法为用户提供更好的播放体验。反之，如果网络质量不好，用户也无法切换到更低码率的视频，从而导致播放卡顿。
发明内容
本发明所要解决的技术问题是，针对现有技术不足，提供一种基于HLS多码流模式下的直播方法及系统，克服网络抖动，充分利用带宽。
为解决上述技术问题，本发明所采用的技术方案是：一种基于HLS多码流模式下的直播方法，该方法实现过程包括：服务器实时提供多种质量级别的媒体流，并对其切片；客户端首先从服务器获取媒体流表，根据网络类型估算一个码流，配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输；当可以播放的时间连续N次大于最长播放切片的下载时间，就向上调整一个播放质量级别，直到最高级别；如果出现单个切片下载时间超过单个切片播放时间，则调低一个播放质量级别，直到最低质量级别。
所述可以播放的时间是指：当前正在播放的切片剩余时间叠加缓存中除最后一个切片的播放时间以外的可以播放的时间。
本发明还提供了一种基于HLS多码流模式下的直播系统，其包括：
服务器，用于提供多种质量级别的媒体流，并对其切片；
客户端，用于从服务器获取媒体流表，根据网络类型估算一个码流，配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输；
调整单元，用于执行如下操作：当可以播放的时间连续N次大于最长播放切片的下载时间，就向上调整一个播放质量级别，直到最高级别；如果出现单个切片下载时间超过单个切片播放时间，则调低一个播放质量级别，直到最低质量级别。
与现有技术相比，本发明所具有的有益效果为：本发明在播放之前， 参考了网络类型又对真实的网络环境进行测算，结合得出更接近实际环境的观看码率，节约了估算时间和减少了网络消耗，结果也更准确；能应对网络抖动带来的影响，和对可能起始判断不准的情况进行修正，使其在用户不影响观看的情况下无感知的获得最好的观看效果。
具体实施方式
本发明实现了在充分利用当前带宽能支持的最好画质进行直播。在直播过程中，服务器实时提供多种质量级别的媒体流，并对其切片；客户端首先从服务器获取码流表，根据网络类型估算一个码流， 配合网络测速的结果选择从中选择一个当前最合适的媒体码流进行传输。当可以播放的时间连续3次大于最长播放片的下载时间，就向上调整一个质量级别，直到最高级别；如果出现单片下载时间超过单片播放时间，即刻调低一个质量级别，直到最低质量级别。
本发明具体实现步骤如下：
1.获得多码率的 m3u8 文件，同时测算出实际参考带宽；
2.网络类型捕获，估算码流，根据参考带宽，得到实际采用的码流；
3.选择合适的码流进行传输；
4.每传输完成一片，记录当前片的下载时间，计算出最大片的下载时间；
5.获取到当前正在播放的片剩余时间叠加缓存中除最后一片的播放时间以外的可以播放的时间，得到一个剩余播放时间；
6.如果剩余播放时间连续3次超过最大片的下载时间，则提升一个播放质量，直到最高质量；
如果单片下载时间超过自身可以播放的时间，即刻向下降低一个播放质量，直到最低质量。

Claims (4)

1.一种基于HLS多码流模式下的直播方法，其特征在于，该方法实现过程包括：服务器实时提供多种质量级别的媒体流，并对其切片；客户端首先从服务器获取媒体流表，根据网络类型估算一个码流，配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输；当可以播放的时间连续N次大于最长播放切片的下载时间，就向上调整一个播放质量级别，直到最高级别；如果出现单个切片下载时间超过单个切片播放时间，则调低一个播放质量级别，直到最低质量级别。
2.根据权利要求1所述的基于HLS多码流模式下的直播方法，其特征在于，N=3。
3.根据权利要求1所述的基于HLS多码流模式下的直播方法，其特征在于，所述可以播放的时间是指：当前正在播放的切片剩余时间叠加缓存中除最后一个切片的播放时间以外的可以播放的时间。
4.一种基于HLS多码流模式下的直播系统，其特征在于，包括：
服务器，用于提供多种质量级别的媒体流，并对其切片；
客户端，用于从服务器获取媒体流表，根据网络类型估算一个码流，配合网络测速的结果从媒体流表中选择一个当前最合适的媒体流进行传输；
调整单元，用于执行如下操作：当可以播放的时间连续N次大于最长播放切片的下载时间，就向上调整一个播放质量级别，直到最高级别；如果出现单个切片下载时间超过单个切片播放时间，则调低一个播放质量级别，直到最低质量级别。
CN201811426307.2A 2018-11-27 2018-11-27 基于hls多码流模式下的直播方法及系统 Pending CN109348265A (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811426307.2A CN109348265A (zh) 2018-11-27 2018-11-27 基于hls多码流模式下的直播方法及系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811426307.2A CN109348265A (zh) 2018-11-27 2018-11-27 基于hls多码流模式下的直播方法及系统

Publications (1)

Publication Number Publication Date
CN109348265A true CN109348265A (zh) 2019-02-15

Family

ID=65318385

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811426307.2A Pending CN109348265A (zh) 2018-11-27 2018-11-27 基于hls多码流模式下的直播方法及系统

Country Status (1)

Country Link
CN (1) CN109348265A (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109951727A (zh) * 2019-03-29 2019-06-28 深圳市思迪信息技术股份有限公司 动态计算视频传输所需码率的方法、装置及计算机设备
CN112565833A (zh) * 2020-11-26 2021-03-26 的卢技术有限公司 一种基于hls的多媒体自适应播放控制方法

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102333089A (zh) * 2011-09-26 2012-01-25 南京邮电大学 基于超文本传输协议流化的多码率媒体流自适应控制方法
CN102801690A (zh) * 2011-05-25 2012-11-28 华为技术有限公司 流媒体的处理方法、分发服务器、客户端及系统
CN104123316A (zh) * 2013-04-28 2014-10-29 腾讯科技（深圳）有限公司 资源收藏方法、装置和设备
CN105323604A (zh) * 2015-10-29 2016-02-10 西安交通大学 一种QoE驱动的HTTP流媒体点播缓冲区控制方法
US20160100173A1 (en) * 2014-10-03 2016-04-07 International Business Machines Corporation Enhanced Video Streaming
CN106688239A (zh) * 2015-08-25 2017-05-17 华为技术有限公司 视频下载方法、装置及系统
CN106878828A (zh) * 2017-02-21 2017-06-20 微鲸科技有限公司 自动切换多媒体码率的方法及装置
CN107454075A (zh) * 2017-07-31 2017-12-08 苏州蜗牛数字科技股份有限公司 一种高清视频点播互动方法及系统
CN108063955A (zh) * 2017-12-15 2018-05-22 重庆邮电大学 基于状态机的动态自适应视频传输的码率切换方法
CN108124273A (zh) * 2017-11-17 2018-06-05 上海连尚网络科技有限公司 一种信息获取的方法、设备及介质

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102801690A (zh) * 2011-05-25 2012-11-28 华为技术有限公司 流媒体的处理方法、分发服务器、客户端及系统
CN102333089A (zh) * 2011-09-26 2012-01-25 南京邮电大学 基于超文本传输协议流化的多码率媒体流自适应控制方法
CN104123316A (zh) * 2013-04-28 2014-10-29 腾讯科技（深圳）有限公司 资源收藏方法、装置和设备
US20160100173A1 (en) * 2014-10-03 2016-04-07 International Business Machines Corporation Enhanced Video Streaming
CN106688239A (zh) * 2015-08-25 2017-05-17 华为技术有限公司 视频下载方法、装置及系统
CN105323604A (zh) * 2015-10-29 2016-02-10 西安交通大学 一种QoE驱动的HTTP流媒体点播缓冲区控制方法
CN106878828A (zh) * 2017-02-21 2017-06-20 微鲸科技有限公司 自动切换多媒体码率的方法及装置
CN107454075A (zh) * 2017-07-31 2017-12-08 苏州蜗牛数字科技股份有限公司 一种高清视频点播互动方法及系统
CN108124273A (zh) * 2017-11-17 2018-06-05 上海连尚网络科技有限公司 一种信息获取的方法、设备及介质
CN108063955A (zh) * 2017-12-15 2018-05-22 重庆邮电大学 基于状态机的动态自适应视频传输的码率切换方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109951727A (zh) * 2019-03-29 2019-06-28 深圳市思迪信息技术股份有限公司 动态计算视频传输所需码率的方法、装置及计算机设备
CN112565833A (zh) * 2020-11-26 2021-03-26 的卢技术有限公司 一种基于hls的多媒体自适应播放控制方法

Similar Documents

Publication Publication Date Title
CN109792545B (zh) 从服务器向客户端装置传送视频内容的方法
EP3136732B1 (en) Converting adaptive bitrate chunks to a streaming format
CN107071529B (zh) 一种hls视频播放方法、终端及服务器
KR102086873B1 (ko) 복수의 트랜스코딩된 컨텐츠 스트림들을 제공하기 위한 방법 및 장치
US10812559B2 (en) Just-in-time variable adaptive encoding and delivery of media content
US10200432B2 (en) HTTP streaming client adaptation algorithm based on proportional-integral control
CN102333089A (zh) 基于超文本传输协议流化的多码率媒体流自适应控制方法
EP3318034B1 (en) Low latency media streaming
KR20170118759A (ko) 라이브 비디오 인코딩 및 스트리밍에서의 프레임 복제 및 프레임 확장을 위한 시스템 및 방법
CN110149560B (zh) 基于hls协议的播放器优化方法及系统、存储介质及终端
CN107864402A (zh) 直播视频播放方法及装置
WO2018232796A1 (zh) 一种流媒体文件处理方法及直播系统
WO2018060488A1 (en) Viewer importance adaptive bit rate delivery
CN108833350B (zh) 一种适用于多服务器自适应流媒体系统的数据传输方法
CN109348265A (zh) 基于hls多码流模式下的直播方法及系统
US10045053B1 (en) Fragment insertion for live media streams
Rahman et al. A client side buffer management algorithm to improve QoE
CN107205159B (zh) 网络直播中流媒体的比特率调整方法、装置和存储介质
Kim et al. Analysis and improvement of MPEG-DASH-based internet live broadcasting Services in Real-world Environments
Kim et al. Content-aware rate adaptation scheme to improve stability in HTTP Adaptive Streaming
Fernandez et al. Modular Testbed for KPI Monitoring in Omnidirectional Video Streaming Scenarios
EP3107261A1 (en) System, method and devices for low tatency transmission
WO2021167531A1 (en) Methods and systems for bandwidth estimation
EP3462745A1 (en) Modifying a buffer size
EP2811709B1 (en) Quality of experience measurements in a unicast linear television network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190215

RJ01 Rejection of invention patent application after publication