WO2010045826A1 - 流媒体业务中获取关键帧的方法、系统及用户设备 - Google Patents

流媒体业务中获取关键帧的方法、系统及用户设备 Download PDF

Info

Publication number
WO2010045826A1
WO2010045826A1 PCT/CN2009/073501 CN2009073501W WO2010045826A1 WO 2010045826 A1 WO2010045826 A1 WO 2010045826A1 CN 2009073501 W CN2009073501 W CN 2009073501W WO 2010045826 A1 WO2010045826 A1 WO 2010045826A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
key frame
streaming media
client
request
Prior art date
Application number
PCT/CN2009/073501
Other languages
English (en)
French (fr)
Inventor
尚国强
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to EP09821547.8A priority Critical patent/EP2364017B1/en
Priority to US13/124,464 priority patent/US8813160B2/en
Publication of WO2010045826A1 publication Critical patent/WO2010045826A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/613—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/752—Media network packet handling adapting media to network capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
    • H04N21/6379—Control signals issued by the client directed to the server or network components directed to server directed to encoder, e.g. for requesting a lower encoding rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests

Definitions

  • the present invention relates to the field of communications and multimedia, and in particular, to a method, system and user equipment for acquiring key frames in a streaming media service.
  • the technical problem to be solved by the present invention is to provide a method, a system and a user equipment for acquiring a key frame in a streaming media service, which solves the problem that a user can quickly see a clear video image while watching a program, so that the entire service is made.
  • the user experience has been greatly enhanced.
  • the present invention provides a method for acquiring a key frame in a streaming media service, including:
  • the client receives the video data from the streaming media server, and analyzes the video data.
  • the client sends an adjustment to the streaming media server.
  • a video keyframe request to generate a frequency
  • the streaming media server After receiving the request, the streaming media server determines, and adjusts a video key frame generation frequency according to the request of the client.
  • the method may further include: the streaming media server adjusting the video according to the request of the client
  • the frequency of the key frame generation is that the streaming media server receives the request of one or more clients during the same period of time of multicast or broadcast, and adjusts the frequency of generating the video key frame according to the request of the majority client; or refers to the flow.
  • the media server adjusts the video key frame generation frequency directly according to the request of the client when the system is requested.
  • the above method may further include that the client is within a real-time streaming protocol standard
  • the SET PARAMETER METHOD analyzes the video data to determine if a video keyframe was received at the threshold time.
  • the method may further include that the streaming media server adjusts a video key frame generation frequency while adjusting a corresponding video bandwidth requirement.
  • the present invention also provides a streaming media service system, including a client and a streaming media server, wherein
  • the client is configured to receive video data from the streaming media server, and analyze the video data, and if the network condition is normal, if the video key frame is not received within the set threshold time, the streaming media is sent to the streaming media.
  • the server sends a request to adjust the frequency of generating video key frames;
  • the streaming media server is configured to send video data to the client; after receiving the request by the client, determine, and adjust a video key frame generation frequency according to the request of the client.
  • the streaming media service system may further include: the streaming media server adjusting the video key frame generation frequency according to the request of the client, where the streaming media server receives one or more during the same period of time of multicast or broadcast.
  • the request of the client adjusts the frequency of generating the video key frame according to the request of the majority client; or the streaming media server adjusts the frequency of generating the video key frame directly according to the request of the client when the streaming server is requested.
  • the streaming media service system may further include: the client analyzing the video data by using a SET-PARAMETER METHOD in a real-time streaming protocol standard, and determining whether a video key frame is received at the threshold time.
  • the streaming media service system may further include: the streaming media server is further configured to adjust a video video frame generation frequency and adjust a corresponding video bandwidth requirement.
  • the present invention also provides a user equipment for acquiring key frames in a streaming media service, including a video receiving module and a control module, where The video receiving module is configured to receive video data and send the data to the control module, where the control module is configured to analyze the video data according to the video data sent by the video receiving module, when the network status is normal, If the video keyframe is not received within the set threshold time, a request to adjust the frequency of the video keyframe generation is sent to the streaming server.
  • the user equipment may further include: the control module is implemented by a real-time streaming protocol standard
  • the SET PARAMETER METHOD analyzes the video data to determine if a video keyframe was received at the threshold time.
  • the present invention further provides a streaming media server, the streaming media server is configured to send video data to a client, and receive a request for adjusting a video key frame sent by the client after analyzing the video data, The request is made to determine, and the video key frame generation frequency is adjusted according to the request of the client.
  • the above-mentioned streaming media server adjusts the frequency of generating the video key frame according to the request of the client, where the streaming media server receives the one or more of the clients in the same time period of multicast or broadcast.
  • the request is to adjust the video key frame generation frequency according to the request of the majority of the clients, or to indicate that the streaming media server directly adjusts the video key frame generation frequency according to the request of the client when on-demand.
  • the streaming server is further configured to adjust a corresponding video bandwidth requirement while adjusting a frequency of the video key frame generation.
  • the application of the present invention enables the server to respond to the user's request, and comprehensively judges to form a more reasonable key frame generation time interval, so that the user experience is greatly improved.
  • the invention mainly relates to the increase of message parameters, and the client and server changes are relatively small, and the network structure is not affected, and the implementation is relatively fast and has strong practicability.
  • FIG. 1 is a flowchart of a method for acquiring a key frame in a streaming media service of the present invention
  • FIG. 2 is a schematic structural diagram of a streaming media service system of the present invention
  • FIG. 3 is a schematic flowchart of message interaction between a streaming media client and a streaming media live server.
  • the streaming media client performs video key frame determination under normal network conditions. If the video key frame is not received within the set time, the streaming media client performs a key frame request, and requests the server to adjust the frequency of the video key frame generation. After receiving the request, the streaming media server performs comprehensive judgment. In the multicast or broadcast, according to the request of most clients, or directly according to the client request, the frequency of the video key frame generation is adjusted according to the client request, and the corresponding video bandwidth requirement is adjusted.
  • the present invention is extended in the streaming media service system by the SET_PARAMETER METHOD in the original RTSP (Real Time Streaming Protocol) protocol standard, that is, the original data structure defined by the method is not changed. Only the corresponding fields are expanded, so that both the client and the server can recognize the parameters of the method, and the original system does not need to be greatly modified, and the effect of the user experience is greatly improved.
  • RTSP Real Time Streaming Protocol
  • SET—PARAMETER METHOD carries a parameter that is extended by a parameter: Key-Frame-Span, which is used to indicate the time when the key frame frequency is requested to be generated.
  • the name of the parameter can be arbitrarily specified, but the content is a number, and in seconds, in actual In the application, the unit can also be negotiated, as expressed in the sending protocol:
  • Key-Frame-Span 5 which means that an average of one key frame is generated every 5 seconds.
  • the server makes a comprehensive judgment after receiving the client request, and if the parameter setting request can be accepted, the key frame generation frequency adjustment is performed.
  • the method for acquiring a key frame in the streaming media service of the present invention includes the following steps: Step 100: A client receives video data from a streaming media server, and analyzes the video data, when the network status is normal, if If the video key frame is not received within the set threshold time, the client may send a request for adjusting the frequency of generating the video key frame to the streaming media server;
  • the threshold time can be set to 10 seconds, and the threshold time is a time for judging, The threshold time can be adjusted by the user, and the time value of the request generating frequency is generally smaller than the threshold time.
  • the client analyzes the video data through SET_PARAMETER in the real-time streaming protocol standard to determine whether a video key frame is received at the threshold time.
  • Step 200 After receiving the request, the streaming media server performs comprehensive judgment, and then adjusts a video key frame generation frequency according to the client request, and adjusts a corresponding video bandwidth requirement.
  • the streaming media server adjusts the frequency of generating the video key frame according to the request of the client, where the streaming media server receives the request of multiple clients during the same period of multicast or broadcast, and adjusts the video according to the request of the majority client.
  • the key frame generation frequency, or the streaming server adjusts the video key frame generation frequency directly according to the request of the client when on-demand.
  • the time of the client request may be arranged in an order, for example, according to the data with the smallest request time, the frequency of the video key frame is adjusted. .
  • the specific process of adjusting the frequency of generating a key frame by using the SET_PARAMETER method of the RTSP is as follows.
  • Client->Streaming Server SET_PARAMETER rtsp: ⁇ example.com/fizzle/foo RTSP/1.0
  • the streaming media service system of the present invention includes a client and a streaming media server, where
  • a client configured to receive video data from the streaming media server, and analyze the video data, and if the network condition is normal, if the video key frame is not received within the set threshold time, send the video key frame to the streaming media server. a request to adjust the frequency of video keyframe generation;
  • a streaming media server configured to send video data to the client; after receiving the request by the client, performing comprehensive judgment, according to a request of a majority of clients during multicast or broadcast, or directly according to the request of the client when on-demand , adjust the frequency of video keyframe generation, and adjust the corresponding video bandwidth requirements.
  • the streaming media user equipment of the present invention includes a video receiving module and a control module, wherein the video receiving module is configured to receive video data and send the data to the control module;
  • the control module is configured to analyze the video data according to the video data sent by the video receiving module.
  • the network condition is normal, if the video key frame is not received within the set threshold time, the adjustment video key is sent to the streaming media server.
  • the frame generates a request for frequency.
  • FIG. 3 is a schematic flow chart of message interaction between a streaming media client and a streaming media live server.
  • the figure describes the basic message flow.
  • the client and the server are used.
  • the message does not show some other links such as portals, transmission systems, etc., including the following steps,
  • Step 1 The streaming client sends an RTSP:Describe message to the streaming server.
  • the second step the streaming media server sends a response OK message, and the message has the content of the SDP message;
  • Step 5 The client sends a PLAY request message to the server;
  • Step 6 The server responds to the client sending an OK message
  • Step 7 The client receives an RTP message sent by the server, and the RTP message includes audio Data information;
  • Step 8 The client sends an RTCP message to the server, and feeds back some network information.
  • Step 9 The client receives an RTP message sent by the server, where the RTP message includes video data information.
  • Step 10 The client analyzes the received video data.
  • the video key frame is not received for a long time, for example, setting a threshold value for 10 seconds, that is, the user does not receive the key frame within 10 seconds.
  • the client can initiate a request to adjust the key frame generation time interval to the streaming server.
  • Step 11 After receiving the request from the client, the server performs comprehensive analysis according to the situation. For example, during multicast or broadcast, multiple requests are received in the same time period, and the request time is arranged in an order, for example, according to the request time. Data execution; or adjust the frequency of key frames generated directly on demand according to user requests;
  • Step 12 The server responds to the client
  • Step 13 The server sends video data after adjusting the key frame transmission time interval.
  • the method for obtaining a key frame in the streaming media service provided by the present invention, and the streaming media service system, the user equipment or the streaming media server provided by the present invention can quickly respond to the user's key to the video.
  • the request for frequency adjustment is generated, and a reasonable time interval for generating video key frames is formed through comprehensive judgment, so that the user experience of streaming media is faster and smoother.
  • the invention mainly relates to the increase of message parameters, the client and server changes are relatively small, does not affect the network structure, and is relatively fast and has strong practicability.

Description

流媒体业务中获取关键帧的方法、 系统及用户设备
技术领域
本发明涉及通讯及多媒体领域， 具体涉及一种流媒体业务中获取关键帧 的方法、 系统及用户设备。
背景技术
随着通讯技术的发展， 能够向终端设备提供的通讯带宽越来越大， 多媒 体在移动终端上得到了飞速的发展， 手机电视、 流媒体等业务逐渐在成熟起 来。 但是这些多媒体业务主要还是展现了特色的一面， 还没有充分挖掘在这 些业务上的其他业务的集成。
如何使用户在观看节目时， 能够最快的看到清晰的视频图像， 使得整个 业务的用户体验得到更大限度的提升， 成为当前需要解决的问题。
发明内容
本发明所要解决的技术问题是提供一种流媒体业务中获取关键帧的方 法、 系统及用户设备， 解决了用户在观看节目时， 能够很快地看到清晰的视 频图像的问题， 使得整个业务的用户体验得到更大限度的提升。
为了解决上述问题，本发明提供了一种流媒体业务中获取关键帧的方法， 包括，
设置接收视频关键帧的阈值时间；
客户端从流媒体服务器接收视频数据， 并对视频数据进行分析， 当网络 状况正常时， 如果所述客户端在所述阈值时间内没有收到视频关键帧， 则向 所述流媒体服务器发送调整视频关键帧产生频率的请求； 以及
所述流媒体服务器收到所述情求后进行判断， 根据所述客户端的请求， 调整视频关键帧产生频率。
上述方法还可包括， 所述流媒体服务器根据所述客户端的请求调整视频 关键帧产生频率， 是指所述流媒体服务器在组播或者广播的同一时间段内收 到了一个或多个客户端的请求， 根据多数客户端的请求调整视频关键帧产生 频率； 或是指所述流媒体服务器在点播时直接根据所述客户端的请求调整视 频关键帧产生频率。
上述方法还可包括， 所述客户端是通过实时流传输协议标准内的
SET PARAMETER METHOD对视频数据进行分析， 判断在所述阈值时间是 否收到视频关键帧。
上述方法还可包括，所述流媒体服务器调整视频关键帧产生频率的同时， 调整相应的视频带宽需求。
本发明还提供了一种流媒体业务系统， 包括客户端和流媒体服务器， 其 中，
所述客户端， 用于从所述流媒体服务器接收视频数据， 并对视频数据进 行分析， 当网络状况正常时， 如果在设定的阈值时间没有收到视频关键帧， 则向所述流媒体服务器发送调整视频关键帧产生频率的请求；
所述流媒体服务器， 用于向客户端发送视频数据； 接收所述客户端所述 请求后进行判断， 根据所述客户端的请求， 调整视频关键帧产生频率。
上述流媒体业务系统还可包括， 所述流媒体服务器根据所述客户端的请 求调整视频关键帧产生频率， 是指所述流媒体服务器在组播或者广播的同一 时间段内收到了一个或多个客户端的请求， 根据多数客户端的请求调整视频 关键帧产生频率； 或是指所述流媒体服务器在点播时直接根据所述客户端的 请求调整视频关键帧产生频率。
上述流媒体业务系统还可包括， 所述客户端通过实时流传输协议标准内 的 SET— PARAMETER METHOD对视频数据进行分析， 判断在所述阈值时间 是否收到视频关键帧。
上述流媒体业务系统还可包括， 所述流媒体服务器还用于调整视频关键 帧产生频率的同时， 调整相应的视频带宽需求。
本发明还提供了一种用户设备， 用于流媒体业务中获取关键帧， 包括视 频接收模块和控制模块， 其中， 所述视频接收模块， 用于接收视频数据， 并发送给所述控制模块； 所述控制模块， 用于根据所述视频接收模块发送的视频数据， 对视频数 据进行分析， 当网络状况正常时， 如果在设定的阈值时间没有收到视频关键 帧， 则向流媒体服务器发送调整视频关键帧产生频率的请求。
上述用户设备还可包括， 所述控制模块是通过实时流传输协议标准内的
SET PARAMETER METHOD对视频数据进行分析， 判断在所述阈值时间是 否收到视频关键帧。
本发明还提供了一种流媒体服务器， 所述流媒体服务器设置为向客户端 发送视频数据， 接收所述客户端在对所述视频数据分析后发送的调整视频关 键帧的请求， 对所述请求进行判断， 根据所述客户端的所述请求调整所述视 频关键帧产生频率。
上述流媒体服务器根据所述客户端的所述请求调整所述视频关键帧产生 频率， 是指所述流媒体服务器在组播或者广播的同一时间段内收到了一个或 多个所述客户端的所述请求， 根据多数所述客户端的所述请求调整所述视频 关键帧产生频率， 或者是指所述流媒体服务器在点播时直接根据所述客户端 的所述请求调整所述视频关键帧产生频率。
上述流媒体服务器还设置为在调整所述视频关键帧产生频率的同时， 调 整相应的视频带宽需求。
与现有技术相比， 应用本发明， 使得服务器能够响应用户的请求， 综合 判断后形成一个较为合理的关键帧产生时间间隔， 使得用户的体验有很大提 升。 本发明主要涉及消息参数的增加， 客户端和服务器改动均比较小， 不影 响网络结构， 实现较为快速， 有很强的实用性。
附图概述
图 1是本发明的流媒体业务中获取关键帧的方法的流程图；
图 2是本发明的流媒体业务系统的结构示意图； 图 3是一个流媒体客户端向流媒体直播服务器之间进行消息交互的流程 示意图。
本发明的较佳实施方式
下面结合附图和具体实施方式对本发明作进一步说明。
本发明的主要构思是： 在网絡正常的条件下， 流媒体客户端进行视频关 键帧判断。 如杲在设定时间内没有收到视频关键帧的前提下， 则流媒体客户 端进行关键帧请求， 请求服务器对视频关键帧产生频率进行调整， 流媒体服 务器收到该请求后， 进行综合判断， 在组播或者广播时根据多数客户端的请 求， 或在点播时直接根据所述客户端请求， 调整其视频关键帧产生频率， 并 调整相应的视频带宽需求。
本发明在流媒体业务系统中， 通过原有的 RTSP ( Real Time Streaming Protocol, 实时流传输协议 )协议标准内的 SET_PARAMETER METHOD (参 数设置方法） 进行扩充， 即不改变该方法定义的原有数据结构， 仅仅扩充相 应的字段， 使客户端和服务器都能识别该方法内的参数内容， 不需要对原有 系统进行大的改动， 用户体验的效果得到很大的提升。
SET— PARAMETER METHOD 携带的参数中扩充一个参数： Key-Frame-Span, 用于表示请求产生关键帧频率的时间， 该参数的名称可任 意规定， 但内容为数字， 并且以秒为单位， 在实际应用中， 单位也可以进行 协商设置， 如在发送协议中表示为：
Key-Frame-Span: 5, 表示为平均每 5秒产生一帧关键帧。 服务器在收到 客户端请求后进行综合判断， 如果能够接受该参数设置请求， 则进行关键帧 产生频率调整。
如图 1所示， 本发明的流媒体业务中获取关键帧的方法， 包括以下步骤， 步骤 100、 客户端从流媒体服务器接收视频数据， 并对视频数据进行分 析， 当网络状况正常时， 如果在设定的阈值时间没有收到视频关键帧， 则客 户端可以向流媒体服务器发送调整视频关键帧产生频率的请求；
所述阈值时间可以设置为 10秒， 该阁值时间是一个用于判断的时间， 该 阈值时间可由用户进行调整， 请求产生频率的时间值一般要小于所述阁值时 间。
所述客户端是通过实时流传输协议标准内的 SET_PARAMETER对视频 数据进行分析， 判断在所述阈值时间是否收到视频关键帧。
步骤 200、 流媒体服务器收到所述请求后， 进行综合判断， 然后根据客 户端的请求， 调整视频关键帧产生频率， 并调整相应的视频带宽需求。
所述流媒体服务器根据所述客户端的请求调整视频关键帧产生频率， 是 指所述流媒体服务器在组播或者广播的同一时间段内收到了多个客户端的请 求， 根据多数客户端的请求调整视频关键帧产生频率， 或所述流媒体服务器 在点播时直接根据所述客户端的请求调整视频关键帧产生频率。
如果所述流媒体服务器在组播或者广播的同一时间段内收到了多个客户 端的请求， 可以针对客户端请求的时间做一个顺序排列， 例如按照请求时间 最小的数据， 调整视频关键帧产生频率。
根据本发明的一个实施例， 利用 RTSP 的 SET_PARAMETER方法调整 关键帧的产生频率的具体过程如下，
客户端-〉流媒体服务器： SET_PARAMETER rtsp：〃 example.com/fizzle/foo RTSP/1.0
CSeq: 421
Session: efhyrio8012t
User-Agent: StreamClient/l.lb5
Key-Frame-Span: 5
流媒体服务器 ->客户端： RTSP/1.0 200 OK
CSeq: 421
Session: efhyrio8012t
User-Agent: StreamClient/l.lb5
Key-Frame-Span: 5 如图 2所示， 本发明的流媒体业务系统， 包括客户端和流媒体服务器， 其中，
客户端， 用于从所述流媒体服务器接收视频数据， 并对视频数据进行分 析， 当网络状况正常时， 如果在设定的阈值时间没有收到视频关键帧， 则向 所述流媒体服务器发送调整视频关键帧产生频率的请求；
流媒体服务器， 用于向客户端发送视频数据； 接收所述客户端的所述请 求后， 进行综合判断， 在组播或者广播时根据多数客户端的请求， 或者在点 播时直接根据所述客户端的请求， 调整视频关键帧产生频率， 并调整相应的 视频带宽需求。
本发明的流媒体用户设备， 包括视频接收模块和控制模块， 其中， 视频接收模块， 用于接收视频数据， 并发送给控制模块；
控制模块， 用于根据视频接收模块发送的视频数据， 对视频数据进行分 析， 当网络状况正常时， 如果在设定的阔值时间没有收到视频关键帧， 则向 流媒体服务器发送调整视频关键帧产生频率的请求。
下面结合具体实例对本发明作进一步说明。
图 3是一个流媒体客户端向流媒体直播服务器之间进行消息交互的流程 示意图， 图中描述了基本的消息流程， 同时， 为了简化示意图的结构， 仅仅 釆用了客户端和服务器之间的消息， 没有显示一些其他环节如门户网站、 传 输系统等， 包括以下步骤，
第一步： 流媒体客户端向流媒体服务器发送相关链接的 RTSP:Describe 消息。
第二步： 流媒体服务器发送响应 OK消息， 消息中有 SDP消息内容； 第三步： 客户端解析 SDP消息内容， 向服务器发送 SETUP请求消息； 第四步： 服务器响应客户端发送 OK消息；
第五步： 客户端向服务器发送 PLAY请求消息；
第六步： 服务器响应客户端发送 OK消息；
第七步： 客户端接收服务器发送来的 RTP消息，该 RTP消息中包含音频 数据信息；
第八步： 客户端向服务器发送 RTCP消息， 反馈一些网络信息； 第九步： 客户端接收服务器发送来的 RTP消息，该 RTP消息中包含视频 数据信息；
第十步： 客户端对接收到的视频数据进行分析， 当网絡状况正常时， 而 长时间收不到视频关键帧， 比如设置一个门槛值 10秒， 即用户在 10秒内没 有收到关键帧， 则客户端可以向流媒体服务器发起调整关键帧产生时间间隔 的请求。 ¾口：
SET— PARAMETER rtsp：〃 example.com/fizzle/foo RTSP/1.0
CSeq: 421
Session: efhyrio8012t
User-Agent: StreamClient/1. Ib5
Key-Frame- Span: 5
第十一步： 服务器收到客户端的请求后， 根据情况进行综合分析， 比如 组播或者广播时在同一时间段内收到了多个请求， 针对请求的时间做一个顺 序排列， 例如按照请求时间最小的数据执行； 或者在点播时直接根据用户请 求， 调整产生关键帧的频率；
第十二步： 服务器对客户端作出响应；
第十三步： 服务器在调整关键帧发送时间间隔后， 发送视频数据。 以上所述， 仅为本发明较佳的具体实施方式， 但本发明的保护范围并不 局限于此， 任何熟悉该技术的人在本发明所揭露的技术范围内， 可轻易想到 的变化或替换， 都应涵盖在本发明的保护范围之内。 因此， 本发明的保护范 围应该以权利要求的保护范围为准。
工业实用性
采用本发明提供的流媒体业务中获取关键帧的方法、 利用本发明提供的 流媒体业务系统、 用户设备或流媒体服务器， 能够快速响应用户对视频关键 产生频率调整的请求， 通过综合判断形成一个较为合理的视频关键帧产生时 间间隔， 使得用户对流媒体的体验更加快速流畅。 本发明主要涉及消息参数 的增加， 客户端和服务器改动均比较小， 不影响网络结构， 实现较为快速， 有很强的实用性。

Claims

权 利 要 求 书
1、 一种流媒体业务中获取关键帧的方法， 包括，
设置接收视频关键帧的阔值时间；
客户端从流媒体服务器接收视频数据， 并对所述视频数据进行分析， 当 网络状况正常时， 如果所述客户端在所述阈值时间内没有收到所述视频关键 帧， 则向所述流媒体服务器发送调整视频关键帧产生频率的请求； 以及
所述流媒体服务器收到所述请求后进行判断， 根据所述客户端的所述请 求， 调整所述视频关键帧产生频率。
2、 如权利要求 1所述的方法， 其中，
所述流媒体服务器根据所述客户端的所述请求调整所述视频关键帧产生 频率， 是指所述流媒体服务器在组播或者广播的同一时间段内收到了一个或 多个所述客户端的所述请求， 根据多数所述客户端的所述请求调整所述视频 关键帧产生频率； 或者是指所述流媒体服务器在点播时直接根据所述客户端 的所述请求调整所述视频关键帧产生频率。
3、 如权利要求 1所述的方法， 其中，
所述客户端通过实时流传输协议标准内的 SET— PARAMETER METHOD 对所述视频数据进行分析， 以判断在所述阈值时间是否收到视频关键帧。
4、 如权利要求 1所述的方法， 其中，
所述流媒体服务器调整所述视频关键帧产生频率的同时， 调整相应的视 频带宽需求。
5、 一种流媒体业务系统， 包括客户端和流媒体服务器， 其中， 所述客户端设置为从所述流媒体服务器接收视频数据 , 并对所述视频数 据进行分析， 当网络状况正常时， 如果在设定的阈值时间没有收到视频关键 帧， 则向所述流媒体服务器发送调整视频关键帧产生频率的请求；
所述流媒体服务器设置为向所述客户端发送所述视频数据， 在接收所述 客户端所述请求后进行判断， 根据所述客户端的所述请求， 调整所述视频关 键帧产生频率。
6、 如权利要求 5所述的流媒体业务系统， 其中，
所述流媒体服务器根据所述客户端的所述请求调整所述视频关键帧产生 频率， 是指所述流媒体服务器在组播或者广播的同一时间段内收到了一个或 多个所述客户端的所述请求， 根据多数所述客户端的所述情求调整所述视频 关键帧产生频率； 或者是指所述流媒体服务器在点播时直接根据所述客户端 的所述请求调整所述视频关键帧产生频率。
7、 如权利要求 5所述的流媒体业务系统， 其中，
所述客户端通过实时流传输协议标准内的 SET— PARAMETER METHOD 对所述视频数据进行分析，以判断在所述阈值时间是否收到所述视频关键帧。
8、 如权利要求 5所述的流媒体业务系统， 其中，
所述流媒体服务器还设置为在调整所述视频关键帧产生频率的同时， 调 整相应的视频带宽需求。
9、 一种用户设备， 所述用户设备设置为在流媒体业务中获取关键帧， 包括视频接收模块和控制模块， 其中，
所述视频接收模块设置为接收视频数据， 并将所述视频数据发送给所述 控制模块；
所述控制模块设置为接收所述视频数据， 对所述视频数据进行分析， 当 网络状况正常时， 如果在设定的阈值时间没有收到视频关键帧， 则向流媒体 服务器发送调整视频关键帧产生频率的请求。
10、 如权利要求 9所述的用户设备， 其中，
所述控制模块通过实时流传输协议标准内的 SET_PARAMETER METHOD对所述视频数据进行分析 ,以判断在所述阈值时间是否收到所述视 频关键帧。
11、 一种流媒体服务器， 所述流媒体服务器设置为向客户端发送视频数 据，接收所述客户端在对所述视频数据分析后发送的调整视频关键帧的请求， 对所述请求进行判断， 根据所述客户端的所述请求调整所述视频关键帧产生 频率。
12、 如权利要求 11所述的流媒体服务器， 所述流媒体服务器根据所述客 户端的所述请求调整所述视频关键帧产生频率， 是指所述流媒体服务器在组 播或者广播的同一时间段内收到了一个或多个所述客户端的所述请求， 根据 多数所述客户端的所述请求调整所述视频关键帧产生频率， 或者是指所述流 媒体服务器在点播时直接根据所述客户端的所述请求调整所述视频关键帧产 生频率。
13、 如权利要求 11所述的流媒体服务器， 所述流媒体服务器还设置为在 调整所述视频关键帧产生频率的同时， 调整相应的视频带宽需求。
PCT/CN2009/073501 2008-10-23 2009-08-25 流媒体业务中获取关键帧的方法、系统及用户设备 WO2010045826A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP09821547.8A EP2364017B1 (en) 2008-10-23 2009-08-25 Method, system and user device for obtaining key frame in streaming media service
US13/124,464 US8813160B2 (en) 2008-10-23 2009-08-25 Method, system and user device for obtaining a key frame in a streaming media service

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200810170583.7 2008-10-23
CN200810170583.7A CN101383959B (zh) 2008-10-23 2008-10-23 流媒体业务中获取关键帧的方法、系统及用户设备

Publications (1)

Publication Number Publication Date
WO2010045826A1 true WO2010045826A1 (zh) 2010-04-29

Family

ID=40463540

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2009/073501 WO2010045826A1 (zh) 2008-10-23 2009-08-25 流媒体业务中获取关键帧的方法、系统及用户设备

Country Status (4)

Country Link
US (1) US8813160B2 (zh)
EP (1) EP2364017B1 (zh)
CN (1) CN101383959B (zh)
WO (1) WO2010045826A1 (zh)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101383959B (zh) * 2008-10-23 2012-01-11 中兴通讯股份有限公司 流媒体业务中获取关键帧的方法、系统及用户设备
CN101854382A (zh) * 2010-04-26 2010-10-06 上海乐毅信息科技有限公司 用于监控视频在3g网络传输的优化方法
US8773490B2 (en) * 2010-05-28 2014-07-08 Avaya Inc. Systems, methods, and media for identifying and selecting data images in a video stream
KR101512584B1 (ko) * 2010-12-09 2015-04-15 노키아 코포레이션 비디오 시퀀스로부터의 제한된 콘텍스트 기반 식별 키 프레임
CN102819528B (zh) * 2011-06-10 2016-06-29 中国电信股份有限公司 生成视频摘要的方法和装置
JP6066561B2 (ja) * 2012-01-26 2017-01-25 キヤノン株式会社 映像処理装置、映像処理方法およびプログラム
KR101397592B1 (ko) 2012-03-21 2014-05-20 삼성전자주식회사 멀티미디어 콘텐츠를 수신하기 위한 방법 및 장치
CN103391403B (zh) * 2013-08-23 2017-08-25 北京奇艺世纪科技有限公司 一种实现多镜头视频拍摄的实时编辑方法及装置
US20150188963A1 (en) * 2013-12-30 2015-07-02 Sonic Ip, Inc. Systems and Methods for Distributing Adaptive Bitrate Streaming Content by Multicast
US9386067B2 (en) 2013-12-30 2016-07-05 Sonic Ip, Inc. Systems and methods for playing adaptive bitrate streaming content by multicast
US20170085931A1 (en) * 2015-09-22 2017-03-23 Samsung Electronics Co., Ltd. Electronic apparatus and method for providing content thereof
US10805615B2 (en) 2016-12-14 2020-10-13 LogMeln, Inc. Synchronizing video signals using cached key frames
CN108259815B (zh) * 2018-03-20 2020-09-01 广州视源电子科技股份有限公司 视频关键帧转发方法、装置和视频直播系统
CN111787292B (zh) * 2020-09-04 2020-12-04 浙江大华技术股份有限公司 基于多个网络摄像机的数据传输方法及相关装置
CN112165653B (zh) * 2020-09-28 2022-04-15 中国建设银行股份有限公司 一种视频播放方法、装置及设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1964485A (zh) * 2006-09-05 2007-05-16 中兴通讯股份有限公司 一种多媒体广播频道快速播放的方法
JP2007124576A (ja) * 2005-10-31 2007-05-17 Sharp Corp 映像再生装置、映像再生方法、映像再生プログラム、および、映像再生プログラムを記録した記録媒体
CN101222616A (zh) * 2008-01-22 2008-07-16 中兴通讯股份有限公司 点播服务中的mpeg传送流的传输处理方法
JP2008172629A (ja) * 2007-01-12 2008-07-24 Victor Co Of Japan Ltd コンテンツ統合サーバ
CN101383959A (zh) * 2008-10-23 2009-03-11 中兴通讯股份有限公司 流媒体业务中获取关键帧的方法、系统及用户设备

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06237451A (ja) * 1993-02-10 1994-08-23 Hitachi Ltd 動画通信方式および端末装置
US6680976B1 (en) * 1997-07-28 2004-01-20 The Board Of Trustees Of The University Of Illinois Robust, reliable compression and packetization scheme for transmitting video
CN1717935B (zh) 2002-11-27 2010-06-16 皇家飞利浦电子股份有限公司 根据请求进行ⅰ图像插入
EP1453269A1 (en) 2003-02-25 2004-09-01 Matsushita Electric Industrial Co., Ltd. A method of reporting quality metrics for packet switched streaming
FR2860665B1 (fr) 2003-10-07 2006-04-07 Canon Kk Decodage de sequence d'images numeriques
ES2338232T3 (es) * 2004-07-01 2010-05-05 Oy Gamecluster Ltd Procedimiento y dispositivo para transferir tramas de datos predictivas y no predictivas.
JP2007116543A (ja) 2005-10-21 2007-05-10 Canon Inc 無線通信装置、無線通信装置の制御方法およびプログラム
US8842555B2 (en) * 2005-10-21 2014-09-23 Qualcomm Incorporated Methods and systems for adaptive encoding of real-time information in packet-switched wireless communication systems
US7673238B2 (en) * 2006-01-05 2010-03-02 Apple Inc. Portable media device with video acceleration capabilities
KR100842262B1 (ko) * 2006-11-16 2008-06-30 한국전자통신연구원 Ｉｐｔｖ 서비스 또는 디지털 방송 환경에서의 방송 채널전환 가속 시스템 및 그 방법
US8238420B1 (en) * 2008-01-24 2012-08-07 Adobe Systems Incorporated Video content transcoding for mobile devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007124576A (ja) * 2005-10-31 2007-05-17 Sharp Corp 映像再生装置、映像再生方法、映像再生プログラム、および、映像再生プログラムを記録した記録媒体
CN1964485A (zh) * 2006-09-05 2007-05-16 中兴通讯股份有限公司 一种多媒体广播频道快速播放的方法
JP2008172629A (ja) * 2007-01-12 2008-07-24 Victor Co Of Japan Ltd コンテンツ統合サーバ
CN101222616A (zh) * 2008-01-22 2008-07-16 中兴通讯股份有限公司 点播服务中的mpeg传送流的传输处理方法
CN101383959A (zh) * 2008-10-23 2009-03-11 中兴通讯股份有限公司 流媒体业务中获取关键帧的方法、系统及用户设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2364017A4 *

Also Published As

Publication number Publication date
CN101383959A (zh) 2009-03-11
US20110265130A1 (en) 2011-10-27
EP2364017A4 (en) 2012-08-22
EP2364017B1 (en) 2016-04-06
EP2364017A1 (en) 2011-09-07
US8813160B2 (en) 2014-08-19
CN101383959B (zh) 2012-01-11

Similar Documents

Publication Publication Date Title
WO2010045826A1 (zh) 流媒体业务中获取关键帧的方法、系统及用户设备
US10873608B2 (en) Methods and devices for media description delivery
TWI516064B (zh) 媒體串流傳輸的通信期控制
JP2008530835A (ja) パケット交換ネットワーク上のオンデマンドマルチチャネルストリーミングセッション
EP2466911B1 (en) Method and device for fast pushing unicast stream in fast channel change
US20130013799A1 (en) Method and apparatus for transmitting and receiving content in a broadcasting system
WO2009049478A1 (fr) Procédé, système et dispositif pour lire un média diffusé en continu
JP2011525757A (ja) メディアコンテンツを推奨する方法、装置およびシステム
WO2013127172A1 (zh) 一种流媒体传输方法、设备及系统
JP2007536859A (ja) ストリーミングサービスにおける改善された品質フィードバック
WO2009018738A1 (fr) Procédé, dispositif et système de service associé destinés à fournir un contenu vidéo
WO2009138045A1 (zh) 书签业务处理方法及系统和书签业务提供装置
WO2009138006A1 (zh) 媒体播放控制的方法及系统、元数据执行单元
WO2011143867A1 (zh) 一种实现机顶盒与家庭网关交互的方法及系统
WO2008148333A1 (fr) Système et procédé de traitement d'un flux vidéo
WO2011022994A1 (zh) 组播实时传输协议会话快速接入的方法、装置及系统
WO2013155766A1 (zh) 一种多媒体视频数据的发送、接收方法及对应装置
WO2014026590A1 (zh) Iptv系统实现边放边下的方法、终端及cdn服务器
JP2004187170A (ja) ビデオ会議システム
WO2009015539A1 (fr) Procédé de commande multidiffusion pour service de demande de contenu multimédia et son système
WO2014110670A1 (en) Media server
WO2010025675A1 (zh) 一种业务内容的播放方法、系统和装置
US9066127B2 (en) Method and device for controlling bandwidth of set top boxes in internet protocol television (IPTV) system
WO2015109842A1 (zh) 一种处理分段节目的方法、服务器及客户端设备
WO2011107017A1 (zh) 一种媒体同步的方法和系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09821547

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 13124464

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2009821547

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE