WO2009115011A1 - 实现流媒体定位播放的方法、装置及系统 - Google Patents

实现流媒体定位播放的方法、装置及系统 Download PDF

Info

Publication number
WO2009115011A1
WO2009115011A1 PCT/CN2009/070720 CN2009070720W WO2009115011A1 WO 2009115011 A1 WO2009115011 A1 WO 2009115011A1 CN 2009070720 W CN2009070720 W CN 2009070720W WO 2009115011 A1 WO2009115011 A1 WO 2009115011A1
Authority
WO
WIPO (PCT)
Prior art keywords
positioning
streaming media
key frame
preview
user
Prior art date
Application number
PCT/CN2009/070720
Other languages
English (en)
French (fr)
Inventor
李华
范云松
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP09700051A priority Critical patent/EP2120459A4/en
Priority to US12/482,548 priority patent/US8875201B2/en
Publication of WO2009115011A1 publication Critical patent/WO2009115011A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17336Handling of requests in head-ends
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection

Definitions

  • the present invention relates to the field of streaming media technologies, and in particular, to a method, device and system for implementing streaming media positioning and playback.
  • Streaming media refers to the use of streaming technology in the network for the transmission of media files. The user does not need to wait for the download of all the streaming media files to complete, but only waits for a short period of time to watch. While the user is watching, the background will continue to download the remaining streaming media files to ensure the integrity of the viewing.
  • streaming media fast-forward, fast-return, and positioning experience based on user control on the terminal has become a feature of streaming media playback.
  • most of the positioning operation schemes used in the existing streaming media playback scheme are input through a series of user interfaces (UI, User Interface) of the user, and a target time point is obtained, and then the user confirms the input.
  • the screen will switch to the target time point; however, user positioning is usually only concerned with the content of the program.
  • the existing implementation of streaming media positioning plays the following technical solution: When the program is released, several frame images of the program source are extracted at agreed time intervals, processed/compressed and sent to the streaming media server as part of the program information, the user When the program is on-demand, the processed/compressed extracted program is automatically downloaded to the local, so that when the user controls the cursor to move the play progress bar, the program source screen extracted at the same time period as the time can be displayed according to the time at which the cursor stays.
  • the technical problem to be solved by the embodiments of the present invention is to provide a method, device, and system for implementing streaming media positioning and playing, so as to improve the positioning operation experience of the user, control the downloading time of the extracted program, and reduce the storage requirement of the streaming media terminal.
  • a streaming media positioning and playing method includes:
  • a streaming media terminal comprising:
  • a positioning play request sending unit configured to send a positioning play request to the streaming media server
  • a receiving processing unit configured to receive and store the preview key frame data of the positioning play delivered by the streaming media server according to the predetermined bufferable amount range
  • a preview display processing unit configured to preview display a preview key frame image stored by the receiving processing unit according to a user positioning operation request
  • the positioning playback processing unit starts streaming media playback according to the selected preview key frame of the user positioning.
  • a streaming media server comprising:
  • a receiving processing unit configured to perform a receiving process on the positioning play request sent by the streaming media terminal; and a selecting processing unit, configured to select, according to the positioning play request received by the receiving processing unit, the preview key frame data of the positioning play;
  • the processing unit sends the preview key frame data of the positioning play selected by the processing unit to the streaming media terminal.
  • a streaming media system including a streaming media terminal and a streaming media server, wherein the streaming media terminal is configured to: send a positioning play request to a streaming media server;
  • the streaming media server receives a positioning play request sent by the streaming media terminal, and selects preview key frame data for positioning and playing according to the received positioning play request; and sends the selected preview key frame data for positioning playback Give streaming media terminals.
  • the streaming media terminal may send a positioning play request to the streaming media server according to the request of the user to initiate the positioning operation; and receive and store the preview key frame data sent by the streaming media server for positioning and playing; Displaying the stored preview key frame data according to the user positioning operation request; starting the streaming media playback according to the selected preview key frame of the user positioning, because the streaming media terminal can directly display the screen to the user in a preview manner during the positioning operation;
  • the user can provide a WYSIWYG location preview experience, which improves the user's positioning operation experience.
  • the streaming media terminal can control receiving and storing the preview key issued by the streaming media server for positioning and playing. Frame data. Therefore, the time to download the extracted program to the local is controllable, and the storage capacity of the streaming media terminal is reduced.
  • FIG. 1 is a schematic flowchart of a streaming media positioning and playing method according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a streaming media server selecting and delivering a key frame according to a step size and a direction specified by a streaming media terminal according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a method for controlling a buffering sliding window of a streaming media terminal according to an embodiment of the present invention
  • FIG. 4 is a schematic flowchart of a streaming media terminal and a streaming media server for implementing streaming media positioning and playing according to an embodiment of the present invention
  • FIG. 5 is a schematic structural diagram of a streaming media system according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a streaming media terminal positioning play request sending unit according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a streaming media terminal receiving processing unit according to an embodiment of the present invention
  • FIG. 8 is a schematic structural diagram of a streaming media terminal according to an embodiment of the present invention
  • FIG. 9 is a schematic structural diagram of a streaming media terminal detection processing unit according to an embodiment of the present invention
  • FIG. 10 is a schematic structural diagram of a streaming media server receiving processing unit according to an embodiment of the present invention. detailed description
  • FIG. 1 the figure is a schematic flowchart of a streaming media positioning and playing method according to an embodiment of the present invention.
  • the streaming media location playback processing on the streaming media terminal side is taken as an example for description. To include the following steps:
  • Step S101 Send a positioning play request to the streaming media server.
  • the positioning play request is sent according to the request of the user to initiate the positioning operation.
  • the step information and the positioning direction information of the selected preview key frame may be carried in the positioning play request.
  • the streaming media server may select a preview key frame according to the step information and the positioning direction information sent by the streaming media terminal, and the selection of the preview key frame may be based on the step information and the positioning direction information from the current time point. Select.
  • the step information and the positioning direction information of the selected preview key frame may not be carried, and the streaming media server may select the preview key frame by other means, for example, according to its default setting.
  • the figure is a schematic diagram of a streaming media server selecting and delivering a key frame according to a step and direction specified by a streaming media terminal according to an embodiment of the present invention.
  • the frame data is sent in the order of the key frame II, the predicted coded frame P, the predicted coded frame P, and the bidirectionally predictive coded frame B.
  • the streaming media terminal needs to send the positioning direction and the step size to the streaming media server.
  • the information that is, the step size is L1 or L2, and the streaming server determines whether it is forward selection or reverse selection according to the positioning direction, and selects the preview key according to the step length L1 or L2 according to the step time interval in the stored code stream data.
  • the frame is sent to the streaming media terminal. For example, if the step size is L1, the preview key frame of the IL10, IL1x, ILly...ILln is sent to the streaming media terminal, or if the step size is L2, the IL20 is selected.
  • the preview key frames of IL2x, IL2y...IL2n are sent to the streaming terminal.
  • Step S102 Receive and store a preview key frame for positioning and playing by the streaming media server according to a predetermined bufferable amount range, where the predetermined bufferable amount range may be a default setting on the streaming media terminal, or may be Need to set it yourself.
  • the streaming media server may issue a preview key frame for positioning playback in an oppressed manner.
  • the pressing mode means that whenever the streaming media terminal can receive data, the streaming media server immediately sends data to the streaming media terminal until the streaming media terminal cannot receive more data, and the pressing mode can minimize the streaming media terminal and The interaction overhead of the streaming media server to reduce communication time and improve user experience.
  • the Buffer window size is WS. If the streaming media terminal receives a frame, the window size is reduced. 1. Once the window size is 0, the streaming server stops sending data. The server is notified when the location buffer window of the terminal changes, and the server then delivers the media data.
  • a buffer Buffer can also be maintained in the streaming media terminal, and the streaming media server passes the check.
  • the measurement mechanism detects that the available buffer window of the streaming media terminal is 0. After detecting that the available buffer window is 0, the streaming server can initiate a retransmission mechanism to attempt to continue to deliver the preview key frame data.
  • the streaming media terminal does not need to send a response to the streaming media server during normal transmission, but can send a response message to the streaming media server once the available buffer window is close to 0 or 0 (according to the implementation mechanism).
  • the streaming media terminal can no longer receive data, and the streaming media server records the time point at which the streaming media terminal receives the data. Thereafter, the streaming media server attempts to send a message to the streaming media terminal from the data after the time point (retransmission mechanism)
  • the streaming terminal has a window that is not 0, the response is sent to the streaming server, otherwise the streaming server repeatedly transmits the frame.
  • the streaming media terminal can set a certain buffer amount of the decoding buffer sliding window WS for buffering the streaming media data, and the video output is kept suspended when the user performs the positioning operation, on the streaming media terminal.
  • Controlling receiving and storing the preview key frame of the positioning play delivered by the streaming media server according to the decoding buffer sliding window, and keeping the current decoding pointer of the decoding buffer sliding window as far as possible to the preview key frame of the middle position of the sliding window,
  • the current decoding pointer points to the frame of the current terminal player to be decoded.
  • the current decoding pointer of the decoding buffer sliding window is stepped with each click. Corresponding keyframes.
  • the decoding buffer sliding window is shifted to the right; if the user positioning operation request direction is a reverse operation, the decoding buffer sliding window is shifted to the left;
  • the subsequent key frame is discarded only when it is not within the range of the decoding buffer sliding window, otherwise it is always stored in the buffer of the decoding buffer sliding window;
  • the streaming media server reports the start time point corresponding to the decoding buffer sliding window of the preview key frame to the streaming media server, for example, if the original positioning operation request direction is Right, that is, the positioning operation request direction is forward. At this time, the decoding buffer sliding window is full. After moving one space to the left, that is, after the positioning operation direction is reversed, the time of one frame required by the leftmost side must be reported. To the streaming server, let the streaming server send the preview key frame data from the frame after the point to ensure the continuity of the data in the buffer of the decoding buffer sliding window.
  • Step S103 displaying a corresponding preview key frame picture, where the key frame pointed by the current decoding pointer is displayed, and when the specific implementation is performed, the display is mainly performed according to the user positioning operation request, for example, the user By stepping by hop by step, the corresponding preview key frame picture can be displayed to the user one by one in the same step direction;
  • Step S104 Start streaming media playback according to the selected preview key frame of the user positioning. For example, when the user locates the screen according to a certain preview key frame, the streaming media may be started from the preview key frame selected by the positioning. Play.
  • the user after detecting that the user stops the positioning operation, for example, detecting that the user stops the positioning operation for more than the specified time, the user enters the playing state, and re-enters the playing from the key frame of the current positioning output.
  • the streaming media terminal can directly display the screen to the user in a preview manner during the positioning operation; the user can provide a WYSIWYG location preview experience, which improves the user's positioning operation experience;
  • the streaming media terminal can control the receiving and storing the preview key frame data for positioning and playing by the streaming media server according to the predetermined bufferable amount range, for example, the decoding buffer sliding window according to the set certain buffer amount. It is used to control the cached streaming media data. Therefore, the time for downloading the extracted program to the local is controllable, and the storage capacity of the streaming media terminal is also reduced.
  • a streaming media terminal interacts with a streaming media server to implement streaming media positioning and playback.
  • FIG. 4 the figure is a flowchart for implementing streaming media positioning and playing by a streaming media terminal and a streaming media server according to an embodiment of the present invention.
  • the streaming media terminal sends a positioning play request to the streaming media server, where the positioning playback request carries the specified step and the forward positioning direction (step S202);
  • the streaming media server accepts the positioning play request, and selects the preview key frame according to the specified step size, and sends it to the streaming media terminal in an oppressed manner (step 203);
  • the streaming media terminal buffers the preview key frame sent by the streaming media server (step S204) Then the user forwards the button stepwise or continuously, and the streaming media terminal outputs the preview key frame according to the specified step size (steps S205-S206); wherein the streaming media terminal can maintain a decoding buffer sliding window buffer preview key frame, if When the decoding buffer sliding window is idle, the streaming server can continue to transmit the preview key frame in an oppressed manner (step S207).
  • the user reverse positioning operation is similar, that is, the user operation enters the reverse positioning play (step S301); the streaming media terminal sends a positioning play request to the streaming media server, and the positioning play request Carrying the specified step size and the reverse positioning direction (step S302); the streaming media server accepts the positioning play request, and selects the preview key frame according to the specified step size, and sends the preview to the streaming media terminal in an oppressive manner (step 303); The media terminal buffers the preview key frame sent by the streaming media server (step S304); then if the user reverses the button stepping or continuous operation, the streaming media terminal outputs the preview key frame according to the specified step size (steps S305-S306); The media terminal can maintain a decoding buffer sliding window buffer preview key frame. If the decoding buffer sliding window is idle, the streaming server can continue to send the preview key frame in an oppressed manner (step S307).
  • the method for implementing the streaming media positioning and playing in this embodiment can be used to display the video to the user directly in the preview mode, whether the device is in the forward positioning or the reverse positioning.
  • the WYSIWYG location preview experience improves the user's positioning operation experience.
  • the streaming media terminal can control receiving and storing the preview key frame data sent by the streaming media server for positioning playback, for example, according to
  • the decoding buffer sliding window of a certain buffer amount is set for controlling the buffer streaming media data, so that the time for downloading the extracted program to the local is controllable, and the storage capacity of the streaming media terminal is also reduced.
  • FIG. 5 a schematic structural diagram of a streaming media system according to an embodiment of the present invention.
  • the streaming media system includes a streaming media terminal 1 and a streaming media server 2, which are respectively described below.
  • the streaming media terminal is configured to: send a positioning play request to the streaming media server; receive and store the preview key frame data of the positioning play delivered by the streaming media server according to the predetermined bufferable amount range; and request preview display of the preview according to the user positioning operation request Keyframe data; initiates streaming playback based on the selected preview keyframe selected by the user.
  • the streaming media server is configured to: receive a positioning play request sent by the streaming media terminal, and select preview key frame data for positioning and playing according to the positioning play request; and send the preview key frame data for positioning playback Give streaming media terminals.
  • the streaming media terminal 1 may include: a positioning play request sending unit 11, a receiving processing unit 12, a preview display processing unit 13, and a positioning play processing unit 14, which are specifically described as follows:
  • the positioning play request sending unit 11 is mainly configured to send a positioning play request to the streaming media server.
  • the positioning play request sending unit 11 mainly sends a positioning play request according to the request of the user to initiate the positioning operation, for example, the user operates the positioning play. After the positioning operation is performed, the positioning and playing request sending unit 11 may send a positioning and playing request to the streaming server.
  • the positioning and playing request sending unit 11 may include:
  • the encapsulating subunit 111 is configured to encapsulate a positioning play request carrying the step size and/or the positioning direction information, and the sending subunit 112 sends the positioning play request of the carrying step and/or the positioning direction information encapsulated by the encapsulating subunit 111. Give the streaming server.
  • the receiving processing unit 12 is configured to receive and store the preview key frame data of the positioning and playback issued by the streaming media server according to the predetermined bufferable amount range.
  • the decoding buffer sliding window WS is configured to buffer the streaming media data, and the receiving processing unit 12 can control the receiving and storing the preview key frame of the positioning playback delivered by the streaming media server according to the decoding buffer sliding window, and maintain the decoding buffer sliding.
  • the current decoding pointer of the window points to the middle of the sliding window as much as possible.
  • the receiving processing unit 12 may include:
  • the receiving sub-unit 121 is configured to receive preview key frame data of the positioning play delivered by the streaming media server;
  • the determining sub-unit 122 is configured to determine whether the preview key frame data of the stored positioning play has reached the decoding buffer sliding window limit
  • the storage subunit 123 is configured to store the preview key frame data received by the receiving subunit 121 when the judgment subunit 122 determines that the result is no.
  • the preview display processing unit 13 is mainly configured to preview and display the stored preview key frame data according to the user positioning operation request. For example, referring to the foregoing description, the user steps by hop by clicking, and then previewing the display processing unit 13 The corresponding preview key frame picture can be displayed to the user one by one in the same step direction;
  • the positioning and playing processing unit 14 is mainly used to start streaming media playback according to the selected preview key frame of the user positioning.
  • the positioning may be performed from the positioning.
  • the selected preview keyframe initiates streaming playback.
  • the embodiment further includes an operation detecting unit: configured to detect a user operation. Specifically, when the user initiates the positioning operation, the notification positioning play request sending unit 11 is detected, for example, detecting that the user operates the positioning play bar to start the positioning operation; and detecting the user performing the positioning operation, notifying the preview display processing unit 13, for example, detecting the user clicking manner.
  • the hop-by-hop stepping is performed; when the user starts the streaming media playback, the positioning playback processing unit 14 is notified.
  • FIG. 8 is another schematic structural diagram of a streaming media terminal according to an embodiment of the present invention.
  • the streaming media terminal in this embodiment includes a positioning play request sending unit 11, a receiving processing unit 12, a preview display processing unit 13, and a positioning play processing unit 14, and further includes: a detecting processing unit 15.
  • the detecting process 15 is mainly used to notify the positioning and playing processing unit 14 to start streaming media playback after detecting that the user stops the positioning operation.
  • the detecting processing unit 15 Can include:
  • the determining sub-unit 151 is configured to determine that the user stops the positioning operation when the user stops the positioning operation for more than a predetermined time.
  • the predetermined time may be set by default, or may be set by the user;
  • Determining the sub-unit 152 if it is determined that the sub-unit 151 determines that the result is YES, it is determined that the user stops the positioning operation, and the positioning playback processing unit 14 is notified to start streaming media playback. Otherwise, it is determined that the user does not detect the positioning operation, and does not do deal with.
  • the streaming media server 2 may include: a receiving processing unit 21, a selecting processing unit 22, and a sending processing unit 23, which are specifically described as follows:
  • the receiving processing unit 21 is mainly configured to receive and process a positioning play request sent by the streaming media terminal.
  • the positioning playback request sent by the streaming media terminal may be directly received, or may be parsed after receiving the positioning playback request.
  • the locating play request obtains the step information and the locating direction information carried in the request.
  • the receiving processing unit 21 may include:
  • the receiving subunit 211 is configured to receive a positioning play request sent by the streaming media terminal.
  • the parsing sub-unit 212 is configured to parse the positioning play request received by the receiving sub-unit 211 to obtain step information and positioning direction information of the preview key frame selection.
  • the selection processing unit 22 is mainly used to select and use according to the positioning play request.
  • the selection processing unit 22 may perform the selection according to the step information and the positioning direction information carried in the positioning play request, or the selection processing unit 22 may set according to the streaming media server itself. Step or direction information is selected, or other methods are selected, and will not be described in detail here;
  • the delivery processing unit 23 mainly sends the preview key frame data for the positioning and playback to the streaming media terminal.
  • the delivery processing unit 23 can be delivered in an oppressed manner, that is, once When it is detected that the buffer area of the cacheable preview key frame on the streaming media terminal is idle, the preview key frame is sent to the streaming media terminal, and when the cache area of the preview key frame can be cached on the streaming media terminal, the flow to the streaming media terminal is stopped. Send a preview keyframe.
  • the streaming media terminal can directly display the screen to the user in a preview manner during the positioning operation; the user can be given a WYSIWYG positioning preview.
  • the user's positioning operation experience is improved; and after the user initiates the positioning operation, the streaming media terminal can control receiving and storing the preview key frame data sent by the streaming media server for positioning and playing, for example, according to a certain buffer amount set.
  • the decoding buffer sliding window is used to control the buffered streaming media data, so that the time to download the extracted program to the local is controllable, and the storage capacity of the streaming media terminal is also reduced.
  • the present invention can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is a better implementation. the way.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a A computer device (which may be a personal computer, server, or network device, etc.) performs the methods described in various embodiments of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Description

实现流媒体定位播放的方法、 装置及系统
本申请要求于 2008 年 03 月 19 日提交中国专利局、 申请号为 200810026890.8, 发明名称为"实现流媒体定位播放的方法、 装置及系统"的中 国专利申请的优先权, 其全部内容通过引用结合在本申请中。
技术领域
本发明涉及流媒体技术领域,特别是指实现流媒体定位播放的方法、装置 及系统。
背景技术
流媒体是指在网络中使用流式传输技术进行媒体文件的传输。用户不需等 待全部流媒体文件下载完成, 而只需等待一小段时间就可以进行观看,在用户 观看的同时后台会继续对流媒体文件剩余的进行下载以保证观看的完整性。
目前,随着流媒体技术的发展,基于终端上用户控制的流媒体快进、快退、 定位体验成为了流媒体播放的一个特点。但是现有实现流媒体播放的方案中所 采用的定位操作方案大多都是通过用户一系列的用户接口(UI, User Interface ) 输入, 得到一个定位的目标时间点, 然后通过用户确认输入, 此时画面才会切 换至目标时间点;但用户定位往往所关心的只是节目的内容,在通过目标时间 点进行定位时并不直观, 而且用户对于定位的目标时间点并不能很好的把握, 所以经常需要用户多次定位或者定位加快进、快退的组合来达到实际的定位播 放目的, 用户操作并不方便。
现有的实现流媒体的定位播放采用如下的技术方案: 在节目发布时, 以约 定的时间间隔抽取节目源的若干帧画面, 处理 /压缩后发送到流媒体服务器, 作为节目信息的一部分, 用户点播节目时, 将所述处理 /压缩后的抽取的节目 自动下载到本地, 以实现用户控制光标移动播放进度条时,可根据光标停留的 时刻显示与该时刻相同时段抽取的节目源画面。
但发明人在对现有技术进行研究后,发现现有技术存在以下缺陷: 在节目 播放时, 需要下载抽取后的节目到本地需要较长的时间; 如果节目时间较长, 码流较大时,抽取后的节目大小将会变得非常大,这就要求流媒体终端的有非 常高的存贮能力。
发明内容 本发明实施例解决的技术问题是提供一种实现流媒体定位播放的方法、装 置及系统, 以改善用户的定位操作体验, 控制抽取节目的下载时间, 降低对流 媒体终端的存储要求。
本发明实施例提供如下技术方案:
一种流媒体定位播放方法, 包括:
向流媒体服务器发送定位播放请求;
根据预定可緩存量范围接收并存储流媒体服务器下发的用于定位播放的 预览关键帧;
显示所述用于定位播放的预览关键帧画面;
根据用户定位选定的预览关键帧启动流媒体播放。
一种流媒体终端, 包括:
定位播放请求发送单元, 用于向流媒体服务器发送定位播放请求; 接收处理单元,用于根据预定可緩存量范围接收并存储流媒体服务器下发 的定位播放的预览关键帧数据;
预览显示处理单元,用于根据用户定位操作请求预览显示所述接收处理单 元存储的预览关键帧画面;
定位播放处理单元, 根据用户定位选定的预览关键帧启动流媒体播放。 一种流媒体服务器, 包括:
接收处理单元, 用于对流媒体终端发来的定位播放请求进行接收处理; 选取处理单元,用于根据所述接收处理单元接收的定位播放请求选取定位 播放的预览关键帧数据;
下发处理单元,将选取处理单元选取的定位播放的预览关键帧数据下发给 流媒体终端。
一种流媒体系统, 包括流媒体终端和流媒体服务器,其中所述流媒体终端 用于: 向流媒体服务器发送定位播放请求;
根据预定可緩存量范围接收并存储流媒体服务器下发的定位播放的预览 关键帧数据;
根据用户定位操作请求预览显示存储的预览关键帧数据;
根据用户定位选定的预览关键帧启动流媒体播放; 所述流媒体服务器: 对流媒体终端发来的定位播放请求进行接收处理; 根据接收的定位播放请求选取用于定位播放的预览关键帧数据; 将选取的用于定位播放的预览关键帧数据下发给流媒体终端。
根据上述本发明实施例的技术方案 ,例如可由流媒体终端根据用户启动定 位操作的请求向流媒体服务器发送定位播放请求;接收并存储流媒体服务器下 发的用于定位播放的预览关键帧数据;根据用户定位操作请求显示所述存储的 预览关键帧数据;根据用户定位选定的预览关键帧启动流媒体播放, 由于在定 位操作的过程中流媒体终端能够直接以预览的方式将画面展示给用户;可给用 户一种所见即所得的定位预览体验, 改善了用户的定位操作体验; 且用户启动 定位操作后,流媒体终端可控制接收并存储流媒体服务器下发的用于定位播放 的预览关键帧数据。 因此, 下载抽取后的节目到本地的时间可控, 降低了对流 媒体终端的存储能力。
附图说明
图 1是本发明实施例流媒体定位播放方法的流程示意图;
图 2是本发明实施例流媒体服务器根据流媒体终端指定的步长和方向选 取并下发关键帧的示意图;
图 3是本发明实施例流媒体终端解码緩冲滑动窗口控制方式示意图; 图 4是本发明实施例流媒体终端与流媒体服务器交互实现流媒体定位播 放的流程示意图;
图 5是本发明实施例流媒体系统的结构示意图;
图 6是本发明实施例流媒体终端定位播放请求发送单元的一种结构示意 图;
图 Ί是本发明实施例流媒体终端接收处理单元的一种结构示意图; 图 8是本发明实施例流媒体终端的一种结构示意图;
图 9是本发明实施例流媒体终端检测处理单元的一种结构示意图; 图 10是本发明实施例流媒体服务器接收处理单元的一种结构示意图。 具体实施方式
参考图 1, 该图是本发明实施例流媒体定位播放方法的流程示意图。 本实施例中以流媒体终端侧的流媒体定位播放处理为例进行说明,具体主 要包括下述步骤:
步骤 S101 , 向流媒体服务器发送定位播放请求, 具体实现时, 主要是根 据用户启动定位操作的请求发送定位播放请求,例如可在定位播放请求中携带 选取预览关键帧的步长信息和定位方向信息,这样, 流媒体服务器可根据流媒 体终端发送来的所述步长信息和定位方向信息选取预览关键帧 ,预览关键帧的 选取可以是从当前时间点开始根据所述步长信息和定位方向信息选取。 另夕卜, 也可不携带所述的选取预览关键帧的步长信息和定位方向信息,而由流媒体服 务器通过其他方式, 例如根据自身默认设置来选取预览关键帧。
以具体实施例来说, 例如, 参考图 2, 该图是本发明实施例流媒体服务器 根据流媒体终端指定的步长和方向选取并下发关键帧的示意图。正常码流情况 下, 帧数据按照关键帧 II , 预测编码帧 P, 预测编码帧 P, 双向预测编码帧 B 的顺序下发,本实施例中流媒体终端需要向流媒体服务器发送定位方向和步长 信息, 即步长均为 L1或者 L2, 流媒体服务器根据定位方向确定是正向选取, 还是反向选取, 根据所述步长 L1或者 L2从存储的码流数据中按照步长时间 间隔选取预览关键帧并下发给流媒体终端, 例如若步长为 Ll, 则选取 IL10, ILlx, ILly...ILln的预览关键帧下发给流媒体终端, 或者, 若步长为 L2, 则 选取 IL20, IL2x, IL2y...IL2n的预览关键帧下发给流媒体终端。
步骤 S102, 根据预定可緩存量范围接收并存储所述流媒体服务器下发的 用于定位播放的预览关键帧,所述预定可緩存量范围可以是流媒体终端上默认 设置, 也可以由用户根据需要自行设置。 另外, 具体实现时, 例如流媒体服务 器可能以压迫方式下发定位播放的预览关键帧。所述压迫方式, 即指每当流媒 体终端可以接收数据 ,则流媒体服务器就立即向流媒体终端下发数据直到流媒 体终端不能接收再多的数据为止,压迫方式能够尽量减少流媒体终端和流媒体 服务器的交互开销, 以减少通信时间, 提高用户体验。
例如: 流媒体终端开始定位时的定位緩冲 Buffer窗口大小为 WS, 那么流 媒体终端每收到一个帧, 窗口大小就减 1, 一旦窗口大小为 0, 流媒体服务器 停止发送数据。 当终端的定位緩冲窗口变化时通知服务器,服务器再下发媒体 数据。
本实施例中在流媒体终端还可维护一个緩冲 Buffer,流媒体服务器通过检 测机制检测到流媒体终端的可用緩冲窗口为 0的状态,当检测到该可用緩冲窗 口为 0之后, 流媒体服务器可启动一种重传机制试图继续下发预览关键帧数 据。
需要说明的,正常发送时流媒体终端不用向流媒体服务器发送响应,但一 旦可用緩冲窗口接近为 0或为 0时(根据实现机制可以选择), 则可向流媒体 服务器发送响应报文告知流媒体终端无法再接收数据,流媒体服务器此时会记 录流媒体终端接收数据到哪个时间点 ,此后流媒体服务器会从该时间点之后的 数据开始试图发送报文给流媒体终端 (重传机制), 当流媒体终端有窗口不为 0时发送响应给流媒体服务器, 否则流媒体服务器一直重复发送该帧。
为此, 例如, 参考图 3所示, 流媒体终端可设定一定緩冲量的解码緩冲滑 动窗口 WS用于緩存流媒体数据,在用户进行定位操作时,视频输出维持暂停, 流媒体终端上按照所述的解码緩冲滑动窗口控制接收并存储流媒体服务器下 发的定位播放的预览关键帧,并保持解码緩冲滑动窗口的当前解码指针尽量指 向该滑动窗口的中间位置的预览关键帧 ,当前解码指针指向的是当前终端播放 器的要解码输出的帧; 当用户以单击方式逐跳步进定位时, 每单击一次, 该解 码緩冲滑动窗口的当前解码指针随之步进指向相应的关键帧。
如图 3所示, 若用户定位操作请求方向是正向操作时, 所述解码緩冲滑动 窗口右移; 若用户定位操作请求方向是反向操作时, 所述解码緩冲滑动窗口左 移; 解码后的关键帧仅当它不在所述解码緩存滑动窗口的范围内时被丢弃, 否 则一直存放在所述解码緩冲滑动窗口的緩冲区中;
另夕卜,在用户定位操作请求方向改变后, 向流媒体服务器上报流媒体服务 器再次下发预览关键帧的解码緩冲滑动窗口对应的开始时间点, 例如, 若原来 的定位操作请求方向是向右的, 即定位操作请求方向为正向,此时解码緩冲滑 动窗口是满的, 向左移动一格后, 即定位操作方向为反向后, 必须将最左边要 求的一帧的时间上报给流媒体服务器 ,让流媒体服务器从该点以后的帧开始发 送预览关键帧数据,以保证解码緩冲滑动窗口的緩冲区中数据在时间上的连续 性。
步骤 S103 , 显示相应的预览关键帧画面, 所显示的是当前解码指针指向 的关键帧, 具体实现时, 主要是根据用户定位操作请求进行显示, 例如, 用户 以单击方式逐跳步进,则可同样按照步进方向逐个向用户显示相应的预览关键 帧画面;
步骤 S104, 根据用户定位选定的预览关键帧启动流媒体播放, 具体实现 时, 例如, 当用户根据某个预览关键帧的画面定位后, 则可从该定位选定的预 览关键帧启动流媒体播放。
需要说明的,在检测到用户停止定位操作后, 例如检测到用户停止定位操 作超过指定时间, 则转入播放状态,从当前定位输出的关键帧开始重新进入播 放。
从本实施例可知,由于在定位操作的过程中流媒体终端能够直接以预览的 方式将画面展示给用户; 可给用户一种所见即所得的定位预览体验, 改善了用 户的定位操作体验; 且用户启动定位操作后, 流媒体终端可根据预定可緩存量 范围控制接收并存储流媒体服务器下发的用于定位播放的预览关键帧数据,例 如根据设定的一定緩冲量的解码緩冲滑动窗口用于控制緩存流媒体数据, 因 此,下载抽取后的节目到本地的时间可控,也降低了对流媒体终端的存储能力。
下面以流媒体终端与流媒体服务器交互实现流媒体定位播放的实施例为 例进行说明。
参考图 4, 该图是本发明实施例流媒体终端与流媒体服务器交互实现流媒 体定位播放的流程图。
本实施例中用户操作进入定位播放后, 视频暂停(步骤 S201 ); 流媒体终 端向流媒体服务器发送定位播放请求,所述定位播放请求中携带指定步长和正 向的定位方向(步骤 S202 ); 流媒体服务器接受定位播放请求, 正向根据指定 步长选择预览的关键帧, 以压迫方式发送给流媒体终端 (步骤 203 ); 流媒体 终端对流媒体服务器发送来的预览关键帧緩存 (步骤 S204 ); 然后用户正向按 键步进或连续操作, 流媒体终端按照指定步长输出显示预览关键帧 (步骤 S205-S206 ); 其中流媒体终端可维持一个解码緩冲滑动窗口緩存预览关键帧, 若所述解码緩冲滑动窗口空闲,则流媒体服务器可以压迫方式继续发送预览关 键帧 (步骤 S207 )。
同样的,用户反向定位操作也是类似的,即用户操作进入反向定位播放(步 骤 S301 ); 流媒体终端向流媒体服务器发送定位播放请求, 所述定位播放请求 中携带指定步长和反向的定位方向(步骤 S302 ); 流媒体服务器接受定位播放 请求,反向根据指定步长选择预览的关键帧,以压迫方式发送给流媒体终端(步 骤 303 ); 流媒体终端对流媒体服务器发送来的预览关键帧緩存(步骤 S304 ); 然后若用户反向按键步进或连续操作 ,流媒体终端按照指定步长输出显示预览 关键帧 (步骤 S305-S306 ); 其中流媒体终端可维持一个解码緩冲滑动窗口緩 存预览关键帧, 若所述解码緩冲滑动窗口空闲, 则流媒体服务器可以压迫方式 继续发送预览关键帧 (步骤 S307 )。
从本实施例实现流媒体定位播放的方法可知,不论是正向定位播放还是反 向定位播放,由于在定位操作的过程中流媒体终端能够直接以预览的方式将画 面展示给用户; 可给用户一种所见即所得的定位预览体验, 改善了用户的定位 操作体验; 且用户启动定位操作后, 流媒体终端可控制接收并存储流媒体服务 器下发的用于定位播放的预览关键帧数据,例如根据设定的一定緩冲量的解码 緩冲滑动窗口用于控制緩存流媒体数据, 因此, 下载抽取后的节目到本地的时 间可控, 也降低了对流媒体终端的存储能力。
以上是对本发明实施例实现流媒体定位播放方法的说明,下面结合附图说 明本发明实施例实现流媒体定位播放的装置及系统。
参考图 5 , 本发明实施例流媒体系统的结构示意图。
本实施例中, 流媒体系统包括流媒体终端 1和流媒体服务器 2, 下面分别 进行说明。
所述流媒体终端用于: 向流媒体服务器发送定位播放请求;根据预定可緩 存量范围接收并存储流媒体服务器下发的定位播放的预览关键帧数据;根据用 户定位操作请求预览显示所述预览关键帧数据;根据用户定位选定的预览关键 帧启动流媒体播放。
所述流媒体服务器用于: 对流媒体终端发来的定位播放请求进行接收处 理;根据所述定位播放请求选取用于定位播放的预览关键帧数据; 将用于定位 播放的预览关键帧数据下发给流媒体终端。
为实现流媒体定位播放, 如图 5所示, 所述流媒体终端 1可包括: 定位播 放请求发送单元 11、接收处理单元 12、预览显示处理单元 13以及定位播放处 理单元 14, 具体说明如下: 本实施例中定位播放请求发送单元 11主要用于向流媒体服务器发送定位 播放请求, 具体实现时, 定位播放请求发送单元 11主要根据用户启动定位操 作的请求发送定位播放请求, 例如用户操作定位播放条启动定位操作后, 定位 播放请求发送单元 11可向流媒体服务器发送定位播放请求, 作为一个可选的 实施例, 参考图 6, 所述定位播放请求发送单元 11可包括:
封装子单元 111 , 用于封装携带步长和 /或定位方向信息的定位播放请求; 发送子单元 112,将所述封装子单元 111封装的携带步长和 /或定位方向信 息的定位播放请求发送给流媒体服务器。
本实施例中接收处理单元 12主要用于根据预定可緩存量范围接收并存储 流媒体服务器下发的定位播放的预览关键帧数据,具体实现时, 例如参考前述 说明,可设定一定緩冲量的解码緩冲滑动窗口 WS用于緩存流媒体数据,接收 处理单元 12可按照所述的解码緩冲滑动窗口控制接收并存储流媒体服务器下 发的定位播放的预览关键帧,并保持解码緩冲滑动窗口的当前解码指针尽量指 向该滑动窗口的中间位置, 当用户以单击方式逐跳步进定位时, 每单击一次, 该解码緩冲滑动窗口的当前解码指针随之步进指向相应的关键帧,作为一个可 选的实施例, 参考图 7, 所述接收处理单元 12可包括:
接收子单元 121 , 用于接收流媒体服务器下发的定位播放的预览关键帧数 据;
判断子单元 122, 用于判断已存储的定位播放的预览关键帧数据是否已达 到解码緩冲滑动窗口限制;
存储子单元 123 , 用于在判断子单元 122判断结果为否时, 将接收子单元 121接收的预览关键帧数据进行存储。
本实施例中预览显示处理单元 13主要用于根据用户定位操作请求预览显 示所述存储的预览关键帧数据, 例如, 参考前述说明, 用户以单击方式逐跳步 进, 则预览显示处理单元 13可同样按照步进方向逐个向用户显示相应的预览 关键帧画面;
本实施例中定位播放处理单元 14主要用于根据用户定位选定的预览关键 帧启动流媒体播放, 例如, 参考前述说明, 当用户根据某个预览关键帧的画面 定位后 , 则可从该定位选定的预览关键帧启动流媒体播放。 本实施例中还包括操作检测单元: 用于检测用户操作。具体地检测到用户 启动定位操作时通知定位播放请求发送单元 11,例如检测到用户操作定位播放 条启动定位操作; 检测到用户进行定位操作时通知预览显示处理单元 13 , 例 如检测到用户单击方式进行逐跳步进;检测到用户启动流媒体播放时通知定位 播放处理单元 14。
另外, 参考图 8, 该图是本发明实施例流媒体终端的另一种结构示意图。 本实施例中所述流媒体终端包括定位播放请求发送单元 11、 接收处理单 元 12、预览显示处理单元 13以及定位播放处理单元 14, 另外还包括: 检测处 理单元 15。
本实施例中检测处理 15主要用于在检测到用户停止定位操作后, 通知所 述定位播放处理单元 14启动流媒体播放, 例如, 作为一个可选的实施例, 参 考图 9, 检测处理单元 15可包括:
判断子单元 151 , 用于判断用户停止定位操作是在用户停止定位操作超过 预定时间, 具体实现时, 例如所述预定时间可以默认设置, 也可以由用户自行 设置;
确定子单元 152, 若判断子单元 151判断结果为是, 则确定检测到用户停 止定位操作, 通知所述定位播放处理单元 14启动流媒体播放, 否则, 确定没 有检测到用户停止定位操作, 不做处理。
为实现流媒体定位播放, 如图 5所示, 所述流媒体服务器 2可包括: 接收 处理单元 21、 选取处理单元 22和下发处理单元 23 , 具体说明如下:
本实施例中接收处理单元 21主要用于对流媒体终端发来的定位播放请求 进行接收处理, 具体实现时, 可直接接收流媒体终端发送来的定位播放请求, 或者,接收到定位播放请求后解析该定位播放请求获取该请求中携带的步长信 息和定位方向信息, 例如, 作为一个可选的实施例, 参考图 10, 接收处理单 元 21可包括:
接收子单元 211 , 用于接收流媒体终端发来的定位播放请求;
解析子单元 212, 用于解析接收子单元 211接收的所述定位播放请求获取 预览关键帧选取的步长信息和定位方向信息。
本实施例中选取处理单元 22主要用于根据所述定位播放请求选取用于定 位播放的预览关键帧数据, 具体实现时, 例如选取处理单元 22可按照定位播 放请求中携带发送过来的步长信息和定位方向信息进行选取,或者选取处理单 元 22可根据流媒体服务器本身设置的步长或方向等信息进行选取, 或者其他 的方式进行选取, 这里不再详细说明;
本实施例中下发处理单元 23主要将选取用于定位播放的预览关键帧数据 下发给流媒体终端, 具体实现时, 参考前述说明, 下发处理单元 23可采用压 迫方式下发, 即一旦检测到流媒体终端上可緩存预览关键帧的緩存区空闲, 则 启动向流媒体终端发送预览关键帧 ,而在流媒体终端上可緩存预览关键帧的緩 存区满时, 则停止向流媒体终端发送预览关键帧。
从上述本实施例的实现流媒体定位播放的流媒体系统可知,由于在定位操 作的过程中流媒体终端能够直接以预览的方式将画面展示给用户;可给用户一 种所见即所得的定位预览体验, 改善了用户的定位操作体验; 且用户启动定位 操作后,流媒体终端可控制接收并存储流媒体服务器下发的用于定位播放的预 览关键帧数据,例如根据设定的一定緩冲量的解码緩冲滑动窗口用于控制緩存 流媒体数据, 因此, 下载抽取后的节目到本地的时间可控, 也降低了对流媒体 终端的存储能力。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到本发明 可借助软件加必需的通用硬件平台的方式来实现, 当然也可以通过硬件,但很 多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上 或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机 软件产品存储在一个存储介质中, 包括若干指令用以使得一台计算机设备 (可 以是个人计算机, 服务器, 或者网络设备等)执行本发明各个实施例所述的方 法。
以上所述仅为本发明的优选实施方式 , 并不构成对本发明保护范围的限 定。 任何在本发明的精神和原则之内所作的任何修改、 等同替换和改进等, 均 应包含在本发明的权利要求保护范围之内。

Claims

权 利 要 求
1、 一种流媒体定位播放方法, 其特征在于, 包括:
向流媒体服务器发送定位播放请求;
根据预定可緩存量范围接收并存储所述流媒体服务器下发的用于定位播 放的预览关键帧;
显示所述用于定位播放的预览关键帧画面;
根据用户定位选定的预览关键帧启动流媒体播放。
2、 根据权利要求 1所述的流媒体定位播放方法, 其特征在于, 所述流媒 体服务器下发用于定位播放的预览关键帧所采用的方式包括:所述流媒体服务 器采用压迫方式下发用于定位播放的预览关键帧。
3、根据权利要求 1所述的流媒体定位播放方法, 其特征在于, 所述的根据 预定可緩存量范围接收并存储流媒体服务器下发的用于定位播放的预览关键 帧包括:按照一个预定的解码緩冲滑动窗口接收并存储流媒体服务器下发的定 位播放的预览关键帧数据,保持所述解码緩冲滑动窗口的当前解码指针指向所 述滑动窗口的中间位置的预览关键帧。
4、根据权利要求 3所述的流媒体定位播放方法, 其特征在于, 当用户以单 击方式逐跳步进定位操作时,每单击一次, 所述解码滑动窗口的当前解码指针 步进指向相应的关键帧;
如果用户定位操作请求方向是正向操作时,所述解码緩冲滑动窗口向正向 操作方向移动;
如果用户定位操作请求方向是反向操作时,所述解码緩冲滑动窗口向反向 操作方向移动;
对于解码后的关键帧,当所述解码后的关键帧不在解码緩存滑动窗口的范 围内时,丢弃所述解码后的关键帧, 否则在所述解码緩冲滑动窗口的緩冲区中 保存所述解码后的关键帧。
5、 根据权利要求 4所述的流媒体定位播放方法, 其特征在于, 还包括: 在用户定位操作请求方向改变后 ,向流媒体服务器上报流媒体服务器再次 下发预览关键帧的解码緩冲滑动窗口对应的开始时间点。
6、 根据权利要求 1所述的流媒体定位播放方法, 其特征在于, 所述定位 播放请求包括: 选取预览关键帧的步长信息和定位方向信息, 则流媒体服务器 按照所述定位方向信息确定选取预览关键帧的方向和所述步长信息,选取预览 关键帧。
7、 根据权利要求 1所述的流媒体定位播放方法, 其特征在于, 还包括: 在检测到用户停止定位操作后, 进入播放状态。
8、 根据权利要求 7所述的流媒体定位播放方法, 其特征在于, 所述检测 到用户停止定位操作包括:
用户停止定位操作超过预定时间。
9、 一种流媒体终端, 其特征在于, 包括:
定位播放请求发送单元, 用于向流媒体服务器发送定位播放请求; 接收处理单元,用于根据预定可緩存量范围接收并存储流媒体服务器下发 的定位播放的预览关键帧数据;
预览显示处理单元,用于根据用户定位操作请求预览显示所述接收处理单 元接收并存储的预览关键帧画面;
定位播放处理单元, 根据用户定位选定的预览关键帧启动流媒体播放。
10、根据权利要求 9所述的流媒体终端, 其特征在于, 所述定位播放请求 发送单元包括:
封装子单元, 用于封装携带步长和 /或定位方向信息的定位播放请求; 发送子单元, 将所述封装子单元封装的所述携带步长和 /或定位方向信息 的定位播放请求发送给流媒体服务器。
11、根据权利要求 9所述的流媒体终端, 其特征在于, 所述接收处理单元 包括:
接收子单元, 用于接收流媒体服务器下发的定位播放的预览关键帧数据; 判断子单元,用于判断已存储的定位播放的预览关键帧数据是否已达到解 码緩冲滑动窗口限制;
存储子单元, 用于在所述判断子单元判断结果为否时,将所述接收子单元 接收的预览关键帧数据进行存储。
12、 根据权利要求 9所述的流媒体终端, 其特征在于, 还包括: 检测处理单元, 用于在检测到用户停止定位操作后,指令所述定位播放处 理单元启动流媒体播放。
13、 根据权利要求 12所述的流媒体终端, 其特征在于, 所述检测处理单 元包括:
判断子单元,用于判断用户停止定位操作是在用户停止定位操作超过预定 时间;
确定子单元, 若判断子单元判断结果为是, 则确定检测到用户停止定位操 作, 进入正常播放; 否则, 确定没有检测到用户停止定位操作, 不做处理。
14、 一种流媒体服务器, 其特征在于, 包括:
接收处理单元, 用于对流媒体终端发来的定位播放请求进行接收处理; 选取处理单元,用于根据接收处理单元接收的所述定位播放请求选取定位 播放的预览关键帧数据;
下发处理单元,将选取处理单元选取的定位播放的预览关键帧数据下发给 流媒体终端。
15、 根据权利要求 14所述的流媒体服务器, 其特征在于, 所述接收处理 单元包括:
接收子单元, 用于接收流媒体终端发来的定位播放请求;
解析子单元,用于解析所述接收子单元接收的所述定位播放请求获取预览 关键帧选取的步长信息和定位方向信息;
所述选取处理单元按照解析子单元的输出的所述步长信息和定位方向信 息选取用于定位播放的预览关键帧数据。
16、 根据权利要求 14所述的流媒体服务器, 其特征在于, 所述下发处理 单元以压迫方式下发用于定位播放的预览关键帧。
17、 一种流媒体系统, 包括流媒体终端和流媒体服务器, 所述流媒体终端 和流媒体服务器通过网络相连, 其特征在于, 所述流媒体终端用于: 向流媒体 服务器发送定位播放请求;
根据预定可緩存量范围接收并存储流媒体服务器下发的定位播放的预览 关键帧数据;
根据用户定位操作请求预览显示所述预览关键帧数据;
根据用户定位选定的预览关键帧启动流媒体播放; 所述流媒体服务器用于: 对流媒体终端发来的定位播放请求进行接收处 根据所述定位播放请求选取用于定位播放的预览关键帧数据;
将用于定位播放的预览关键帧数据下发给流媒体终端。
PCT/CN2009/070720 2008-03-19 2009-03-10 实现流媒体定位播放的方法、装置及系统 WO2009115011A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP09700051A EP2120459A4 (en) 2008-03-19 2009-03-10 METHOD, DEVICE AND SYSTEM FOR REALIZING MULTIMEDIA CONTENT READING POSITIONING
US12/482,548 US8875201B2 (en) 2008-03-19 2009-06-11 Method, device and system for implementing seeking play of stream media

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200810026890.8 2008-03-19
CN 200810026890 CN101540881B (zh) 2008-03-19 2008-03-19 实现流媒体定位播放的方法、装置及系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/482,548 Continuation US8875201B2 (en) 2008-03-19 2009-06-11 Method, device and system for implementing seeking play of stream media

Publications (1)

Publication Number Publication Date
WO2009115011A1 true WO2009115011A1 (zh) 2009-09-24

Family

ID=41090492

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2009/070720 WO2009115011A1 (zh) 2008-03-19 2009-03-10 实现流媒体定位播放的方法、装置及系统

Country Status (4)

Country Link
US (1) US8875201B2 (zh)
EP (1) EP2120459A4 (zh)
CN (1) CN101540881B (zh)
WO (1) WO2009115011A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110213206A (zh) * 2018-04-26 2019-09-06 腾讯科技(深圳)有限公司 流数据处理方法、服务器及计算机可读存储介质

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009087008A (ja) * 2007-09-28 2009-04-23 Toshiba Corp 情報処理システムおよび制御方法
CN102333243A (zh) * 2010-07-14 2012-01-25 北京泓润光谷数字媒体技术有限责任公司 一种流媒体直播时移点播装置
CN102547374A (zh) * 2010-12-07 2012-07-04 华录文化产业有限公司 一种基于播放时间点的视频图像的预览方法和装置
CN102137302A (zh) * 2010-12-09 2011-07-27 华为技术有限公司 流媒体视频内容的播放方法和装置
CN102264004B (zh) * 2011-08-05 2014-11-12 Tcl集团股份有限公司 一种防止关键帧缺失而不能seek的方法及装置
CN102523513B (zh) * 2011-12-31 2015-04-29 西南交通大学 基于视频播放器精确获取原视频文件图像的实现方法
CN102780919A (zh) * 2012-08-24 2012-11-14 乐视网信息技术(北京)股份有限公司 通过关键帧进行视频定位和播放的方法
CN103096131B (zh) * 2013-02-06 2016-06-08 天脉聚源(北京)传媒科技有限公司 一种直播流处理方法和装置
CN104066007A (zh) * 2013-03-19 2014-09-24 鸿富锦精密工业(深圳)有限公司 云端服务设备、视频播放时多画面预览的方法及系统
US9769546B2 (en) * 2013-08-01 2017-09-19 Hulu, LLC Preview image processing using a bundle of preview images
CN104837030B (zh) * 2014-02-12 2019-04-16 中国电信股份有限公司 一种http流媒体实现快进快退播放的方法和系统
CN103813210A (zh) * 2014-02-24 2014-05-21 深圳市同洲电子股份有限公司 一种定位播放的方法、服务器及系统
WO2015130148A1 (ko) 2014-02-28 2015-09-03 삼성전자 주식회사 통신 시스템에서 멀티미디어 콘텐츠 재생 방법 및 장치
CN104581381A (zh) * 2015-01-04 2015-04-29 浪潮软件股份有限公司 一种终端视频浏览辅助定位方法和装置
CN104661083A (zh) * 2015-02-06 2015-05-27 南京传唱软件科技有限公司 视频播放方法、系统、流媒体播放方法、装置及系统
US10440076B2 (en) * 2015-03-10 2019-10-08 Mobitv, Inc. Media seek mechanisms
CN106331871B (zh) * 2015-07-08 2020-01-17 阿里巴巴集团控股有限公司 一种实现视频流快进或快退的方法及装置
CN105100961B (zh) * 2015-07-23 2018-03-13 华为技术有限公司 视频缩略图生成方法及生成装置
CN108696772B (zh) * 2017-04-11 2021-07-16 苏州谦问万答吧教育科技有限公司 一种实时视频的传输方法及装置
CN109688429A (zh) * 2018-12-18 2019-04-26 广州励丰文化科技股份有限公司 一种基于非关键视频帧的预览方法及服务设备
CN111669618B (zh) * 2019-03-08 2022-11-15 杭州海康威视系统技术有限公司 画面播放控制方法、装置、设备及存储介质
CN110958470A (zh) * 2019-12-09 2020-04-03 北京字节跳动网络技术有限公司 一种多媒体内容处理方法、装置、介质和电子设备
CN111954058B (zh) * 2020-08-13 2023-11-21 北京达佳互联信息技术有限公司 图像处理方法、装置、电子设备以及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1312643A (zh) * 2000-03-08 2001-09-12 Lg电子株式会社 产生合成关键帧的方法和使用该方法的视频浏览系统
CN1444398A (zh) * 2002-03-12 2003-09-24 中国科学院计算技术研究所 基于关键帧的视频流索引播放系统
CN101025987A (zh) * 2006-02-21 2007-08-29 广州市纽帝亚资讯科技有限公司 基于视频内容的视频播放的快进快退方法与设备
CN101102212A (zh) * 2007-07-31 2008-01-09 中国网络通信集团公司 端到端信息传输方法及系统

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2127347A1 (en) * 1993-07-07 1995-01-08 Donald F. Hooper Segmented video on-demand system
US5793980A (en) * 1994-11-30 1998-08-11 Realnetworks, Inc. Audio-on-demand communication system
US5659539A (en) * 1995-07-14 1997-08-19 Oracle Corporation Method and apparatus for frame accurate access of digital audio-visual information
US6115037A (en) * 1996-11-15 2000-09-05 Hitachi Denshi Kabushiki Kaisha Motion image control method and apparatus
US6327418B1 (en) * 1997-10-10 2001-12-04 Tivo Inc. Method and apparatus implementing random access and time-based functions on a continuous stream of formatted digital data
GB9822550D0 (en) * 1998-10-15 1998-12-09 British Telecomm Computer communications
JP3557371B2 (ja) * 1999-07-15 2004-08-25 松下電器産業株式会社 Avデコーダ制御方法、及びavデコーダ制御装置
KR100447366B1 (ko) * 1999-07-29 2004-09-08 샤프 가부시키가이샤 기록 매체의 액세스 위치 특정 방법 및 기록 매체의 관리 장치
US20020073136A1 (en) * 2000-12-07 2002-06-13 Tomoaki Itoh Data reproduction method, data receiving terminal and data receiving method
CN1557072A (zh) * 2001-09-21 2004-12-22 ���˹���Ѷ��� 使用缓冲器大小计算用于拥塞控制的传输速率的数据通信方法和系统
US7432940B2 (en) * 2001-10-12 2008-10-07 Canon Kabushiki Kaisha Interactive animation of sprites in a video production
US20090282444A1 (en) * 2001-12-04 2009-11-12 Vixs Systems, Inc. System and method for managing the presentation of video
US20030135640A1 (en) * 2002-01-14 2003-07-17 Texas Instruments Incorporated Method and system for group transmission and acknowledgment
US7418492B1 (en) * 2002-06-20 2008-08-26 P-Cube Ltd. System and a method for testing network communication devices
US20040045020A1 (en) * 2002-08-29 2004-03-04 Witt Jeffrey Michael Commercial identification system
FI116816B (fi) * 2002-10-14 2006-02-28 Nokia Corp Median suoratoisto
EP1584048A1 (en) * 2003-01-06 2005-10-12 Koninklijke Philips Electronics N.V. Method and apparatus for similar video content hopping
US7535836B2 (en) * 2003-02-12 2009-05-19 Broadcom Corporation Method and system to provide word-level flow control using spare link bandwidth
US20050028213A1 (en) * 2003-07-31 2005-02-03 International Business Machines Corporation System and method for user-friendly fast forward and backward preview of video
US20050183120A1 (en) * 2004-01-13 2005-08-18 Saurabh Jain Multi-user personalized digital multimedia distribution methods and systems
JP4333655B2 (ja) * 2005-08-24 2009-09-16 ソニー株式会社 コンテンツ受信装置およびコンテンツ受信方法
CN100525447C (zh) 2005-12-07 2009-08-05 联合信源数字音视频技术(北京)有限公司 支持精确定位的音视频媒体数据组织实现方法
CN100469140C (zh) 2006-01-06 2009-03-11 腾讯科技(深圳)有限公司 一种在线播放中快速跳转的方法、终端及服务器
US7962942B1 (en) * 2006-02-28 2011-06-14 Rovi Guides, Inc. Systems and methods for enhanced trick-play functions
US8438646B2 (en) * 2006-04-28 2013-05-07 Disney Enterprises, Inc. System and/or method for distributing media content
JP4187028B2 (ja) * 2006-09-13 2008-11-26 ヤマハ株式会社 ネットワークシステム及び音響信号処理装置
CN1976440B (zh) 2006-12-11 2011-03-30 中山大学 一种在iptv中精确定位播放进度的方法及系统
US7992097B2 (en) * 2006-12-22 2011-08-02 Apple Inc. Select drag and drop operations on video thumbnails across clip boundaries
US20080155585A1 (en) * 2006-12-22 2008-06-26 Guideworks, Llc Systems and methods for viewing substitute media while fast forwarding past an advertisement
JP4787779B2 (ja) * 2007-03-14 2011-10-05 株式会社リコー 画像処理装置、プログラムおよびプレビュー画像表示方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1312643A (zh) * 2000-03-08 2001-09-12 Lg电子株式会社 产生合成关键帧的方法和使用该方法的视频浏览系统
CN1444398A (zh) * 2002-03-12 2003-09-24 中国科学院计算技术研究所 基于关键帧的视频流索引播放系统
CN101025987A (zh) * 2006-02-21 2007-08-29 广州市纽帝亚资讯科技有限公司 基于视频内容的视频播放的快进快退方法与设备
CN101102212A (zh) * 2007-07-31 2008-01-09 中国网络通信集团公司 端到端信息传输方法及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2120459A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110213206A (zh) * 2018-04-26 2019-09-06 腾讯科技(深圳)有限公司 流数据处理方法、服务器及计算机可读存储介质
CN110213206B (zh) * 2018-04-26 2022-06-21 腾讯科技(深圳)有限公司 流数据处理方法、服务器及计算机可读存储介质

Also Published As

Publication number Publication date
EP2120459A4 (en) 2010-03-24
US8875201B2 (en) 2014-10-28
US20090249423A1 (en) 2009-10-01
CN101540881B (zh) 2011-04-13
EP2120459A1 (en) 2009-11-18
CN101540881A (zh) 2009-09-23

Similar Documents

Publication Publication Date Title
WO2009115011A1 (zh) 实现流媒体定位播放的方法、装置及系统
US8316404B2 (en) Multimedia playback control apparatus and method
US9899059B2 (en) Method of management of a multimedia program, server, terminals, signal and corresponding computer programs
US7788398B2 (en) Media player plug-in installation techniques
US10666699B2 (en) Live edge detection during video playback
US20080271095A1 (en) Method and system for previewing media over a network
US20090049186A1 (en) Method to facilitate trick-modes for streaming video
JP2001527709A (ja) ビデオをオン・デマンドでレンダリングするvcrに似た機能
WO2012075842A1 (zh) 流媒体视频内容的播放方法和装置
US8886765B2 (en) System and method for predicitive trick play using adaptive video streaming
KR101475991B1 (ko) 모바일 디바이스상에서 비디오를 플레이하기 위한 방법 및 시스템
KR20190019953A (ko) 트릭 플레이 모드에서 가변 속도를 제공하기 위한 시스템 및 방법
WO2021143386A1 (zh) 资源传输方法及终端
US8230468B2 (en) Dynamically creating trick files to hide latency in streaming networks
JP2017204273A (ja) 表示装置
JP6021385B2 (ja) ストリーミングメディア再生装置、ストリーミングメディア再生方法、及びプログラム
CN106612462B (zh) 快进快退的处理方法及终端
JP2003333488A (ja) ストリーミングデータ再生方式及びストリーミングデータ再生方法
CN111479122B (zh) 视频播放方法、装置、设备及存储介质
JP4222253B2 (ja) クライアント端末、ストリーミングサーバ及びストリーミング切り替え配信システム
WO2010057391A1 (zh) 一种流媒体播放控制方法、设备及系统
KR20140042263A (ko) 미디어 스트리밍 서비스에서 버퍼링 데이터를 송수신하기 위한 장치 및 방법
JP6099715B2 (ja) ストリーミングメディア再生装置、ストリーミングメディア再生方法、及びプログラム
JP2015504633A (ja) マルチメディア資産を表示する方法、関連するシステム、メディアクライアント、および関連するメディアサーバ
KR101378092B1 (ko) 스트리밍 데이터 스킵 탐색 방법 및 장치

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2009700051

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09700051

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE