WO2010031273A1 - 视频编码 / 解码方法、装置与视频播放方法、装置及系统 - Google Patents

视频编码 / 解码方法、装置与视频播放方法、装置及系统 Download PDF

Info

Publication number
WO2010031273A1
WO2010031273A1 PCT/CN2009/072768 CN2009072768W WO2010031273A1 WO 2010031273 A1 WO2010031273 A1 WO 2010031273A1 CN 2009072768 W CN2009072768 W CN 2009072768W WO 2010031273 A1 WO2010031273 A1 WO 2010031273A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
current
video
encoder
media server
Prior art date
Application number
PCT/CN2009/072768
Other languages
English (en)
French (fr)
Inventor
罗泽文
仇刚
刘启铭
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2010031273A1 publication Critical patent/WO2010031273A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162User input
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4383Accessing a communication channel
    • H04N21/4384Accessing a communication channel involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • Video encoding/decoding method, device and video playing method, device and system The present application is filed on September 22, 2008, the Chinese Patent Office, the application number is 200810211296.6, and the invention name is "video encoding/decoding method, device and video playing method".
  • the priority of the Chinese Patent Application the entire disclosure of which is incorporated herein by reference.
  • the present invention relates to the field of communication technologies, and in particular, to video codec technology.
  • the streaming media is generally transmitted by using an image sequence such as "IPPPPPPPPI", wherein, in the double-quoted character string, I represents an I frame, and P represents a P frame. Since the P frame must be decoded according to the I frame, if the user accesses, it is not accessed at the time of sending the I frame, that is, the first data received by the client is not an I frame, and the client cannot decode until receiving. The next I frame. Thus, a serious flower screen or black screen will inevitably occur from the user switching time to the short time before the next I frame arrives.
  • the server In order to eliminate the blooming or black screen phenomenon when accessing/switching/inserting, etc., the server is required to first transmit I frame data when the user accesses/switches/inserts.
  • the inventors have found that at least the following problems exist in the prior art:
  • a buffer area is created, and the buffer area buffers data between at least two I frames. That is, the buffer area is required to have at least one complete I frame data, and other P frames and B frame data are also buffered.
  • the cache data is found. The most recent I frame data, from which the I frame data is served for the user.
  • the streaming media server always starts sending data to the user according to the I frame closest to the current access frame of the user in the buffer area, thereby causing the same time.
  • Different users see different programs, and can't watch the current live programs in real time, with a certain delay. Since the current frame is not an I frame when the user accesses, the program that the user receives is always from A program played in an I frame closest to the access user frame in the buffer area.
  • the PSS Packet-switched Streaming Server
  • the current frame is a P frame or a B frame.
  • the PSS Packet-switched Streaming Server
  • the P4 frame data continues to provide services.
  • sending the current frame after sending the I frame of the buffer area is equivalent to discarding the frame data between the P frame or the B frame of the latest I frame to the current frame.
  • it is equivalent to losing P2. P2, P3 frame data. Therefore, image blurring or mosaic phenomenon inevitably occurs during initial access.
  • the current live channel is not an I frame when the user accesses, and the streaming media server always starts sending to the user according to the I frame closest to the current access frame of the user in the buffer area.
  • the data so that the same time, the programs accessed by the users at different times are different, and the delay between the programs viewed by the user and the programs played in real time is generated.
  • the embodiment of the present invention provides a video editing. Decoding method, device and video playing method, device and system to solve the delay problem.
  • an embodiment of the present invention provides a video coding method, where the method includes:
  • the encoder inter-codes the source image into a p-frame
  • the I frame corresponding to the P frame is stored in the buffer of the encoder.
  • an embodiment of the present invention provides a video decoding method, where the method includes:
  • the received video frame is a P frame
  • obtain an I frame corresponding to the current P frame refer to the The I frame corresponding to the current P frame is decoded.
  • an embodiment of the present invention provides a video playing method, where the method includes:
  • the streaming media server sends an I frame request message corresponding to the P frame.
  • the streaming media server receives an I frame, where the I frame is obtained by the encoder device performing intraframe coding on the source image corresponding to the P frame according to the acquiring an I frame request;
  • the streaming media server forwards the I frame to the client device, so that the client device performs decoding and playing on the received video P frame corresponding to the I frame according to the I frame.
  • an embodiment of the present invention further provides a video encoding apparatus, where the apparatus includes:
  • a coding unit configured to: when the encoder inter-codes the source image into a P-frame, intra-code the source image to obtain an I-frame corresponding to the P-frame;
  • Cache unit used to store the I frame corresponding to the P frame in the buffer of the encoder.
  • an embodiment of the present invention further provides a video decoding apparatus, where the apparatus includes:
  • a receiving unit configured to receive a video frame forwarded by the streaming media server
  • a decoding unit configured to: when the received video frame is a P frame, acquire an I frame corresponding to the current P frame, and perform decoding by referring to the I frame corresponding to the current P frame.
  • an embodiment of the present invention further provides a video playing device, where the device includes:
  • the information sending unit is configured to: when the received video frame is a P frame, the streaming media server sends an I frame request message corresponding to the P frame;
  • the information receiving unit is configured to: receive, by the streaming media server, an I frame, where the I frame is obtained by the encoder device performing intraframe coding on the source image corresponding to the P frame according to the acquiring an I frame request; Receiving, by the message channel, the response message for acquiring the I frame through the message channel;
  • the information forwarding unit is configured to: forward, by the streaming media server, the I frame to the client device, so that the client device performs decoding and playing on the received video P frame corresponding to the I frame according to the I frame.
  • an embodiment of the present invention further provides a video playing system, where the system includes:
  • a request receiving unit configured to: when the received video frame is a P frame, the encoder device receives an I frame request message that is sent by the streaming media server and acquires the P frame;
  • An information acquiring unit configured to: perform an intraframe encoding on a source image corresponding to the current P frame according to the acquiring an I frame request message, and acquire an I frame corresponding to the current P frame;
  • An information sending unit configured to: send, by the encoder device, the I frame to the streaming media server; send, by using a message channel, the response message for acquiring the I frame to the streaming media server; Sending the I frame to the streaming media server;
  • a forwarding unit configured to: forward, by the streaming media server, the I frame to the client device;
  • the client device performs decoding and playing on the received video P frame corresponding to the I frame according to the I frame.
  • the video playing method, apparatus, and system, and video encoding/decoding method and apparatus provided by the embodiments of the present invention perform P-frame corresponding to P-frame encoding while performing inter-frame encoding of the source image into a P-frame on the encoder side. Encoding of the I frame and storing it in the buffer of the encoder for later use; when the packet domain streaming server determines that the current access frame is not an I frame, initiates the acquisition of the I frame request, and the encoder device will acquire according to the request.
  • the I frame forward the I frame to the client device through the packet domain streaming server, so that the client device can decode the currently accessed P frame according to the I frame, so that the user accesses, switches, and inserts
  • the client device can decode the currently accessed P frame according to the I frame, so that the user accesses, switches, and inserts
  • the image is decoded according to the I frame
  • the user accessing the I frame corresponding to the currently accessed P frame can be directly broadcasted, thereby not only reducing the I frame.
  • the playback time of the live channel is delayed, and the P frame can be decoded clearly, which improves the sharpness of the decoded image.
  • 1 is a schematic diagram of playing a frame from a user access point in the prior art
  • 2 is a flowchart of a video encoding method according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a video decoding method according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of a video playing method according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of a process for implementing a video playing method when a user accesses according to an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of a video encoding apparatus according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram of a video decoding apparatus according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a video playing device according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of a video playing system according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of a data body in a message channel according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic diagram of a video encoding method according to an embodiment of the present invention.
  • a video encoding method is provided in the embodiment of the present invention.
  • the method includes:
  • the encoder interframes the source image into a P frame
  • the step 202 may have three different encoding methods:
  • the first encoding method of the I frame is:
  • the original image of the reference frame of the current P frame is used as a source image, and intraframe coding is performed to acquire an I frame corresponding to the P frame.
  • the encoding method of the second synthesized I frame is:
  • the reconstructed image of the current P frame reference frame is used as a source image, and intra-coded is performed to acquire an I frame corresponding to the P frame.
  • the coding method of the third composite I frame is:
  • An image synthesized by combining original images of at least two reference frames of the current P frame is used as a source image, and intra-coded to obtain an I frame corresponding to the P frame.
  • the step 203 may include:
  • the I frame corresponding to the P frame is stored in real time according to the size of the encoder buffer.
  • a video decoding method is provided in the embodiment of the present invention.
  • the method includes:
  • the received video frame is a P frame, obtain an I frame corresponding to the current P frame, and perform decoding by referring to the I frame corresponding to the current P frame. If the received video frame is a P frame, the I frame corresponding to the current P frame is obtained, and the step of decoding the I frame corresponding to the current P frame is performed, including:
  • the source image is intra-coded into a P-frame by an encoder, the source image is intra-coded, and the I-frame corresponding to the P-frame is obtained and cached in the frame.
  • the encoder when the user accesses the P frame, the I frame corresponding to the P frame can be acquired in real time for decoding, so that the user can watch the program of the live channel without delay.
  • an embodiment of the present invention provides a video playing method, where the method includes: 401: If the received video frame is a P frame, the streaming media server sends an I frame request message corresponding to the P frame.
  • the streaming media server receives an I frame, where the I frame is obtained by the encoder device performing intraframe coding on the source image corresponding to the P frame according to the acquiring an I frame request; that is, using a message channel, streaming media
  • the server receives the response message for acquiring the I frame; and the streaming server receives the I frame through the temporary channel.
  • the streaming media server forwards the I frame to the client device, so that the client device performs decoding and playing on the received video P frame corresponding to the I frame according to the I frame.
  • the request message carries at least a live channel ID, a current frame ID, a receiving port of the temporary channel, and a command indication value.
  • the response message carries at least a live channel ID, a current frame ID, a receiving port of the temporary channel, and a command indication. value.
  • FIG. 5 a flowchart of processing a video playback method when a user accesses is provided in the embodiment of the present invention.
  • the specific steps are as follows:
  • the client device sends an on-demand request according to the user requirement
  • the PSS responds to the request response after receiving the on-demand request.
  • PSS determines whether the current frame is an I frame, if it is an I frame, directly proceeds to step 508; if it is not an I frame, directly proceeds to step 504;
  • the PSS sends an I frame requesting the current frame.
  • the request message of the I frame requesting the current frame may be sent to the encoder device by using a message.
  • the encoder device performs an I frame synthesis process according to the received request for acquiring an I frame of the current frame.
  • the implementation of the present invention may be performed by using a video coding method as described above:
  • the process of playing the frame by the access user shown in FIG. 1 is taken as an example, and in the embodiment of the present invention, 10, P1, P2, P3, P4, P5,
  • the process of encoding P6, P7, P8, and 19 frames is as shown in FIG. If Fn is to be encoded as a P frame, in addition to performing the normal flow of 1 and 2 to encode the source image of Fn into a P frame, it is also necessary to perform 3 processes, and perform intraframe coding by Flow 3 to generate a source image corresponding to the Fn.
  • the Fn may be a source image of a reference frame of a current frame, or may be a reconstructed image of a reference frame of a current frame, or may be an image that combines multiple reference frames of a current frame.
  • the encoder device responds to the request of the PSS, and notifies the packet domain streaming server of the response message of the synthesized I frame by using a message channel.
  • the data structure of the request message and the response message transmitted through the message channel may be as shown in FIG. 10.
  • the embodiment of the present invention takes a message channel based on the TCP protocol as an example, and the encoder device Encoder generally supports multiple channels. According to the channel ID, a live channel can be uniquely identified. Sometimes the channel ID may fill in the multicast IP of the live channel.
  • the meaning of the command indication value is as follows: 01 indicates that the PSS requests the Encoder to synthesize the I frame corresponding to the current frame, and 02 indicates the Encoder response. PSS request.
  • the specific usage of the data body structure is as follows: When the PSS needs to request a composite I frame of a P frame, first, construct a piece of data according to the above data body structure, and establish a short TCP connection with the Encoder to obtain the synthesized I frame data. Then; then, the above constructed data is transmitted to the Encoder using the TCP protocol. After the encoder receives the PSS request and synthesizes the I frame according to the specified composite I frame method, first, constructs a piece of data according to the above data body structure, and responds to the PSS request through the message channel, and then synthesizes the I through the temporary channel. The frame data is sent to the designated port in the data structure, so that the entire transfer interaction process is completed.
  • the encoder device sends the data of the I frame through the temporary channel, and sends the I frame to the packet domain streaming server through the temporary channel.
  • the request message and the response message carry at least a live channel ID, a current frame ID, a receiving port of the temporary channel, and a command indication value; the message channel is based at least on TCP (Transfer Control Protocol), UDP (User Datagram Protocol) One of the user data protocols; the temporary channel is based on RTP (Real-time Transport Protocol). 508.
  • the PSS sends data of the I frame.
  • the PSS subsequently sends a normal live stream according to the normal live broadcast process.
  • the client device determines whether the current received frame is an I frame
  • the I frame is played directly. If the current frame is not an I frame and its reference frame does not exist, the I frame corresponding to the current P frame is acquired for decoding.
  • the method for synthesizing an I frame in the manner of the third synthesized I frame mentioned above changes the reference relationship of the reference frame of the current frame. For example: the reference frame Pi, Pj, Pk frame of a Pn frame, since Pi, Pj, Pk are combined into I frame, the sequence number of the frame can only be reserved, so some macroblocks of Pn cannot be based on the frame indicated by the message.
  • the sequence number is found to find the reference frame, so that it cannot be decoded, so the current frame can be decoded according to the synthesized I frame mentioned in the implementation of the present invention.
  • Another most common case is that due to the instability of the wireless network, packet loss is highly likely, and H does not lose the reference frame Pi of Pn. Subsequent P frames cannot be decoded until the next I frame arrives. In this case, an I frame may also be acquired according to an embodiment of the present invention, thereby decoding the current frame.
  • an embodiment of the present invention provides a video encoding apparatus, where the apparatus includes: an encoding unit 601: configured to perform the source image when an encoder interframes a source image into a P frame. Intra coding, obtaining an I frame corresponding to a P frame;
  • the buffer unit 602 is configured to store the I frame corresponding to the P frame in a buffer of the encoder.
  • the video encoding device further includes:
  • the source image obtaining unit 603 an original image for reconstructing a reference frame of a current P frame, a reconstructed image, or an image of an original image synthesized of at least two reference frames of a current P frame.
  • the cache unit 602 further includes:
  • Cache setting subunit configured to set an encoder buffer size according to a current encoding frame of the encoder and a current forwarding frame of the packet domain streaming server;
  • Update storage subunit used to update the I frame corresponding to the P frame according to the size of the encoder cache.
  • an embodiment of the present invention provides a video decoding apparatus, where the apparatus includes: a receiving unit 701: configured to receive a video frame forwarded by a streaming media server;
  • the decoding unit 702 is configured to: when the received video frame is a P frame, acquire an I frame corresponding to the current P frame, and perform decoding by referring to the I frame corresponding to the current P frame.
  • the embodiment of the present invention provides a video playing device.
  • the device includes: an information sending unit 801: configured to: when a received video frame is a P frame, the streaming media server sends and obtains the corresponding P frame. I frame request message;
  • the information receiving unit 802 is configured to: receive, by the streaming media server, an I frame, where the I frame is obtained by the encoder device performing intraframe coding on the source image corresponding to the P frame according to the acquiring an I frame request;
  • the streaming media server receives the response message for acquiring the I frame through the message channel;
  • the information forwarding unit 803 the streaming media server forwards the I frame to the client device, so that the client device performs decoding and playback on the received video P frame corresponding to the I frame according to the I frame.
  • the embodiment of the present invention provides a video playing system.
  • the system includes: a request receiving unit 901: configured to: when the received video frame is a P frame, the encoder device receives the sending sent by the streaming media server. An I frame request message corresponding to the P frame;
  • the information acquiring unit 902 is configured to: perform, by the encoder device, the intra-frame encoding of the source image corresponding to the current P frame according to the acquiring an I frame request, to obtain an I frame corresponding to the current P frame;
  • the information sending unit 903 is configured to: send, by the encoder device, the I frame to the streaming media server; that is, send, by using a message channel, the response message for acquiring the I frame to the packet domain streaming server; The channel is delivered to the packet domain streaming server.
  • the forwarding unit 904 is configured to: the streaming media server forwards the I frame to the client device; and the decoding playing unit 905, the client device performs decoding and playing on the received video P frame corresponding to the received I frame according to the I frame.
  • decoding and playing unit 905 further includes:
  • Fault-tolerant processing sub-unit configured to determine, according to the received video frame, that the currently received video frame is P a frame, the client device performs decoding and playing on the received video P frame according to the I frame corresponding to the current P frame.
  • the video playing method, device and system provided by the embodiment of the present invention, when the source image is inter-coded into a P-frame on the encoder side, the P-frame corresponding to the I frame is encoded while the P-frame encoding is performed, and Stored in the buffer of the encoder for later use; when the packet domain streaming server determines that the current access frame is not an I frame, initiates an I frame request, and the encoder device acquires an I frame according to the request and the I frame. Forwarding to the client device by the packet domain streaming server, so that the client device can decode the currently accessed P frame according to the I frame, so that when the user accesses, switches, and inserts, the user can clearly see in real time.
  • the image data server always sends data to the user according to the I frame closest to the current access frame of the user in the buffer area, because the time of the user access is different and the current access frame is not an I frame. Thereby causing the same time, the programs accessed by the users at different times are different, so that the programs viewed by the user and the programs played in real time are
  • the delay generated by the present invention is decoded according to the I frame, so that the user accessing at different times can directly obtain the I frame corresponding to the currently accessed P frame for live broadcast, thereby reducing the live channel. Playback delay, and can also clearly decode the P frame, improving the clarity of the decoded image.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Description

视频编码 /解码方法、 装置与视频播放方法、 装置及系统 本申请要求于 2008 年 9 月 22 日提交中国专利局、 申请号为 200810211296.6、 发明名称为"视频编码 /解码方法、 装置与视频播放方法、 装 置及系统"的中国专利申请的优先权, 其全部内容通过引用结合在本申请中。 技术领域
本发明涉及通讯技术领域, 尤其涉及视频编解码技术。
背景技术
由于直播数据的实时性, 要求用户不管何时接入, 只要观看同一个频道, 所观看的节目都是一样, 实际上就是要求各个客户端几乎同时接收到同样的 媒体数据。 流媒体一般釆用诸如 "IPPPPPPPPI" 的图像序列来传输, 其中, 所述双引号的字符串中, I表示 I帧, P表示 P帧。 由于 P帧必须依据 I帧才 能解码, 如果用户接入时, 不是在发 I帧的时刻接入, 即客户端收到的第一个 数据就不是 I帧, 客户端就无法解码, 直到收到下一个 I帧。 这样, 从用户 切换时刻到下一个 I帧到来之前的一小段时间必然出现严重的花屏或黑屏。实 际上, 不仅仅是接入时刻有此问题, 码率切换、 频道切换、 插播广告等等场 景都存在类似的问题。 为了消除接入 /切换 /插播等场景时的花屏或黑屏现象, 就要求服务端在用户接入 /切换 /插播时, 首先发送 I帧数据。
在实现本发明的过程中, 发明人发现现有技术中至少存在如下问题: 在流媒体服务器中, 针对每个直播频道,开创一个緩存区, 该緩存区緩存 至少两个 I帧之间的数据, 即要求緩存区至少有一个完整的 I帧数据, 其他的 P帧与 B帧数据也要緩存起来,当用户接入并且当前帧不是 I帧时如图 1中所 示,从緩存数据中找到最近的 I帧数据,从此 I帧数据开始为该用户提供服务。 这样, 使得同一直播频道, 由于所述的用户接入帧不是 I帧, 流媒体服务器总 是根据緩存区中与用户当前接入帧最近的 I帧,开始给用户发送数据,从而造 成相同的时间, 不同的用户看到的节目不同, 不能实时观看当前的直播节目, 有一定的时延。 因为用户接入时, 当前帧不是 I帧, 用户收看到的节目总是从 緩存区中与接入用户帧最近的 I帧播放的节目。
在流媒体服务器中,针对每个直播频道,可以緩存最近一个完整的 I帧数 据, 后续每收到一个完整的新 I帧数据, 实时更新。 当有新用户接入进来并且 当前帧不是 I帧时, PSS ( Packet-switched Streaming Server, 分组域流媒体服 务器 )先给该用户发送緩存好的 I帧数据, 然后接着发送当前帧, 所述的当前 帧是 P帧或者 B帧。 如图 1所示, 即 PSS先把 10帧数据发送完毕后, 就接着 P4帧数据继续提供服务。 但是, 在发送緩存区 I帧后就发送当前帧, 相当于 丟掉了隔在最近 I帧到当前帧的 P帧或 B帧间的帧数据, 如图 1所示, 就是 相当于丟掉了 P2、 P2、 P3帧的数据。 因此, 初始接入时不可避免的出现图像 模糊或马赛克现象。
发明内容
为了解决现有技术中, 同一直播频道, 由于用户接入时当前的接入帧不 是 I帧, 而流媒体服务器总是根据緩存区中与用户当前接入帧最近的 I帧, 开 始给用户发送数据, 从而造成相同的时间, 不同时刻接入的用户看到的节目 不同, 使得用户观看到的节目与实时播放的节目之间产生的时延问题, 本发 明的实施例提供了一种视频编解码方法、 装置与视频播放方法、 装置及系统 以解决的时延问题。
在实现本发明的技术方案中, 本发明的实施例提供了一种视频编码方法, 该方法, 包括:
编码器将源图像进行帧间编码为 p帧;
将所述源图像进行帧内编码, 获取与 P帧相对应的 I帧;
将所述与 P帧相对应的 I帧存储在编码器的緩存中。
在实现本发明的技术方案中, 本发明实施例提供了一种视频解码方法, 该方法, 包括:
接收流媒体服务器转发的视频帧;
若接收的视频帧为 P帧时, 获取与当前 P帧相对应的 I帧, 参考所述与 当前 P帧相对应的 I帧进行解码。
在实现本发明的技术方案中, 本发明实施例提供了一种视频播放方法, 该方法, 包括:
若接收的视频帧为 P帧时, 流媒体服务器发送获取所述 P帧对应的 I帧 请求消息;
流媒体服务器接收 I帧, 所述 I帧为编码器设备根据所述的获取 I帧请求 将所述 P帧所对应的源图像进行帧内编码所获取的;
流媒体服务器将所述 I帧转发给客户端设备,以便所述客户端设备根据所 述 I帧对接收的所述 I帧对应的视频 P帧进行解码播放。
在实现本发明的技术方案中, 本发明实施例还提供一种视频编码装置, 该装置, 包括:
编码单元: 用于在编码器将源图像进行帧间编码为 P帧时, 将所述源图 像进行帧内编码, 获取与 P帧相对应的 I帧;
緩存单元: 用于将所述与 P帧相对应的 I帧存储在编码器的緩存中。
在实现本发明的技术方案中, 本发明实施例还提供一种视频解码装置, 该装置, 包括:
接收单元, 用于接收流媒体服务器转发的视频帧;
解码单元, 用于若接收的视频帧是 P帧时, 获取与当前 P帧相对应的 I 帧, 参考所述与当前 P帧相对应的 I帧进行解码。
在实现本发明的技术方案中, 本发明实施例还提供一种视频播放装置, 该装置, 包括:
信息发送单元: 用于若接收的视频帧为 P帧时, 流媒体服务器发送获取 所述 P帧对应的 I帧请求消息;
信息接收单元: 用于流媒体服务器接收 I帧, 所述 I帧为编码器设备根据 所述的获取 I帧请求将所述 P帧所对应的源图像进行帧内编码所获取的;还用 于通过消息通道, 流媒体服务器接收所述获取 I帧的响应消息; 信息转发单元: 用于流媒体服务器将所述 I帧转发给客户端设备, 以便所 述客户端设备根据所述 I帧对接收的所述 I帧对应的视频 P帧进行解码播放。
在实现本发明的技术方案中, 本发明实施例还提供一种视频播放系统, 该系统, 包括:
请求接收单元, 用于若接收的视频帧为 P帧时, 编码器设备接收流媒体 服务器发送的获取所述 P帧对应的 I帧请求消息;
信息获取单元,用于编码器设备根据所述的获取 I帧请求消息,将所述当 前 P帧所对应的源图像进行帧内编码, 获取与当前 P帧相对应的 I帧;
信息下发单元, 用于编码器设备将所述 I帧下发给所述的流媒体服务器; 通过消息通道,下发所述获取 I帧的响应消息给流媒体服务器;通过临时通道, 下发所述 I帧给流媒体服务器下发;
转发单元, 用于流媒体服务器将所述 I帧转发给客户端设备;
解码播放单元, 客户端设备根据所述 I帧对接收的所述 I帧对应的视频 P 帧进行解码播放。
本发明实施例提供的视频播放方法、 装置及系统与视频编码 /解码方法、 装置, 通过在编码器侧将源图像进行帧间编码为 P帧时, 在进行 P帧编码的 同时进行 P帧相应 I帧的编码,并将其存储在编码器的緩存中以备后用; 当分 组域流媒体服务器判断当前接入帧不是 I帧, 发起获取 I帧请求, 编码器设备 将根据所述请求获取 I帧并将所述 I帧通过分组域流媒体服务器转发给客户端 设备,从而使得客户端设备可以根据所述 I帧对当前接入的 P帧进行解码,从 而使得用户接入、 切换 /插播时, 可以实时清晰的收看到图像; 本发明根据所 述的 I 帧进行解码, 可以使得不同时刻接入的用户, 直接获得与当前接入 P 帧相对应的 I帧进行直播,从而不但减小了直播频道的播放延时, 而且还可以 清晰的将 P帧进行解码, 改善了解码图像的清晰度。
附图说明
图 1为现有技术中从用户接入点播放帧的示意图; 图 2为本发明实施例提供的一种视频编码方法流程图;
图 3为本发明实施例提供的一种视频解码方法流程图;
图 4为本发明实施例提供的一种视频播放方法流程图;
图 5 为本发明实施例提供的当用户接入时, 实现视频播放方法的处理流 程图;
图 6为本发明实施例提供的一种视频编码装置结构示意图;
图 7为本发明实施例提供的一种视频解码装置结构示意图;
图 8为本发明实施例提供的一种视频播放装置结构示意图;
图 9为本发明实施例提供的一种视频播放系统结构示意图;
图 10为本发明实施例提供的消息通道中数据体的结构示意图;
图 11为本发明实施例提供的一种视频编码方法的原理图。
具体实施方式
下面结合附图对本发明实施例提供的一种视频编码 /解码方法、 装置及视 频播放方法、 装置进行详细描述。
如图 2 所示, 本发明实施例提供的一种视频编码方法, 在实现本发明实 施例的过程中, 该方法, 包括:
201 : 编码器将源图像进行帧间编码为 P帧;
202: 将所述源图像进行帧内编码, 获取与 P帧相对应的 I帧;
203: 将所述与 P帧相对应的 I帧存储在编码器的緩存中。
其中, 在该实施例中, 所述的步骤 202分别可以有三种不同的编码方法: 第一种合成 I帧的编码方法为:
获取当前 P帧的参考帧的原始图像;
将所述当前 P帧的参考帧的原始图像作为源图像, 进行帧内编码, 获取 与 P帧相对应的 I帧。
第二种合成 I帧的编码方法为:
获取当前 P帧的参考帧的重构图像; 将所述当前 P帧参考帧的重构图像作为源图像,进行帧内编码, 获取与 P 帧相对应的 I帧。
第三种合成 I帧的编码方法为:
获取当前 P帧的至少两幅参考帧的源图像合成的图像;
将所述当前 P帧的至少两幅参考帧的原始图像合成的图像作为源图像, 进行帧内编码, 获取与 P帧相对应的 I帧。
进一步地, 在该实施例中, 所述的步骤 203可以包括:
根据编码器的当前编码帧与分组域流媒体服务器的当前转发帧设置编码 器緩存的大小;
将所述与 P帧相对应的 I帧,根据所述编码器緩存的大小进行实时更新存 储。
如图 3 所示, 本发明实施例提供的一种视频解码方法, 在实现本发明实 施例的过程中, 该方法, 包括:
301 : 接收流媒体服务器转发的视频帧;
302: 若接收的视频帧为 P帧时, 获取与当前 P帧相对应的 I帧, 参考所 述与当前 P帧相对应的 I帧进行解码。 其中, 若接收的视频帧是 P帧时, 获 取与当前 P帧相对应的 I帧,参考所述与当前 P帧相对应的 I帧进行解码的步 骤, 包括:
根据接收到的视频帧, 判断当前接收的视频帧为 P帧;
获取与当前 P帧相对应的 I帧,参考所述与当前 P帧相对应的 I帧进行解 码。
本发明实施例提供的视频编码 /解码方法, 通过编码器将源图像进行帧间 编码为 P帧的同时, 将源图像进行帧内编码, 获取与 P帧相对应的 I帧并将 其緩存在编码器中, 使得用户在接入为 P帧时, 可以实时获取与 P帧相对应 的 I帧进行解码, 从而用户可以无时延的观看直播频道的节目。
如图 4所示, 本发明实施例提供了一种视频播放方法, 该方法, 包括: 401 : 若接收的视频帧为 P帧时, 流媒体服务器发送获取所述 P帧对应的 I帧请求消息;
402: 流媒体服务器接收 I帧, 所述 I帧为编码器设备根据所述的获取 I 帧请求将所述 P帧所对应的源图像进行帧内编码所获取的; 即通过消息通道, 流媒体服务器接收所述获取 I帧的响应消息; 通过临时通道, 流媒体服务器接 收所述 I帧。
403: 流媒体服务器将所述 I帧转发给客户端设备, 以便所述客户端设备 根据所述 I帧对接收的所述 I帧对应的视频 P帧进行解码播放。
其中, 所述请求消息中至少携带直播频道 ID、 当前帧 ID、 临时通道的接 收端口和命令指示值; 所述响应消息中至少携带直播频道 ID、 当前帧 ID、 临 时通道的接收端口和命令指示值。
如图 5 所示, 本发明实施例提供的当用户接入时, 实现视频播放方法的 处理流程图; 在实现本发明实施例的过程中, 具体的步骤如下:
501、 客户端设备根据用户需要发出点播请求;
502、 PSS点播接收到点播请求后回复请求响应;
503、 PSS判断当前帧是否是 I帧, 如果是 I帧, 直接进入第 508步; 如 果不是 I帧, 直接进行步骤 504;
504、 PSS发送请求当前帧的 I帧; 其中, 所述的请求当前帧的 I帧的请 求消息可以通过消息通过发送给编码器设备。
505、 编码器设备根据接收的获取当前帧的 I帧的请求, 进行 I帧合成处 理; 本发明实施可以通过如上所述的视频编码方法进行合成 I帧处理:
在实现本发明实施例中获取合成 I帧的过程中,以图 1所示的接入用户播 放帧的过程为例, 本发明实施例的在对 10、 Pl、 P2、 P3、 P4、 P5、 P6、 P7、 P8、 19帧进行编码的过程如图 11所示。 如果 Fn将要编码为 P帧, 除了执行 1和 2的正常流程将 Fn的源图像编码为 P帧之外, 还需要执行 3流程, 通过 流程 3进行帧内编码生成一个与该 Fn的源图像相对应的 I帧,将所述的 I帧存 储在如图 7中的 In中; 如果 Fn将要编码为 I帧时, In与输出到 NAL的数据 都一样; 如果 Fn将要编码为 B帧时, 由于 B帧不会被别的帧参考, 也就是说 Fn肯定不会被后续帧参考, 也就没有必要生成 Fn对应的 I帧数据。 其中, 所 述的 Fn可以是当前帧的参考帧的源图像, 也可以是当前帧的参考帧的重构图 像, 还可以是将当前帧的多个参考帧合成的一幅图像。
506、 编码器设备响应 PSS的请求, 将所述合成 I帧的响应消息通过消息 通道通知分组域流媒体服务器;
其中, 所述通过消息通道传送的请求消息和响应消息的数据体结构可以 如图 10所示,本发明实施例以基于 TCP协议的消息通道为例, 由于编码器设 备 Encoder—般支持多个频道, 根据频道 ID就能唯一识别出一个直播频道, 有时候频道 ID可能填写直播频道的组播 IP; 命令指示值含义如下: 01表示 PSS向 Encoder请求当前帧对应的合成 I帧, 02表示 Encoder响应 PSS的请求。 该数据体结构的具体使用办法为: 当 PSS需要请求某 P帧的合成 I帧时, 首 先, 按上述数据体结构构造一条数据, 并与 Encoder建立短 TCP连接即获取 到合成 I 帧数据就断开; 然后, 使用 TCP协议把上述构造好的数据传输到 Encoder上。 当 Encoder接收到 PSS请求后, 按规定的合成 I帧方法合成 I帧 后, 首先, 按上述数据体结构构造一条数据, 并将该数据通过消息通道响应 PSS的请求,然后通过临时通道把合成 I帧数据发送到数据体结构中指定的端 口中, 这样整个传输交互过程就完成了。
507、 编码器设备通过临时通道发送 I帧的数据; 将所述 I帧通过临时通 道向分组域流媒体服务器下发。
所述请求消息与响应消息中至少携带直播频道 ID、 当前帧 ID、 临时通道 的接收端口和命令指示值; 所述消息通道至少基于 TCP ( Transfer Control Protocol , 传输控制协议)、 UDP ( User Datagram Protocol , 用户数据 4艮协议 ) 中的一种; 所述临时通道基于 RTP ( Real-time Transport Protocol, 实时传输 协议)。 508、 PSS发送 I帧的数据;
509、 PSS后续按照普通直播流程发送正常的直播流。
进一步讲, 根据分组域流媒体服务器转发的帧, 客户端设备判断当前接 收帧是否为 I帧;
如果当前接收帧是 I帧, 就直接播放 I帧, 如果当前帧不是 I帧, 并且其 参考帧不存在, 就获取与当前 P帧相对应的 I帧进行解码。 其中, 上述提到的 第三种合成 I帧的方式, 所述合成 I帧的过程, 改变了当前帧的参考帧的参考 关系。 例如: 某 Pn帧的参考帧 Pi、 Pj、 Pk帧, 由于 Pi、 Pj、 Pk被合成了 I 帧, 帧的序号只能保留一个, 因此 Pn的某些宏块就无法根据报文指示的帧序 号来找到参考帧,从而就无法解码, 所以就可以根据本发明实施中提到的合成 I帧对当前帧进行解码。还有一种最常见的情况是,由于无线网络的不稳定性, 极有可能出现丟包, H没丟了 Pn的参考帧 Pi, 后续的 P帧直到下一个 I帧到 达之前就不能解码, 这种情况, 也可以根据本发明的实施例获取 I帧, 从而对 当前帧进行解码。
如图 6所示, 本发明实施例提供了一种视频编码装置, 该装置, 包括: 编码单元 601 : 用于在编码器将源图像进行帧间编码为 P帧时,将所述源 图像进行帧内编码, 获取与 P帧相对应的 I帧;
緩存单元 602: 用于将所述与 P帧相对应的 I帧存储在编码器的緩存中。 其中, 所述的视频编码装置, 还包括:
源图像获取单元 603: 用于获取当前 P帧的参考帧的原始图像、重构图像 或者当前 P帧的至少两幅参考帧的原始图像合成的图像。
所述的緩存单元 602, 进一步包括:
緩存设置子单元: 用于根据编码器的当前编码帧与分组域流媒体服务器 的当前转发帧设置编码器緩存的大小;
更新存储子单元: 用于将所述与 P帧相对应的 I帧,根据所述编码器緩存 的大小进行实时更新存储。 如图 7所示, 本发明实施例提供了一种视频解码装置, 该装置, 包括: 接收单元 701: 用于接收流媒体服务器转发的视频帧;
解码单元 702: 用于若接收的视频帧为 P帧时,获取与当前 P帧相对应的 I帧, 参考所述与当前 P帧相对应的 I帧进行解码。
如图 8所示, 本发明实施例提供了一种视频播放装置; 该装置, 包括: 信息发送单元 801 : 用于若接收的视频帧为 P帧时, 流媒体服务器发送获 取所述 P帧对应的 I帧请求消息;
信息接收单元 802: 用于流媒体服务器接收 I帧, 所述 I帧为编码器设备 根据所述的获取 I帧请求将所述 P帧所对应的源图像进行帧内编码所获取的; 还用于通过消息通道, 流媒体服务器接收所述获取 I帧的响应消息;
信息转发单元 803: 用于流媒体服务器将所述 I帧转发给客户端设备, 以 便所述客户端设备根据所述 I帧对接收的所述 I帧对应的视频 P帧进行解码播 放。
如图 9所示, 本发明实施例提供了一种视频播放系统; 该系统, 包括: 请求接收单元 901 : 用于若接收的视频帧为 P帧时,编码器设备接收流媒 体服务器发送的获取所述 P帧对应的 I帧请求消息;
信息获取单元 902: 用于编码器设备根据所述的获取 I帧请求, 将所述当 前 P帧所对应的源图像进行帧内编码, 获取与当前 P帧相对应的 I帧;
信息下发单元 903: 用于编码器设备将所述 I帧下发给所述的流媒体服务 器; 即通过消息通道, 下发所述获取 I帧的响应消息给分组域流媒体服务器; 通过临时通道, 下发所述 I帧给分组域流媒体服务器下发。
转发单元 904, 用于流媒体服务器将所述 I帧转发给客户端设备; 解码播放单元 905, 客户端设备根据所述 I帧对接收的所述 I帧对应的视 频 P帧进行解码播放。
进一步, 所述的解码播放单元 905 , 还包括:
容错处理子单元: 用于根据接收到的视频帧, 判断当前接收的视频帧为 P 帧, 客户端设备根据所述的与当前 P帧相对应的 I帧对所述接收的视频 P帧 进行解码播放。
本发明实施例提供的视频播放方法、 装置及系统, 通过在编码器侧将源 图像进行帧间编码为 P帧时, 在进行 P帧编码的同时进行 P帧相应 I帧的编 码, 并将其存储在编码器的緩存中以备后用; 当分组域流媒体服务器判断当 前接入帧不是 I帧, 发起获取 I帧请求, 编码器设备将根据所述请求获取 I帧 并将所述 I帧通过分组域流媒体服务器转发给客户端设备,从而使得客户端设 备可以根据所述 I帧对当前接入的 P帧进行解码, 从而使得用户接入、 切换 / 插播时, 可以实时清晰的收看到图像; 与现有技术, 由于用户接入的时刻不 同并且当前的接入帧不是 I帧,流媒体服务器总是根据緩存区中与用户当前接 入帧最近的 I帧, 开始给用户发送数据, 从而造成相同的时间, 不同时刻接入 的用户看到的节目不同, 使得用户观看到的节目与实时播放的节目之间产生 的时延, 本发明根据所述的 I帧进行解码, 可以使得不同时刻接入的用户, 直 接获得与当前接入 P帧相对应的 I帧进行直播,从而不但减小了直播频道的播 放延时, 而且还可以清晰的将 P帧进行解码, 改善了解码图像的清晰度。
通过以上的实施方式的描述, 本领域普通技术人员可以理解: 实现上述 实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成, 所述的程序可以存储于一计算机可读取存储介质中, 该程序在执行时, 包括 如上述方法实施例的步骤, 所述的存储介质, 如: ROM/RAM、磁碟、光盘等。
以上所述, 仅为本发明的具体实施方式, 但本发明的保护范围并不局限 于此, 任何熟悉本技术领域的技术人员在本发明揭露的技术范围内, 可轻易 想到变化或替换, 都应涵盖在本发明的保护范围之内。 因此, 本发明的保护 范围应以权利要求的保护范围为准。

Claims

权 利 要求 书
1、 一种视频编码方法, 其特征在于, 包括:
编码器将源图像进行帧间编码为 p帧;
将所述源图像进行帧内编码, 获取与 P帧相对应的 I帧;
将所述与 P帧相对应的 I帧存储在编码器的緩存中。
2、 根据权利要求 1所述的视频编码方法, 其特征在于, 将所述源图像进行 帧内编码, 获取与 P帧相对应的 I帧的步骤, 包括:
获取当前 P帧的参考帧的原始图像;
将所述当前 P帧的参考帧的原始图像, 进行帧内编码, 获取与 P帧相对应 的 I帧。
3、 根据权利要求 1所述的视频编码方法, 其特征在于, 将所述源图像进行 帧内编码, 获取与 P帧相对应的 I帧的步骤, 包括:
获取当前 P帧的参考帧的重构图像;
将所述当前 P帧参考帧的重构图像, 进行帧内编码, 获取与 P帧相对应的 I 帧。
4、 根据权利要求 1 所述的视频编码方法, 其特征在于, 将所述源图像进 行帧内编码, 获取与 P帧相对应的 I帧的步骤, 包括:
获取当前 P帧的至少两幅参考帧的原始图像合成的图像;
将所述当前 P帧的至少两幅参考帧的原始图像合成的图像, 进行帧内编码, 获取与 P帧相对应的 I帧。
5、 根据权利要求 1所述的视频编码方法, 其特征在于, 将所述与 P帧相对 应的 I帧存储在编码器的緩存中的步骤, 包括:
根据编码器的当前编码帧与流媒体服务器的当前转发帧设置编码器緩存的 大小;
将所述与 P帧相对应的 I帧,根据所述编码器緩存的大小进行实时更新存储。
6、 一种视频解码方法, 其特征在于, 包括: 接收流媒体服务器转发的视频帧;
若接收的视频帧为 P帧时, 获取与当前 P帧相对应的 I帧, 参考所述与当 前 P帧相对应的 I帧进行解码。
7、 根据权利要求 6所述的视频解码方法, 其特征在于, 若接收的视频帧是 P帧时, 获取与当前 P帧相对应的 I帧, 参考所述与当前 P帧相对应的 I帧进行 解码的步骤, 包括:
根据接收到的视频帧, 判断当前接收的视频帧为 P帧;
获取与当前 P帧相对应的 I帧,参考所述与当前 P帧相对应的 I帧进行解码。
8、 一种视频播放方法, 其特征在于, 包括:
若接收的视频帧为 P帧时, 流媒体服务器发送获取所述 P帧对应的 I帧请 求消息;
流媒体服务器接收 I帧, 所述 I帧为编码器设备根据所述的获取 I帧请求将 所述 P帧所对应的源图像进行帧内编码所获取的;
流媒体服务器将所述 I帧转发给客户端设备,以便所述客户端设备根据所述 I帧对接收的所述 I帧对应的视频 P帧进行解码播放。
9、 根据权利要求 8所述视频播放方法, 其特征在于, 根据所述的获取 I帧 请求, 流媒体服务器接收 I帧的步骤, 包括:
通过消息通道, 流媒体服务器接收所述获取 I帧的响应消息;
通过临时通道, 流媒体服务器接收所述 I帧。
10、 根据权利要求 9 所述视频播放方法, 其特征在于, 所述请求消息中至 少携带直播频道 ID、 当前帧 ID、 临时通道的接收端口和命令指示值; 所述响应 消息中至少携带直播频道 ID、 当前帧 ID、 临时通道的接收端口和命令指示值。
11、 一种视频编码装置, 其特征在于, 包括:
编码单元(601 ), 用于在编码器将源图像进行帧间编码为 P帧时, 将所述 源图像进行帧内编码, 获取与 P帧相对应的 I帧;
緩存单元(602 ), 用于将所述与 P帧相对应的 I帧存储在编码器的緩存中。
12、 根据权利要求 11所述的视频编码装置, 其特征在于, 还包括: 源图像获取单元(603 ): 用于获取当前 P帧的参考帧的原始图像、 重构图 像或者当前 P帧的至少两幅参考帧的原始图像合成的图像。
13、 根据权利要求 11所述的视频编码装置, 其特征在于, 所述緩存单元, 进一步包括:
緩存设置子单元: 用于根据编码器的当前编码帧与流媒体服务器的当前转 发帧设置编码器緩存的大小;
更新存储子单元: 用于将所述与 P帧相对应的 I帧,根据所述编码器緩存的 大小进行实时更新存储。
14、 一种视频解码装置, 其特征在于, 包括:
接收单元(701 ), 用于接收流媒体服务器转发的视频帧;
解码单元(702 ), 用于若接收的视频帧是 P帧时, 获取与当前 P帧相对应 的 I帧, 参考所述与当前 P帧相对应的 I帧进行解码。
15、 一种视频播放装置, 其特征在于, 包括:
信息发送单元(801 ): 用于若接收的视频帧为 P帧时, 流媒体服务器发送 获取所述 P帧对应的 I帧请求消息;
信息接收单元(802 ): 用于流媒体服务器接收 I帧, 所述 I帧为编码器设备 根据所述的获取 I帧请求将所述 P帧所对应的源图像进行帧内编码所获取的;还 用于通过消息通道, 流媒体服务器接收所述获取 I帧的响应消息;
信息转发单元 ( 803 ): 用于流媒体服务器将所述 I帧转发给客户端设备, 以 便所述客户端设备根据所述 I帧对接收的所述 I帧对应的视频 P帧进行解码播 放。
16、 一种视频播放系统, 其特征在于, 包括:
请求接收单元(901 ), 用于若接收的视频帧为 P帧时, 编码器设备接收流 媒体服务器发送的获取所述 P帧对应的 I帧请求消息;
信息获取单元(902 ), 用于编码器设备根据所述的获取 I帧请求消息, 将所 述当前 P帧所对应的源图像进行帧内编码, 获取与当前 P帧相对应的 I帧; 信息下发单元 ( 903 ) , 用于编码器设备将所述 I帧下发给所述的流媒体服务 器; 通过消息通道, 下发所述获取 I帧的响应消息给流媒体服务器; 通过临时通 道, 下发所述 I帧给流媒体服务器下发;
转发单元(904 ), 用于流媒体服务器将所述 I帧转发给客户端设备; 解码播放单元( 905 ) , 客户端设备根据所述 I帧对接收的所述 I帧对应的视 频 P帧进行解码播放。
17、 根据权利要求 16所述视频播放装置, 其特征在于, 所述的解码播放单 元, 包括:
容错处理子单元, 用于根据接收到的视频帧, 判断当前接收的视频帧为 P 帧, 客户端设备根据所述的与当前 P帧相对应的 I帧对所述接收的视频 P帧进 行解码播放。
PCT/CN2009/072768 2008-09-22 2009-07-15 视频编码 / 解码方法、装置与视频播放方法、装置及系统 WO2010031273A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN 200810211296 CN101686391A (zh) 2008-09-22 2008-09-22 视频编码/解码方法、装置与视频播放方法、装置及系统
CN200810211296.6 2008-09-22

Publications (1)

Publication Number Publication Date
WO2010031273A1 true WO2010031273A1 (zh) 2010-03-25

Family

ID=42039083

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2009/072768 WO2010031273A1 (zh) 2008-09-22 2009-07-15 视频编码 / 解码方法、装置与视频播放方法、装置及系统

Country Status (2)

Country Link
CN (1) CN101686391A (zh)
WO (1) WO2010031273A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112866736A (zh) * 2021-01-15 2021-05-28 北京乐学帮网络技术有限公司 一种关键帧发送方法、处理服务器及直播系统
CN113727174A (zh) * 2021-07-14 2021-11-30 深圳市有为信息技术发展有限公司 控制车辆卫星定位系统视频平台播放的方法、装置及电子设备
CN113784123A (zh) * 2021-11-11 2021-12-10 腾讯科技(深圳)有限公司 视频编码方法和装置、存储介质及电子设备

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102196249B (zh) * 2011-05-17 2012-12-05 浙江宇视科技有限公司 监控数据回放方法及编码器、视频管理服务器
CN104602044B (zh) * 2015-02-05 2019-02-15 秦永红 一种rtmp流媒体公网直播系统及其设计方法
CN104902289B (zh) * 2015-06-29 2017-10-27 秦永红 一种rtmp流媒体直播系统热备份的设计方法及其系统
CN105704527A (zh) * 2016-01-20 2016-06-22 努比亚技术有限公司 一种终端及终端进行视频帧定位的方法
CN106027991B (zh) * 2016-07-12 2024-02-13 李巍 一种医疗视频影像直播一体机
CN106303682B (zh) * 2016-08-09 2019-09-20 华为技术有限公司 频道切换的方法、装置、终端及服务器
CN106295300B (zh) * 2016-08-15 2019-04-26 深圳先进技术研究院 一种穿戴式智能设备身份认证方法及装置
CN107801049B (zh) * 2016-09-05 2020-01-17 杭州海康威视数字技术股份有限公司 一种实时视频传送、播放方法及装置
CN106604064A (zh) * 2016-12-30 2017-04-26 北京奇艺世纪科技有限公司 一种快速开播方法及装置
CN107135400A (zh) * 2017-06-12 2017-09-05 上海高顿教育培训有限公司 一种降低网络直播延时的方法
CN110149491B (zh) * 2018-02-11 2021-09-28 腾讯科技(深圳)有限公司 视频编码方法、视频解码方法、终端及存储介质
CN111314648A (zh) * 2020-02-28 2020-06-19 联想(北京)有限公司 信息处理方法、处理装置、第一电子设备和服务器
CN115174943B (zh) * 2022-07-08 2023-10-31 叠境数字科技(上海)有限公司 一种边云协同及客户端自适应的自由视角播放方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002032146A1 (en) * 2000-10-06 2002-04-18 General Instrument Corporation Transcoding progressive i-slice refreshed mpeg data streams to enable trick play
CN1610407A (zh) * 2003-10-23 2005-04-27 致伸科技股份有限公司 可适应场景改变的视讯压缩方法
CN1848962A (zh) * 2005-04-15 2006-10-18 索尼株式会社 程序、信息处理装置、信息处理方法以及记录介质
CN1957617A (zh) * 2004-05-25 2007-05-02 皇家飞利浦电子股份有限公司 用于编码数字视频数据的方法和设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002032146A1 (en) * 2000-10-06 2002-04-18 General Instrument Corporation Transcoding progressive i-slice refreshed mpeg data streams to enable trick play
CN1610407A (zh) * 2003-10-23 2005-04-27 致伸科技股份有限公司 可适应场景改变的视讯压缩方法
CN1957617A (zh) * 2004-05-25 2007-05-02 皇家飞利浦电子股份有限公司 用于编码数字视频数据的方法和设备
CN1848962A (zh) * 2005-04-15 2006-10-18 索尼株式会社 程序、信息处理装置、信息处理方法以及记录介质

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112866736A (zh) * 2021-01-15 2021-05-28 北京乐学帮网络技术有限公司 一种关键帧发送方法、处理服务器及直播系统
CN113727174A (zh) * 2021-07-14 2021-11-30 深圳市有为信息技术发展有限公司 控制车辆卫星定位系统视频平台播放的方法、装置及电子设备
CN113784123A (zh) * 2021-11-11 2021-12-10 腾讯科技(深圳)有限公司 视频编码方法和装置、存储介质及电子设备

Also Published As

Publication number Publication date
CN101686391A (zh) 2010-03-31

Similar Documents

Publication Publication Date Title
WO2010031273A1 (zh) 视频编码 / 解码方法、装置与视频播放方法、装置及系统
JP5788101B2 (ja) メディアデータのネットワークストリーミング
KR101540878B1 (ko) 파일 전달 방법들을 이용한 ip 브로드캐스트 스트리밍 서비스 배포
CN107566918B (zh) 一种视频分发场景下的低延时取流秒开方法
WO2011000253A1 (zh) 一种媒体流处理方法及通讯系统以及相关设备
JP5363473B2 (ja) 改善されたメディア・セッション管理の方法と装置
JP5366107B2 (ja) メディア遅延を低減するための方法、装置およびシステム
US8488066B2 (en) System and method for fast digital channel changing
EP2509320A1 (en) Channel switching method, apparatus and system
BR112016022201B1 (pt) Método para recuperar dados de mídia por um dispositivo cliente que tem um cliente de serviço de multicast de multimídia e um cliente de streaming adaptativo dinâmico sobre http, dispositivo cliente que tem um cliente de serviço de multicast de multimídia e um cliente de streaming adaptativo dinâmico sobre http, e, memória legível por computador
WO2009039741A1 (fr) Procédé et dispositif permettant la commutation de chaînes iptv
CN107819809B (zh) 对内容进行同步操作的方法及装置
WO2010054543A1 (zh) 一种频道切换方法、装置和系统
JP2014212538A (ja) 符号化ビデオ・データのストリーミング
WO2010133123A1 (zh) 转发视频数据的方法、装置和系统
WO2017096935A1 (zh) 一种快速频道切换方法、服务器及iptv系统
JP2007150916A (ja) コミュニケーションシステム、端末装置及びコンピュータプログラム
WO2008148333A1 (fr) Système et procédé de traitement d'un flux vidéo
WO2016077072A1 (en) Delivering partially received segments of streamed media data
KR20110040687A (ko) 네트워크 기기, 정보 처리 장치, 스트림 전환 방법, 정보 처리 방법, 프로그램 및 콘텐츠 배신 시스템
US20140321556A1 (en) Reducing amount of data in video encoding
WO2010075705A1 (zh) 一种ip电视频道切换处理方法、装置和系统
WO2010022598A1 (zh) 交互电视频道切换方法及系统、音视频流发送方法及装置
JP4735666B2 (ja) コンテンツサーバ、情報処理装置、ネットワーク機器、コンテンツ配信方法、情報処理方法およびコンテンツ配信システム
US8208561B2 (en) Technique for media frame decoding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09813994

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09813994

Country of ref document: EP

Kind code of ref document: A1