CN101686391A - Video coding/decoding method and device as well as video playing method, device and system - Google Patents
Video coding/decoding method and device as well as video playing method, device and system Download PDFInfo
- Publication number
- CN101686391A CN101686391A CN 200810211296 CN200810211296A CN101686391A CN 101686391 A CN101686391 A CN 101686391A CN 200810211296 CN200810211296 CN 200810211296 CN 200810211296 A CN200810211296 A CN 200810211296A CN 101686391 A CN101686391 A CN 101686391A
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- current
- media server
- encoder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/162—User input
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
- H04N21/4383—Accessing a communication channel
- H04N21/4384—Accessing a communication channel involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Abstract
The embodiment of the invention discloses a video coding/decoding method and a device as well as a video playing method, a device and a system, which relate to the technical field of communication. The invention is invented for solving the problem of time delay generated between a program watched by users and a program played at real time in the same direct broadcast channel in the prior art as the access moment of the users is different, the current access frame is not an I frame, and a flow medium server always begins to transmit data to the users according to the I frame which is proximateto the current access frame of the users in a buffer area so as to cause different programs watched by the users accessing at the same time and different moment. The embodiment of the invention provides a video coding method. The method comprises the following steps: carrying out interframe coding on a source image to obtain a P frame by a coder; carrying out intraframe coding on the source imageand obtaining an I frame corresponding to the P frame; and storing the I frame corresponding to the P frame in a buffer memory of the coder. By the invention, the accessed users can watch live programs at real time.
Description
Technical field
The present invention relates to communication technique field, relate in particular to video coding and decoding technology.
Background technology
Because the real-time of live data requires the user no matter when insert, as long as watch same channel, the program of being watched all is the same, in fact is exactly to require each client almost to receive same media data simultaneously.Streaming Media is general to adopt the image sequence such as " IPPPPPPPPI " to transmit, and wherein, in the character string of described double quotation marks, I represents the I frame, and P represents the P frame.Because the P frame must could decode according to the I frame, if when the user inserts, not to send out the moment access of I frame, promptly first data of receiving of client are not the I frames just, client just can't be decoded, up to receiving next I frame.Like this, serious flower screen or blank screen must appear in a bit of time before that arrives from user's switching instant to next I frame.In fact, be carved with this problem when being not only access, all there is similar problem in code check switching, channel switching, commercial breaks or the like scene.Flower screen during scenes such as inserting in order eliminating/switch/to intercut or blank screen phenomenon, just require service end insert the user/switch/when intercutting, at first send the I frame data.
In realizing process of the present invention, the inventor finds that there are the following problems at least in the prior art:
In streaming media server, at each direct broadcast band, start a buffer area, data between at least two I frames of this buffer area buffer memory, promptly require buffer area to have complete I frame data at least, other P frame and B frame data also want buffer memory to get up, when the user insert and present frame when not being the I frame as shown in fig. 1, find nearest I frame data from data cached, from then on the I frame data begin to provide service for this user.Like this, make same direct broadcast band, because it is not the I frame that described user inserts frame, streaming media server always according in the buffer area with the nearest I frame of the current access frame of user, begin to send data, thereby cause the identical time, the program difference that different users sees to the user, can not watch current programme televised live in real time, certain time delay is arranged.Because when the user inserts, present frame is not the I frame, the program that the user the watches program that always nearest I frame is play with inserting user's frame from buffer area.
In streaming media server, at each direct broadcast band, can the nearest complete I frame data of buffer memory, follow-up complete new I frame data, the real-time update whenever received.Insert into and present frame when not being the I frame as new user, PSS (Packet-switched Streaming Server, packet domain stream media server) send the good I frame data of buffer memory for earlier this user, then send present frame then, described present frame is P frame or B frame.As shown in Figure 1, after promptly PSS finished the transmission of I0 frame data earlier, just then the P4 frame data continued to provide service.But, after sending buffer area I frame, just send present frame, be equivalent to lose every at I frame recently to the P frame of present frame or the frame data of B interframe, as shown in Figure 1, be equivalent to lose the data of P2, P2, P3 frame exactly.Image blurring or mosaic phenomenon inevitably appears when therefore, initially inserting.
Summary of the invention
In order to solve in the prior art, same direct broadcast band, because current access frame was not the I frame when user inserted, and streaming media server always according in the buffer area with the nearest I frame of the current access frame of user, begin to send data to the user, thereby cause the identical time, the program difference that the different users that insert constantly see, the delay problem that produces between the program that makes program that the user watches and play in real time, embodiments of the invention provide a kind of video coding-decoding method, device and video broadcasting method, the Apparatus and system delay problem with solution.
In realizing technical scheme of the present invention, embodiments of the invention provide a kind of method for video coding, and this method comprises:
It is the P frame that encoder carries out interframe encode with source images;
Described source images is carried out intraframe coding, obtain and the corresponding I frame of P frame;
Be stored in the buffer memory of encoder with the corresponding I frame of P frame described.
In realizing technical scheme of the present invention, the embodiment of the invention provides a kind of video encoding/decoding method, and this method comprises:
The frame of video of receiving stream media server forwards;
If when the frame of video that receives is the P frame, obtain and the corresponding I frame of current P frame, decode with reference to the corresponding I frame of described and current P frame.
In realizing technical scheme of the present invention, the embodiment of the invention provides a kind of video broadcasting method, and this method comprises:
When if the frame of video that receives is the P frame, streaming media server sends the I frame request message that obtains described P frame correspondence;
Streaming media server receives the I frame, and described I frame is that encoder device carries out intraframe coding according to the request of the described I of obtaining frame with the pairing source images of described P frame and obtains;
Streaming media server is transmitted to client device with described I frame, so as described client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
In realizing technical scheme of the present invention, the embodiment of the invention also provides a kind of video coding apparatus, and this device comprises:
Coding unit: be used for source images being carried out interframe encode when being the P frame, described source images is carried out intraframe coding, obtain and the corresponding I frame of P frame at encoder;
Buffer unit: the buffer memory that is used for described and the corresponding I frame of P frame are stored in encoder.
In realizing technical scheme of the present invention, the embodiment of the invention also provides a kind of video decoder, and this device comprises:
Receiving element is used for the frame of video of receiving stream media server forwards;
Decoding unit is used for obtaining and the corresponding I frame of current P frame when if the frame of video that receives is the P frame, decodes with reference to the corresponding I frame of described and current P frame.
In realizing technical scheme of the present invention, the embodiment of the invention also provides a kind of video play device, and this device comprises:
Information transmitting unit: be used for when if the frame of video that receives is the P frame, streaming media server sends the I frame request message that obtains described P frame correspondence;
Information receiving unit: be used for streaming media server and receive the I frame, described I frame is that encoder device carries out intraframe coding according to the request of the described I of obtaining frame with the pairing source images of described P frame and obtains; Also be used for by message channel, streaming media server receives the described response message that obtains the I frame;
The information retransmission unit: be used for streaming media server described I frame be transmitted to client device so that described client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
In realizing technical scheme of the present invention, the embodiment of the invention also provides a kind of audio/video player system, and this system comprises:
The request receiving element is used for when if the frame of video that receives is the P frame I frame request message that obtains described P frame correspondence that encoder device receiving stream media server sends;
Information acquisition unit is used for encoder device according to the described I of obtaining frame request message, and the pairing source images of described current P frame is carried out intraframe coding, obtains and the corresponding I frame of current P frame;
Information issues the unit, is used for encoder device described I frame is handed down to described streaming media server; By message channel, the response message that issues the described I of obtaining frame is given streaming media server; By occasional passage, issue described I frame and issue to streaming media server;
Retransmission unit is used for streaming media server described I frame is transmitted to client device;
Decoding broadcast unit, client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
The video broadcasting method that the embodiment of the invention provides, Apparatus and system and video coding/decoding method, device, by source images being carried out interframe encode when being the P frame in coder side, when carrying out P frame coding, carry out the coding of the corresponding I frame of P frame, and it is stored in the buffer memory of encoder for future use; Judging current access frame when packet domain stream media server is not the I frame, the request of I frame is obtained in initiation, encoder device will obtain the I frame and described I frame will be transmitted to client device by packet domain stream media server according to described request, thereby make client device to decode to the P frame of current access according to described I frame, thereby make the user insert, switch/when intercutting, can watch image in real time clearly; The present invention decodes according to described I frame, can be so that the different user who inserts constantly, directly obtain to carry out live with the corresponding I frame of current access P frame, thereby not only reduced the broadcast time-delay of direct broadcast band, but also can clearly the P frame be decoded, improved the definition of decoded picture.
Description of drawings
Fig. 1 is a schematic diagram of playing frame in the prior art from user access point;
A kind of method for video coding flow chart that Fig. 2 provides for the embodiment of the invention;
A kind of video encoding/decoding method flow chart that Fig. 3 provides for the embodiment of the invention;
A kind of video broadcasting method flow chart that Fig. 4 provides for the embodiment of the invention;
Fig. 5 for the embodiment of the invention provide when the user inserts, realize the process chart of video broadcasting method;
A kind of video coding apparatus structural representation that Fig. 6 provides for the embodiment of the invention;
A kind of video decoder structural representation that Fig. 7 provides for the embodiment of the invention;
A kind of video play device structural representation that Fig. 8 provides for the embodiment of the invention;
A kind of audio/video player system structural representation that Fig. 9 provides for the embodiment of the invention;
The structural representation of data volume in the message channel that Figure 10 provides for the embodiment of the invention;
The schematic diagram of a kind of method for video coding that Figure 11 provides for the embodiment of the invention.
Embodiment
Below in conjunction with accompanying drawing a kind of video coding/decoding method, device and video broadcasting method, the device that the embodiment of the invention provides is described in detail.
As shown in Figure 2, a kind of method for video coding that the embodiment of the invention provides, in the process that realizes the embodiment of the invention, this method comprises:
201: it is the P frame that encoder carries out interframe encode with source images;
202: described source images is carried out intraframe coding, obtain and the corresponding I frame of P frame;
203: be stored in the buffer memory of encoder with the corresponding I frame of P frame with described.
Wherein, in this embodiment, described step 202 can have three kinds of different coding methods respectively:
The coding method of first kind of synthetic I frame is:
Obtain the original image of the reference frame of current P frame;
The original image of the reference frame of described current P frame as source images, is carried out intraframe coding, obtain and the corresponding I frame of P frame.
The coding method of second kind of synthetic I frame is:
Obtain the reconstructed image of the reference frame of current P frame;
The reconstructed image of described current P frame reference frame as source images, is carried out intraframe coding, obtain and the corresponding I frame of P frame.
The coding method of the third synthetic I frame is:
Obtain the synthetic image of source images of at least two width of cloth reference frames of current P frame;
The image that the original image of at least two width of cloth reference frames of described current P frame is synthetic carries out intraframe coding as source images, obtains and the corresponding I frame of P frame.
Further, in this embodiment, described step 203 can comprise:
The size of encoder buffer is set according to the current transmitted frame of the current encoded frame of encoder and packet domain stream media server;
With the described and corresponding I frame of P frame, carry out the real-time update storage according to the size of described encoder buffer.
As shown in Figure 3, a kind of video encoding/decoding method that the embodiment of the invention provides, in the process that realizes the embodiment of the invention, this method comprises:
301: the frame of video of receiving stream media server forwards;
302: when being the P frame, obtain and the corresponding I frame of current P frame, decode with reference to the corresponding I frame of described and current P frame as if the frame of video that receives.Wherein, when being the P frame as if the frame of video that receives, obtain and the corresponding I frame of current P frame, the step with reference to the corresponding I frame of described and current P frame is decoded comprises:
According to the frame of video that receives, the frame of video of judging current reception is the P frame;
Obtain and the corresponding I frame of current P frame, decode with reference to the corresponding I frame of described and current P frame.
The video coding/decoding method that the embodiment of the invention provides, by encoder source images is carried out interframe encode when being the P frame, source images is carried out intraframe coding, obtain with the corresponding I frame of P frame and with it and be buffered in the encoder, make the user when inserting to the P frame, can obtain in real time with the corresponding I frame of P frame and decode, thereby the user can not have the program of watching direct broadcast band of time delay.
As shown in Figure 4, the embodiment of the invention provides a kind of video broadcasting method, and this method comprises:
401: when being the P frame as if the frame of video that receives, streaming media server sends the I frame request message that obtains described P frame correspondence;
402: streaming media server receives the I frame, and described I frame is that encoder device carries out intraframe coding according to the request of the described I of obtaining frame with the pairing source images of described P frame and obtains; Promptly by message channel, streaming media server receives the described response message that obtains the I frame; By occasional passage, streaming media server receives described I frame.
403: streaming media server is transmitted to client device with described I frame, so as described client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
Wherein, carry the receiving port and the order indicated value of direct broadcast band ID, present frame ID, occasional passage in the described request message at least; At least carry the receiving port and the order indicated value of direct broadcast band ID, present frame ID, occasional passage in the described response message.
As shown in Figure 5, the embodiment of the invention provide when the user inserts, realize the process chart of video broadcasting method; In the process that realizes the embodiment of the invention, concrete step is as follows:
501, client device sends order request according to user's needs;
502, the PSS program request is replied the request response after receiving order request;
503, PSS judges whether present frame is the I frame, if the I frame directly entered for the 508th step; If not the I frame, directly carry out step 504;
504, PSS sends the I frame of request present frame; Wherein, the request message of the I frame of described request present frame can be by message by sending to encoder device.
505, encoder device carries out the synthetic processing of I frame according to the request of the I frame that obtains present frame that receives; The invention process can be synthesized the I frame by aforesaid method for video coding and be handled:
In realizing the embodiment of the invention, obtain in the process of synthetic I frame, the process of playing frame with access user shown in Figure 1 is an example, the embodiment of the invention in the process that I0, P1, P2, P3, P4, P5, P6, P7, P8, I9 frame are encoded as shown in figure 11.If Fn will be encoded to the P frame, except carrying out 1 and 2 normal flow the source images of Fn is encoded to the P frame, also need to carry out 3 flow processs, carry out intraframe coding by flow process 3 and generate the corresponding I frame of the source images with this Fn, described I frame is stored in as among the In among Fig. 7; When if Fn will be encoded to the I frame, In is the same with the data that output to NAL; When if Fn will be encoded to the B frame, because the B frame can not that is to say that Fn can just not there is no need to generate the I frame data of Fn correspondence by the subsequent frame reference certainly yet by other frame reference.Wherein, described Fn can be the source images of the reference frame of present frame, also can be the reconstructed image of the reference frame of present frame, can also be the piece image that a plurality of reference frames of present frame are synthetic.
506, the request of encoder device response PSS, with the response message of described synthetic I frame by message channel notice packet domain stream media server;
Wherein, the data volume structure of described request message that transmits by message channel and response message can be as shown in figure 10, the embodiment of the invention is an example with the message channel based on Transmission Control Protocol, because a plurality of channels of the general support of encoder device Encoder, just can uniquely identify a direct broadcast band according to channel ID, sometimes channel ID may fill in the multicast IP of direct broadcast band; Order indicated value implication is as follows: 01 expression PSS is to the synthetic I frame of Encoder request present frame correspondence, and 02 expression Encoder responds the request of PSS.The concrete use way of this data volume structure is: when PSS need ask the synthetic I frame of certain P frame, at first, by data of above-mentioned data volume structure construction, and set up short TCP with Encoder and is connected and promptly gets access to the just disconnection of synthetic I frame data; Then, use Transmission Control Protocol the good transfer of data of above-mentioned structure to Encoder.After Encoder receives the PSS request, behind the synthetic I frame of synthetic I frame method in accordance with regulations, at first, by data of above-mentioned data volume structure construction, and with of the request of these data by message channel response PSS, by occasional passage synthetic I frame data are sent in the port of appointment in the data volume structure then, whole like this transmission reciprocal process has just been finished.
507, encoder device sends the data of I frame by occasional passage; Described I frame is issued to packet domain stream media server by occasional passage.
At least carry the receiving port and the order indicated value of direct broadcast band ID, present frame ID, occasional passage in described request message and the response message; Described message channel is a kind of based among TCP (Transfer ControlProtocol, transmission control protocol), the UDP (User Datagram Protocol, User Datagram Protoco (UDP)) at least; Described occasional passage is based on RTP (Real-time Transport Protocol, RTP).
508, PSS sends the data of I frame;
509, PSS is follow-up sends normal live TV stream according to common live flow process.
Further, according to the frame that packet domain stream media server is transmitted, client device judges whether current received frame is the I frame;
If current received frame is the I frame, just play-over the I frame, if present frame is not the I frame, and its reference frame do not exist, and just obtains with the corresponding I frame of current P frame and decodes.Wherein, the mode of above-mentioned the third synthetic I frame of mentioning, the process of described synthetic I frame has changed the referring-to relation of the reference frame of present frame.For example: reference frame Pi, the Pj of certain Pn frame, Pk frame, because Pi, Pj, Pk have been synthesized the I frame, the sequence number of frame can only keep one, therefore some macro block of Pn just can't find reference frame according to the frame number of message indication, thereby just can't decode, so just can decode to present frame according to the synthetic I frame of mentioning in the invention process.Also have a kind of modal situation to be, because the unsteadiness of wireless network, packet loss very likely appears, suppose to lose the reference frame Pi of Pn, the subsequent P frame just can not be decoded before next I frame arrives, this situation also can be obtained the I frame according to embodiments of the invention, thereby present frame is decoded.
As shown in Figure 6, the embodiment of the invention provides a kind of video coding apparatus, and this device comprises:
Coding unit 601: be used for source images being carried out interframe encode when being the P frame, described source images is carried out intraframe coding, obtain and the corresponding I frame of P frame at encoder;
Buffer unit 602: the buffer memory that is used for described and the corresponding I frame of P frame are stored in encoder.
Wherein, described video coding apparatus also comprises:
Source images acquiring unit 603: the synthetic image of original image of at least two width of cloth reference frames of original image, reconstructed image or current P frame that is used to obtain the reference frame of current P frame.
Described buffer unit 602 further comprises:
Buffer memory is provided with subelement: the size that is used for being provided with according to the current transmitted frame of the current encoded frame of encoder and packet domain stream media server encoder buffer;
Updated stored subelement: be used for the described and corresponding I frame of P frame, carry out the real-time update storage according to the size of described encoder buffer.
As shown in Figure 7, the embodiment of the invention provides a kind of video decoder, and this device comprises:
Receiving element 701: the frame of video that is used for the receiving stream media server forwards;
Decoding unit 702: be used for obtaining and the corresponding I frame of current P frame, decode with reference to the corresponding I frame of described and current P frame when if the frame of video that receives is the P frame.
As shown in Figure 8, the embodiment of the invention provides a kind of video play device; This device comprises:
Information transmitting unit 801: be used for when if the frame of video that receives is the P frame, streaming media server sends the I frame request message that obtains described P frame correspondence;
Information receiving unit 802: be used for streaming media server and receive the I frame, described I frame is that encoder device carries out intraframe coding according to the request of the described I of obtaining frame with the pairing source images of described P frame and obtains; Also be used for by message channel, streaming media server receives the described response message that obtains the I frame;
Information retransmission unit 803: be used for streaming media server described I frame be transmitted to client device so that described client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
As shown in Figure 9, the embodiment of the invention provides a kind of audio/video player system; This system comprises:
Request receiving element 901: be used for when if the frame of video that receives is the P frame I frame request message that obtains described P frame correspondence that encoder device receiving stream media server sends;
Information acquisition unit 902: be used for encoder device according to the request of the described I of obtaining frame, the pairing source images of described current P frame is carried out intraframe coding, obtain and the corresponding I frame of current P frame;
Information issues unit 903: be used for encoder device described I frame is handed down to described streaming media server; Promptly by message channel, the response message that issues the described I of obtaining frame is given packet domain stream media server; By occasional passage, issue described I frame and issue to packet domain stream media server.
Retransmission unit 904 is used for streaming media server described I frame is transmitted to client device;
Decoding broadcast unit 905, client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
Further, described decoding broadcast unit 905 also comprises:
The fault-tolerant processing subelement: be used for according to the frame of video that receives, the frame of video of judging current reception is the P frame, client device according to the corresponding I frame of described and current P frame to the broadcast of decoding of the video P frame of described reception.
The video broadcasting method that the embodiment of the invention provides, Apparatus and system, by source images being carried out interframe encode when being the P frame in coder side, when carrying out P frame coding, carry out the coding of the corresponding I frame of P frame, and it is stored in the buffer memory of encoder for future use; Judging current access frame when packet domain stream media server is not the I frame, the request of I frame is obtained in initiation, encoder device will obtain the I frame and described I frame will be transmitted to client device by packet domain stream media server according to described request, thereby make client device to decode to the P frame of current access according to described I frame, thereby make the user insert, switch/when intercutting, can watch image in real time clearly; With prior art, because the moment that the user inserts is different and current access frame is not the I frame, streaming media server always according in the buffer area with the nearest I frame of the current access frame of user, begin to send data to the user, thereby cause the identical time, the program difference that the different users that insert constantly see, the time delay that produces between the program that makes program that the user watches and play in real time, the present invention decodes according to described I frame, can be so that the different user who inserts constantly, directly obtain to carry out live with the corresponding I frame of current access P frame, thereby not only reduced the broadcast time-delay of direct broadcast band, but also can clearly the P frame be decoded, improved the definition of decoded picture.
Through the above description of the embodiments, one of ordinary skill in the art will appreciate that: realize that all or part of step in the foregoing description method is to instruct relevant hardware to finish by program, described program can be stored in the computer read/write memory medium, this program is when carrying out, comprise step as above-mentioned method embodiment, described storage medium, as: ROM/RAM, magnetic disc, CD etc.
The above; only be the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; can expect easily changing or replacing, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claim.
Claims (17)
1, a kind of method for video coding is characterized in that, comprising:
It is the P frame that encoder carries out interframe encode with source images;
Described source images is carried out intraframe coding, obtain and the corresponding I frame of P frame;
Be stored in the buffer memory of encoder with the corresponding I frame of P frame described.
2, method for video coding according to claim 1 is characterized in that, described source images is carried out intraframe coding, obtains the step with the corresponding I frame of P frame, comprising:
Obtain the original image of the reference frame of current P frame;
Original image with the reference frame of described current P frame carries out intraframe coding, obtains and the corresponding I frame of P frame.
3, method for video coding according to claim 1 is characterized in that, described source images is carried out intraframe coding, obtains the step with the corresponding I frame of P frame, comprising:
Obtain the reconstructed image of the reference frame of current P frame;
Reconstructed image with described current P frame reference frame carries out intraframe coding, obtains and the corresponding I frame of P frame.
4, method for video coding according to claim 1 is characterized in that, described source images is carried out intraframe coding, obtains the step with the corresponding I frame of P frame, comprising:
Obtain the synthetic image of original image of at least two width of cloth reference frames of current P frame;
The image that the original image of at least two width of cloth reference frames of described current P frame is synthetic carries out intraframe coding, obtains and the corresponding I frame of P frame.
5, method for video coding according to claim 1 is characterized in that, described and the corresponding I frame of P frame is stored in the step in the buffer memory of encoder, comprising:
The size of encoder buffer is set according to the current transmitted frame of the current encoded frame of encoder and streaming media server;
With the described and corresponding I frame of P frame, carry out the real-time update storage according to the size of described encoder buffer.
6, a kind of video encoding/decoding method is characterized in that, comprising:
The frame of video of receiving stream media server forwards;
If when the frame of video that receives is the P frame, obtain and the corresponding I frame of current P frame, decode with reference to the corresponding I frame of described and current P frame.
7, video encoding/decoding method according to claim 6 is characterized in that, when being the P frame as if the frame of video that receives, obtains and the corresponding I frame of current P frame, and the step with reference to the corresponding I frame of described and current P frame is decoded comprises:
According to the frame of video that receives, the frame of video of judging current reception is the P frame;
Obtain and the corresponding I frame of current P frame, decode with reference to the corresponding I frame of described and current P frame.
8, a kind of video broadcasting method is characterized in that, comprising:
When if the frame of video that receives is the P frame, streaming media server sends the I frame request message that obtains described P frame correspondence;
Streaming media server receives the I frame, and described I frame is that encoder device carries out intraframe coding according to the request of the described I of obtaining frame with the pairing source images of described P frame and obtains;
Streaming media server is transmitted to client device with described I frame, so as described client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
9, described according to Claim 8 video broadcasting method is characterized in that, obtains the request of I frame according to described, and streaming media server receives the step of I frame, comprising:
By message channel, streaming media server receives the described response message that obtains the I frame;
By occasional passage, streaming media server receives described I frame.
10, according to the described video broadcasting method of claim 9, it is characterized in that, carry the receiving port and the order indicated value of direct broadcast band ID, present frame ID, occasional passage in the described request message at least; At least carry the receiving port and the order indicated value of direct broadcast band ID, present frame ID, occasional passage in the described response message.
11, a kind of video coding apparatus is characterized in that, comprising:
Coding unit is used at encoder source images being carried out interframe encode when being the P frame, and described source images is carried out intraframe coding, obtains and the corresponding I frame of P frame;
Buffer unit is used for described and the corresponding I frame of P frame are stored in the buffer memory of encoder.
12, video coding apparatus according to claim 11 is characterized in that, also comprises:
Source images acquiring unit: the synthetic image of original image of at least two width of cloth reference frames of original image, reconstructed image or current P frame that is used to obtain the reference frame of current P frame.
13, video coding apparatus according to claim 11 is characterized in that, described buffer unit further comprises:
Buffer memory is provided with subelement: the size that is used for being provided with according to the current transmitted frame of the current encoded frame of encoder and streaming media server encoder buffer;
Updated stored subelement: be used for the described and corresponding I frame of P frame, carry out the real-time update storage according to the size of described encoder buffer.
14, a kind of video decoder is characterized in that, comprising:
Receiving element is used for the frame of video of receiving stream media server forwards;
Decoding unit is used for obtaining and the corresponding I frame of current P frame when if the frame of video that receives is the P frame, decodes with reference to the corresponding I frame of described and current P frame.
15, a kind of video play device is characterized in that, comprising:
Information transmitting unit: be used for when if the frame of video that receives is the P frame, streaming media server sends the I frame request message that obtains described P frame correspondence;
Information receiving unit: be used for streaming media server and receive the I frame, described I frame is that encoder device carries out intraframe coding according to the request of the described I of obtaining frame with the pairing source images of described P frame and obtains; Also be used for by message channel, streaming media server receives the described response message that obtains the I frame;
The information retransmission unit: be used for streaming media server described I frame be transmitted to client device so that described client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
16, a kind of audio/video player system is characterized in that, comprising:
The request receiving element is used for when if the frame of video that receives is the P frame I frame request message that obtains described P frame correspondence that encoder device receiving stream media server sends;
Information acquisition unit is used for encoder device according to the described I of obtaining frame request message, and the pairing source images of described current P frame is carried out intraframe coding, obtains and the corresponding I frame of current P frame;
Information issues the unit, is used for encoder device described I frame is handed down to described streaming media server; By message channel, the response message that issues the described I of obtaining frame is given streaming media server; By occasional passage, issue described I frame and issue to streaming media server;
Retransmission unit is used for streaming media server described I frame is transmitted to client device;
Decoding broadcast unit, client device according to described I frame to the broadcast of decoding of the video P frame of the described I frame correspondence that receives.
According to the described video play device of claim 16, it is characterized in that 17, described decoding broadcast unit comprises:
The fault-tolerant processing subelement is used for according to the frame of video that receives, and the frame of video of judging current reception is the P frame, client device according to the corresponding I frame of described and current P frame to the broadcast of decoding of the video P frame of described reception.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810211296 CN101686391A (en) | 2008-09-22 | 2008-09-22 | Video coding/decoding method and device as well as video playing method, device and system |
| PCT/CN2009/072768 WO2010031273A1 (en) | 2008-09-22 | 2009-07-15 | Video encoding/decoding method, device and video playing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810211296 CN101686391A (en) | 2008-09-22 | 2008-09-22 | Video coding/decoding method and device as well as video playing method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101686391A true CN101686391A (en) | 2010-03-31 |
Family
ID=42039083
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200810211296 Pending CN101686391A (en) | 2008-09-22 | 2008-09-22 | Video coding/decoding method and device as well as video playing method, device and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN101686391A (en) |
| WO (1) | WO2010031273A1 (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102196249A (en) * | 2011-05-17 | 2011-09-21 | 杭州华三通信技术有限公司 | Monitoring data playback method, EC (Encoder) and video management server |
| CN104602044A (en) * | 2015-02-05 | 2015-05-06 | 秦永红 | RTMP stream media public network live broadcast system and design method thereof |
| CN104902289A (en) * | 2015-06-29 | 2015-09-09 | 秦永红 | Design method and system for RTMP (Real Time Messaging Protocol) streaming media live system warm backup |
| CN106027991A (en) * | 2016-07-12 | 2016-10-12 | 李巍 | Medical video and live broadcast all-in-one machine |
| CN106604064A (en) * | 2016-12-30 | 2017-04-26 | 北京奇艺世纪科技有限公司 | Rapid broadcasting method and device |
| WO2017124897A1 (en) * | 2016-01-20 | 2017-07-27 | 努比亚技术有限公司 | Terminal, method for video frame positioning by terminal, and computer storage medium |
| CN107135400A (en) * | 2017-06-12 | 2017-09-05 | 上海高顿教育培训有限公司 | A kind of method for reducing network direct broadcasting delay |
| WO2018028547A1 (en) * | 2016-08-09 | 2018-02-15 | 华为技术有限公司 | Channel switching method and device |
| WO2018032599A1 (en) * | 2016-08-15 | 2018-02-22 | 深圳先进技术研究院 | Identity authentication method and device for wearable intelligent device |
| CN107801049A (en) * | 2016-09-05 | 2018-03-13 | 杭州海康威视数字技术股份有限公司 | A kind of real-time video transmission, player method and device |
| CN110149491A (en) * | 2018-02-11 | 2019-08-20 | 腾讯科技（深圳）有限公司 | Method for video coding, video encoding/decoding method, terminal and storage medium |
| CN111314648A (en) * | 2020-02-28 | 2020-06-19 | 联想(北京)有限公司 | Information processing method, processing device, first electronic equipment and server |
| CN115174943A (en) * | 2022-07-08 | 2022-10-11 | 叠境数字科技（上海）有限公司 | Free visual angle playing method and system based on edge cloud cooperation and client self-adaption |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112866736A (en) * | 2021-01-15 | 2021-05-28 | 北京乐学帮网络技术有限公司 | Key frame sending method, processing server and live broadcast system |
| CN113727174A (en) * | 2021-07-14 | 2021-11-30 | 深圳市有为信息技术发展有限公司 | Method and device for controlling vehicle satellite positioning system video platform to play and electronic equipment |
| CN113784123B (en) * | 2021-11-11 | 2022-03-15 | 腾讯科技（深圳）有限公司 | Video encoding method and apparatus, storage medium, and electronic device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7046910B2 (en) * | 1998-11-20 | 2006-05-16 | General Instrument Corporation | Methods and apparatus for transcoding progressive I-slice refreshed MPEG data streams to enable trick play mode features on a television appliance |
| US20050089232A1 (en) * | 2003-10-23 | 2005-04-28 | Chun-Ming Hsu | Method of video compression that accommodates scene changes |
| WO2005117449A1 (en) * | 2004-05-25 | 2005-12-08 | Koninklijke Philips Electronics N.V. | Method and device for encoding digital video data |
| TW200704205A (en) * | 2005-04-15 | 2007-01-16 | Sony Corp | Program, information processing apparatus, information processing method and recording medium |
-
2008
- 2008-09-22 CN CN 200810211296 patent/CN101686391A/en active Pending
-
2009
- 2009-07-15 WO PCT/CN2009/072768 patent/WO2010031273A1/en active Application Filing
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102196249A (en) * | 2011-05-17 | 2011-09-21 | 杭州华三通信技术有限公司 | Monitoring data playback method, EC (Encoder) and video management server |
| CN104602044B (en) * | 2015-02-05 | 2019-02-15 | 秦永红 | A kind of RTMP Streaming Media public network live broadcast system and its design method |
| CN104602044A (en) * | 2015-02-05 | 2015-05-06 | 秦永红 | RTMP stream media public network live broadcast system and design method thereof |
| CN104902289A (en) * | 2015-06-29 | 2015-09-09 | 秦永红 | Design method and system for RTMP (Real Time Messaging Protocol) streaming media live system warm backup |
| CN104902289B (en) * | 2015-06-29 | 2017-10-27 | 秦永红 | A kind of design method and its system of RTMP flow medium live systems Hot Spare |
| WO2017124897A1 (en) * | 2016-01-20 | 2017-07-27 | 努比亚技术有限公司 | Terminal, method for video frame positioning by terminal, and computer storage medium |
| CN106027991A (en) * | 2016-07-12 | 2016-10-12 | 李巍 | Medical video and live broadcast all-in-one machine |
| CN106027991B (en) * | 2016-07-12 | 2024-02-13 | 李巍 | Medical video image live broadcast all-in-one |
| US10958972B2 (en) | 2016-08-09 | 2021-03-23 | Huawei Technologies Co., Ltd. | Channel change method and apparatus |
| WO2018028547A1 (en) * | 2016-08-09 | 2018-02-15 | 华为技术有限公司 | Channel switching method and device |
| WO2018032599A1 (en) * | 2016-08-15 | 2018-02-22 | 深圳先进技术研究院 | Identity authentication method and device for wearable intelligent device |
| CN107801049A (en) * | 2016-09-05 | 2018-03-13 | 杭州海康威视数字技术股份有限公司 | A kind of real-time video transmission, player method and device |
| CN107801049B (en) * | 2016-09-05 | 2020-01-17 | 杭州海康威视数字技术股份有限公司 | Real-time video transmission and playing method and device |
| CN106604064A (en) * | 2016-12-30 | 2017-04-26 | 北京奇艺世纪科技有限公司 | Rapid broadcasting method and device |
| CN107135400A (en) * | 2017-06-12 | 2017-09-05 | 上海高顿教育培训有限公司 | A kind of method for reducing network direct broadcasting delay |
| CN110149491A (en) * | 2018-02-11 | 2019-08-20 | 腾讯科技（深圳）有限公司 | Method for video coding, video encoding/decoding method, terminal and storage medium |
| CN110149491B (en) * | 2018-02-11 | 2021-09-28 | 腾讯科技（深圳）有限公司 | Video encoding method, video decoding method, terminal and storage medium |
| CN111314648A (en) * | 2020-02-28 | 2020-06-19 | 联想(北京)有限公司 | Information processing method, processing device, first electronic equipment and server |
| CN115174943A (en) * | 2022-07-08 | 2022-10-11 | 叠境数字科技（上海）有限公司 | Free visual angle playing method and system based on edge cloud cooperation and client self-adaption |
| CN115174943B (en) * | 2022-07-08 | 2023-10-31 | 叠境数字科技（上海）有限公司 | Free view angle playing method and system with edge cloud cooperation and client self-adaption |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010031273A1 (en) | 2010-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101686391A (en) | Video coding/decoding method and device as well as video playing method, device and system | |
| JP6342457B2 (en) | Network streaming of encoded video data | |
| CN1893364B (en) | Milestone synchronization in broadcast multimedia streams | |
| CN100550999C (en) | A kind of digital channel fast switch over method and system and device for creating auxiliary channel | |
| JP5788101B2 (en) | Network streaming of media data | |
| JP5964972B2 (en) | Stream multimedia data from multiple sources | |
| KR101558116B1 (en) | Switching between representations during network streaming of coded multimedia data | |
| KR101453239B1 (en) | Streaming encoded video data | |
| CA2933203C (en) | Robust live operation of dash | |
| CN101472154A (en) | Method for switching digital channel and device for processing digital video | |
| CN111372145B (en) | Viewpoint switching method and system for multi-viewpoint video | |
| CN102761773A (en) | Method for improving user experience of IPTV (Internet Protocol Television) service by using I frames | |
| CN1998240B (en) | Method and device for transferring predictive and non-predictive data frames | |
| CN102067551A (en) | Media stream processing | |
| Roumy et al. | Universal lossless coding with random user access: the cost of interactivity | |
| CN101489101B (en) | Method, apparatus and system for IP television channel switching processing | |
| CN103685314A (en) | Method for achieving seamless switching of unicast and multicast of stream media playing | |
| WO2016209727A1 (en) | Reporting media consumption based on service area | |
| CN103918258A (en) | Reducing amount of data in video encoding | |
| CN101515934A (en) | Method, device and communication system for forwarding scalable video coded data message | |
| KR101008753B1 (en) | Multimedia data streaming system | |
| CN102572547B (en) | Synchronous method, synchronous device and terminal for quickly accessing into multicast group | |
| CN110248047B (en) | Synchronous switching method and system of video matrix | |
| CN114513658B (en) | Video loading method, device, equipment and medium | |
| US20230224532A1 (en) | Dynamic resolution change hints for adaptive streaming |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20100331 |