WO2011095118A1 - Procédé, appareil et système de traitement de décalage temporel de réseau - Google Patents

Procédé, appareil et système de traitement de décalage temporel de réseau Download PDF

Info

Publication number
WO2011095118A1
WO2011095118A1 PCT/CN2011/070771 CN2011070771W WO2011095118A1 WO 2011095118 A1 WO2011095118 A1 WO 2011095118A1 CN 2011070771 W CN2011070771 W CN 2011070771W WO 2011095118 A1 WO2011095118 A1 WO 2011095118A1
Authority
WO
WIPO (PCT)
Prior art keywords
time shift
media stream
user terminal
time
unicast
Prior art date
Application number
PCT/CN2011/070771
Other languages
English (en)
Chinese (zh)
Inventor
孙兵
杨佩林
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2011095118A1 publication Critical patent/WO2011095118A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/26616—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for merging a unicast channel into a multicast channel, e.g. in a VOD application, when a client served by unicast channel catches up a multicast channel to save bandwidth
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64—Addressing
    • H04N21/6405—Multicasting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/64—Addressing
    • H04N21/6408—Unicasting

Definitions

  • the present invention relates to the field of communications, and in particular, to a method, device and system for processing network time shift. Background technique
  • Video services such as IPTV (Internet TV) are becoming more and more popular.
  • IPTV Internet TV
  • the advantage of these video services is that they can allow users to pause, fast forward, rewind and other functions when receiving video services, and provide users with an interactive feeling. Brought a new video experience.
  • These features are often referred to as Time-Shifted for video services.
  • the video terminal device has a large-capacity storage space, and the video terminal stores the received video service into a large-capacity storage space, and the user passes through the storage space. Get the video stream to play the normal video service after the time shift function such as pause, fast forward or fast reverse.
  • the network time-shifting processing based on the network device is implemented based on unicast. After the user enters the pause, fast forward or fast rewind, the server needs to establish a unicast transmission channel for each time-shifted user terminal.
  • the unicast transmission mode transmits the corresponding video code stream to the corresponding user terminal, thereby realizing the playback of the normal video service after the time shift function such as pause, fast forward or fast reverse.
  • the inventors have found that at least the following problems exist in the prior art:
  • the terminal is required to support a large-capacity storage space first, and the terminal is added. Cost;
  • the terminal can only time shift the video it has received, that is, if the terminal does not store the video content, it cannot realize time shifting;
  • the network device to implement time shift processing, based on unicast transmission
  • Embodiments of the present invention provide a method, device, and system for processing network time shift, which solve the terminal
  • the time-shift and unicast network time-shifting defects enable multicast services (such as BTV services) to be switched from unicast transmission mode to multicast transmission mode after time shifting, thereby reducing system bandwidth consumption and improving system performance. It can also realize the time shifting process of seamless switching of media streams of time-shifted services (including unicast time-shifted services and multicast time-shifted services).
  • a method for processing network time shifts including:
  • time shift play request message includes time and/or location information of the media stream that needs to be played when the user terminal time shift occurs;
  • the unicast transmission rate of the media stream is sent to the user terminal, and according to the time shift play request message sent by the user terminal, The user terminal sends a time-shift playback response message, where the response message includes operation indication information; and the media stream is transmitted to the user terminal by unicast;
  • the media stream is transmitted to the user terminal by multicast.
  • a method for network time shift processing comprising:
  • the media stream is played at the playback rate.
  • a method for processing network time shifts including:
  • a method for network time shift processing comprising:
  • a time shift play request is sent to the long time shift server, and the network time shift processing is implemented by the long time shift server.
  • a time-shifting server comprising:
  • a receiving unit configured to receive a time shift play request message sent by the user terminal, where the time shift play request message includes time and/or location information of the media stream that needs to be played when the user terminal time shift occurs;
  • a determining unit configured to determine, according to time and/or location information that the media stream needs to be played when the time shift occurs, to determine whether to switch the media stream corresponding to the time shift play request message from unicast transmission to multicast transmission;
  • a first adjusting unit configured to: when the determining unit determines to switch the media stream from a unicast transmission to a multicast transmission, improve a unicast transmission rate of sending the media stream to the user terminal;
  • a sending unit configured to send a time shift request response message to the user terminal according to the time shift play request message sent by the user terminal, where the response message includes operation indication information
  • a transmitting unit configured to transmit the media stream to the user terminal by using unicast
  • a switching unit configured to: when the unicast transmission process is consistent with the multicast transmission process of the media stream, transmit the media stream to the user terminal by using multicast.
  • a network time shift processing system comprising:
  • a user terminal configured to send a time shift play request message to the time shift server, where the time shift play request message includes time and/or location information of the media stream that needs to be played when the time shift occurs of the user terminal;
  • a time shift server configured to receive a time shift play request message sent by the user terminal, where the time shift play request message includes time and/or location information of the media stream that needs to be played when the user terminal time shift occurs; according to the user terminal The time and/or location information of the media stream needs to be played when the shift occurs, determining whether to switch the media stream corresponding to the time shift request play message from unicast transmission to multicast transmission; if it is determined that the media stream is transmitted from unicast Switching to the multicast transmission, the unicast transmission rate of the media stream is sent to the user terminal, and the time shift play request message is sent to the user terminal according to the time shift play request message sent by the user terminal, where
  • the response message includes operation indication information; transmitting the media stream to the user terminal by unicast; when the unicast transmission process and the media stream are multicasted into the When the processes are consistent, the media stream is transmitted to the user terminal by multicast;
  • the user terminal is further configured to: receive a time shift play response message sent by the time shift server, where the response message includes operation indication information; and acquire, according to the operation indication information, a play rate of the media stream played by the user terminal; The media stream is played at the playback rate.
  • the user terminal After the user equipment is used, after the user terminal moves the video service, the user terminal sends a time shift play request to the time shift server, and the time shift server determines whether the time shift request play message is corresponding.
  • the media stream is switched from the unicast transmission to the multicast transmission, and if so, the unicast transmission rate of the media stream is sent to the user terminal, when the unicast transmission process is consistent with the multicast transmission process of the media stream,
  • the media stream is transmitted to the user terminal through multicast, and the transmission mode of the media stream after the time shift of the multicast service can be switched from unicast transmission to multicast transmission, thereby reducing system bandwidth consumption and improving system performance.
  • the time shifting server further sends operation indication information to the user terminal, so that the user terminal acquires a play rate of playing the media stream according to the operation indication information, and plays the media stream according to the play rate. Therefore, the normal play of the media stream after the time shift of the user terminal occurs is realized.
  • FIG. 1 is a flowchart of a method for time-shift processing of a server-side network in Embodiment 1 of the present invention
  • FIG. 2 is a flowchart of a method for time-shift processing of a network on a user terminal side according to Embodiment 1 of the present invention
  • FIG. 3 is a flowchart of operations for time-shifting a network for time-shifted in a second embodiment of the present invention
  • FIG. 3 is a flow chart of the operation of the network time shift processing of the fast forward or fast reverse time shift
  • FIG. 5 is a flow chart showing the operation of the network time shift processing of the pause time shift in the fourth embodiment of the present invention
  • FIG. 6 is the fourth embodiment of the present invention
  • FIG. 7 is a block diagram showing the composition of a server in a fast forward or fast reverse time shift
  • Embodiment 8 is a block diagram showing the composition of another server in Embodiment 5 of the present invention.
  • FIG. 9 is a block diagram showing the composition of a user terminal according to Embodiment 5 of the present invention.
  • 10 is a block diagram showing the composition of another user terminal according to Embodiment 5 of the present invention.
  • FIG 11 is a block diagram showing the system composition of network time shift processing in Embodiment 5 of the present invention. detailed description
  • the embodiment of the invention provides a processing method for network time shifting. As shown in FIG. 1, the method includes:
  • time shift play request message sent by the user terminal, where the time shift play request message includes time and/or location information required to play the media stream when the user terminal time shift occurs.
  • the time and/or location information of the media stream is required to be played when the time shift occurs, and the time and/or location of the media stream requested to be played after the pause is ended in the pause state, or fast forward or fast forward in the fast forward/rewind mode
  • the time and/or location of the media stream requested to be played after the rewinding ends; the time and/or location information required to play the media stream when the time shift occurs may be, but is not limited to, required by the user terminal when the time shift occurs
  • Media time during which media stream is normally played (media time includes relative time or absolute time of media stream playback) and/or media location, or media frame location information, or time of requesting received media stream or location of media stream requesting reception , or the serial number of the media stream that is requested to be received, the serial number may be RTP (Rea l -t ime Transpor t Prot oco l , real-time transport protocol), the serial number 'J number, TCP (Transmi ss ion Cont
  • the media stream starting from the serial number must be capable of being independently demultiplexed and independently decoded, if the media stream starting from the serial number cannot be independently demultiplexed.
  • independent decoding should also be able to be demultiplexed and decoded when combined with previously received media streams in the user terminal's storage space. For example, for a video media stream (I 1B2B3P4B5P10B11B12P13B12B15), if the video terminal does not receive the message from the header of the II frame, then from a certain part of the message of the II frame to the B15 frame message, the video The terminal cannot decode properly.
  • the location information normally broadcasted by the user terminal to the server is the media serial number information, and is any packet from the beginning of a certain part of the II frame to the middle of the B15 frame message.
  • the video terminal must ensure that there is a message from the head of the 11 frames, or there is a reference frame that has been decoded in the video buffer, so that the decoding can be smoothly performed.
  • step 102 Determine, according to the time and/or location information of the media stream that is required to play the time when the user terminal moves, to determine whether to switch the media stream corresponding to the time shift request broadcast message from unicast transmission to multicast transmission; If the media stream is switched from unicast transmission to multicast transmission, step 103 is performed, otherwise the requested media stream is sent to the user terminal by unicast.
  • the server When the server receives the time and/or location information of the media stream when the time shift occurs, it is determined according to the information whether the media stream needs to be switched from the unicast transmission to the multicast transmission after the time shift, that is, It is said that if the time shift range requested by the user terminal is within the time shift range of the server configured to switch from unicast back to multicast, the user is notified to switch back to multicast from unicast, otherwise the media stream is transmitted in unicast mode after time shift. Generally, if the time shift requested by the user terminal is short, it is necessary to switch back to multicast from unicast, which can save bandwidth; if the time shift requested by the user terminal is long, in this case, catch up by unicast. The multicast mode takes a long time, so there is no need to switch back to multicast from unicast mode.
  • the unicast transmission rate of the media stream is sent to the user terminal, so that the unicast transmission rate of the sending media stream is greater than the multicast transmission rate before the time shift occurs, and is played according to the time shift sent by the user terminal.
  • the request message sends a time shift play response message to the user terminal, where the response message includes operation indication information.
  • the operation indication information includes: the user terminal plays the play information of the media stream and/or the server transmits the transmission information of the media stream by using unicast, where
  • the playback information includes a playback rate of the media stream played by the terminal, where the transmission information includes a transmission rate of the media stream by unicast transmission.
  • the transmission rate of the unicast transmission of the media stream depends on the performance of the time shifting server, the network state and the time shift buffer size of the user terminal, the remaining buffer size, and the information that needs to be accelerated. For example, if the remaining buffer is relatively large, the accelerated transmission of the media stream can be used immediately, and the transmission speed can be large.
  • the rate of the transmitted media stream is increased to avoid receiving the media stream.
  • Time-lapse buffer is lost; wait until the user terminal accelerates playback and consumes a certain media stream, so that the user terminal has a large time-shift buffer After that, the rate at which the media stream is sent is further increased.
  • the media stream is transmitted to the user terminal by using unicast.
  • the media stream is transmitted to the user terminal by multicast.
  • the embodiment of the invention further provides a processing method for network time shifting. As shown in FIG. 2, the method includes:
  • the user terminal receives a time shift play response message sent by the time shift server, where the response message includes operation indication information.
  • the operation indication information includes: the terminal playing the playback information of the media stream and/or the transmission information of the media stream by the server by using the unicast, wherein the playback information includes a playback rate of the media stream played by the terminal, where The transmission information includes a transmission rate of the unicast transmission of the media stream.
  • the user terminal acquires a play rate of playing the media stream according to the operation indication information.
  • the user terminal when the user terminal moves after watching the video service occurs, the user terminal sends a time shift play request to the time shift server, and the schematic server determines whether the time shift request message pair should be played.
  • the media stream is switched from the unicast transmission to the multicast transmission, and if so, the unicast transmission rate of the media stream is sent to the user terminal, when the unicast transmission process is consistent with the multicast transmission process of the media stream, Transmitting the media stream to the user terminal by multicast, and realizing that the multicast service can be switched from the unicast transmission mode to the multicast transmission mode after time shifting, thereby reducing system bandwidth consumption and improving system performance;
  • the time shifting server further sends the operation indication information to the user terminal, and the user terminal acquires the playing rate of the media stream according to the operation indication information, and plays the media stream according to the playing rate, thereby realizing the user. Normal playback of the media stream after the terminal time shift occurs.
  • the embodiment of the invention provides a processing method for network time shifting.
  • the time shift caused by the pause is taken as an example, and the processing method of the network time shift is specifically illustrated, as shown in FIG. 3 .
  • the method includes:
  • the user terminal sends a pause request message to the server, where the pause request message includes a pause.
  • Time and/or location information may be, but not limited to, PATS-R (Pause Time Shifted Reques t).
  • the user terminal may choose not to send the pause request message, directly skip step 301 and step 302, and proceed to step 303 to send the paused time-shifted play request message.
  • the embodiment of the present invention does not limit this.
  • the time or location information at the time of the pause may be, but not limited to, the media play time or the media play position when the user terminal is paused when the time shift occurs, or the time when the user terminal receives the media stream or the received media stream. Or the user terminal receives the serial number of the media stream.
  • the time shift server sends a pause response message to the user terminal in response to the pause request message sent by the user terminal, where the response message includes indication information indicating whether the time shift response is successful.
  • the reason why the time shift response fails is that the time shift server is busy, cannot respond to the pause request, or there is no time shift media stream in the time shift server, and the like.
  • the user terminal sends a time shift play request message to the time shift server, where the time shift play request message includes the user terminal.
  • the size of the storage space of the media stream is temporarily stored in the time shifting process, and the remaining buffer size may be expressed as the size of the storage space in which the user terminal may temporarily store the media stream during the current time shifting process.
  • the time shift play request message may be, but not limited to, a PLMS-R (P l ay Time Shifted Reques t).
  • the time and/or location information of the media to be played normally when the time shift occurs may be the time and/or location information in Embodiment 1.
  • the sequence number of the media stream requested to be received the sequence number is the serial number of the last media stream in the buffer, because the signaling is delayed. For this reason, the buffer will continue to receive some media messages, whether it is unicast pause or leave the multicast group.
  • the position information of the normal play is a serial number
  • the media stream starting from the serial number must be capable of being independently demultiplexed and independently decoded
  • the media stream starting from the serial number cannot Independent demultiplexing and independent decoding should also be satisfied when storing empty with the user terminal
  • the previously received media streams in the middle are combined and demultiplexed and decoded.
  • the serial number can ensure that the user terminal can seamlessly connect between the media stream saved during the pause and the media stream that the server will send, and the server does not send more or less time-shifting media streams.
  • the time shifting server sends a time shift play response message to the user terminal according to the time shift play request message sent by the user terminal, where the response message includes operation indication information.
  • the response message further includes indication information about whether the time shift play request of the user terminal is successful, and the reason why the time delay play request of the user terminal fails is not limited to the following reasons: The time shift range of the time shift server, or the time shift server is busy unable to respond to the time shift play request of the user terminal, or there is no time shift media stream in the time shift server, and the like.
  • the operation indication information includes the playback information of the media stream played by the terminal and/or the transmission information of the media stream by the server by unicast, wherein the playback information includes a playback rate of the media stream played by the terminal, and the playback rate.
  • the playback information includes a playback rate of the media stream played by the terminal, and the playback rate.
  • normal playback information such as the time shift of V0D service, will not switch from unicast to multicast; long pause, will not switch from unicast to multicast
  • speed up playback of information such as
  • the BTV service also needs to switch back to multicast from unicast.
  • the transmission information includes a current transmission rate, an accelerated transmission rate, or an accelerated transmission time, etc., the acceleration
  • the sending rate is determined by the server according to the location information when the user terminal time shift occurs, the position information of the normal playing, the size of the time shift buffer, and the size of the remaining buffer, and the acceleration is sent to catch up with the multicast, so as to be
  • the broadcast process is switched to the multicast process; the transmission information further includes information about frame dropping, time of joining the multicast group, and/or duration of unicast.
  • the method for speeding up playback of the media stream includes a method for speeding up the playback of the media stream, where the method for speeding up the playback of the media stream includes: a method of fast forward video or a method of hiding a video frame; wherein the user terminal accelerates playing media by fast forward video.
  • the flow is as follows:
  • the user terminal accelerates the playing of the media stream by hiding the video frame, as follows:
  • the method of hiding the video frame refers to skipping the next video frame to be played immediately after playing some video frames, and directly playing the next video frame.
  • Video frame the frame rate per second is unchanged. For example, if the video frame rate per second is
  • the server may choose not to send video frames that need to be hidden, so that less network transmission can be performed. Traffic, reducing the bandwidth required to send media streams.
  • the transmission rate of the media stream depends on the time shift buffer size, the remaining buffer size, and the rate of accelerated playback. If the remaining buffer is relatively large, the accelerated transmission is immediately used. If the remaining buffer is small, The rate of sending the media stream is increased to prevent the received media stream from being lost due to exceeding the time shift buffer; and after the user terminal accelerates playback and consumes a certain media stream, the user terminal is compared with the time shift buffer. After the big time, the rate of sending the media stream is further increased.
  • step 306 is performed.
  • the user terminal receives a time shift play response message sent by the time shift server, where the response message includes operation indication information, and acquires a play rate of playing the media stream according to the operation instruction information, and according to the The playback rate of the media stream is used to play the media stream.
  • step 307 is performed.
  • the acquiring the playback rate of the media stream by the user terminal according to the operation indication information includes: according to the user terminal buffer The size and the size of the remaining buffer and the transmission rate of the media stream by the unicast transmission determine the playback rate of the media stream to be played.
  • the time shift server switches the media stream corresponding to the time shift play request message from unicast transmission to multicast transmission, and transmits the media stream to the multicast transmission.
  • the server can notify the user to join the multicast group.
  • the multicast stream is obtained by the user terminal.
  • the user terminal can obtain the time of joining the multicast group and join the multicast group to obtain the multicast stream.
  • the foregoing message may be implemented by using an existing or extended RTCP message or an RTSP message or an RTP message, or may be implemented by other messages, which is not limited by the embodiment of the present invention.
  • the user terminal when the user terminal moves after watching the video service pause, the user terminal sends a time shift play request to the time shift server, and the time shift server determines whether the time shift request play message is corresponding.
  • the media stream is switched from the unicast transmission to the multicast transmission, and if so, the unicast transmission rate of the media stream is sent to the user terminal, so that the unicast transmission process can be associated with the media stream group after being transmitted for a certain time by unicast.
  • the broadcast transmission process is consistent.
  • the media stream corresponding to the time shift request message is switched to multicast transmission to the user terminal, thereby reducing the system.
  • the consumption of the bandwidth is increased, and the system is configured to send the operation indication information to the user terminal, so that the user terminal acquires the playback rate of the media stream according to the operation indication information, and according to the Playing the media stream at a playback rate, thereby realizing normal playback of the media stream after the time shift of the user terminal occurs .
  • An embodiment of the present invention provides a method for processing a network time shift.
  • a time shift from multicast to unicast is caused by a fast forward or fast reverse operation.
  • the processing method of the network time shift is illustrated. As shown in FIG. 4, the method includes:
  • the user terminal sends a fast forward (fas t forward) or a fast rewind (rewind) play request to the time shift server.
  • the time shifting server receives the fast forward or fast reverse play request sent by the user terminal, and transmits the media stream corresponding to the fast forward or fast reverse play request to the user terminal by using unicast.
  • the user terminal After the media stream fast forwards or rewinds to a location that is required by the user, the user terminal sends a time shift play request message to the time shift server, where the time shift play request message includes the user terminal fast.
  • the time and/or location information of the media stream to be played normally when entering or rewinding, and the time shift buffer size and/or the remaining buffer size.
  • the time or location information of the normal playing media stream is required when the fast forward/reverse time shift occurs, and the time or location information in Embodiment 1 may be used. . Further, the time or location information that needs to be played normally should be the starting position of a video GoP (Group of Picture). For example, for a video media stream GOP (I 1 B2B 3P4B5B6P7B8B9P 1 0B1 1B12P 1 3 B14B15), it should be the starting position of the II frame. If the video terminal does not receive the message from the header of the II frame, the video terminal cannot decode normally from the beginning of the message of a certain part of the II frame to the B1 5 frame message.
  • a video GoP Group of Picture
  • the media stream starting from the serial number must be capable of independent demultiplexing and independent decoding, if the media stream starting from the serial number cannot be independently demultiplexed and independent.
  • the decoding should also be able to be demultiplexed and decoded when combined with previously received media streams in the user terminal's storage space. That is, if the normal broadcast location information reported by the user terminal to the server is the media serial number information, and is any packet from the beginning of a certain part of the II frame to the middle of the B15 frame message. For the serial number, the video terminal must ensure that there is a message from the head of the II frame, or there is a reference frame that has been decoded in the video buffer, so that the decoding can be smoothly performed.
  • the time shift server sends a time shift play response message according to the time shift play request message sent by the user terminal, where the response message includes operation indication information.
  • time-shifting play request of the user terminal fails is not limited to the following reasons: the time shift of the user terminal exceeds the time shift range of the time shift server, or the time shift server is busy unable to respond to the user terminal. Time-shift playback request, or no time-shifted media stream in the time-shifting server, and the like.
  • step 405. When the time shift server successfully responds to the time shift play request, the media stream corresponding to the time shift play request message is transmitted to the user terminal by unicast; and step 406 is performed.
  • the terminal user acquires a play rate of the play media stream according to the received operation indication information, and plays the media stream according to the acquired play rate.
  • the unicast transmission process and the media stream are When the multicast transmission process is consistent, go to step 407.
  • the operation indication information includes the playback information of the media stream played by the terminal and/or the transmission information of the media stream by the server by unicast.
  • the play information includes a play rate of the media stream played by the terminal, and the play rate includes normal play information or accelerated play information, and the accelerated play further includes the number of frames to be accelerated or the time required for acceleration; the accelerated play information includes fast forward by video.
  • the mode plays or hides the video frame. For details, refer to the content of the corresponding part of Embodiment 2.
  • the time shift server After the user terminal joins the multicast group, the time shift server sends the time shift play request.
  • the media stream corresponding to the message is switched from unicast transmission to multicast transmission, and the media stream is transmitted to the user terminal through multicast.
  • the server may notify the user to join the multicast group to obtain the multicast stream.
  • the user terminal may obtain the time of joining the multicast group and join the multicast group to obtain the multicast stream.
  • the embodiment of the invention does not limit this.
  • the foregoing message may be implemented by using an existing or extended RTCP message or an RTSP message or an RTP message, or may be implemented by other messages, which is not limited by the embodiment of the present invention.
  • the user terminal when the user terminal moves after watching the video service fast forwards or rewinds, the user terminal sends a time shift play request to the time shift server, and the time shift server determines whether the time shift request is to be performed.
  • the media stream corresponding to the play message is switched from the unicast transmission to the multicast transmission, and if so, the unicast transmission rate of the media stream is sent to the user terminal, so that the unicast transmission process can be performed after the unicast transmission for a certain time.
  • the multicast transmission process of the media stream is consistent.
  • the media stream corresponding to the time shift request message is switched to multicast transmission to the user terminal.
  • the operating time is further reduced, and the time shifting server sends the operation indication information to the user terminal, so that the user terminal obtains the playing rate of the media stream according to the operation indication information. And playing the media stream according to the play rate, thereby realizing the media stream after the user terminal shifts time Often playing.
  • the embodiment of the invention provides a processing method for network time shifting, wherein the short time shifting server realizes a short time shift range, and processes a short time shifting process to switch from a unicast transmission mode to a multicast transmission mode.
  • the long-term shifting server implements a long time-shifting range and handles long-distance time-shifting times, usually using unicast mode, but does not rule out switching from unicast transmission mode to multicast transmission mode.
  • the embodiment of the present invention sends a time shift play request message to the long time shift server if the time interval between the time shift play time and the current multicast stream time exceeds the short time shift range, and if not exceeded, the short time time shift server Sending a time-shifted play request message is an example, and the processing method of the network time shift is specifically explained.
  • the short time shifting server can implement the switching of the media stream from the unicast transmission to the multicast transmission. Therefore, when the pause time shift occurs, the pause time shift is generally sent to the short time shift server. Requesting to obtain a time shift range in which the short time shift server can provide services. But the invention is implemented
  • the user terminal may also send a pause time shift request to the long time shift server when the pause time shift occurs, which is not specifically limited in this embodiment of the present invention.
  • the short time shift server sends the pause time shift request as an example, and the network time shift processing method is specifically described in conjunction with FIG. 5, where the method includes:
  • the user terminal sends a pause time shift request to the short time shift server, where the pause time shift request carries time and/or location information when the user terminal pauses time shift transmission.
  • the short time shifting server sends a pause time shift response message to the user terminal according to the timeout request, where the response message includes an indication message for notifying whether the time delay request of the user terminal is successful.
  • the time shifting time range of the short time shifting server is notifying whether the time delay request of the user terminal is successful.
  • the reason for suspending the time shift response failure is usually: the time shift server is busy, unable to respond to the pause time shift request, or there is no time shift media stream in the time shift server, and the like.
  • the user terminal receives a pause time shift response message sent by the short time shift server, and when the indication information indicates that the pause time shift request is successful, the user terminal further determines whether the pause time is short. Within the shift range, if the pause time is within the short time shift range, step 503a is performed; if the pause time exceeds the short time shift range, step 503b is performed.
  • step 503a Send, by the user terminal, a time shift play request to the short time shift server, and execute step 504a.
  • step 503b Send, by the user terminal, a time shift play request to the long time shift server, and execute step 504b.
  • the short time shift server responds to the time shift play request, improves a unicast transmission rate of sending a media stream to the user terminal, and plays a request message according to the time shift sent by the user terminal to the user.
  • the terminal sends a time-shift playback response message, where the response message includes operation indication information, and step 505 is performed.
  • the improving the unicast transmission rate for sending the media stream to the user terminal may be determined according to information provided by the user terminal, performance of the server, and network status.
  • the information provided by the user terminal includes time and/or location information, time shift buffer size, remaining buffer size, and the like, which are normally played when the user terminal moves time.
  • the long-term server responds to the time-shifted play request, and passes the unicast at a normal rate.
  • the media stream corresponding to the time shift play request message transmits the user terminal, and instructs the user terminal to play the media stream at a normal rate until the end.
  • the short time shifting server unicasts the media stream corresponding to the time shift play request message to the user terminal, and performs step 506.
  • the user terminal acquires a play rate of playing the media stream according to the received operation indication information, and plays the media stream according to the play rate. For details, refer to step 306 in Figure 3, and details are not described herein.
  • step 507 is performed.
  • the user terminal joins a multicast group, and switches the media stream corresponding to the time-shifted playback request message from a unicast transmission to a multicast transmission, and transmits the media stream to the user terminal by multicast.
  • the embodiment of the present invention specifically sends a fast forward or fast reverse time shift request to the long time shift server when the user terminal sends the fast forward or fast reverse time shift, and the method for network time shift processing is specifically described in conjunction with FIG. 6 .
  • the user terminal sends a fast forward or fast reverse time shift request to the long time shift server.
  • the long time shift server transmits, by using a unicast, the media stream corresponding to the fast forward or fast reverse request to the user terminal.
  • the user terminal determines whether the fast forward/reverse time shift time is within a short time shift range, if the fast forward or fast backward If the time shift time is within the short time shift range, step 603a is performed; if the fast forward or fast reverse time shift time exceeds the short time shift range, the step is performed.
  • the user terminal sends a request to terminate the fast forward or fast rewind media stream to the long time shift server, and sends a time shift play request message to the short time shift server, and step 604a is performed.
  • the user terminal sends a time shift play request message to the long time shift server, and performs step 604b.
  • the short time shift range is a time shift range in which the short time shift server provides a service, and the long time shift is performed when the user terminal sends a fast forward or fast reverse time shift request to the long time shift server.
  • the short time shifting server increases a unicast transmission rate of the media stream to the user terminal, and sends a time shift playback response message to the user terminal according to the time shift play request message sent by the user terminal.
  • the operation response message is included in the response message, and step 605 is performed.
  • the improving the unicast transmission rate for sending the media stream to the user terminal may be determined according to information provided by the user terminal, performance of the server, and network status.
  • the information provided by the user terminal includes time and/or location information, time shift buffer size, remaining buffer size, and the like, which are normally played when the user terminal moves time.
  • the long-term server responds to the time-shifted play request, and transmits the media stream corresponding to the time-shifted play request message to the user terminal by using a unicast at a normal rate, and indicates that the user terminal is normal.
  • the media stream is played at the rate until the end.
  • the short time shifting server unicasts the media stream corresponding to the time shift play request message to the user terminal, and performs step 606.
  • step 607 is performed.
  • the user terminal joins a multicast group, and switches the media stream corresponding to the time shift play request message from unicast transmission to multicast transmission, and transmits the media stream to the user terminal by multicast.
  • the user terminal determines whether to send the time shift play request message to the long time shift server according to the time shift time, or is short
  • the time shift server sends a time shift play request message, and when it is determined that the time shift play request message is sent to the short time shift server, the short time shift server implements the time shift by providing a rate of sending the media stream to the user terminal.
  • the media stream corresponding to the play request message is switched from the unicast transmission mode to the multicast transmission mode, thereby reducing system bandwidth consumption and improving system performance; and the short time shifting server further sends operation indication information to the user terminal, so that The user terminal acquires a play rate of the time-shifted media stream according to the operation indication information, and plays the media stream according to the play rate, thereby realizing normal play of the media stream after the time shift of the user terminal occurs.
  • the embodiment of the present invention provides a time shift server.
  • the time shift server includes: a receiving unit 71, a determining unit 72, a first adjusting unit 73, a sending unit 74, a transmitting unit 75, and a switching unit 76.
  • the receiving unit 71 is configured to receive a time shift play request message sent by the user terminal, where the time shift play request message includes time and/or location information that the user terminal normally plays.
  • the determining unit 72 is configured to determine whether to switch the media stream corresponding to the time shift request play message from unicast transmission to multicast transmission according to time and/or location information of normal play when the user terminal time shift occurs;
  • the first adjusting unit 73 is configured to: when the determining unit 72 determines to switch the media stream from the unicast transmission to the multicast transmission, improve a unicast transmission rate of the media stream sent to the user terminal, so that After the transmission of the media stream, the unicast transmission process is consistent with the multicast transmission process of the media stream, thereby implementing switching of the media stream from unicast transmission to multicast transmission.
  • the sending unit 74 is configured to send a time shift play response message to the user terminal according to the time shift play request message sent by the user terminal, where the response message includes operation indication information, where the operation indication information is
  • the broadcast information including the playback media stream of the terminal and/or the transmission information of the media stream by the server by unicast, wherein the broadcast information includes a playback rate of the media stream played by the terminal, where the transmission information includes a unicast transmission.
  • the transmission rate of the media stream is
  • the playing information may further include a number of frames that need to be accelerated to be played, a time when the media stream needs to be accelerated, an indication information indicating that the user terminal accelerates playing the media stream, and a manner of speeding up playing the media stream.
  • the manner in which the accelerated playback of the media stream is performed includes a method of fast forward video or a method of hiding a video frame.
  • the transmitting information may further include a time for accelerating the transmission of the media stream.
  • the transmitting unit 75 is configured to transmit the media stream to the user terminal by using a unicast
  • the switching unit 76 is configured to: when the unicast transmission process is consistent with the multicast transmission process of the media stream, The media switches from unicast transmission to handover of multicast transmission, and transmits the media stream to the user terminal by multicast.
  • the time shift play request message further includes the user terminal requesting to receive the media stream. a sequence number for determining a starting location of the media stream before transmitting the media stream to the user terminal by unicast.
  • the time shifting server further includes: a second adjusting unit 77, configured to: when the time shift play request message further includes the size of the user terminal buffer and the size of the remaining buffer, Adjusting a unicast transmission rate of the media stream to the user terminal according to the size of the time shift buffer of the user terminal and the size of the remaining buffer. For example, if the remaining buffer is relatively large, the accelerated transmission media stream can be used immediately, and the transmission speed can be large; if the remaining buffer is relatively small, the rate of the transmission media stream is increased to avoid receiving. The media stream is lost due to the time-shifting buffer; after the user terminal accelerates playback and consumes a certain media stream, the time-shift buffer of the user terminal is relatively large, and then the rate of sending the media stream is greatly increased. .
  • a second adjusting unit 77 configured to: when the time shift play request message further includes the size of the user terminal buffer and the size of the remaining buffer, Adjusting a unicast transmission rate of the media stream to the user terminal according to the size of the time
  • the embodiment of the present invention further provides a user terminal, which may be a video terminal device.
  • the terminal includes: a receiving unit 81, an obtaining unit 82, and a playing unit 83.
  • the receiving unit 81 is configured to receive a time shift play response message sent by the server, where the response message includes operation indication information, where the indication information includes the play information of the terminal playing the media stream, and/or the server transmits by using the unicast The transmission information of the media stream, where the playback information includes a playback rate of the media stream played by the terminal, where the transmission information includes a transmission rate of the media stream by unicast transmission.
  • the obtaining unit 82 is configured to obtain a play rate of the play media stream according to the operation indication information, where the acquiring unit 82 obtains the play rate of the play media stream according to the indication information, and includes: if the receiving unit 81 receives The indication information includes the playing speed of the media stream played by the user terminal, and the obtaining unit 82 parses the indication information, so that the playing rate of the media stream played by the user terminal can be obtained from the indication information. If the indication information received by the receiving unit 81 includes only the transmission information, the acquiring unit 82 needs to parse the indication information first, and obtain, from the indication information, a transmission rate of the unicast transmission of the media stream.
  • the rule for determining the rate at which the user terminal plays the media stream is: ensuring that there is no media stream in the storage space of the user terminal, and the total amount of the media stream cannot exceed the size of the storage space. If the size of the remaining storage space of the user terminal is relatively small, the rate at which the user terminal plays the media stream may be accelerated, so that the user The terminal has enough remaining storage space.
  • the playing unit 8 3 is configured to play the media stream according to the playing rate acquired by the acquiring unit 82.
  • the user terminal further includes: a sending unit 84; the sending unit 84 is configured to send a time shift play request message to the time shift server.
  • the time shift request playback message includes time and/or location information of normal play when the user terminal time shift occurs.
  • the time shift play request message may be, but not limited to, PATS-R (Paus e T ime Sh i ted Reque s t , time shift pause request).
  • the time shift play request message may further include a size of the buffer of the user terminal and a size of a remaining buffer.
  • the time shift buffer size may be represented as the user terminal at the current time.
  • the remaining buffer size may be expressed as the size of the storage space of the media stream that the user terminal may temporarily store during the current time shift.
  • the sending unit 84 can also be configured to send to the server again. Transmitting the request, updating the size of the remaining storage space of the user terminal, so that the server further adjusts the rate of the unicast transmission media stream, thereby speeding down the unicast to the multicast process, thereby further reducing the unicast transmission.
  • the embodiment of the invention provides a system for network time shift processing. As shown in FIG. 11, the system includes: a user terminal 91 and a time shift server 92.
  • the user terminal 91 is configured to send a time shift play request message to the time shift server 92, where the time shift play request message includes time and/or location information of the media stream that needs to be played when the user terminal time shift occurs.
  • the time shift server 92 is configured to receive a time shift play request message sent by the user terminal 91, where the time shift play request message includes time and/or location information of the media stream that needs to be played when the time shift occurs of the user terminal; Determining whether to switch the media stream corresponding to the time shift request play message from the unicast transmission to the multicast transmission when the time shift occurs normally and/or the location information occurs; if it is determined that the media stream is transmitted from the unicast Switching to the multicast transmission, the unicast transmission rate of the media stream is sent to the user terminal, and the time-shift playback response message is sent to the user terminal 91 according to the time-shifted playback request message sent by the user terminal.
  • the operation message includes operation indication information; and the media is The stream is transmitted to the user terminal 91 by unicast; when the unicast transmission process is consistent with the multicast transmission process of the media stream, the media stream is transmitted to the user terminal 91 by multicast.
  • the user terminal 91 is further configured to receive a time shift play response message sent by the time shift server 92, where the response message includes operation indication information, and acquire a play rate of playing the media stream according to the operation indication information; The media stream is played at the playback rate.
  • the user terminal when the user terminal moves after watching the video service pauses, the user terminal sends a time shift playback request to the time shift server, and the time shift server determines whether to correspond to the time shift request play message.
  • the media stream is switched from unicast transmission to multicast transmission, and if so, the unicast transmission rate of the media stream is sent to the user terminal, so that the unicast transmission process can be associated with the media stream after being transmitted for a certain time by unicast.
  • the multicast transmission process is consistent.
  • the media stream corresponding to the time shift request message is switched to multicast transmission to the user terminal, thereby reducing The system bandwidth is consumed to improve system performance; and the time shifting server further sends operation indication information to the user terminal, so that the user terminal acquires a play rate of playing the media stream according to the operation indication information, and according to the Playing the media stream at the playback rate, thereby realizing the normal playback of the media stream after the time shift of the user terminal occurs
  • the time-shifting server in the embodiment of the present invention may be a single-ended server, or may be merged with other network function devices, which may be network aggregation devices, network access devices, metropolitan area network devices, or fast.
  • the present invention can be implemented by means of software plus necessary general hardware, and of course, by hardware, but in the case of more than 4, the former is better.
  • Implementation Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a readable storage medium, such as a floppy disk of a computer.
  • a hard disk or optical disk or the like includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Des modes de réalisation de la présente invention portent sur un procédé, un appareil et un système de traitement d'un décalage temporel de réseau, qui concernent le domaine des communications, et permettent une commutation d'un mode de transmission en envoi individuel à un mode de transmission en multidiffusion après un décalage temporel, de façon à réduire le coût en largeur de système et à améliorer les performances du système. Le procédé de l'invention comprend les étapes suivantes : selon les informations de temps et/ou d'emplacement nécessaires pour reproduire des flux multimédias lorsqu'un décalage temporel se produit dans un terminal utilisateur, un serveur de décalage temporel détermine de commuter ou non un flux multimédia correspondant à un message de requête de reproduction en décalage temporel d'une transmission en envoi individuel à une transmission en multidiffusion, si oui, il augmente le débit de transmission en envoi individuel pour envoyer le flux multimédia audit terminal utilisateur, et envoie un message de réponse à la requête de décalage temporel audit terminal utilisateur ; ledit terminal utilisateur obtient le débit de reproduction du flux multimédia conformément au message de réponse, et reproduit le flux multimédia conformément audit débit ; lorsque la progression de transmission en envoi individuel est conforme à la progression de transmission en multidiffusion dudit flux multimédia, ledit flux multimédia est commuté vers un mode de multidiffusion et transmis audit terminal utilisateur.
PCT/CN2011/070771 2010-02-05 2011-01-28 Procédé, appareil et système de traitement de décalage temporel de réseau WO2011095118A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010106599.9 2010-02-05
CN 201010106599 CN102149021B (zh) 2010-02-05 2010-02-05 网络时移的处理方法、装置及系统

Publications (1)

Publication Number Publication Date
WO2011095118A1 true WO2011095118A1 (fr) 2011-08-11

Family

ID=44354971

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/070771 WO2011095118A1 (fr) 2010-02-05 2011-01-28 Procédé, appareil et système de traitement de décalage temporel de réseau

Country Status (2)

Country Link
CN (1) CN102149021B (fr)
WO (1) WO2011095118A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103139641A (zh) * 2011-12-02 2013-06-05 三星电子（中国）研发中心 在实时数字电视时移播放中实现音视频无缝切换的方法及装置
CN107147923B (zh) * 2017-05-05 2019-06-21 中广热点云科技有限公司 一种时移点播方法
CN113411755B (zh) * 2017-12-28 2022-10-04 华为技术有限公司 一种通信方法、及相关产品

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101094378A (zh) * 2006-06-21 2007-12-26 华为技术有限公司 一种交互式网络电视的时移方法和系统
CN101287014A (zh) * 2008-06-10 2008-10-15 北京邮电大学 一种实现流媒体业务的方法、系统及装置
CN101431657A (zh) * 2007-11-07 2009-05-13 华为技术有限公司 一种网络电视时移处理方法、系统和装置
CN101588494A (zh) * 2009-06-30 2009-11-25 华为技术有限公司 一种媒体流处理方法及通讯系统以及相关设备

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100759807B1 (ko) * 2005-12-09 2007-09-20 한국전자통신연구원 Ｉｐｔｖ 방송에서 시청시간 이동 서비스 방법
CN100531381C (zh) * 2006-01-27 2009-08-19 中国科学院声学研究所 基于rtp协议的iptv机顶盒组/单播无缝切换方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101094378A (zh) * 2006-06-21 2007-12-26 华为技术有限公司 一种交互式网络电视的时移方法和系统
CN101431657A (zh) * 2007-11-07 2009-05-13 华为技术有限公司 一种网络电视时移处理方法、系统和装置
CN101287014A (zh) * 2008-06-10 2008-10-15 北京邮电大学 一种实现流媒体业务的方法、系统及装置
CN101588494A (zh) * 2009-06-30 2009-11-25 华为技术有限公司 一种媒体流处理方法及通讯系统以及相关设备

Also Published As

Publication number Publication date
CN102149021A (zh) 2011-08-10
CN102149021B (zh) 2013-09-25

Similar Documents

Publication Publication Date Title
CN101753973B (zh) 一种频道切换方法、装置和系统
JP5366107B2 (ja) メディア遅延を低減するための方法、装置およびシステム
US20090265743A1 (en) Video on demand control method, client device and switching control apparatus
JP5363473B2 (ja) 改善されたメディア・セッション管理の方法と装置
JP5215604B2 (ja) クライアント装置、通信システム及びデータ処理方法
EP2472857B1 (fr) Procédé de traitement de flux multimédia et système de communication et dispositifs associés
WO2011153868A1 (fr) Procédé, appareil et système pour la commutation de voies
KR101475991B1 (ko) 모바일 디바이스상에서 비디오를 플레이하기 위한 방법 및 시스템
WO2010139284A1 (fr) Procédé, système et dispositifs associés destinés à traiter une commutation de canal
CN107277554B (zh) 一种时移节目单播转换组播的方法
US8959240B2 (en) Method, apparatus and system for rapid acquisition of multicast realtime transport protcol sessions
CN107566918A (zh) 一种视频分发场景下的低延时取流秒开方法
JP2008029006A (ja) クライアント装置、通信システム及びデータ処理方法
CN103685314B (zh) 实现流媒体播放单播和多播无缝切换的方法
JP5428734B2 (ja) ネットワーク機器、情報処理装置、ストリーム切替方法、情報処理方法、プログラムおよびコンテンツ配信システム
WO2011095118A1 (fr) Procédé, appareil et système de traitement de décalage temporel de réseau
WO2010022598A1 (fr) Procédé et système pour commuter des canaux iptv, procédé et dispositif pour envoyer des flux audio et vidéo
US8208561B2 (en) Technique for media frame decoding
JP4888955B2 (ja) コンテンツ配信方法および装置
WO2012079428A1 (fr) Procédé de synchronisation et appareil de synchronisation pour un accès rapide à un groupe de multidiffusion, et terminal
CN106937155B (zh) 接入设备、因特网协议电视iptv系统和频道切换方法
WO2011022983A1 (fr) Procédé, dispositif et système de données vidéo de multidiffusion
Diepolder et al. Improved Channel Switching for Hybrid Unicast/Broadcast Mobile Television.
WO2011106930A1 (fr) Procédé, équipement et système pour mettre en œuvre une opération de magnétoscope (vcr) pour flux média enrichi
KR20050068095A (ko) 영상 프레임 저장 및 재생을 위한 통화로 재설정 장치 및그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11739397

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11739397

Country of ref document: EP

Kind code of ref document: A1