WO2018041092A1 - 一种基于异构网络的多媒体资源同步推送方法 - Google Patents

一种基于异构网络的多媒体资源同步推送方法 Download PDF

Info

Publication number
WO2018041092A1
WO2018041092A1 PCT/CN2017/099434 CN2017099434W WO2018041092A1 WO 2018041092 A1 WO2018041092 A1 WO 2018041092A1 CN 2017099434 W CN2017099434 W CN 2017099434W WO 2018041092 A1 WO2018041092 A1 WO 2018041092A1
Authority
WO
WIPO (PCT)
Prior art keywords
broadband
time
multimedia
resource
multimedia resource
Prior art date
Application number
PCT/CN2017/099434
Other languages
English (en)
French (fr)
Inventor
徐异凌
张文军
冯姗
陈浩
王延峰
孙军
管云峰
Original Assignee
上海交通大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201610757375.1A external-priority patent/CN107801103B/zh
Priority claimed from CN201610916013.2A external-priority patent/CN107968950A/zh
Application filed by 上海交通大学 filed Critical 上海交通大学
Priority to JP2018567950A priority Critical patent/JP6732970B2/ja
Priority to US16/319,531 priority patent/US11265587B2/en
Priority to KR1020187037923A priority patent/KR102271686B1/ko
Priority to CA3026535A priority patent/CA3026535C/en
Publication of WO2018041092A1 publication Critical patent/WO2018041092A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L27/00—Modulated-carrier systems
    • H04L27/26—Systems using multi-frequency codes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64746—Control signals issued by the network directed to the server or the client
    • H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
    • H04N21/64769—Control signals issued by the network directed to the server or the client directed to the server for rate control

Definitions

  • the invention relates to a heterogeneous media network transmission method in the field of information technology, in particular to a multimedia resource synchronization push method based on a heterogeneous network.
  • media sources are not just specific content providers, more and more producers are involved, including many individual users who are also content providers and producers. These content from different providers have various associations. In order to meet the individual needs of different users, these related content often need to be presented synchronously. In this environment, heterogeneous network convergence is an inevitable trend in the development of next-generation networks, which fully demonstrates that future communications are no longer a specific access technology, but multiple access technologies coexist and work together.
  • the media content presented by the terminal can be transmitted from multiple transmission channels at the same time, such as a broadcast channel and a broadband channel.
  • the media resources of the broadcast channel have extension Short and short (substantially neglected), high bandwidth and stable characteristics, and for different broadband channels (WIFI, 3G/4G, etc.), bandwidth and network delay are very different.
  • the server pushes media content to users through broadcast, if the user requests the same media.
  • the broadband resources of the content due to the delay and bandwidth of the broadband network, will cause the content received by the client from the broadcast and broadband to be out of synchronization on the timeline;
  • the server pushes the same media content to the user through broadcast and broadband, if the user Request to replace the broadband resource media stream (such as different viewing angles, different audio, etc.).
  • different bandwidth and bandwidth of the broadband network will cause the new bandwidth content and broadcast content of the terminal to be out of sync.
  • the server will broadcast and broadband.
  • the user pushes the same media content. If the broadband network status deteriorates at a certain moment, the broadband channel playback is not smooth. When the video is played again smoothly, the broadcast and broadband resources of different users are not synchronized.
  • the technical problem to be solved by the present invention is to provide a synchronous push method for multimedia resources based on heterogeneous networks, which realizes a mechanism for synchronizing broadcast media and broadband media content of a server under heterogeneous network transmission, and solves the network condition in heterogeneous network transmission. Different issues that cause broadcast and broadband user media resources to be out of sync.
  • a method for synchronously pushing multimedia resources based on a heterogeneous network adopting any one of the following two types, wherein:
  • Step 1 The server knows the end-to-end broadband network delay information of different users
  • Step 2 After receiving the request from the client, the server calculates the time at which the multimedia resource can be synchronously presented according to the end-to-end broadband network delay information of the different users;
  • Step 3 The server sends the multimedia resources after the time that can be synchronously presented, and the user broadcasts the content according to the initial presentation time of the media resource, so that the broadband content of different users can be synchronously presented;
  • Step 1 The server knows the broadband network delay and available broadband information of different users
  • Step 2 After receiving the request from the client, the server calculates the time at which the multimedia resource can be synchronously presented according to the broadband network delay and the available broadband information of different users;
  • Step 3 The server sends the multimedia resources after the time that can be synchronously presented, and informs the user of the multimedia resource content playback start time, and the different user terminals synchronously present the broadband content according to the playback start time.
  • step 2 of the method 1 in the case that the broadband network delay ⁇ t of the user is different, the server sends the multimedia resource at time t ini at time t 0 to ensure synchronization, where t ini is after t tmp The first complete independent solvable media resource MU's starting moment, where:
  • t 0 is the transmission time
  • MU_duration is the duration of the media unit
  • ⁇ t is the downlink end-to-end broadband network delay
  • t tmp is the time when the calculated user receives the first independent solvable media resource MU.
  • the value of the MU_duration is 0 to 10 s;
  • ⁇ t is: 0 to ⁇ .
  • the value of the MU_duration is 0.5s
  • ⁇ t 2 s.
  • the content that is sent by the server is a multimedia resource after the time t ini , in order to synchronize the broadband and the broadcast, after the user receives the complete first MU through the broadband, and Do not play immediately, but wait until t ini to play the multimedia resources at the moment.
  • the server sends a multimedia resource to the user end, and the user end plays the content synchronously according to the start time of the media resource.
  • step 2 of the method 2 for the broadband network delay ⁇ t and the available bandwidth B b where the user is located, the server sends the multimedia resource at the time t ini at time t 0 to ensure synchronization, where t Ini is the starting moment of the first complete independent solvable media resource MU after t tmp , where:
  • t 0 is the transmission time
  • MU_size is the average size of the transmitted MU
  • MU_duration is the duration of the media unit
  • B r is the fixed code rate of playing the multimedia resource
  • B b is the available bandwidth of the broadband network
  • ⁇ t is the downlink broadband network.
  • the delay, t tmp is the time when the calculated client receives the first independent solvable media resource MU.
  • the value of the MU_size is 0 to 100 Mbits.
  • the value of the MU_duration is 0 to 10 s;
  • the value of B r is: 0 to 50 Mbps;
  • B b 0 to 1 Tbps
  • ⁇ t is: 0 to ⁇ .
  • the value of the MU_size is: 30 Mbits
  • the value of the MU_duration is 0.5s
  • the value of B r is: 25 Mbps;
  • the value of B b is: 1 Mbps;
  • ⁇ t 2 s.
  • the content that is sent by the server is a multimedia resource after the time t ini , in order to synchronize the broadband and the broadcast, after the user receives the complete first MU through the broadband, and Do not play immediately, but wait until t ini to play the multimedia resources at the moment.
  • the server when the server sends the multimedia resource, the server sends a downlink signaling to notify the user of the sequence number of the first independently solvable media resource to notify the user of the playing time.
  • the method 1 and the method 2 are applicable to different users in the heterogeneous network media service requesting the same multimedia resource to the server at a certain time or switching different multimedia resources or re-requesting the multimedia resource due to the deterioration of the network status. In order to make the content of the part of the media resource synchronously presented.
  • the server adopts a method for synchronously pushing a media resource or an adaptive method for accessing a synchronous media resource according to the condition of a broadband network of different users, so as to implement a broadcast media and a broadband media content of the server under the heterogeneous network transmission.
  • the mechanism of playing synchronization solves the problem that media resources are not synchronized due to different network conditions.
  • Embodiment 1 is a timing diagram of Embodiment 1 of the present invention.
  • Embodiment 2 is a timing diagram of Embodiment 2 of the present invention.
  • the present invention is directed to solving the above technical problems.
  • the implementation details of the technical solutions are described in detail below through two embodiments, so as to be understood by those skilled in the art. According to the different scenarios, the method of any one of the following two embodiments may be adopted. If the user end can learn the end-to-end network delay information, the method in the first embodiment is used, if the user terminal can only learn the broadband network delay, When the time when the media resource enters the client process is used, the method in the second embodiment is adopted.
  • the overall technical line of this embodiment is: by using a corresponding method in the network, the end-to-end broadband network delay information of different users is known, which is used to change the start time of the server to start transmitting broadband resources, and realize heterogeneous Synchronization of multimedia resources under the network.
  • the method steps in this embodiment include:
  • the server can learn the end-to-end broadband network delay information of different users according to some methods, such as signaling information fed back by the UE, and estimation and measurement.
  • the server calculates the time at which the multimedia resources can be synchronously presented according to the delay of the network in which the different users are located.
  • the server sends the multimedia resources after the time that can be synchronously presented, and the client synchronously plays the content according to the media content playing start time, so as to ensure that the broadband content of different users can be synchronously presented.
  • the specific implementation is as follows:
  • Step 1 It is known that the server receives the client request at time t 0 , the downlink end-to-end broadband network delay ⁇ t of different user groups, and the MU_duration of the media unit MU (duplicate media unit);
  • Step 2 For the end-to-end broadband network delay of the user, the server sends the multimedia resource at time t ini at time t 0 to ensure synchronization, and t ini is the starting time of the first complete MU after t tmp , such as formula (1), formula (2):
  • MU_duration is the duration of the media unit
  • t 0 is the transmission time
  • ⁇ t is the downlink end-to-end broadband network delay
  • t tmp is the time when the calculated client receives the first MU.
  • the above parameters can be selected from the following values:
  • MU_duration 0 to 10 s, the preferred value is 0.5 s;
  • the preferred value is 2s.
  • Step 3 Since the content to be sent is the multimedia resource at time t ini and later, in order to ensure broadband and broadcast synchronization, after the broadband receives the complete first MU, it does not play immediately, but waits until t ini time and later. Send the media content at the moment.
  • the audience When the user is watching the Olympic live broadcast program, because the audience is different, the audience has a multi-angle video for the audience to choose.
  • the audience Although the audience is watching the main program at the moment, they also watch the close-up performance of an athlete in a small screen, but the athlete's game is soon over, and the audience wants to immediately change the angle to watch the other athlete's posture, so the audience
  • the server sends a request, and the request signaling should include an end-to-end network delay fixed_end_to_end_delay, which is available in HRBM_message, as shown in Table 1:
  • t 0 18:00:00
  • the user can see the appearance of another athlete from different perspectives under the synchronization of broadcast and on-demand, thus well solving the problem that the broadcast and broadband user media resources are not synchronized due to different network conditions in the heterogeneous network transmission. problem.
  • the overall technical route adopted in this embodiment is: by using a corresponding method in the network, information such as the delay of the broadband network and the available bandwidth of different users are used, which is used to change the start time of the broadband transmission of the service to start the service, and realize Synchronization of multimedia resources under heterogeneous networks.
  • the method steps in this embodiment include:
  • the server can learn information about the broadband network delay and available bandwidth of different users according to some methods, such as signaling information fed back by the UE, and estimation and measurement.
  • the server calculates the time at which the multimedia resources can be synchronously presented according to the delay of the network in which the different users are located.
  • the server sends the resources that can synchronously present the time and informs the client of the media content playback start time, so that the broadband content of different users can be synchronously presented.
  • the specific implementation is as follows:
  • Step 1 It is known that the server receives the client request at time t 0 , the downlink broadband network delay ⁇ t of different user groups, the available bandwidth B b , the video code rate B r , and the uniable media unit MU (media unit) Duration MU_duration;
  • Step 2 For the broadband network delay and available bandwidth of the user, the server sends the multimedia resource at time t ini at time t 0 to ensure synchronization, and t ini is the starting time of the first complete MU after t tmp , such as formula (1), formula (2), formula (3):
  • t 0 is the transmission time
  • MU_size is the average size of the transmitted MU
  • MU_duration is the duration of the media unit
  • B r is the fixed code rate of playing the multimedia resource
  • B b is the broadband
  • ⁇ t is the delay of the downlink broadband network
  • t tmp is the time when the calculated client receives the first MU
  • the above parameters can be selected from the following values:
  • MU_size 0 to 100 Mbits, and the preferred value is 30 Mbits.
  • MU_duration 0 to 10 s, the preferred value is 0.5 s;
  • B r 0 to 50 Mbps, and the preferred value is 25 Mbps;
  • the preferred value is 2s.
  • Step 3 Since the content to be sent is the multimedia resource at time t ini and later, in order to ensure broadband and broadcast synchronization, after the broadband receives the complete first MU, it does not play immediately, but waits until t ini time and later. Send the media content at the moment.
  • the client request and the server inform the user that the mode is not limited.
  • the signaling mode is taken as an example, and the signaling is based on the MMT protocol. Of course, in other embodiments. It can also be applied to other media protocols, not limited to the MMT protocol:
  • the audience When the user is watching the Olympic live broadcast program, because the audience is different, the audience has a multi-angle video for the audience to choose.
  • the audience Although the audience is watching the main program at the moment, they also watch the close-up performance of an athlete in a small screen, but the athlete's game is soon over, and the audience wants to immediately change the angle to watch the other athlete's posture, so the audience
  • the server sends a request, and the request signaling should include a network delay network_delay and an available broadband information network_bandwidth, and the request message request_message is as follows:
  • t 0 18:00:00
  • the server needs to send a downlink signaling to inform the client to send the first independent solvable media resource.
  • the serial number to inform the user of the time of playback, the response message response_message is as follows:
  • the time when the current client receives the resource is 18:00:1610, and the current cache is cached.
  • the media unit will wait until 18:00:1641 to play the resource again.
  • the user can see the appearance of another athlete from different perspectives under the synchronization of broadcast and on-demand, thus well solving the problem that the broadcast and broadband user media resources are not synchronized due to different network conditions in the heterogeneous network transmission. problem.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本发明公开了一种基于异构网络的多媒体资源同步推送方法，包括：步骤一：服务端获知不同用户所处的端到端宽带网络延时信息或宽带网络延时以及可用宽带信息；步骤二：服务端在收到用户请求之后，根据不同用户所处的端到端宽带网络延时或宽带网络延时和可用宽带信息，计算出多媒体资源能够同步呈现的时刻；步骤三：服务端发送上述能同步呈现的时刻的多媒体资源，用户端根据媒体资源的起始呈现时间同步播放内容使得不同用户的宽带内容都能同步呈现。本发明解决了异构网络传输中因网路状况不同而导致广播和宽带用户媒体资源不同步的问题。

Description

一种基于异构网络的多媒体资源同步推送方法 技术领域
本发明涉及一种信息技术领域的异构媒体网络传输方法，特别是涉及一种基于异构网络的多媒体资源同步推送方法。
背景技术
随着网络技术的日新月异，媒体呈现方式发生了翻天覆地的变化，新的媒体形式层出不穷。传统电视已不再是人们获取信息和娱乐的主要途径，更多的终端设备出现在我们面前，如连接互联网的PC、几乎人手一台的手机以及越来越普及的移动平板电脑等，这些新的产品已经在慢慢侵蚀传统电视业务的市场。多媒体业务伴随变革的移动通信和宽带无线技术的发展日益成熟，大规模的媒体融合已经成为一种必然趋势，在这个过程中，新的思路和高端产品不断出现，使用户能够便捷地接入网络，轻松地享用更丰富的媒体内容和多样化的服务。
与此同时，媒体内容的呈现将不只是简单的视频，音频，字幕，媒体类型将会越来越丰富多样。媒体来源也不只是特定的内容提供商，越来越多的制作者参与其中，包括很多个人用户同时也是内容的提供和制作者。这些来自不同提供者的内容存在着各种关联关系，为了满足不同用户的个性化需求，这些关联内容往往需要同步呈现。在此环境下，异构网络融合作为下一代网络发展的必然趋势，充分说明了未来的通信不再是某种特定的接入技术，而是多种接入技术并存、协同工作。
在异构媒体网络的环境下，终端呈现的媒体内容可同时从多个传输通道传输过来，例如广播通道和宽带通道。广播通道的媒体资源具有延 迟短(基本忽略不计)，带宽高且稳定的特点，而对于不同的宽带通道(WIFI，3G/4G等)，带宽和网络延时都有很大的差异性。
因此对于由广播和宽带构成的异构网络媒体资源服务中，由于宽带通道网络状况的差异性，会有以下三种不同步的案例：服务端通过广播向用户推送媒体内容，如果用户请求相同媒体内容的宽带资源，则由于宽带网络的延时和带宽，会造成客户端从广播和宽带接收的内容在时间线上的不同步；服务端通过广播和宽带向用户推送相同的媒体内容，如果用户请求更换宽带资源媒体流(如不同视角、不同音频等)，切换媒体流时，由于不同宽带网络延时和带宽不同，会造成终端新带宽内容和广播内容不同步；服务端通过广播和宽带向用户推送相同的媒体内容，如果在某个时刻宽带网络状况变差造成宽带通道播放不流畅，等到视频再次流畅播放时，会造成不同用户间广播和宽带的资源不同步。
因此，在新一代异构网络传输系统下如何让服务端根据网络状况同步传输多媒体资源，成为一个亟待解决的问题。
发明内容
本发明所要解决的技术问题是提供一种基于异构网络的多媒体资源同步推送方法，实现异构网络传输下服务端广播媒体和宽带媒体内容同步的机制，解决了异构网络传输中因网络状况不同而导致广播和宽带用户媒体资源不同步的问题。
本发明是通过下述技术方案来解决上述技术问题的：
一种基于异构网络的多媒体资源同步推送方法，所述方法采用以下两种中任一种，其中：
-方法一：包括以下步骤：
步骤一：服务端获知不同用户所处的端到端宽带网络延时信息；
步骤二：服务端在收到用户端请求之后，根据不同用户所处的端到端宽带网络延时信息，计算出多媒体资源能够同步呈现的时刻；
步骤三：服务端发送上述能同步呈现的时刻以后的多媒体资源，用户端根据媒体资源的起始呈现时间同步播放内容使得不同用户的宽带内容都能同步呈现；
-方法二：包括以下步骤：
步骤一：服务端获知不同用户所处的宽带网络延时以及可用宽带信息；
步骤二：服务端在收到用户端请求之后，根据不同用户所处的宽带网络延时和可用宽带信息，计算出多媒体资源能够同步呈现的时刻；
步骤三：服务端发送上述能同步呈现的时刻以后的多媒体资源，并告知用户端多媒体资源内容播放起始时间，不同用户端依据播放起始时间同步呈现宽带内容。
进一步的，所述方法一的步骤二中，针对用户所处的宽带网络延时△t不同情况，服务端在t0时刻发送tini时刻的多媒体资源以保证同步，其中tini为ttmp之后的第一个完整独立可解媒体资源MU的起始时刻，其中：
0≤tini-ttmp<MU_duration
ttmp＝t0+△t
式中：t0为发送时刻，MU_duration为媒体单元时长，△t为下行端到端宽带网络延时，ttmp为计算所得用户端收到第一个独立可解媒体资源MU的时刻。
更进一步的，所述方法一中：
所述MU_duration取值为：0～10s；
所述Δt取值为：0～∞。
更优的，所述方法一中：
所述MU_duration取值为：0.5s；
所述Δt取值为：2s。
进一步的，所述方法一的步骤三中，服务端起始发送的内容是tini时刻以后的多媒体资源，为使宽带和广播同步，用户端通过宽带收到完整的第一个MU之后，并不立即播放，而是等到tini时刻再播放此刻的多媒体资源。
进一步的，所述方法一中，所述服务端发送多媒体资源给用户端，用户端根据媒体资源的起始呈现时间同步播放内容。
进一步的，所述方法二的步骤二中，针对用户所处的宽带网络延时△t及可用带宽Bb不同情况，服务端在t0时刻发送tini时刻的多媒体资源以保证同步，其中tini为ttmp之后的第一个完整独立可解媒体资源MU的起始时刻，其中：
0≤tini-ttmp<MU_duration
MU_size＝MU_duration*Br
ttmp＝t0+MU_size/Bb+△t
式中：t0为发送时刻，MU_size为发送的平均MU的大小，MU_duration为媒体单元时长，Br为播放多媒体资源的固定码率，Bb为宽带网络的可用带宽，△t为下行宽带网络延时，ttmp为计算所得用户端收到第一个独立可解媒体资源MU的时刻。
更进一步的，所述方法二中：
所述MU_size取值为：0～100Mbits；
所述MU_duration取值为：0～10s；
所述Br取值为：0～50Mbps；
所述Bb取值为：0～1Tbps；
所述Δt取值为：0～∞。
更优的，所述方法二中：
所述MU_size取值为：30Mbits；
所述MU_duration取值为：0.5s；
所述Br取值为：25Mbps；
所述Bb取值为：1Mbps；
所述Δt取值为：2s。
进一步的，所述方法二的步骤三中，服务端起始发送的内容是tini时刻以后的多媒体资源，为使宽带和广播同步，用户端通过宽带收到完整的第一个MU之后，并不立即播放，而是等到tini时刻再播放此刻的多媒体资源。
进一步的，所述方法二中，所述服务端发送多媒体资源的同时，发送一个下行信令告知用户端发送的第一个独立可解媒体资源的序号来通知用户播放的时间。
进一步的，所述方法一和方法二，适用于异构网络媒体服务中不同的用户在某时刻向服务端请求同一个多媒体资源或者切换不同多媒体资源或者因网络多状况恶化而重新请求多媒体资源，为使该部分媒体资源内容同步呈现的情况。
本发明的积极进步效果在于：
采用本发明上述的方法，服务端针对不同用户宽带网络的状况，采取同步推送媒体资源的方法或自适应的接入同步媒体资源的方法，实现异构网络传输下服务端广播媒体和宽带媒体内容播放同步的机制，解决了因为不同网络状况不同带来的媒体资源不同步的问题。
附图说明
图1为本发明实施例一的时序示意图；
图2为本发明实施例二的时序示意图；
具体实施方式
下面结合附图给出本发明较佳实施例，以详细说明本发明的技术方案。
如今，基于异构网络的多样化终端呈现方式已成为发展的趋势。在观看高质量广播视频节目的同时，人们对于多样化的网络媒体服务的诉求也越来越高。一般来说，由广播通道过来的媒体内容有很小并且固定的延时，因此对于媒体内容的同步影响不大；而从宽带过来的媒体内容如音视频、字幕、多媒体应用等内容易受当前IP网络影响，产生较大且抖动的延时，给内容同步带来了问题。
本发明为解决上述技术问题，以下通过两个实施例来详细说明技术方案的实施细节，以便于本领域技术人员的理解。根据不同场景可以采用以下两实施例中任一种的方法，若用户端能获知端到端网络延时信息，则采用实施例一中的方法，若用户端只能获知宽带网络延时，不包含媒体资源进入用户端过程的时间，则采用实施例二中的方法。
实施例一
本实施例总体技术线路为：通过在网络中的相应方法，获知不同用户所处的端到端宽带网络延时信息，用来改变服务端起始传输宽带资源的起始时间，实现了异构网络下多媒体资源的同步。
具体的，本实施例方法步骤包括：
首先，服务端可以根据一些方法，比如通过用户端反馈过来的信令信息、通过估算测量等，获知不同用户所处的端到端宽带网络延时信息。
其次，针对异构网络媒体服务中不同的用户在某时刻向服务端请求同一个多媒体资源或者切换不同多媒体资源或者因网络状况恶化而重新请求多 媒体资源的情况，为保证该部分多媒体资源内容同步呈现，服务端在收到用户请求之后，根据不同用户所处网络的延时情况，计算出多媒体资源能够同步呈现的时刻。
最后，服务端发送上述能同步呈现的时刻以后的多媒体资源，客户端根据媒体内容播放起始时间同步播放内容，保证不同用户的宽带部分内容都能同步呈现。
如图1所示，在具体实施例中，具体实施如下：
步骤一：已知服务端在t0时刻收到客户端请求，不同用户群体的下行端到端宽带网络延时△t，独立可解媒体单元MU(media unit)时长MU_duration；
步骤二：针对用户所处的端到端宽带网络延时不同情况，服务器在t0时刻发送tini时刻的多媒体资源以保证同步，tini为ttmp之后的第一个完整MU的起始时刻，其中如式(1)、式(2)：
0≤tini-ttmp<MU_duration……(1)
ttmp＝t0+△t……(2)
式(1)中MU_duration为媒体单元时长，式(2)中，t0为发送时刻，△t为下行端到端宽带网络延时，ttmp为计算所得客户端收到第一个MU的时刻；
在一优选实施方式中，上述的参数可以选择以下数值：
MU_duration：0～10s，较优值为0.5s；
△t：0～∞，较优值为2s。
步骤三：由于起始发送的内容是tini时刻及以后的多媒体资源，为保证宽带和广播同步，宽带收到完整的第一个MU之后，并不立即播放，而是等到tini时刻及以后再发送此刻的媒体内容。
下面给出多媒体资源同步的具体事例(用户端请求和服务端告知用户端方式不限，以下均以信令方式为例，信令基于MMT协议)：
当用户正在观看奥运直播节目，由于精彩众多，观众口不一，因此节目方专为观众拍摄了多角度视频，供观众选择。
虽然此刻观众在看主节目的同时，还在小画面中观看某个运动员的特写表现，可是该运动员的比赛很快就结束了，观众想立刻更换角度收看另一运动员的身姿，于是观众向服务端发送请求，该请求信令应包含端到端网络延时fixed_end_to_end_delay，该字段在HRBM_message中可获得，如下表1：
表1
Figure PCTCN2017099434-appb-000001
message_id–HRBM的消息标识
version–HRBM的消息版本
length–HRBM的消息长度
extension_fields_Byte–HRBM扩展性字段
max_buffer_size–HRBM最大缓存大小
fixed_end_to_end_delay–端到端网络延时
max_transmission_delay–最大传输延时
t0＝18:00:00服务端收到了请求，其中fixed_end_to_end_delay＝△t＝2s。独立可解媒体单元时长从视频资源中可获知，MU_duration＝0.5s。
△t＝2s
ttmp＝t0+△t＝18:00:02
tini＝18:00:022
服务端在t0＝18:00:00时刻发送tini＝18:00:022的资源，客户端收到第一个媒体资源时间是18:00:02，根据收到第一个媒体资源的时间戳信息timestamp＝18:00:022，缓存当前媒体单元，等到18:00:022再播放该资源。
至此，用户就能在广播和点播同步下看到不同视角的另一运动员的身姿了，从而很好地解决了异构网络传输中因网络状况不同而导致广播和宽带用户媒体资源不同步的问题。
实施例二
本实施例采用的总体技术路线是：通过在网络中的相应方法，获知不同用户所处的宽带网络延时及可用带宽等信息，用来改变服务端起始传输宽带资源的起始时间，实现了异构网络下多媒体资源的同步。
具体的，本实施例方法步骤包括：
首先，服务端可以根据一些方法，比如通过用户端反馈过来的信令信息、通过估算测量等，获知不同用户所处的宽带网络延时以及可用带宽等信息。
其次，针对异构网络媒体服务中不同的用户在某时刻向服务端请求同一个多媒体资源或者切换不同多媒体资源或者因网络状况恶化而重新请求多媒体资源的情况，为保证该部分多媒体资源内容同步呈现，服务端在收到用户请求之后，根据不同用户所处网络的延时情况，计算出多媒体资源能够同步呈现的时刻。
最后，服务端发送能同步呈现时刻的资源并告知客户端媒体内容播放起始时间，保证不同用户的宽带部分内容都能同步呈现。
如图2所示，在一具体实施例中，具体实施如下：
步骤一：已知服务端在t0时刻收到客户端请求，不同用户群体的下行宽带网络延时△t，可用带宽Bb，视频码率Br以及独立可解媒体单元MU(media unit)时长MU_duration；
步骤二：针对用户所处的宽带网络延时及可用带宽不同情况，服务器在t0时刻发送tini时刻的多媒体资源以保证同步，tini为ttmp之后的第一个完整MU的起始时刻，其中如式(1)、式(2)、式(3)：
0≤tini-ttmp<MU_duration……(1)
MU_size＝MU_duration*Br……(2)
ttmp＝t0+MU_size/Bb+△t……(3)
式(3)中，t0为发送时刻，MU_size为发送的平均MU的大小，具体计算见式(2)，MU_duration为媒体单元时长，Br为播放多媒体资源的固定码率，Bb为宽带网络的可用带宽，△t为下行宽带网络延时，ttmp为计算所得客户端收到第一个MU的时刻；
在一优选实施方式中，上述的参数可以选择以下数值：
MU_size：0～100Mbits，较优值为30Mbits；
MU_duration：0～10s，较优值为0.5s；
Br：0～50Mbps，较优值为25Mbps；
Bb：0～1Tbps，较优值为1Mbps；
△t：0～∞，较优值为2s。
步骤三：由于起始发送的内容是tini时刻及以后的多媒体资源，为保证宽带和广播同步，宽带收到完整的第一个MU之后，并不立即播放，而是等到tini时刻及以后再发送此刻的媒体内容。
下面给出多媒体资源同步的具体实施例，该实施例中的用户端请求和服务端告知用户端方式不限，以下均以信令方式为例，信令基于MMT协议，当然，在其他实施例中，也可以适用于其他的媒体协议，并不限于MMT协议：
当用户正在观看奥运直播节目，由于精彩众多，观众口不一，因此节目方专为观众拍摄了多角度视频，供观众选择。
虽然此刻观众在看主节目的同时，还在小画面中观看某个运动员的特写表现，可是该运动员的比赛很快就结束了，观众想立刻更换角度收看另一运动员的身姿，于是观众向服务端发送请求，该请求信令应包含网络延时network_delay和可用宽带信息network_bandwidth，请求消息request_message如下表1：
表1
Figure PCTCN2017099434-appb-000002
Figure PCTCN2017099434-appb-000003
t0＝18:00:00服务端收到了请求，其中△t＝2s，Bb＝512Kbit/s。视频码率和独立可解媒体单元时长从视频资源中可获知，Br＝16482Kbit/s，MU_duration＝0.5s。
MU_size＝MU_duration*Br＝0.5*16482＝8241bits
△T＝MU_size/Bb+△t＝8241/512+2＝16.10s
ttmp＝t0+△T＝18:00:1610
tini＝18:00:1641
服务端在t0＝18:00:00时刻发送tini＝18:00:1641的资源，发送资源的同时，服务端需发送一个下行信令告知客户端发送的第一个独立可解媒体资源的序号来通知用户播放的时间，响应消息response_message如下：
表2
Figure PCTCN2017099434-appb-000004
Figure PCTCN2017099434-appb-000005
客户端根据信令中已知的第一个媒体资源序列查表获知时间信息timestamp＝18:00:1641和大小MU_size＝33Mbits，当前客户端收到资源的时刻为18:00:1610，缓存当前媒体单元，等到18:00:1641再播放该资源。
至此，用户就能在广播和点播同步下看到不同视角的另一运动员的身姿了，从而很好地解决了异构网络传输中因网络状况不同而导致广播和宽带用户媒体资源不同步的问题。
以上所述的具体实施例，对本发明的解决的技术问题、技术方案和有益效果进行了进一步详细说明，所应理解的是，以上所述仅为本发明的具体实施例而已，并不用于限制本发明，凡在本发明的精神和原则之内，所做的任 何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (12)

  1. 一种基于异构网络的多媒体资源同步推送方法，其特征在于，所述方法采用以下两种中任一种，其中：
    -方法一：包括以下步骤：
    步骤一：服务端获知不同用户所处的端到端宽带网络延时信息；
    步骤二：服务端在收到用户端请求之后，根据不同用户所处的端到端宽带网络延时信息，计算出多媒体资源能够同步呈现的时刻；
    步骤三：服务端发送上述能同步呈现的时刻以后的多媒体资源，用户端根据媒体资源的起始呈现时间同步播放内容使得不同用户的宽带内容都能同步呈现；
    -方法二：包括以下步骤：
    步骤一：服务端获知不同用户所处的宽带网络延时以及可用宽带信息；
    步骤二：服务端在收到用户端请求之后，根据不同用户所处的宽带网络延时和可用宽带信息，计算出多媒体资源能够同步呈现的时刻；
    步骤三：服务端发送上述能同步呈现的时刻以后的多媒体资源，并告知用户端多媒体资源内容播放起始时间，不同用户端依据播放起始时间同步呈现宽带内容。
  2. 根据权利要求1所述的基于异构网络的多媒体资源同步推送方法，其特征在于，所述方法一的步骤二中，针对用户所处的宽带网络延时△t不同情况，服务端在t0时刻发送tini时刻的多媒体资源以保证同步，其中tini为ttmp之后的第一个完整独立可解媒体资源MU的起始时刻，其中：
    0≤tini-ttmp<MU_duration
    ttmp＝t0+△t
    式中：t0为发送时刻，MU_duration为媒体单元时长，△t为下行端到端 宽带网络延时，ttmp为计算所得用户端收到第一个独立可解媒体资源MU的时刻。
  3. 根据权利要求2所述的基于异构网络的多媒体资源同步推送方法，其特征在于：
    所述MU_duration取值为：0～10s；
    所述Δt取值为：0～∞。
  4. 根据权利要求3所述的基于异构网络的多媒体资源同步推送方法，其特征在于：
    所述MU_duration取值为：0.5s；
    所述Δt取值为：2s。
  5. 根据权利要求2所述的基于异构网络的多媒体资源同步推送方法，其特征在于，所述方法一的步骤三中，服务端起始发送的内容是tini时刻以后的多媒体资源，为使宽带和广播同步，用户端通过宽带收到完整的第一个MU之后，并不立即播放，而是等到tini时刻再播放此刻的多媒体资源。
  6. 根据权利要求1所述的基于异构网络的多媒体资源同步推送方法，其特征在于，所述方法一中，所述服务端发送多媒体资源给用户端，用户端根据媒体资源的起始呈现时间同步播放内容。
  7. 根据权利要求1所述的基于异构网络的多媒体资源同步推送方法，其特征在于，所述方法二的步骤二中，针对用户所处的宽带网络延时△t及可用带宽Bb不同情况，服务端在t0时刻发送tini时刻的多媒体资源以保证同步，其中tini为ttmp之后的第一个完整独立可解媒体资源MU的起始时刻，其中：
    0≤tini-ttmp<MU_duration
    MU_size＝MU_duration*Br
    ttmp＝t0+MU_size/Bb+△t
    式中：t0为发送时刻，MU_size为发送的平均MU的大小，MU_duration为媒体单元时长，Br为播放多媒体资源的固定码率，Bb为宽带网络的可用带宽，△t为下行宽带网络延时，ttmp为计算所得用户端收到第一个独立可解媒体资源MU的时刻。
  8. 根据权利要求7所述的基于异构网络的多媒体资源同步推送方法，其特征在于：
    所述MU_size取值为：0～100Mbits；
    所述MU_duration取值为：0～10s；
    所述Br取值为：0～50Mbps；
    所述Bb取值为：0～1Tbps；
    所述Δt取值为：0～∞。
  9. 根据权利要求8所述的基于异构网络的多媒体资源同步推送方法，其特征在于：
    所述MU_size取值为：30Mbits；
    所述MU_duration取值为：0.5s；
    所述Br取值为：25Mbps；
    所述Bb取值为：1Mbps；
    所述Δt取值为：2s。
  10. 根据权利要求7所述的基于异构网络的多媒体资源同步推送方法，其特征在于，所述方法二的步骤三中，服务端起始发送的内容是tini时刻以后的多媒体资源，为使宽带和广播同步，用户端通过宽带收到完整的第一个MU之后，并不立即播放，而是等到tini时刻再播放此刻的多媒体资源。
  11. 根据权利要求1所述的基于异构网络的多媒体资源同步推送方法， 其特征在于，所述方法二中，所述服务端发送多媒体资源的同时，发送一个下行信令告知用户端发送的第一个独立可解媒体资源的序号来通知用户播放的时间。
  12. 根据权利要求1-11任一项所述的基于异构网络的多媒体资源同步推送方法，其特征在于，所述方法一和方法二，适用于异构网络媒体服务中不同的用户在某时刻向服务端请求同一个多媒体资源或者切换不同多媒体资源或者因网络多状况恶化而重新请求多媒体资源，为使该部分媒体资源内容同步呈现的情况。
PCT/CN2017/099434 2016-08-29 2017-08-29 一种基于异构网络的多媒体资源同步推送方法 WO2018041092A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2018567950A JP6732970B2 (ja) 2016-08-29 2017-08-29 異種ネットワークに基づくマルチメディアリソースを同期に送る方法
US16/319,531 US11265587B2 (en) 2016-08-29 2017-08-29 Multimedia resource synchronous pushing method based on heterogeneous network
KR1020187037923A KR102271686B1 (ko) 2016-08-29 2017-08-29 이종 네트워크 기반의 멀티미디어 자원 동기화 푸시 방법
CA3026535A CA3026535C (en) 2016-08-29 2017-08-29 Multimedia resource synchronous pushing method based on heterogeneous network

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201610757375.1 2016-08-29
CN201610757375.1A CN107801103B (zh) 2016-08-29 2016-08-29 异构网络下基于网络状况的多媒体资源自适应同步方法
CN201610916013.2 2016-10-20
CN201610916013.2A CN107968950A (zh) 2016-10-20 2016-10-20 一种基于异构网络的多媒体资源同步推送方法

Publications (1)

Publication Number Publication Date
WO2018041092A1 true WO2018041092A1 (zh) 2018-03-08

Family

ID=61300029

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/099434 WO2018041092A1 (zh) 2016-08-29 2017-08-29 一种基于异构网络的多媒体资源同步推送方法

Country Status (4)

Country Link
JP (1) JP6732970B2 (zh)
KR (1) KR102271686B1 (zh)
CA (1) CA3026535C (zh)
WO (1) WO2018041092A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019231163A1 (ko) * 2018-05-31 2019-12-05 삼성에스디에스 주식회사 메시지 전송 지연 관리 장치 및 방법

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010003523A1 (en) * 1998-12-30 2001-06-14 Evan Stephen Crandall Method and apparatus for internet co-browsing over cable television and controlled through computer telephony
CN101304351A (zh) * 2008-06-30 2008-11-12 湖南创智数码科技股份有限公司 基于点对点传输的流媒体直播系统同步播放方法
CN101938456A (zh) * 2009-06-30 2011-01-05 华为技术有限公司 一种减小媒体延迟的方法、设备及系统
CN102572611A (zh) * 2010-12-07 2012-07-11 中国电信股份有限公司 不同用户同步收看网络直播流的方法和系统

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100889836B1 (ko) * 2007-11-15 2009-03-20 한양대학교 산학협력단 데이터 방송의 동기화 기능을 갖는 방송 수신기 및 이를이용한 데이터 방송의 동기화 방법
WO2016124130A1 (zh) * 2015-02-06 2016-08-11 上海交通大学 一种异构网络传输下的动态时间窗口及缓存机制

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010003523A1 (en) * 1998-12-30 2001-06-14 Evan Stephen Crandall Method and apparatus for internet co-browsing over cable television and controlled through computer telephony
CN101304351A (zh) * 2008-06-30 2008-11-12 湖南创智数码科技股份有限公司 基于点对点传输的流媒体直播系统同步播放方法
CN101938456A (zh) * 2009-06-30 2011-01-05 华为技术有限公司 一种减小媒体延迟的方法、设备及系统
CN102572611A (zh) * 2010-12-07 2012-07-11 中国电信股份有限公司 不同用户同步收看网络直播流的方法和系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019231163A1 (ko) * 2018-05-31 2019-12-05 삼성에스디에스 주식회사 메시지 전송 지연 관리 장치 및 방법

Also Published As

Publication number Publication date
JP2019527497A (ja) 2019-09-26
KR102271686B1 (ko) 2021-07-01
JP6732970B2 (ja) 2020-07-29
CA3026535C (en) 2021-09-21
CA3026535A1 (en) 2018-03-08
KR20190013967A (ko) 2019-02-11

Similar Documents

Publication Publication Date Title
JP5788473B2 (ja) 端末の出力を同期させる方法およびシステム
JP5363473B2 (ja) 改善されたメディア・セッション管理の方法と装置
US11303682B2 (en) Adaptive bit rates in multicast communications
JP5181026B2 (ja) 移動テレビシステムのためのアクセスネットワークのハンドオーバ
US10645447B2 (en) Fast channel change method and server, and IPTV system
JP5100838B2 (ja) 移動テレビシステムのためのアクセスネットワークのハンドオーバ
EP2101500A1 (en) A video on demand controlling method, a client device and a switch controlling equipment
JP2008530835A (ja) パケット交換ネットワーク上のオンデマンドマルチチャネルストリーミングセッション
WO2010075743A1 (zh) 一种网络电视显示时间的方法及设备
WO2012122935A1 (zh) 互联网协议电视内容共享方法、装置以及终端设备
KR20130005873A (ko) 방송 시스템에서 컨텐츠 수신 방법 및 장치
WO2012163181A1 (zh) 快速频道切换的实现方法和装置
WO2008031293A1 (en) A method for quickly playing the multimedia broadcast channels
TW201204037A (en) Use of picture-in-picture stream for internet protocol television fast channel change
WO2018041092A1 (zh) 一种基于异构网络的多媒体资源同步推送方法
CN107801103B (zh) 异构网络下基于网络状况的多媒体资源自适应同步方法
WO2018171567A1 (zh) 播放媒体流的方法、服务器及终端
CN106572062B (zh) 一种异构媒体传输网络下的资源动态请求方法
CN107968950A (zh) 一种基于异构网络的多媒体资源同步推送方法
WO2011022983A1 (zh) 组播视频数据的方法、装置及系统
EP2645671A1 (en) Switching the playing out of information content beween end-user devices
CN101577810A (zh) 移动电视播放系统及方法

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 3026535

Country of ref document: CA

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17845394

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018567950

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20187037923

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 15.07.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17845394

Country of ref document: EP

Kind code of ref document: A1