CN105284093A - Supporting transport diversity and time-shifted buffers for media streaming over a network - Google Patents

Supporting transport diversity and time-shifted buffers for media streaming over a network Download PDF

Info

Publication number
CN105284093A
CN105284093A CN201480004712.9A CN201480004712A CN105284093A CN 105284093 A CN105284093 A CN 105284093A CN 201480004712 A CN201480004712 A CN 201480004712A CN 105284093 A CN105284093 A CN 105284093A
Authority
CN
China
Prior art keywords
media data
map information
client
request
application service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201480004712.9A
Other languages
Chinese (zh)
Other versions
CN105284093B (en
Inventor
K·R·福尔
N·奈克
T·施托克哈默
F·乌卢皮纳尔
C·M·D·帕索斯
C·N·洛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN105284093A publication Critical patent/CN105284093A/en
Application granted granted Critical
Publication of CN105284093B publication Critical patent/CN105284093B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/563Data redirection of data network streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/18Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals

Abstract

A proxy unit is configured to obtain mapping information that maps an identifier for media data to a resource location based on a service for retrieving the media data, wherein the service defines at least one of a plurality of types of transports for transporting the media data, receive a request for the media data from an application service client, determine whether the service is available, and, when available, cause the application service client to receive the media data from a unit that receives the media data using the service from the resource location, based on the mapping information.

Description

Transmission diversity and time shift buffer is supported for the media streaming on network
This application claims the U.S. Provisional Application sequence No.61/752 submitted on January 15th, 2013, the rights and interests of 456 and the U.S. Provisional Application sequence No.61/809 submitted on April 8th, 2013, the rights and interests of 871, are incorporated to its entirety herein by reference.
Technical field
Present disclosure relates to communication system, and more particularly, relates to the delivery of content via network.
Background technology
Can be incorporated in a lot of equipment by digital multimedia (comprising Voice & Video and other media) ability, described equipment comprises Digital Television, digital direct broadcast system, wireless broadcast system, personal digital assistant (PDA), on knee or desktop PC, digital camera, digital recording equipment, digital media player, video game device, video game console, honeycomb or satellite radio telephone, video conference device etc.Digital multimedia device realizes the video, audio frequency and/or other media compression technology that such as describe in the expansion by MPEG-2, MPEG-4, ITU-TH.263 or ITU-TH.264/MPEG-4 the 10th part, standard that advanced video coding (AVC) defines and these standards, more effectively to transmit and receive digital medium information.
Techniques for Multimedia Compression execution spatial prediction and/or time prediction are to reduce or to remove redundancy intrinsic in video sequence.For block-based Video coding, frame of video or fragment (slice) can be divided into block.Each piece can by Further Division.Block in (I) frame or fragment of intraframe coding is encoded relative to the prediction of adjacent block usage space.Block in (P or the B) frame or fragment of interframe encode can relative to the adjacent block usage space prediction in same frame or fragment or relative to other reference frame prediction service time.
After multi-medium data is encoded (such as, compression), can by packet to carry out transmitting or storing.Data assembling can be become meet the file of any standard in various standard, described standard such as International Organization for standardization (ISO) base media file format and its expansion, as AVC.
In order to provide the various communication services such as such as voice, video, grouped data, Message Transmission, broadcast, deploy cordless communication network widely.These wireless networks can be can by share can Internet resources support the multi-access network of multiple user.The example of this multi-access network comprises code division multiple access (CDMA) network, time division multiple access (TDMA) network, frequency division multiple access (FDMA) network, orthogonal FDMA (OFDMA) network and Single Carrier Frequency Division Multiple Access (SC-FDMA) network.
As the evolution of global system mobile communication (GSM) and Universal Mobile Telecommunications System (UMTS), third generation partner program (3GPP) Long Term Evolution (LTE) represents the major progress in cellular technology.LTE physical layer (PHY) provides the efficient way transmitting both data and control information between the base station and the mobile device of such as UE of such as enode b (eNB).In previously application, for promoting that the method for multimedia high-bandwidth communication is Single Frequency Network (SFN) operation.SFN utilizes transmitting set (such as, for example, eNB) to communicate with subscriber UE.In unicast operation, each eNB is controlled, to send the signal of the information of carrying for one or more certain subscriber UE.The specificity (specificity) of clean culture signaling makes it possible to realize person-to-person service, such as, for example, and audio call, communication of text messages or video call.
Summary of the invention
Put it briefly, this disclosure has described the technology of the stream medium data on network.Such as, this disclosure has described a kind of technology for carrying out receiving media data via dissimilar transmission (any transmission in such as, clean culture, broadcast and/or multicast).Such as, redirector/agent unit can make application service client directly fetch media data via clean culture from the Internet, or when broadcast or multicast service is available, fetches media data from broadcast or multicast middleware unit.Alternately, when broadcast or multicast service is unavailable, redirector/agent unit can represent application service client to fetch media data.When polytype transmission is available and/or for transmitting media data, term " transmission diversity " can be used below.When provider's (media source) and/or the transmission for transmitting media change (such as, by redirector/agent unit), term can be used below " to be redirected " or " being redirected ".
This disclosure further describes the technology of the media data fetched about buffer memory.Such as, fetched media data can be stored in time shift buffer (TSB).This disclosure has described the technology (such as, the playback duration about media content) of the size for sending TSB with signal form, make it possible to the memory of distribution appropriate amount for TSB.By this way, and/or stunt (trick) mode (such as F.F. or rewinding) can be used to carry out playback in time playback media data after a while.
In one example in which, a kind of method of fetching media data comprises: obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission of multiple types of described media data; The request for described media data is received from application service client; Determine whether described service is available; And when described service is available, making described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
In another example, a kind of equipment for fetching media data comprises agent unit, described agent unit is configured to carry out following operation: obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission of multiple types of described media data; The request for described media data is received from application service client; Determine whether described service is available; And when described service is available, making described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
In another example, a kind of equipment for fetching media data comprises the unit for obtaining map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission of multiple types of described media data; For receiving the unit for the request of described media data from application service client; For determining whether described service is available unit; And for when described service is available, making described application service client receive the unit of described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
In another example, a kind of computer-readable recording medium has the instruction be stored thereon, when executed, make processor to perform following operation: to obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission of multiple types of described media data; The request for described media data is received from application service client; Determine whether described service is available; And when described service is available, making described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
In another example, a kind of method of processing media data comprises: receive Session Description Protocol (SDP) message, described SDP message comprises the attribute defining time shift buffer (TSB) degree of depth; Based on the value of described attribute, determine the amount of the memory of described TSB; Distribute the memory of determined amount to form described TSB; And, in described TSB, store the media data be at least partially associated with described SDP message.
In another example, a kind of equipment for the treatment of media data comprises one or more processor, described one or more processor is configured to carry out following operation: receive Session Description Protocol (SDP) message, described SDP message comprises the attribute defining time shift buffer (TSB) degree of depth; Based on the value of described attribute, determine the amount of the memory of described TSB; Distribute the memory of determined amount to form described TSB; And, in described TSB, store the media data be at least partially associated with described SDP message.
In another example, a kind of equipment for the treatment of media data comprises: for receiving the unit of Session Description Protocol (SDP) message, described SDP message comprises the attribute defining time shift buffer (TSB) degree of depth; For the value based on described attribute, determine the unit of the amount of the memory of described TSB; For distributing the memory of determined amount to form the unit of described TSB; And, for storing the unit of the media data be at least partially associated with described SDP message in described TSB.
In another example, a kind of computer-readable recording medium has the instruction be stored thereon, when executed, make processor to perform following operation: receive Session Description Protocol (SDP) message, described SDP message comprises the attribute defining time shift buffer (TSB) degree of depth; Based on the value of described attribute, determine the amount of the memory of described TSB; Distribute the memory of determined amount to form described TSB; And, in described TSB, store the media data be at least partially associated with described SDP message.
Accompanying drawing explanation
Fig. 1 shows the example system for supporting transmission diversity.
Fig. 2 A-2B shows the alternative example comprising redirector/act on behalf of the to support device of transmission diversity.
Fig. 3 shows the aspect using and be configured to carry out the example process flow of the redirector/agency of redirect operation.
Fig. 4 shows the aspect using and be configured to carry out the method for the redirector/agency of agent operation.
Fig. 5 shows the example of the method for supporting transmission diversity.
Fig. 6 shows the exemplary means of the method for realizing Fig. 5.
Fig. 7 and Fig. 8 shows the further aspect for supporting transmission diversity.
Fig. 9 and Figure 10 shows the block diagram for supporting Exemplary multicast services device clients (MSDC) framework that RTP (RTP)/real-time streaming protocol (RTSP) is transmitted as a stream.
Figure 11 shows the concept map of MBMS (eMBMS) user service describing (USD) schema fragment of exemplary evolution.
Figure 12 and 13 shows the block diagram of example components, and described example components is for supporting the transmission diversity for RTSP/RTP client.
Figure 14 A and 14B shows for expanding USD to carry the concept map of exemplary extensible markup language (XML) content model of HTTP dynamic self-adapting Streaming Media (DASH) transmission information.
Figure 15 shows the concept map of the exemplary architecture for supporting the DASH on MBMS.
Figure 16 show be associated with the network architecture of Figure 15, for the call flow of broadcasting and DASH content in unicast transmission transmits.
Figure 17 shows the concept map of another exemplary architecture for supporting the DASH on MBMS.
Figure 18-23 show be associated with the network architecture of Figure 17, for the flow chart of broadcasting and DASH content in unicast transmission transmits.
Figure 24 is for the technology according to present disclosure, shows the flow chart for sending with signal form about the illustrative methods of time shift buffer (TSB) degree of depth.
Embodiment
In general, this disclosure has described for by the technology of network support for the transmission mechanism of various types of stream medium data, described various types of stream medium data is as such as audio frequency and/or video data.Such as, application service client (it also can be called as streaming client) can be configured to carry out alternately with agent unit, to fetch media data according to unicast protocol or broadcast (or multicast) agreement.In some instances, agent unit can determine whether to use Radio Broadcasting Agreements to fetch media data, such as based on client device whether for using Radio Broadcasting Agreements to come in the overlay area of the service provider of transfer medium data, and whether in overlay area, select Radio Broadcasting Agreements or unicast protocol based on described client device.Client device can perform application service client and/or comprise agent unit.In some instances, client device can perform application service client, and agent unit can be included in the equipment separated with client device.
The technology of present disclosure can use together with the various application layer protocols for stream medium data.Such as, the technology of present disclosure can use together with HTTP dynamic self-adapting Streaming Media (DASH), and it utilizes HTTP to carry out streaming transmission of media data.As another example, the technology of present disclosure can use together with RTP (RTP) or real-time streaming protocol (RTSP).In these and other cases, the meaning of the transmission mechanism known for fetching media data is not needed in application service client, application service client (such as, RTP client, RTSP client or DASH client) may be that transmission is unknowable.Such as, application service client does not need to know that bottom transmission mechanism corresponds to unicast protocol or broadcast or multicast protocol.
As discussed in more detail below, agent unit (it also can be called as redirector/agent unit) can be configured to receive request from application service client, and wherein said request specifies some media data.Agent unit can determine whether to use specific transmission mechanism (such as, Radio Broadcasting Agreements or unicast protocol) to fetch media data.Agent unit can make application service client use the one (based on availability, preference, reliability and/or other factors) in transmission mechanism to carry out receiving media data subsequently.Such as, if Radio Broadcasting Agreements than unicast protocol more preferably, then this Radio Broadcasting Agreements is available, agent unit can make application service client carry out receiving media data via Radio Broadcasting Agreements, if and Radio Broadcasting Agreements is unavailable, then agent unit can make application service client via unicast protocol to receive described media data.
As an example, for DASH, media data may as broadcast and/or unicast services available from one or more server (such as, broadcasting server and unicast server).The media that DASH client can receive for the amendment of media data from agent unit (instead of service) express description (MPD), and it indicates this media data to be available.When DASH client sends the request for media data to agent unit, agent unit can determine that unicast protocol or Radio Broadcasting Agreements can be used for fetching asked media data.If Radio Broadcasting Agreements is available, then broadcast reception unit (such as, MBMS (eMBMS) middleware unit of multicast broadcast multimedia service (MBMS) or evolution) can receiving media data, and agent unit can make DASH client send the request for media data to broadcast reception unit.On the other hand, if Radio Broadcasting Agreements is disabled, then agent unit can make DASH client send the request for media data, to use clean culture to fetch media data to unicast server.Alternatively, agent unit can fetch media data from unicast server, then provides fetched media data to DASH client.In some instances, unicast server can correspond to identical server with broadcasting server.
As another example, DESCRIBE, SETUP and PLAY order can be submitted to agent unit for RTP or RTSP, RTP client (alternately, it can correspond to RTSP client).In response to DESCRIBE order, agent unit can to RTP client provide amendment Session Description Protocol (SDP) message.The SDP message of this amendment can authorized agency's unit address as this media data from here can address.The SDP message of this amendment can make RTP client send SETUP and PLAY order to agent unit.Available when agent unit determines Radio Broadcasting Agreements, then agent unit can to broadcast reception unit (such as, MBMS or eMBMS middleware unit) send SETUP and PLAY order, this broadcast reception unit can receive this media data and to RTP client forwarding media data.On the other hand, when agent unit, to determine Radio Broadcasting Agreements unavailable, then agent unit can fetch media data from unicast server, then provides fetched media data to RTP client.
In some instances, the assembly for performing the technology of present disclosure can comprise application service client, agent unit and broadcast reception unit.In various example, client device can comprise random component in these assemblies or all components, separately assembly or its any combination.Alternately, client device can comprise application service client, and agent unit and/or broadcast reception unit can be included in the one or more equipment be separated with client device.
In addition, present disclosure also describes the technology about sending with signal form for the data of time shift buffer (TSB).Client device (at this also referred to as " subscriber equipment ") can memory allocated to form TSB, described TSB for keeping media data, to support various special-effect mode, such as F.F., rewinding, playback etc.In the ordinary course of things, special-effect mode can refer to media data with the order outside the output of definition order or the playback mode of speed playback media data.Such as, in F.F., some media data can be skipped.As another example, in rewinding, can reverse for the output order of media data, and some media data can be skipped.Such as, for video data, in order to skip media data, only showing and use the picture of intra-frame encoding mode coding and skip inter coded images.
According to the technology of present disclosure, such as, in SDP message, data can be sent, for instantiation TSB with signal form.Such as, value in seconds can be utilized to send TSB attribute with signal form, and described value defines the amount of the media data that can be stored in TSB.Client device can calculate the amount of the memory required for TSB based on the value of described TSB attribute.For video data, this calculating may relate to the frame rate of the video data in media data.Client device based on the average magnitude of the data of each image, the quantity of the picture of (based on frame rate) and the time span that defined by TSB attribute in a period of time, can calculate the memory size for TSB.Similarly, client device can also be determined for this time period, the amount of voice data, text data or other data or the memory needed for media.Therefore, client device can distribute these data to perform trick mode to the TSB for store storage media data.In addition, client device can for the data received via Radio Broadcasting Agreements (such as MBMS or eMBMS) to perform special-effect mode.
In other words, in some instances, the technology of present disclosure comprises middleware framework, and it is for supporting the feature that the real-time protocol (RTP)/real-time streaming protocol (RTP/RTSP) on the multicast broadcast multimedia service of evolution (eMBMS) network is transmitted as a stream.These functions comprise time shift buffer and transmission diversity (such as, to switch multicast for the clean culture of delivery of content or vice versa).For time shift buffer (TSB) feature, this framework can support the expansion of Session Description Protocol (SDP), to comprise with the data of the signal form transmit buffer degree of depth.As an example of transmission diversity feature, present disclosure presents a kind of framework, in described framework, the application consuming content does not need to know the details switched from the transmission unicasting to broadcast (or vice versa), because this switching can manage in middleware rank.
In HTTP stream transmission, the operation often used comprises GET and part GET.Fetching of the whole file that GET operation requests and given Uniform Resource Identifier (URI) (such as, URL or URN) are associated.Fetching of bytes range (subset) of part GET operation requests resource.Therefore, GET or part GET operation for HTTP stream transmission, video segment can be provided, this is because can fetch one or more independent video segment.In video segment, not co-orbital some stable segments may be there is.In HTTP stream transmission, media expression can be the structured set of the addressable data of client.Client can ask and downloads of media data message to express streaming services to user.
Using HTTP to transmit as a stream in the example of DASH data, for the video and/or audio data of content of multimedia, multiple expression (representation) may be there is.The inventory (manifest) of this expression can be expressed to describe in (MPD) data structure at media and be defined.Media express the structured set that can correspond to addressable, the device data of HTTP streaming client.HTTP streaming client equipment can be asked and downloads of media data message, expresses streaming services with the user to client device.Can describe media with MPD data structure to express, it can comprise dynamically updating of MPD.
Media representation can comprise the sequence of one or more period.In MPD, the period can be defined by period unit.In MPD, each period can have attribute start.This MPD can comprise start attribute for each period and availablityStartTime attribute.For real time service, the start attribute of described period and the summation of MPD attribute availableStartTime can with the up durations of UTC form set period, first media segment (Segment) of each expression particularly in each period.For on-demand service, the start attribute of the first period may be 0.For any other period, start attribute can specify the time started of corresponding period relative to the first period time started between time migration.Each period can extend, until the beginning of next period, or in the end the period when, until the end that media are expressed.The time started of period may be accurately.They may reflect the actual sequential caused from the media playing all periods in early stage.
Each period can comprise the one or more expressions for same media content.A kind of expression can be one in several alternative version of codes of audio frequency, video or other data.This expression can be different due to type of coding, such as, and bit rate, resolution and/or for video data and bit rate, language and/or the encoding and decoding for voice data.Term represents can be used to refer to the audio or video data of coding or the section of other media or data, and it corresponds to the concrete period of institute's media content, and is encoded in a concrete fashion.
The expression of physical segment can be assigned to group, and described group indicated by the group attribute in MPD.Expression in same group is considered to mutually alternative usually.Such as, each expression of the video data of concrete period can be distributed to identical group, make any expression in described expression to be selected for decoding, with the video data of show needle to the content of multimedia of corresponding period.In some instances, the media content in the period by any one expression (if present) from group 0, or can represent from the combination represented at the most of each non-zero groups.Time series data for each expression of period can represent relative to the time started of this period.
Expression can comprise one or more sections.Each expression can comprise initialization segments, or each section of each expression can self-initialize.When it is present, initialization segments can comprise the initialization information for accessing this expression.In the ordinary course of things, initialization segments does not comprise media data.Section can use identifier to quote uniquely, and described identifier is Uniform Resource Identifier (URI) (such as, URL(uniform resource locator) (URL) or unified resource name (URN)) such as.MPD can provide identifier for each section.In some instances, MPD can also provide bytes range with the form of range attribute, and corresponding by reference URI, range attribute can correspond to the data for the section of the successive byte scope in addressable resource (such as, file).
Each expression can also comprise one or more media component, and wherein each media component can correspond to the independent medium type of of version of code, as audio frequency, video or timing text (captions such as, for closing).In representing at one, it is Time Continuous that media component can cross over continuous print media section boundary.
Technology described herein can be used for above-mentioned wireless network and wireless technology and other wireless network and wireless technology.For the sake of clarity, describe some aspect of these technology below for LTE, and use and LTE term in following major part describes.
RTP/RTSP stream transmission is the common protocol for supporting Real Time Streaming to serve.The framework of the rtp streaming formula transmission on Long Term Evolution (LTE) network is described in 3GPP specification for eMBMS service.But, in the disclosure content, recognize the two problems of RTP/RTSP, and discuss the technology that may be used for overcoming these problems.
Time shift buffer (TSB) is the feature that may be used for storing a part of media content in subscriber equipment (UE).This buffer allows user the playback point of media content to be moved forward or backward.In this process, need notice UE buffer depth, this degree of depth provides to be needed to add up to equal content how long to allow the instruction of special effects mode playback (such as, F.F. or rewind playback) at equipment place to UE.In a realization of VLC media player, by being provided as the buffer depth of parameter to VLC player when starting, enable TSB feature.This process is not automatic, but needs the intervention of user conversely, to provide buffer memory depth parameter, thus enables TSB.This disclosure has described the technology for supporting TSB at the middleware layer (as multicast service device clients (MSDC)) enabling eMBMS.
Session Description Protocol (SDP) describes a kind of terminal point information and Media Stream (session) relevant parameter thereof of streaming services, is referred to as " session profile ".Therefore, if transmission service is available in different transmission methods during stream, then multiple profiles of the difference transmission/endpoint parameter described for service are needed.Such as, broadcast in real time can refer to Multicast IP Address for its Media Stream and port based on the service of RTP, and the unicast version of service can refer to unicast ip address and port.For broadcast and unicast transmission method, the difference that may there is Media Stream represents.In the lte networks, MSDC provides the transmission of streaming services to the application of enabling eMBMS.In order to support to switch between clean culture He other (such as, broadcast or multicast) transmission methods, need to use multiple session profile, its select by mainly based on UE be broadcast coverage outside or interior.When UE moves to broadcast coverage areas, MSDC can use the version enabling broadcast of SDP profile to connect, and consumes content.But in contrary scene, when UE shifts out broadcast coverage, MSDC may need to use clean culture SDP and set up clean culture with long-range RTSP server to be connected, to consume unicast content.In order to hide the conversion between clean culture and broadcast to user or application, this disclosure has described a kind of mechanism for bumpless transfer.
Except other technology, this disclosure has described about the support technology of TSB and the technology for supporting switching, it can be used alone, use together and/or use with the other technologies combination in any that describes in present disclosure.In order to enable TSB feature based in the stream transmission of RTP on eMBMS, this disclosure has described the technology for using the expansion of SDP mechanism to carry out the depth value sending time shift buffer with signal form.For transmitting switching problem, this disclosure has described the unified approach described for SDP, described SDP describes and comprises both clean culture and broadcast description.In addition, in order to make the conversion between broadcast and clean culture be seamless to application/user, this disclosure has described a kind of solution based on middleware, wherein middleware uses unified SDP to carry out being redirected of contents processing, this process is hidden to user.
According to the aspect of the theme of present disclosure, provide in client device or cluster tool carry out method, device and the framework disposed, to provide level of abstraction, wherein, multiple dissimilar transmission mechanism/agreement (e.g., eMBMS, digital video broadcasting (DVB) etc.) may be used for such as transmitting metadata and digital content to the application of client.Application does not need the details recognizing each individual transmission.Present disclosure can comprise the selection to configurable strategy set, and described policy bit may be used for determining to be delivered to the timing of the selection of the data of application and metadata, position or availability.
The application of accessing web content on the internet can use universal resource identifier (URI) to identify content, and described URI may utilize the resource locator (URL) in HTTP or HTTP safety (HTTPS) scheme.Such as, in the context of MPEG-DASH, use HTTP or HTTPS agreement, the URL be included in HTTP or HTTPS scheme can be solved and quote.In addition, HTTP can be used for obtaining the data quoted by URL.DASH standard can utilize non-HTTPURL, and present disclosure can relate to the situation of any request (comprising based on HTTP request) processed in a flexible way from client, this provide following selection: making to call request is directed to different positions in the different time, and/or instruction requesting client access replacement.
The technology of present disclosure may relate to process client to the example of the redirector function of the request of content.Redirector (herein also referred to as redirector/agency) can be can apply process to the material identified in client-requested, call method or algorithm, the result of this process and the table of match-on criterion are compared, and indicate alternative position, access method, timing information or content (such as to client, hereof), thus client can know where perform subsequent request.In yet another aspect, redirector can represent the request of client executing for content, and obtains the content of asking.In this case, redirector can serve as agency or recursive function unit.
Fig. 1 shows the block diagram of the example system 100 for supporting transmission diversity.This example system 100 can comprise the application 101 of such as mobile device.Application 101 can perform the request to content.Such as, DASH multimedia playback application process inventory or MPD, and determine the URL comprising metadata and data, and send HTTP request.Protocol port that is predetermined, pre-configured or that dynamically determine (such as, using TCP or UDP) can be used to the request of content, such as, be generally used for the agreement of the function of " agency " that configure Web browser.Use configuration file can be comprised to the determination of protocol port, such as, such as acting on behalf of by user or network/system keeper the configuration file set up in automatic configuration (PAC) file, or automatically finding the configuration file set up in the agreement of agreement (WPAD) via such as web proxy.
Redirector/agency 104 can receive the request of application 101 via application service client 102, and processes or resolve this request, to determine asked content.Result and the table (or data structure of other suitable type) comprising match-on criterion can compare, to determine whether to mate by redirector/agency 104.If there is coupling, then redirector/agency 104 can determine redirection target.Target can be delivered to application 101.In yet another aspect, redirector/agency 104 can operate in a recursive manner and apply 101 may not need process redirection target.Such as, redirector/agency 104 can represent application 101 based on redirection target and obtain content.
Redirector/agency 104 can be positioned on same equipment with application 101, or redirector/agency 104 can be positioned on independent equipment.When the redirector/agency 104 of common location, application 101 can be passed through HTTP, API (API), interprocess communication (IPC) etc. and communicate with redirector/agency 104.When redirector/agency 104 is positioned on independent equipment, application 101 can be communicated with redirector (via application service client 102) by HTTP etc.
After determining " coupling " (or not mating), redirection target can be supplied to application 101.This target can indicate the replacement object that will access, with the content objective replacing application 101 to ask.The various methods by it, redirection target being indicated to application 101 may be there are.
Signal transmissions between the assembly of system 100 can use API or IPC to perform.In this, API or IPC mechanism can be used between redirector/agency 104 and application 101 and provide communication.When using API, redirector/agency 104 can call the method or program that realize in application 101 or application library, indicates redirection target.
Signal transmission between the assembly of system 100 can be rewritten by metadata and perform.In this, metadata (such as, DASHMPD) can be rewritten, so that the alternative of denoted object is quoted.Such as, the URI in original metadata can be rewritten, to be formed for accessing alternative URI that is equivalent or replacement content.
Signal transmission between the assembly of system 100 can use the instruction in communication protocol to perform.In this, application layer communication protocol (such as, HTTP) can to use to the mode of application 101 command transmitting information.In a modification, the http response code (such as, this can correspond to form is the code of 3xx, and wherein x may be the number from 0 to 9) of " being redirected " classification can be used.In a sub cases of this modification, such as, code 300 (instruction multiple choices can be used) can be used, wherein, redirector/agency 104 provides the vector quoted (such as, URI), and application 101 can select one or more use from it.
Matching feature can provide the result that the target being derived from application 101 quotes the comparison that (such as, asking URI) quotes with the target in data structure (such as, file, database, matching list etc.).
By the mode of non-limiting example, in one aspect, match-on criterion can be expressed as URI prefix, and single Optimum Matching is indicated by the coupling with longest-prefix (such as indicating, as the number by position or byte is determined common).In yet another aspect, each potential coupling can be assigned with corresponding priority number, and can select the entry of the priority number with maximum (or minimum).
In yet another aspect, matching criterior can be expressed as regular expression, and the coupling character of maximum quantity can be used to determine preferred coupling.In another kind of modification, regular expression can be used for expression matching standard, and can select the potential coupling with maximum (or minimum) priority number.
The matching algorithm of data structure discussed above or content can based on being determined in advance or pre-configured strategy.In yet another aspect, can dynamically add from logic strategy database or delete described strategy.Policy database can use various data structure to realize, and is not limited to data structure or the database realizing of any particular type.
Strategy may be used for the operation determining matching algorithm in many ways, described various ways comprises such as: the match-on criterion from a source is carried out priorization compared to the match-on criterion from other sources or goes priorization (such as, a transport-type can be ace-high/not ace-high); According to source, time, redirection target and/or match-on criterion value, remove match-on criterion; According to source, time, redirection target and/or match-on criterion value, add match-on criterion; And/or according to source, time, redirection target and/or match-on criterion value, amendment match-on criterion.
Example system 100 can comprise transmission middleware 110, carrys out request content for based on the position of being redirected.Transmission middleware 110 can comprise multiple transmission mechanism/agreement, if transmission A110A is to transmitting R110R.Each transmission mechanism (transmission A110A is to transmitting R110R) may have corresponding module, and described module can obtain list and the details of fileinfo, and generation such as gathers (summarizing) URI or public URI prefix.This information can to pass to via communication mechanism (such as, IPC, API or agreement) by these modules can the controller 106 of implementation strategy and resolution, and this may make redirector/agency 104 affect by strategy conversely.Transmission mechanism (transmission A110A to transmitting R110R) can comprise other DVB-race broadcast technology etc. of such as eMBMS, DVB-T2, DVB-S.Each transmission middleware can comprise the Cache for perhaps other data in storing.Such as, transmission middleware can the initial segment of cache content, and it is instantaneous that the delivery of content to application 101 may be seemed user.Transmission middleware 110 can from the source request content of such as content server 120.Additionally or alternati, client can ask the content on network (comprising the Internet 122).For the redirector/agency 104 being configured for agency's " recurrence " and operating, redirector/agency 104 via transmission middleware 110 or can carry out request content via network or the Internet 122.Redirector/agency 104 can be preconfigured to be and operate with in redirection function or agent functionality.Can operationally between such as determine the function of redirector/agency 104 based on one group of rule.
Fig. 2 A-2B shows the alternate examples of device, and described device comprises the redirector/agency 104 for supporting transmission diversity.Redirector/agency 104, the controller 106 with policy database 108 or transmission middleware 110 can be co-located on same equipment with application 101 and client, or can be positioned at equipment separately.In the example of Fig. 2 A, system 200A comprises redirector/act on behalf of 104A, and it is shown as with client and applies 101 and be co-located on UE101A.Such as, application service client 102A can be DASH client, HTTP real time flow medium (HLS), apple Streaming Media (ALS) client, adaptive H TTP Streaming Media (AHS) client or any other suitable client.Application service client 102A can via HTTP, API, IPC or any other suitable agreement or mode and redirector/act on behalf of 104A to communicate.In the example of Fig. 2 B, system 200B comprises redirector/act on behalf of 104B, and it is depicted as to be positioned on independent entity 110, and application service client 102B and application 101 are arranged in UE101B.Such as, application service client 102B can be DASH client, HLS (ALS) client, AHS client or any other suitable client.Application service client 102B can via HTTP or any other suitable agreement or mode and redirector/act on behalf of 104B to communicate.Redirector/act on behalf of 104B can be positioned on any suitable network entity, such as proxy server, gateway, router etc.
Fig. 3 shows the flow chart using and be configured the aspect of carrying out the example process flow 320 redirecting operation redirector/agency.Before process streams 320 starts, policy database 108 (being coupled to controller 106) can provide or the pre-configured policy information with action for determining controller 106.In setup time, policy database 108 can be provided has information.
Application 101, its may to or may not be relevant with the application 101 in Fig. 1, may be configuration apply.Application 101 can be configured to activate transmission middleware 110 (321), and determines the state for transmission middleware 110.Application 101 can be configured to the one or more transmission mechanisms activating transmission middleware 110.Application service client 102 can be configured to have the information (such as, Hostname or address, agreement or protocol port number) (322) for recognition agent end points by application 101 when starting at first.
In this example, more than one transmission mechanism may be available, and various media may be available in the different time in various transmission.Especially, various service may be available, and wherein various service may define the transmission (as broadcast, multicast, clean culture etc.) of the different respective type for transmission of media data separately.Such as, one or more in the DVB race of eMBMS and/or transmission may be available.In addition, such as application program service can be used to describe and to represent available media content (such as, file).The example that application service describes is MBMS user's service describing (USD) metadata clips, and be such as passed MPD fragment when serving as MBMS user in DASH content, it describes various available media component.It is apple HLS (HTTP Real Time Streaming) inventory file that application service describes another example, when HLS content be passed serve as MBMS user.Each transmission mechanism can have corresponding module, and described module can obtain list and the details of fileinfo, and generation gathers URI or public URI prefix.These modules can via communication mechanism (other agreements of such as IPC, API) to the controller 106 of application strategy and resolution transmitting this information, and this makes redirector/agency 104 affect by strategy conversely.
Content server 310 can broadcast the service list (such as, USD, ESG) received by transmission middleware 110 (such as using LTERAN, DVB-T etc.).Suitable module (such as, transmitting in 110A to transmission R110R) analysis service list be the specific form of non-transmitting by information processing.Result (such as, define the service of available listed files and the identifier of data, be also referred to as the availability list of file) can be sent to controller 106 (324) by transmission middleware 110.Controller 106 can process this file availability list and access strategy, to generate one group of mapping (325).Mapping can comprise which URI (or URI prefix) should be redirected to (such as which server, from instantiating services device, file on MBMS may be available, described instantiating services device is associated in MBMS middleware or with MBMS middleware)
Once application service client 102 is called, then application service client 102 can send request (such as, HTTP request) to obtain such as MPD content (326) via the agent address be configured.This request can be sent to redirector/agency 104.Redirector/agency 104 can perform matching algorithm to determine match-on criterion, or, if do not mate generation, then determine another designator (such as, giving tacit consent to redirection target, mistake instruction or the duplicate of raw requests).Redirector/agency 104 such as can use HTTP to provide to application service client 102 subsequently and redirect target or mistake (327A).After observing instruction redirected code (such as, HTTP code) (such as, 3xx type code), application service client 102 depends on type of code to respond.Such as, the type of code except 300 comprises HTTP " position: " head, its can pointer to the alternative site of resource.When receiving this instruction, application service client 102 can use indicated alternative site again to attempt its request.In this example, redirector/agency 104 indicates specific URI should be directed to the server be integrated in MBMS middleware.Therefore, application service client 102 in response to this redirected code, can submit request to, to obtain such as MPD (327B) to transmission middleware 110.
Once application service client 102 has obtained MPD information, then application service client 102 can be determined will access which media segment (such as, when MPEG-DASH, which " expression "), and send the request (328) based on HTTP to redirector/agency 104.Use above-mentioned mechanism (such as, the transport-type be associated with the service that service ID identifies), redirector/agency 104 can provide redirection target (329) to application service client 102.Described target may be default value, the copy of request (instruction application service client 102 should process this request) or quoting different servers.This target subsequently as the position used by DASH client 102 to obtain media fragment.That is, suppose to use this service, content is available, then application service client 102 can submit content requests (330A) to transmission middleware 110, and responsively, transmit middleware 110 and this content can be sent to application service client 102 (331A).For by other sources can content (such as, when service unavailable), application service client 102 can obtain this content (such as, from other server, memory/cache device or the Internet) via additive method.Such as, application service client 102 can send and send content requests (330B) to content server 310, and responsively, the content (331B) that content server 310 can be asked to application service client 102 transmission.
In some cases, the URI (in step 326 or 328) asked from application service client 102 may be unknown concerning redirector/agency 104.In this case, can generation error (such as, HTTP code 404), to indicate application service client 102: it can attempt asking different sections, or stop using HTTP redirection device/agency 104 (such as, substitute, use direct internet access request).Alternately, redirector device 104 can use the position head being equivalent to the request of importing into, to imply non-proxy operation.Redirector/agency 104 may be related on the other hand and serve as agency or web proxy, in this case, it can represent application service client 102 and visit the Internet or another network or Cache, as following shown in the example process flow 400 of Fig. 4.
For the HTTP error code of 300 types, application service client 102 can be presented the selectable vector of tool, it may not be present in " position: " head.In this case, application service client 102 can depend on media coding format, selects in the multiple choices provided, and reinitializes its decoded state.Following scene may occur, such as, occurring in the middle of the playback scenario represented if be redirected, described expression is that the coded system being different from this application service client 102 coded system treated so far different is encoded.
No matter application service client 102 uses any process to select its next media request/access, and application service client 102 can initiate request/access based on redirection information.Subsequent request/access can be transmitted by redirector at first, and provide following chance: redirector is got involved and effectively revises the position (and further feature) from its section of fetching (such as, being stored as location metadata and/or the media segment of file).
Fig. 4 shows the flow chart using and be configured to carry out the aspect of the example process flow 400 of the redirector/agency of agent operation.Before process streams 400 starts, policy database 108 (being coupled to controller 106) can provide or the pre-configured policy information with action for determining controller 106.In setup time, policy database 108 can be provided has information.
Application 101 can be configuration application.Although describe application 101 relative to Fig. 1, it should be understood that this application need not be identical with the application described about Fig. 2.Application 101 can be configured to activate transmission middleware 110 (401).Application 101 can be configured to the one or more transmission mechanisms activating transmission middleware 110.Application service client 102 can be configured to have the information (such as, Hostname or address, agreement or protocol port number) (402) for recognition agent end points by application 101 when starting at first.
In this example, more than one transmission mechanism may be available, and various media may be available in the different time in various transmission.Various types of transmission can be defined by respective service.Such as, one or more in the DVB race of eMBMS and/or transmission may be available.In addition, available media file can use such as, and the MPD fragment of this eMBMSUSD represents, and transmits for DVB via DVB electronic service guidebooks (ESG).The various transmission mechanisms represented by transmission middleware 110 can have corresponding module, and described module can obtain the list of available service and file info details, and for generation of gathering URI or public URI prefix.These modules can via communication mechanism (other agreements of such as IPC, API) to the controller 106 of application strategy and resolution transmitting this information, and this makes redirector/agency 104 affect by strategy conversely.
Content server 310 can be broadcasted by transmission middleware 110 (403 service lists (such as, USD, ESG) received.Suitable module (such as, transmitting in 110A to transmission R110R) analysis service list be the specific form of non-transmitting by information processing.Result can be sent to controller 106 (404) by transmission middleware 110.Controller 106 can process and map (405) to generate one group in file availability list and access strategy.Mapping can comprise which URI (or URI prefix) should be redirected to the server of which instantiation (such as, the upper available file of MBMS or media may be available from instantiating services device, and described instantiating services device is associated in MBMS middleware or with MBMS middleware).
Once application service client 102 is called, then application service client 102 can send request (such as, HTTP request) to obtain such as MPD content (406) via the agent address be configured.This request can be sent to redirector/agency 104.Redirector/agency 104 can perform matching algorithm to determine match-on criterion, or, if do not mate generation, then determine another designator (such as, giving tacit consent to redirection target, mistake instruction or the duplicate of raw requests).In case of an error, mistake can be supplied to application service client 102.If mated, then redirector/agency 104 can serve as agency, and represents application service client 102 to fetch content.Then target as the position used by redirector/agency 104 (it serves as agency), obtains media segment.That is, redirector/agency 104 can to transmission middleware 110 submit content requests (407A) to, and transmit middleware can by this content delivery to redirector/agency 104 (408A).For by other sources can content, redirector/agency 104 (it serves as agency) can obtain content via other servers from memory/file or the Internet.That is, redirector/agency 104 can submit content requests (407B) to content server 310, and content server 310 can by asked delivery of content to redirector/agency (408B).
Fig. 5 shows a kind of flow chart of illustrative methods, and described illustrative methods is used for the multimedia client for cordless communication network (WCN), supports the transmission diversity be associated with content of multimedia.Multimedia client can be maybe can comprise mobile entity.At 502 places, method 500 can comprise the request received for content.At 504 places, method 500 can comprise determines whether exist for the coupling of request based on one group of rule.At 506 places, method 500 can comprise mates in response to determining to exist, and sends be redirected to multimedia client.
Fig. 6 shows the block diagram of exemplary means 600, described exemplary means 600 can be configured to UE, network entity or other suitable entity, or for the processor, assembly or the similar devices that use in UE, network entity or other suitable entity, for the multimedia client for cordless communication network (WCN), support the transmission diversity be associated with content of multimedia.Device 600 can comprise functional block, and it can represent the function implemented by processor, software or its combination (such as, firmware).
As shown in the figure, in one example in which, device 600 can comprise for receiving electric assembly for the request of content or module 602.Device 600 can comprise for determining the electric assembly that whether exists of coupling for request or module 604 based on one group of rule.Device 600 can comprise for there is coupling in response to determining, sends the electric assembly or module 606 that are redirected to multimedia client.
In related fields, when device 600 is configured to network entity, device 600 can comprise the processor module 610 with at least one processor alternatively.In this case, processor 610 can carry out operative communication via bus 612 or similar communicative couplings and assembly 602-606 or similar parts.Processor 610 can realize the scheduling of initiating and dispatching process or the function performed by electric assembly or module 602-606.
In further related fields, device 600 can comprise for carrying out with other network entity the network interface components 614 that communicates.Device 600 can comprise the assembly for storing information alternatively, such as, for example, and memory devices/assembly 616.Computer-readable medium or memory assembly 616 can be operatively coupled to other assembly of device 600 via bus 612 etc.Memory assembly 616 can be suitable for storing computer-readable instruction and data, for activity and its sub-component of executive module 602-606 or processor 610.Memory assembly 616 can remain with the instruction for performing the function be associated with assembly 602-606.Although it is outside to be shown in memory 616, should be understood that, assembly 602-606 can exist in memory 616.
Fig. 7 and 8 shows the block diagram for supporting the aspect of transporting diversity.The assembly of Fig. 7 and/or 8 can be substantially corresponding with the assembly of Fig. 1 described above.Such as, Fig. 7 shows network 700, application service client 702, media application 704, HTTP redirection device/agency 706, controller 708, middleware 712 and policy manager 716.Media application 704 is generally responsible for selecting media content (such as, selection in response to user), and application service client 702 is configured to fetch selected media content, and fetched media content is supplied to media application 704 to carry out playback.Application service client 702 can comprise such as DASH client, and described DASH client is configured to utilize HTTP to carry out streaming transmission of media data.
As above about Fig. 1 discuss, application service client 702 directly can fetch media data from network 700 or from middleware 712.Such as, when supporting that the service of broadcast or multicast is available (such as, determined by controller 708, and the strategy stored by policy manager 716 defined), middleware 712 can receiving media data, and is stored in Cache 714 by received media data.Application service client 702 can send request for media data to redirector/agency 706.When asked media data is received by middleware 712, HTTP redirection device/agency 706 can to the redirected request for media data of middleware 712.Therefore, application service client 702 can send HTTP request to middleware 712, and its middleware 712 can provide media data to application service client 702.On the other hand, when middleware 712 does not receive media data, application service client 702 can be redirected to the network site that media data is available server by HTTP redirection device/agency 706, and wherein, this server may be available via network 700.
As another example, Fig. 8 shows DASH client 802, playback application 804, HTTP redirection device/agency 818, controller 814, MSDC808, MBMS transmitting element 820 and policy database 816.These assemblies can be substantially corresponding with the assembly of the similar title of Fig. 1 and/or Fig. 7.Usually, the technology of Fig. 8 is discussed as and utilizes DASH (it utilizes HTTP conversely), but it should be understood that and also can use other streaming protocols.Such as, about RTP/RTSP, alternative example is discussed below.
At first, policy information can be supplied to the system comprising DASH client 802, playback application 804, HTTP redirection device/agency 818, controller 814 and MSDC808.This policy information can be stored in (830) in policy database 816.This policy information may affect the action of controller 814.Controller 814 can realize with hardware, software, firmware or its combination in any.Infer, when realizing with software and/or firmware, also may provide required hardware, such as one or more hardware based processing unit, it is for performing the instruction of the software corresponding to controller 814.
At first, playback application 804 can provide identifying information, such as, for the information (832) of recognition agent end points (such as, Hostname or ground, agreement and protocol port number).This information should be able to be used to provide by optional configuration.DASH client 802 can configure has identifying information (834).
In the example of fig. 8, more than one transmission may be available, and various media (such as, hereof) may be available in the different time in various transmission.Consider, such as eMBMS and DVB transmission is available.Further consider that using application service to describe represents available media file.Each transmission can have corresponding module, and described module can obtain list and the details of media information, and produces and gather URI or public URI prefix, as shown by the transport module 110A-110R of Fig. 1.Illustrate only MSDC808 in the example of fig. 8, but it should be understood that MSDC808 can comprise multiple respective transport module.These modules are via communication mechanism (such as, IPC, API or agreement) to controller 814 transfer files information, and described controller 814 can application strategy and resolution, and this makes redirector/agency affect by strategy conversely.Fig. 8 illustrate only the part for MBMS (restriction clutter).MBMSrX820 may receive USD (836), and resolves/transmit USD (838) to MSDC808.
Specific for USD information processing is the specific form of non-transmitting and result is sent to controller 814 (840) by MSDC808.Controller 814 can process file availability list subsequently and access strategy maps (842) to generate one group.This mapping indicates which URI (or URI prefix) should be redirected to the server of which instantiation (such as, file available on MBMS may be available from server 812, its in MSDC instantiation or be associated with MSDC).In other words, HTTP redirection device/agency 818 can obtain map information, described map information is based on the service for fetching media data, by the maps identifiers for media data to resource location, wherein, described service definition is at least one in the polytype transmission (such as, broadcast, clean culture or multicast) of transmission of media data.Such as, when MSDC808 can receive data, service can be defined for the broadcast or multicast transport-type of transmission of media data.The media data received can be stored in Cache 810 by MSDC808, is fetched, as discussed below for follow-up by such as DASH client 802.
Once called, DASH client 802 can send HTTP request, to obtain MPD content (844) via the agent address (to HTTP redirection device/agency 818) of configuration.Similarly, HTTP redirection device/agency 818 can receive the HTTP request from DASH client 802.HTTP request can be the request for media data.HTTP redirection device/agency 818 can perform matching algorithm to determine match-on criterion, or, if do not mate generation, then determine another designator (such as, giving tacit consent to redirection target, mistake instruction or the duplicate of raw requests).Therefore, use the match-on criterion about map information, HTTP redirection device/agency 818 can determine that specific service is available, and such as, definition broadcast or multicast is for the service transmitting the media data of asking.Subsequently, HTTP redirection device/agency 818 based on matching algorithm, can use HTTP to provide to DASH client 820 and redirects target or mistake (846).
Observe the DASH client 802 of the HTTP code (such as, 3xx type HTTP code) that instruction is redirected, type of code can have been depended on respond.For except 300 type, HTTP " position: " head can pointer to the alternative position of resource.When receiving this instruction, DASH client 802 can use indicated spare space again to attempt its request.In this example, HTTP redirection device/agency 818 can indicate specific URI should be directed to the server be integrated in MSDC808, and DASH client 802 can obtain MPD (848) from this server.
Once DASH client 802 has obtained MPD information, DASH client 802 can be determined will access what media file (such as, when MPEG-DASH, which " representative "), and send one or more request based on HTTP to fetch determined media file (852).Use above-mentioned mechanism, HTTP redirection device/agency 818 provides redirected target (854) to DASH client 802.This target can be default value, the copy of request (instruction client should process this request) or quoting different servers.This target subsequently as the position used by DASH client 802 such as to obtain media fragment (856) from MSDC808.By this way, when broadcast or multicast when service definition such as transport medium is available, HTTP redirection device/agency 818 can make DASH client 802 receive the media data of asking (such as from unit, MSDC808), described unit uses service from the resource location receiving media data indicated map information.Alternately, redirection target can correspond to via the available network site of some network (comprising the Internet 806).
In some cases, may be unknown from the URI (step 845/852) of client-requested concerning HTTP redirection device/agency 818.In this case, can generation error (such as, HTTP code 404), should attempt to indicate DASH client 802:DASH client 802 asking different sections, or change and do not use HTTP redirection device/agency 818 (that is, being replaced in use straight-forward network or internet access request).Alternative, HTTP redirection device/agency 818 can use the position being equivalent to the request of importing into: head, to imply non-proxy operation.Further modification will comprise HTTP redirection device/agency 818 and serve as conventional web and act on behalf of, and in this case, HTTP redirection device/agency 818 can represent DASH client 802 and access the Internet 806.
By this way, the technology of Fig. 8 represents a kind of example of method, described method comprises: by agent unit (such as, HTTP redirection device/agency 818) carry out following operation: obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission (such as, broadcast, multicast or clean culture) of multiple types of described media data; The request for described media data is received from application service client (such as, DASH client 802); Determine whether described service is available; And when described service is available, making described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
In addition, if resource location corresponds to network site (such as, on position in the Internet 806 or via addressable position, the Internet 806), whether the described media data that then HTTP redirection device/agency 818 can be configured to determine to specify in described request mates with the described media data in described map information, and when the described media data of specifying in described request mates with the described media data in described map information, redirect message is sent to described application service client, described media data is fetched from described network site to make described application service client, the described network site that wherein said redirect message specifies the described maps identifiers for described media data to arrive in described map information.
Similarly, HTTP redirection device/agency 818 represents the example of agent unit, described agent unit is configured to obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission (such as, broadcast, multicast or clean culture) of multiple types of described media data; The request for described media data is received from application service client; Determine whether described service is available; And when described service is available, making described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
Fig. 9 and Figure 10 shows the exemplary MSDC framework for supporting RTP/RTSP to transmit as a stream.Fig. 9 shows the framework without TSB feature, and Figure 10 shows the framework supporting TSB.In these examples, TSB will keep in middleware.The arrow of numbering to represent from network layer to middleware and the data flow of most Zhongdao RTSP/RTP client.Particularly, the data received by LTE modulator-demodulator are provided to the IP storehouse supporting multicast (or broadcast).IP storehouse provides received data (901) to RTP (RTP) functional unit of MSDC middleware, and described RTP functional unit performs forward error correction (FEC) process to data.Then these data are provided back IP storehouse (902).Then data are supplied to RTP client (903) by IP storehouse.
In the example of Figure 10, MSDC1010 can support TSB1012.Therefore, in the example of Figure 10, the data received by LTE modulator-demodulator are provided to the IP storehouse supporting multicast (or broadcast).IP storehouse provides received data (1001) to RTP (RTP) functional unit of MSDC1010, and described RTP functional unit performs forward error correction (FEC) process to data.Then, by data buffer storage in time shift buffer (TSB) 1012 (1002).IP storehouse can receive this data at reasonable time from TSB1012 (1003) subsequently, and these data are supplied to RTP client (1004)
In addition, as described in more detail below, MSDC1010 can receiving package containing the SDP message of attribute, described attribute definition is for the TSB degree of depth of the time shift buffer (TSB) of Figure 10.MSDC1010 can based on such as send with signal form in SDP message, the value of attribute, determine the amount of the memory of TSB1012.Such as, the value of this attribute can limit the length of TSB, such as, about the playback number of seconds for the media data that will be stored in TSB1012.Therefore, MSDC1010 based on such as the frame rate of the video data of the media data that will receive and based on the playback number of seconds that will be buffered in potentially in TSB1012, can determine the amount of the memory by being assigned with to be formed TSB.MSDC1010 can distribute the amount of determined memory for TSB1012 subsequently, and in TSB1012, stores the media data received that is associated with SDP message at least partially.
In order to represent the TSB degree of depth with signal form, the technology of present disclosure also can be used to utilize the extension mechanism of SDP.SDP " a=" (attribute) row may be used for providing the expansion described general session.Semanteme below can be used to represent data about TSB, as an example with signal form:
TSB-attribute=“a=tsb-length:”Value
Value=token
Valuewillhavesecondsasunit
As an example, the SDP fragment next mentioned in Table 1 describes the data for TSB.Buffer depth is in this example 60 seconds, or 1 minute.This means that MSDC (TSB of the MSDC such as, shown in Figure 10) will remain in its time shift buffer the media content equaling a minute.According to the technology of present disclosure, the text representation of band underscore in the form " a=" row, about the Exemplary attributes of TSB.
Table 1
When providing the data for described TSB in sdp, described MSDC can distribute the buffer of the equal parts of the size mentioned in sdp, and RTSP/RTP client can be allowed about the period F.F. of buffer memory or rewind playback.
U.S. Provisional Application sequence No.61/752 based on being submitted on January 5th, 2013 by people such as Fall for realizing an example technique of transmission diversity, 456 solutions proposed, " ARCHITECTURESUPPORTINGTRANSPORTDIVERSITY; " agency case 131286P1 (will be called " Fall provisional application " below), is incorporated to the full content of this application herein by reference.Fall provisional application proposes the general purpose client framework for supporting diversity transmission agreement.Present disclosure for supporting that the technology of the transmission diversity in RTP can be used to spread F all provisional application, it relates to the transmission based on DASH of content.
Be different from DASH agreement, expressing at media the media representation described in (MPD) may change based on transmission diversity method, and Real-time Transport Protocol has no idea directly to distinguish transmission diversity via single SDP profile usually.This disclosure has described the example technique realizing transmission diversity.
As an example, service eMBMS broadcast service limits and allows mechanism to select between clean culture and broadcast transmission mechanism.Such as, deliveryMethod element in eMBMS service definition pattern can comprise the SDP profile describing broadcast delivery session, and AlternativeAccessDelivery element may comprise quoting the RTSPURL accessed for clean culture, or comprising PSSSDP file, it represents clean culture SDP session information.When UE is under broadcasting network coverage, eMBMS middleware can use broadcast SDP session information to consume broadcasted content.Otherwise this middleware can carry out transferring content by the unicastAccessURI be connected in AlternateAccessDelivery.The example of this eMBMS user's service describing (USD) schema fragment is shown in Figure 11.
Have unified single SDP to the alternative example of the deliveryMethod carrying broadcast SDP and clean culture access URI, it comprises both clean culture and broadcast session description in different Media Streams.Because any conversation description in SDP can comprise the definition of multiple Media Stream (such as, one for audio track, and another is for video track), employment mechanism broadcast and unicast media stream can be combined into different set, to provide unified SDP profile.This can be realized by group technology in sdp.The example of grouping mechanism is described below
Mediastreamidentification
a)Identifiesmediastreamswithingroups
b)Media-attribute=“a=mid:”Identification-tag
c)Identification-tag=token
Groupattribute
d)Identifiesunicast/broadcastmediastreams
e)Group-attribute=“a=group:”Semantics(identification-tag)*
f)Semantics=“BROADCAST”|“UNICAST”
Following fragment in table 2 provides example, in the example illustrated, provides the value for group and media stream identifier attribute.In example below, which Media Stream of " a=group: " line display is used for broadcast and which Media Stream is used for clean culture.In this example embodiment, broadcast media stream is represented by " a=mid: " value 1 and 2 respectively, and clean culture is represented by " a=mid: " value 3 and 4 respectively.Therefore, middleware can be connected to IP address 224.1.1.2 and the port 30000 and 30002 for broadcasted content, and is connected to IP address 131.10.1.2 and the port 26890 and 26892 for unicast stream.
Table 2
By this way, Figure 10 shows a kind of example of equipment, described equipment comprises the one or more processors being configured to receive Session Description Protocol (SDP) message, described SDP) message comprises the attribute of the degree of depth defining time shift buffer (TSB), value based on described attribute determines the amount of the memory of TSB, distribute the memory of determined amount to TSB, and the media data that storage is associated with SDP message in TSB at least partially.
Figure 12 and 13 shows the block diagram of the example components for supporting transmission diversity for RTSP/RTP client.Transmission method no matter in eMBMSUSD is used to distinguish between broadcast with unicast transmission, or uses unified single SDP mechanism, and the technology of present disclosure can provide the seamless delivery of content of being undertaken by RTSP/RTP client to obtain.In order to realize this target, as proposed in Fall provisional application, may outside eMBMS middleware (also referred to as multicast service device clients (MSDC)), policy manager, controller and RTSP redirector/agency can remain in UE.As RTSP client request SDP, RTSP redirector/agency always provides SDP profile, and it carries local host (such as IP version 4, address 127.0.0.1) as connection end point address.Method is, no matter this RTSP redirector/agency is via eMBMS middleware (for broadcast) or clean culture RTSP server (for clean culture) receives content, and it is always from local host content to RTSP/RTP client service content.Therefore, client does not know the diversity of transmission mechanism.Our brief description of the primary clustering of framework of providing below, and give how by content delivery to the example of client.
In the example of Figure 12 and 13, playback application is the application of attempting consuming streaming medium content; RTSP/RTP client is the client realizing Real-time Transport Protocol for client behavior; EMBMS middleware realizes eMBMS (or MBMS) broadcast service to find (be transmission or file download for stream) and via broadcast LTE network consumption stream transmission or the middleware framework of file transfers content; Policy manager safeguards database as discussed above; Controller is from policy manager acquisition strategy information and covers instruction from the acquisition of eMBMS middleware and eMBMS broadcast and provide mapping to RTSP redirector/agency, state the group valency will selecting which SDP profile from (clean culture or broadcast); And RTSP redirector/agency receives map information from controller, and depend on that this mapping is collected RTP content (when UE is broadcast coverage) from eMBMS middleware or is connected to clean culture RTSPURI and via unicast transmission to receive the agent unit of content, it can be delivered to RTSP/RTP client subsequently.
Figure 12 represents the example process of the broadcast delivery for RTP content.Figure 12 comprises RTSP/RTP client 1202, playback application 1204, RTSP redirector/agency 1218, controller 1214, eMBMS middleware (also referred to as MSDC) 1208, policy manager 1216 and broadcasting transmitting unit (being also referred to as eMBMSrX) 1220.Figure 12 further depict Long Term Evolution (LTE) Radio Access Network (RAN) 1206.LTERAN1206 provides MBMS, which defines at least one in polytype transmission (such as, broadcast, multicast or clean culture) of media data.Therefore, when MSDC1208 is in the coverage of the covering provided by LTERAN1206, MSDC1208 can use broadcast or multicast to transmit receiving media data via LTERAN1206.In addition, MSDC1208 realizes server 1212, and described server 1212 comprises Cache 1210.By this way, MSDC1208 not only can be used as the client of receiving media data but also can provide the server of data as to such as RTSP/RTP client 1202.In addition, RTSP/RTP client 1202 can fetch media data from such as MSDC1208 or RTSP redirector/agency 1218, and provides described media data subsequently to playback application 1204.
Playback application 1204 can correspond essentially to application 101 (Fig. 1), and RTSP/RTP client 1202 can correspond essentially to application service client 102 (Fig. 1).Equally, MSDC1208 can correspond essentially to transmission middleware 110A-110R (Figure 10).Controller 1214 can correspond essentially to controller 106 (Fig. 1).RTSP redirector/agency 1218 can correspond essentially to redirector/agency 104 (Fig. 1).
In this example, policy manager is provided and has strategy (1230).The USD that described eMBMS middleware (or MSDC) 1208 receives for eMBMS service list describes (1232,1234).SDP profile information for rtp streaming formula transmission service is covered notice with broadcast and passes to controller 1214 (1236) by described MSDC1208 subsequently, and SDP information is mated with Policy List by controller 1214, and map information is supplied to RTSP redirector agency 1218 (1238).Map information comprises data, and which SDP profile connection end point described data pointer, to each scene (broadcast or clean culture cover), use.By this way, RTSP redirector can obtain map information, described map information by the maps identifiers for described media data to resource location.Described resource location can correspond to the network address, such as, via LTERAN1206 can address.Described service definition is used at least one in the transmission of multiple types of transmission of media data, such as broadcast or multicast.
Meanwhile, service list is passed to playback application 1204 (1240) by MSDC1208.Playback application 1204 can correspond to application 101 (Fig. 1).RTSPURI (being provided the service list had from MSDC) and agent address are passed to RTSP/RTP client 1202 (1242) by this playback application 1204 subsequently.When the DESCRIBE order of RTSP/RTP1202 client call (order of RTSP definition) (1244), RTSP redirector/agency 1218 provides the SDP message (1246) of the amendment being redirected to home server.This RTSP/RTP client 1202 resolves SDP information (1248), and calls SETUP order (RTSP order), to set up RTP session with home server.When being successfully established with server, this RTSP/RTP client 1202 also transmits play command (1250).RTSP redirector/agency 1218 provides the success message (1252) to SETUP and PLAY request to RTSP/RTP client 1202.SETUP and the PLAY order received from RTSP/RTP client 1202 by RTSP redirector/agency 1218 represents the example for the request of media data.In addition, RTSP redirector/agency 1218 sends SETUP and PLAY order (1251) to MSDC1208.
Whether the service that RTSP redirector/agency 1218 can determine fetching media data is available, and such as, whether service broadcast or multicast being defined as transmission is available.Whether RTSP redirector/agency 1218 can be in service coverage area based on RTSP redirector/agency 1218 or MSDC1208 at least in part, determines whether serve is available.The technology supposition service of Figure 12 is available.As discussed in detail below, Figure 13 describes the operable added technique when serving unavailable.
Meanwhile, during the movable broadcast session of streaming services, Virtual network operator sends RTP content (1254) on LTERAN1206.MSDC collects RTP content (1256) for the service from broadcast connection end point (being labeled as eMBMSrX1220 in fig. 12), process this content (if necessary), and with the SETUP order of RTSP redirector/agency during, at the end points of being specified by client by delivery of content to RTSP/RTP client 1202 (1258).By this way, when service be available (such as, limit the service of broadcast or multicast transmission) time, RTSP redirector/agency 1218 makes RTSP/RTP client 1202 from MSDC1208 receiving media data (that is, using service from resource location such as via the unit of LTERAN1206 receiving media data).Particularly, in the present example, MSDC1208 is based on map information (such as, above-mentioned USD data) via the media data of LTERAN1206 reception from network site, and service is mapped to this position by this map information.
By this way, the technology of Figure 12 illustrates a kind of example of method, described method comprises: by agent unit (such as, RTSP redirector/agency 1218) carry out following operation: obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission (such as, broadcast, multicast or clean culture) of multiple types of described media data; The request for described media data is received from application service client (such as, RTSP/RTP1202); Determine whether described service is available; And when described service is available, making described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.In this example, the unit of receiving media data corresponds to MSDC1208.
Figure 13 represents the example process of the unicast delivery for RTP content.In the present example, step 1232-1248 and the broadcast delivery about the content described by Fig. 2 are substantially identical.But, in this case, as RTSP/RTP client call SETUP and PLAY order (1310), RTSP redirector/agency 1218 contacts clean culture RTSP server (1312) via RAN/ the Internet 1302 from map information, fetch content (1314) from clean culture RTSP server, and announce during SETUP order or in step 1246 place SDP those during by this delivery of content to the end points mentioned by RTSP/RTP client 1202.Therefore, in this case, RTSP redirector/agency 1218 (it may reside in subscriber equipment, and described subscriber equipment also comprises RTSP/RTP client 1202) serves as the client of long-range RTSP server, and represents RTSP/RTP client to fetch content.
By this way, the technology of present disclosure can use SDP extension mechanism (attribute), provides TSB to indicate with the eMBMS broadcast delivery for RTP content.Present disclosure also defines the exemplary architecture in order to support the bumpless transfer between broadcast and unicast transmission, and in UE, provide RTP delivery of media content mechanism.In addition, this disclosure has described a kind of in SDP message for the clean culture of content and broadcast delivery by the technology of multiple media stream packet based on RTP.
RTSP redirector/agency 1218 illustrates the example of agent unit, described agent unit can be configured to carry out following operation: obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission (such as, broadcast, multicast or clean culture) of multiple types of described media data; The request for described media data is received from application service client; Determine whether described service is available; And when described service is available, making described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
Figure 14 A and 14B shows for expanding USD to carry the concept map of the exemplary XML content model of DASH transmission information.The point that being connected between Figure 14 A and 14B engages is represented herein by the A enclosed.Can be used alone XML content model or use in conjunction with any above-mentioned technology.Fig. 1,2A, 2B, 6, the assembly of 7 and/or 8 can be configured to utilize about the XML content model described by Figure 14 A and 14B.As mentioned above, the technology of present disclosure comprise by the technology being to carry out between clean culture and broadcast transmission mode selecting.Figure 14 B shows and represents that (the broadcast element in USD) and clean culture represent the data of (the unicast element in USD) for limiting broadcast.
According to some technology of present disclosure, application service client, as DASH client (such as, Fig. 1,2A, 2B, 6, the DASH client of 7 and/or 8) initial selected to which represents to come the section of fetching from can be made.Particularly, DASH client can make this initial selected, and the transmission mode of expression belonging to the section of remaining this request unknowable (broadcast and/or clean culture).For exemplary purposes, suppose, HTTP is by DASH client for asking the section of selected expression, and the USD of the expansion shown in Figure 14 B is used for carrying DASH transmission information.Each during one or more broadcast represents is identified by unique baseUrl attribute of broadcast element in USD.
Each example of Broadcast is mapped to unique expression that MBMS carrying is transmitted.During its baseURL by with used by DASH client, a part of section URL makes comparisons, with request segment, specifically, the initial part of the part section of the being URI of described section of URL, it is from URI scheme, and extend to and comprise the identifier of the expression belonging to this section, to determine describedly whether just requestedly to represent.
Such as, assuming that the section URL sent by DASH client is " http://example.com/per-3/rep-512/seg-99.3gp ", it corresponds to the section 99 of the expression 512 (Representationid=' 512 ') in the period 3 (Periodid=' 3 ').For the object of mating with the basesURL in USD, the part of this URI that consider is " http://example.com/per-3/rep-512.When this expression is also available on broadcasting, the example of mediaPresentationDescription2.broadcast will be present in USD, have and provide baseURL by " http://example.com/per-3/rep-512 ", it is identical with the part interested in request URL.Such as, the broadcasting transmitting mating the expression belonging to the section representing request of the part interested in this request URL and the baseURL attribute of the broadcast element of USD.
Similarly, in this example embodiment, zero or multiple clean culture represent in each in USD by unique baseUrl Attribute Recognition of mediaPresentationDescription2.unicast element.As discussed above, mean that this expression is available in delivery of unicast when the match pattern of the same section of URL of asking and clean culture baseURL.Same express possibility two transmission modes be all available, be available in an only transmission mode or two transmission modes be not available.
DASH client submits to the entity of Duan Xiangqi request can be agent unit (or submitting to MBMS or eMBMS client).For exemplary purposes, agent unit is described as performing these technology below, but it should be understood that such as Fig. 1,2A, 2B, 6, MBMS or eMBMS of 7 and/or 8 can be configured to perform the technology owing to agent unit, as described below.By the pattern matching between using for the baseURL value of broadcast and the unicast element in the interested part of request URL and USD, agent unit can determine whether selected transmission mode is available and/or more preferred than another transmission mode.
Agent unit can fetch the strategy of the preference between the various transport-type of instruction.Such as, this strategy can indicate, if request is the expression for transmitting in clean culture, as long as this device is positioned at broadcast coverage, only the expression of broadcast delivery is should be addressable to DASH client.Although transmit in different transmission modes, if baseURL occurs in the identicalContent element of USD, and can be substituted for requested expression, then this broadcast express possibility with original asked be same expression.
Or broadcast represents it can is known alternative expression of transmitting in broadcast, and is considered to switchable expression, and this is owing to appearing in the item list of USD element switchableContent for the baseURL of alternative expression.In this case, message can be sent it back DASH client by agent unit, belongs to make DASH client-requested alternative same section of representing transmitted in broadcast.Such as, agent unit can send the http response message of 300 types to DASH client, it corresponds to redirect message, and described redirect message can specify the resource URL corresponded to from the alternative expression be included in the list of switchableContent.
As another example, if the known section will transmitted in broadcast of DASH client-requested agent unit, but broadcast reception is unavailable (such as, because client device is in outside broadcast coverage areas), then agent unit can send the http response message of 300 types, it comprises the URL of the section corresponding to same unicast transmission, if or this same expression be entry that is disabled but that be shown as in switchableContent in unicast transmission, then correspond to different expression.
As another example, if DASH client-requested is known as the section that agent unit will transmit in broadcast, but broadcast reception can be used, then agent unit proxies the request to local content Cache, and DASH client is returned in fetched section transmission.
Alternatively, agent unit can respond by 400 type error message, and this may cause DASH client to use different section URL to resubmit request.Agent unit otherwise can also transmit different host-host protocols, such as, via API (API), interprocess communication (IPC), sends MPD of the amendment of the base URL selected by omitting etc.
DASH client may be made to select different transmission modes from the redirected of agent unit or error message.In some instances, in the transmission mode be redirected, more than one expressing possibility is available, and in this case, DASH client may be selected from those available expressions.As an example, if DASH client once attempted selecting broadcast to represent (given by the example of the broadcast element by Figure 14 A and 14B), but agent unit determination broadcast reception is disabled, then agent unit can send message (such as to DASH client, 300 type redirect messages, 400 type error message, API Calls via IPC communication etc.), instead select the clean culture of Figure 14 A and 14B to represent to make DASH client.
In some instances, application service client, as DASH client, can be in charge of unicast broadcast conversion.As an example, present disclosure describes for utilizing extra parameter to expand the framework of USD about Figure 14 A and Figure 14 B, DASH on MBMS downloads and transmits, make MBMS client can determine from DASH client's section request whether can as, be or be only from one or more alternative expression.Transmission mode that USD can indicate media to express to describe in (MPD) each expression of specifying (only broadcast, only clean culture, or both broadcast and clean culture).The following describe the exemplary scenario for the rule and mechanism determining to represent availability.
In one example in which, subscriber equipment (UE) can be positioned at MBMS overlay area, and DASH client can ask this USD indicate be disabled via broadcast delivery, specifically represent.Service provider policy can indicate, and when UE is in MBMS covering, only the expression of the broadcast delivery of same program can be accessed.In this case, DASH client may be restricted to from by broadcast delivery can with alternative represent carry out selecting (or being redirected or being instructed to select).
In another example, UE may be positioned at MBMS and cover, and DASH client can ask to be known as expression available on multicast is transmitted.In this case, desired expression directly can be accessed by UE.
In another example, UE may be positioned at outside MBMS receiving area, and DASH client can ask to be known as only available in broadcast delivery expression.In this case, DASH client can be restricted to from the form of changeable content, on delivery of unicast available alternative represent in carry out selecting (or being redirected or being instructed to select).
In another example, UE may be positioned at outside MBMS receiving area, and DASH client can ask also to be known as expression available in broadcast delivery.In this case, DASH client may can receive and represent with the form of identical content, same in clean culture.
The extraneous information can carried in USD comprises the instruction to coverage, and thereon, each expression is transferred, and/or comprises the mark of SDP, and described SDP describes the FLUTE session of carrying described expression.
This disclosure has described a kind of technology, by described technology, can mediaPresentationDescription2 daughter element is added under userServiceDescription, to carry extra transformation parameter.Before this, be proposed MPD-special parameter, as being included in interval I D, adaptation collection ID and RepresentatationID in mediaPresentationDescription2, it can be identified in those expressions available in delivery of unicast.These identical parameters, quote together with to the URI of session description fragment, can identify each expression can transmitted in broadcast, and to carry this expression section, the mapping of FLUTE session.
The problem that the technology of this present disclosure can overcome makes it possible to use HTTP/1.1 as the protocol interface between DASH client and MBMS client for section request/response, maintains clean multi_layer extraction in protocol processes simultaneously.Such as, in former technology, MBMS client must process MPD-customizing messages, the DASH client-requested of the section for specific expression can be corrected as actual available, permitted (such as, according to service provider policy) by transmission mode (broadcast or clean culture) institute expression section by described MPD-customizing messages.When asked expression can not be provided, use HTTP redirection (via 3xx response code to make MBMS client, as in June, 1999 people " HypertextTransferProtocol – HTTP/1.1 " such as Fielding, define in network working group RFC2616, it can obtain at http://www.ietf.org/rfc/rfc2616.txt) alternatively to represent to notify that DASH client is one or more, this MBMS client forms complete section URI by having to for each substitutable resources.Layering conflict about MBMS client part can be eliminated by using the technology of present disclosure.
The technology of present disclosure eliminates MBMS client (or agent unit) and will know the necessity that maybe must process (DASH is specific) MPD information.This MBMS client based on the new metadata in USD appearance and with the section request URI generated by DASH client, only perform data/pattern matching, determine asked section be in available in available, clean culture in broadcast, two kinds of transmission modes all can with or all unavailable, or it is available by some alternate manners (such as, cache memory).This is possible because additionally provide in USD the expression that mark is asked uniquely section belongs to, the part of request URI.In addition, MBMS client can by the position of the matched data pattern in USD, determine that the expression of being asked by DASH client (it is unknowable to transmission mode) is in broadcast, clean culture, in two kinds of transmission modes all or all unavailable, or it is available by some alternate manners (such as, cache memory).Rule relevant to any other and condition, such as cover situation (UE is in clean culture and/or broadcast service zone), service provider policy etc. combine, and based on USD attribute replacementAllowed=' true ', suppose that for returning substitutable resources URI alternative method be allow.This MBMS client can use HTTP/1.1 mechanism by section mediation request to suitable resource, such as, local content Cache in UE, or outside HTTP servers, and does not have through protocol hierarchy conflict.
As found out in the example of Figure 14 A and 14B, described one or more broadcast representative in each in USD by unique baseUrl Attribute Recognition of broadcast element.BaseURL value may be identical for asking the section URI of the section represented with DASH client, and specifically, be identical with the start-up portion of this section of URI, it is from the method, and extends to and comprise this RepresentationID.Such as, if the URI of this section be URL " http://example.com/per-3/rep-512/seg-99.3gp; " corresponding to the section 99 of the expression 512 (RepresentationID=512) in the period 3, then baseURL can be defined as " http://example.com/per-3/rep-512 ".
In the present example, described one or more broadcast representative in each in USD by unique baseUrl Attribute Recognition of broadcast element.Each example of Broadcast maps to unique expression of transmitting in MBMS carrying.The section URI being used for request segment with DASH client compares by its baseUrl, specifically, compare with the start-up portion of this section of URI, it is from URI scheme, and extends to and comprise this Representation-ID (value of the Representationid in MPD).Such as, suppose that the section URI that DASH client sends is URL " http://example.com/per-3/rep-512/seg-99.3gp ", correspond to the request of the section 99 for the expression 512 (Representationid=512) in period 3 (Periodid=3 ").For the object of mating with USD, the part of this URL be concerned about is " http://example.com/per-3/rep-512.When this expression is also available on broadcasting, the example of mediaPresentationDescription2.broadcast will have and provide baseURL by " http://example.com/per-3/rep-512 " in USD, and it is identical with the part interested of request URI.
When MBMS client determine that DASH client is asked, only alternative expression is available, the replacementAllowed attribute of mediaPresentationDescription2 can indicate MBMS client whether and how to provide this notice to DASH client, as defined in RFC2616 via HTTP redirection (3xx conditional code) method.
Such as, if replacementAllowed="True", can suppose that DASH content and MPD are write by this way: allow MBMS client to reset via " 303 see other " and always provide substitutable resources URI to DASH client, and do not consider the transmission mode of alternative expression.Particularly, each alternative URI is formed by the part interested of replacing in section URL, as utilized the baseURL in the USD corresponding to alternative expression to describe above, and in raw requests, retains segment number simultaneously.
On the other hand, if replacementAllowed="false", then for generating substitutable resources URI and this replacement method providing it to DASH client is unallowed.Cause technology that want alternative expression that is requested and that transmit, that produce may be depend on realization (such as, MBMS client may return the 4xx error code with being with or without alternative expression, it is sent with signal form by baseURL value, and depends on DASH client to form alternative request).Below about Figure 15 and 16, be redirected based on HTTP'303' and describe exemplary call flow, what show between MBMS client and DASH client is mutual.
Similarly, zero or multiple clean culture represent in each in USD by unique baseUrl Attribute Recognition of mediaPresentationDescription2.unicast element.As discussed above, mean that this expression is available in delivery of unicast at the same section of URL of asking and the match pattern of clean culture baseURL.It should be noted that same expression can two transmission modes be all available, be available in an only transmission mode or two transmission modes be not available.
In addition, via sessionDescription element, each broadcast represents the SDP file that can be linked to session description fragment or relate to the FLUTE session of carrying described expression.In addition, serviceArea element (if present), can indicate broadcast represent thereon can MBMS region.
Figure 15 shows the concept map of the framework for supporting the DASH on MBMS.The example of Figure 15 represents for the end to end network framework with the DASH delivery of content of clean culture rollback in MBMS carrying.The interface of the TS26.346 definition represented between BM-SC and MBMS client is transmitted in download based on FLUTE.Supposition interface between DASH client and MBMS client (be assumed to here comprise MBMS receiver, http server based on equipment, strategy, be redirected and the solid polymer composite of agent functionality) is HTTP/1.1.
Figure 16 show be associated with the network architecture of Figure 15, for the call flow of broadcasting and DASH content in unicast transmission transmits.Expand for carrying DASH transmission information based on the USD shown in Figure 14 A and 14B relative to the technology described by Figure 16.Although be described to correspond to the network architecture of Figure 15, it should be understood that the technology of Figure 16 can be performed by miscellaneous equipment, other equipment described such as Fig. 1,2A, 2B, 6,7, equipment in the framework of 8 and/or 17.In the example of Figure 16, assuming that USD comprises the information shown in table 3, it comprises the value of baseURL attribute under mediaPresentationDescription2.broadcast and mediaPresentationDescription2.unicas, and supposes that the value of the replacementAllowed attribute in USD is "True".
Table 3
In addition, in this example embodiment, assuming that MPD comprises following content:
·MPDtype=‘dynamic’
·Periodid=‘3’
·Period.SegmentTemplatemedia=
‘http://example.com/per-3/rep-$RepresentationID$/seg-$Number$.3gp’
oRepresentationid=‘512’…
oRepresentationid=‘256’…
oRepresentationid=‘128’…
These exemplary MPD parameter values given, request of attempting can be issued for the DASH client of the section no.99 of the expression 512 in Period3 and be asked URI:http below: //example.com/per-3/rep-512/seg-99.3gp.The call flow diagram of Figure 16 describes the DASH delivery of content for two kinds of different situations: (1) UE is positioned at MBMS overlay area, and ask the section of the expression 512 in Period3, its broadcast transmit on time can, and subsequently, (2) UE shifts out MBMS region, and continue the same expression of request (Representation512), disabled when it is on clean culture transmits, but represent that 256 and 128 is available in clean culture.
In other words, this disclosure has described some technology, described technology is for supporting the use of the signaling based on USD that the DASH of transmission diversity transmits.It can provide one or more improvement at the Previous proposals described from " RationaleforUSDIndicationofDASHDeliveryModeandIllustrati veImplementation " TdocS4-130051 of Qualcomm.Such as, in the method, layering conflict can be avoided completely, this is because MPD information be understood or be processed to MBMS client need not.On the contrary, MBMS client can for the URI of the section of being asked by DASH client to perform the data patterns match of known transmission semanteme, to determine whether asked section asks to send via broadcast and/or clean culture, and this request whether be satisfied with or need to be redirected to same expression or use another kind of transmission mode can with alternatively to represent.
Thisly determine to be positioned at MBMS covering internal or outside, service provider policy (if any) based on such as following factor: UE, to be managed the accessibility of expression by transmission mode, and depend on other conditioned disjunctions rules possibly.Provide the exemplary network architecture for the DASH content delivery via MBMS with clean culture rollback and call flow diagram, so that content delivery to be end to end described, its with the use of the http protocol interface between DASH client and MBMS client for feature.Adhere to that layered protocol should be provided in the framework benefit of in the DASH supported in MBMS, that UE realizes extensibility and simplicity.
The replacementAllowed attribute with the mediaPresentationDescription2 that value is "True" predicts and uses HTTP redirection to limit DASH client-access substitutable resources (expression) via 3xx state code by MBMS client.In this case, suppose that DASH content and MPD are write as follows: allow MBMS client to reset via " 303 see other " and always provide substitutable resources URI to DASH client, and do not consider the transmission mode of alternative expression.Particularly, each alternative URI is formed by the part interested of replacing in section URL, as utilized the baseURL in the USD corresponding to alternative expression to describe above, and protects simultaneously retain segment number in raw requests.If the value="false" of replacementAllowed, then for generating substitutable resources URI and this replacement method providing it to DASH client is unallowed.
Cause wanting the technology produced of alternative expression that is requested and that transmit to depend on realization.Such as, MBMS client may return the 4xx error code with being with or without alternative expression, and it is sent with signal form by the baseURL value in the entity body of http response, and depend on DASH client to form alternative request.Herein, for identifying that alternative expression is the prompting that the existence of available baseURL can be used as to DASH client in the response, its prompting DASH client has the intelligence of the described expression of follow-up direct request.Alternately, baseURL may provide " prompting " in 4xx response, or DASH client may lack the intelligence utilizing this prompting paired new request that another represents in next life, another expression described may or may not correspond to the expression allowed from the angle of this MBMS client.
Figure 17 shows the concept map of the exemplary architecture for supporting the DASH on MBMS.Specify the interface between BM-SC and eMBMS client may be important, and the interface between eMBMS client and DASH client be suitable standard.Such as, described standard can should meet TS26.346 by the interface between regulation BM-SC and eMBMS client.Described standard can also be specified, if DASH client and eMBMS client are from different suppliers, then the interface between eMBMS client and DASH client should follow TS26.247.The example of contrast Figure 16, Figure 17 interface shown between DASH client and eMBMS client can follow the example of TS26.247 (it can be, such as, HTTP/1.1).Figure 17 shows to allow the DASH on MBMS to fall back to the high level architecture of the DASH in clean culture.
Figure 18-23 show be associated with the network architecture of Figure 17, for the flow chart of broadcasting and DASH content in unicast transmission transmits.Although be described to correspond to the network architecture of Figure 17, should be appreciated that the technology of Figure 18-23 can be performed by other equipment, described equipment such as Fig. 1,2A, 2B, 6,7, equipment in the structure of 8 and/or 15.
About the example of Figure 18, USD signaling can be included in the following data illustrated in table 4 for eMBMS client:
Table 4
MPD in this example can specify following data, and wherein BaseURL corresponds to the base portion for the URL of access segment:
BaseURL1=http://www.cnn.com/512/,RepresentationId=“512”;
Template=seg$Number$.3gp,
BaseURL2=http://www.cnn.com/256/,RepresentationId=“256”;
Template=seg$Number$.3gp,
BaseURL3=http://www.cnn.com/128/,RepresentationId=“128”;
Template=seg$Number$.3gp.
In the example shown in Figure 18, assuming that eMBMS client does not have HTTP Proxy function, and only there is HTTP redirection function.
About the example of Figure 19, USD signaling can be included in the following data shown in table 5 for eMBMS client:
Table 5
MPD in this example can specify following data, and wherein BaseURL corresponds to the base portion for the URL of access segment:
BaseURL1=http://www.cnn.com/512/,RepresentationId=“512”;
Template=seg$Number$.3gp,
BaseURL2=http://www.cnn.com/256/,RepresentationId=“256”;
Template=seg$Number$.3gp,
BaseURL3=http://www.cnn.com/128/,RepresentationId=“128”;
Template=seg$Number$.3gp.
In the example shown in Figure 19, assuming that eMBMS client has both HTTP Proxy function and HTTP redirection function.
About the example of Figure 20, USD signaling can be included in following for the data of eMBMS client shown in table 6:
Table 6
MPD in this example can specify following data, and wherein BaseURL corresponds to the base portion for the URL of access segment:
BaseURL1.1=http://www.cnn.com/512/,
BaseURL1.2=http://localhost/512/,RepresentationId=“512”;
Template=seg$Number$.3gp,
BaseURL2=http://www.cnn.com/256/,RepresentationId=“256”;
Template=seg$Number$.3gp,
BaseURL3=http://www.cnn.com/128/,RepresentationId=“128”;
Template=seg$Number$.3gp.
In the example shown in Figure 20, assuming that eMBMS client does not have HTTP Proxy function, and only there is HTTP redirection function.
About the example of Figure 21, USD signaling can be included in the following data shown in table 7 for eMBMS client:
Table 7
MPD in this example can specify following data, and wherein BaseURL corresponds to the base portion for the URL of access segment:
BaseURL1=http://www.cnn.com/;
RepresentationId=“512”;Template=$RepresentationId$/seg$Number$.3gp,
RepresentationId=“256”;Template=$Representagtion$/seg$Number$.3gp,
RepresentationId=“128”;Template=$Representagtion$/seg$Number$.3gp.
In example illustrated in fig. 21, assuming that eMBMS client does not have HTTP Proxy function, and only there is HTTP redirection function.
About the example of Figure 22, USD signaling can be included in the following data illustrated in table 8 for eMBMS client:
Table 8
MPD in this example can specify following data, and wherein BaseURL corresponds to the base portion for the URL of access segment:
BaseURL1=http://localhost/512/,RepresentationId=“512”;
Template=seg$Number$.3gp,
BaseURL2=http://www.cnn.com/256/,RepresentationId=“256”;
Template=seg$Number$.3gp,
BaseURL3=http://www.cnn.com/128/,RepresentationId=”“128”;
Template=seg$Number$.3gp.
In the example shown in Figure 22, assuming that eMBMS client does not have HTTP Proxy function, and only there is HTTP redirection function.
About the example of Figure 23, USD signaling can be included in following for the data of eMBMS client shown in table 9:
Table 9
MPD in this example can specify following data, and wherein BaseURL corresponds to the base portion for the URL of access segment:
BaseURL1=http://www.cnn.com/1024/,RepresentationId=“1024”;
Template=seg$Number$.3gp,
BaseURL2=http://www.cnn.com/512/,RepresentationId=“512”;
Template=seg$Number$.3gp,
BaseURL3=http://www.cnn.com/256/,RepresentationId=“256”;
Template=seg$Number$.3gp,
BaseURL4=http://www.cnn.com/128/,RepresentationId=”“128”;
Template=seg$Number$.3gp.
In the example shown in Figure 23, assuming that eMBMS client does not have HTTP Proxy function, and only there is HTTP redirection function.
Figure 24 is for the technology according to present disclosure, shows the flow chart for sending with signal form about the illustrative methods of time shift buffer (TSB) degree of depth.For exemplary purposes, the method for Figure 25 is described about the assembly (such as, MSDC1010 and TSB1212) of Figure 10.It should be understood, however, that and utilize the technology of time shift buffer can be incorporated to any system in various system described herein, such as, in Fig. 1,7,8,9,12,13 and/or 17 system of Subgraph.
Initially, MSDC1010 can receive Session Description Protocol (SDP) message (2400).SDP message can comprise the attribute of the degree of depth defining time shift buffer (TSB).Therefore, MSDC1010 can determine the value (2402) for described attribute (also referred to as TSB depth attribute) in SDP message.The value of the depth attribute of TSB can limit the degree of depth of TSB, such as, about the number of seconds that will be stored in playback in TSB, media data.Such as, the value of this attribute can limit and can be stored in TSB, in seconds maximum playback duration.
Therefore, MSDC1010 can according to determining the amount (2404) that will be assigned with the memory forming TSB with the degree of depth represented by signal form.Such as, suppose that the number of seconds about the playback duration of media data sends the degree of depth of TSB with signal form, and hypothesis is for video data, with signal form transmission frame speed, then MSDC can determine the quantity of the frame of video that will be stored in TSB, the product of the number of seconds of media data that it can be used as frame rate (representing with number of pictures per second) and will store.Then MSDC1010 can determine the amount of the memory of TSB based on the product of the quantity of the mean bit rate of every frame and frame.MSDC1010 can use similar concept, to determine the memory size of voice data, timing text data etc.
MSDC1010 can distribute the memory of determined amount subsequently, to form TSB (2406).Therefore, along with MSDC1010 receiving media data, MSDC1010 can store the media data that (2408) receive in TSB.Playback application can use the media data of this buffer memory to apply for time shift, such as, for carrying out in time after a while watching or for special-effect mode, and such as F.F. or rewinding.Certainly, the data of institute's buffer memory also may be used for substantially resetting in real time.
By this way, the example of a kind of method of method representation of Figure 24, described method comprises: receive Session Description Protocol (SDP) message, described SDP message comprises the attribute defining time shift buffer (TSB) degree of depth; Based on the value of described attribute, determine the amount of the memory of described TSB; Distribute the memory of determined amount to form described TSB; And, in described TSB, store the media data be at least partially associated with described SDP message.
It will be appreciated by those skilled in the art that information and signal can use any multiple diverse ways and technology to represent.Such as, the data may mentioned in the description on run through, instruction, order, information, signal, bit, symbol and chip can represent with voltage, electric current, electromagnetic wave, magnetic field or particle, light field or particle or its combination in any.
Those skilled in the art be to be further appreciated that, all can be embodied as electronic hardware, computer software or the combination of the two in conjunction with various exemplary box, module, circuit and algorithm steps herein described by disclosure.In order to clearly represent this interchangeability between hardware and software, all around its function, describe, in general terms is carried out to various exemplary assembly, frame, module, circuit and step above.Be embodied as hardware as this function or be embodied as software, the design constraint depending on concrete application and whole system is applied.Those skilled in the art for each embody rule, can realize described function in the mode of accommodation, but, thisly realize decision-making and should not be construed as the protection range causing deviating from present disclosure.
In one or more example, described function can realize in hardware, software, firmware or its combination in any.If realized in software, then these functions can be carried out storing or transmitting as one or more instruction or code on computer-readable recording medium, and be performed by hardware based processing unit.Computer-readable medium can comprise computer-readable recording medium or communication media, wherein computer-readable recording medium corresponds to the tangible medium of such as data storage medium, and communication media comprises any medium such as promoting to transmit from a place to another place computer program according to communication protocol.By this way, computer-readable medium can correspond to the tangible computer readable storage medium storing program for executing of (1) non-transitory usually, or (2) communication media, as such as signal or carrier wave.Data storage medium can be can by one or more computer or one or more processor access to fetch instruction, code and/or data structure to realize any usable medium of the technology described in present disclosure.Computer program can comprise computer-readable medium.
By way of example instead of the mode of restriction, this computer-readable recording medium can comprise RAM, ROM, EEPROM, CD-ROM or other disk storage, magnetic disc store or other magnetic storage apparatus, flash memory or can be used in storing the expectation with instruction or data structure form program code and can by other medium any of computer access.In addition, any connection suitably can be called computer-readable medium.Such as, if instruction be use coaxial cable, optical fiber cable, twisted-pair feeder, Digital Subscriber Line (DSL) or such as infrared ray, wireless and microwave and so on wireless technology from website, server or other remote source, so the wireless technology of coaxial cable, optical fiber cable, twisted-pair feeder, DSL or such as infrared ray, wireless and microwave and so on is included in the definition of described medium.But, should be understood that, computer-readable recording medium and data storage medium do not comprise be connected, carrier wave, signal or other provisional medium, but on the contrary, for non-transitory, tangible storage medium.As used herein, disk and CD comprise compact disk (CD), laser-optical disk, CD, digital versatile disc (DVD), floppy disk and Blu-ray Disc, the wherein usual magnetically copy data of disk, CD then carrys out copy data optically with laser.Combination above also should be included within the protection range of computer-readable medium.
Instruction can be performed by one or more processor, and described one or more processor is one or more digital signal processor (DSP), general purpose microprocessor, application-specific integrated circuit (ASIC) (ASIC), field programmable logic array (FPGA) or other equivalent integrated or discrete logic such as.Therefore, " processor " can refer to any aforementioned structure or be suitable for implementing other structure any of technology described herein as the term is employed herein.In addition, in some respects, function described herein can be provided in the specialized hardware being arranged to Code And Decode and/or software module or be incorporated herein described function in the decoder of combination.In addition, described technology can realize completely in one or more circuit or logic element.
The technology of present disclosure can realize in various equipment or device, and A Hu equipment difficult to understand or device comprise radio hand-held equipment, integrated circuit (IC) or IC set (such as, chipset).Describe each assembly, module or unit in present disclosure, to emphasize the functional aspect of the equipment of the technology be configured to disclosed in execution, but necessarily do not realized by different hardware cells.On the contrary, as mentioned above, various unit can combine in codec hardware unit, or is provided by the set of interoperability hardware cell, and the set of described interoperability hardware cell comprises one or more processor, together with suitable software and/or firmware.
The detailed description more than set forth, together with appended accompanying drawing, is intended to as the description to various configuration, and the concept not being intended to represent described herein can with unique configuration of its practice.For the object of the thorough understanding be supplied to each conception of species, describe in detail and comprise specific details.But, it is evident that to those skilled in the art, these concepts can be put into practice when not having these specific detail.In some instances, in order to avoid these concepts fuzzy, known structure and assembly are shown in form of a block diagram.
Describe various example.These examples and other example are within the protection range of ensuing claims.

Claims (30)

1. fetch a method for media data, described method comprises:
Following operation is carried out by agent unit:
Obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission of multiple types of described media data;
The request for described media data is received from application service client;
Determine whether described service is available; And
When described service is available, make described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
2. method according to claim 1, wherein, described resource location comprises network site, and described method also comprises:
Determine whether the described media data of specifying in described request mates with the described media data in described map information; And
When the described media data of specifying in described request mates with the described media data in described map information, redirect message is sent to described application service client, to make described application service client fetch described media data from described network site, wherein said redirect message specifies in described map information for the described network site that the described maps identifiers of described media data arrives.
3. method according to claim 2, also comprise, when the described media data of specifying in described request does not mate with the described media data in described map information, redirect message is sent to described application service client, to make described application service client fetch described media data from the redirecting network position of acquiescence, wherein said redirect message specifies the redirecting network position of described acquiescence.
4. method according to claim 2, also comprises: when the described media data of specifying in described request does not mate with the described media data in described map information, sends error message to described application service client.
5. method according to claim 2, also comprises: when the described media data of specifying in described request does not mate with the described media data in described map information, the copy of described request is sent it back described application service client.
6. method according to claim 2, also comprise: store described map information in the mapping table, wherein, determine whether the described media data of specifying in described request mates the entry comprising and determine whether to correspond to for the identifier of described media device in described mapping table with the described media data in described map information.
7. method according to claim 2, wherein, described map information comprises the Mapping standard being represented as Uniform Resource Identifier (URI) prefix, and wherein, determine the described media data of specifying in described request whether mate with the described media data in described map information comprise the URI that determines to mate in described request the described media data indicated at least partially, the URI prefix of described map information.
8. method according to claim 7, wherein, the URI determining to mate in described request the described media data of specifying at least partially, the URI prefix of described map information comprise the URI determining to mate the described media data indicated in described request at least partially, the longest URI prefix of described map information.
9. method according to claim 7, wherein, the described URI prefix represented by described Mapping standard corresponds to definition each service for the transport-type of transmission of media data, and wherein, one URI prefix definition broadcast service of described URI prefix, and the 2nd URI prefix definition unicast services of described URI prefix.
10. method according to claim 2, wherein, at least one that described redirect message comprises in following operation is sent: the API (API) sending interprocess communication (IPC) to described application service client and call described application service client.
11. methods according to claim 2, wherein, described map information comprises the priority value for each potential coupling, and wherein, determine that whether the described media data of specifying in described request mates with the described media data in described map information to comprise: the coupling selecting to have highest priority value.
12. methods according to claim 2, wherein, described map information comprises the priority value for each potential coupling, and wherein, determine that whether the described media data of specifying in described request mates with the described media data in described map information to comprise: the coupling selecting to have lowest priority values.
13. methods according to claim 2, wherein, described map information comprises the Mapping standard being represented as regular expression, and wherein, determine that whether the described media data of specifying in described request mates with the described media data in described map information to comprise: the regular expression selecting the character mating maximum quantity, described character directly mate indicate in described request, for the identifier of described media data.
14. methods according to claim 2, wherein, described map information comprises the Mapping standard being represented as regular expression, wherein, described map information comprises the priority value for each potential coupling, and wherein, determine that whether the described media data of specifying in described request mates with the described media data in described map information to comprise: the coupling selecting to have highest priority value.
15. methods according to claim 2, wherein, described map information comprises the Mapping standard being represented as regular expression, wherein, described map information comprises the priority value for each potential coupling, and wherein, determine that whether the described media data of specifying in described request mates with the described media data in described map information to comprise: the coupling selecting to have lowest priority values.
16. methods according to claim 1, wherein, determine whether described service is that available comprising determines whether described agent unit is positioned at service coverage area.
17. methods according to claim 1, wherein, described request meets HTTP dynamic self-adapting Streaming Media (DASH) request, and described method also comprises:
Following operation is performed by described agent unit:
Receive described DASH to ask, wherein, the network address of described agent unit is specified in described DASH request;
Ask in response to described DASH, fetch the described media data of specifying in described request, and provide described media data to described application service client.
18. 1 kinds for fetching the equipment of media data, described equipment comprises agent unit, and described agent unit is configured to carry out following operation:
Obtain map information, described map information is based on the service for fetching described media data, by the maps identifiers for described media data to resource location, wherein, described service definition is for transmitting at least one in the transmission of multiple types of described media data;
The request for described media data is received from application service client;
Determine whether described service is available; And
When described service is available, make described application service client receive described media data from unit, described unit, based on described map information, uses described service to receive described media data from described resource location.
19. equipment according to claim 18, wherein, described resource location comprises network site, and wherein, described agent unit is also configured to:
Determine whether the described media data of specifying in described request mates with the described media data in described map information; And
When the described media data of specifying in described request mates with the described media data in described map information, redirect message is sent to described application service client, to make described application service client fetch described media data from described network site, wherein said redirect message is specified in described map information for the described network site that the described maps identifiers of described media data arrives.
20. equipment according to claim 19, wherein, described agent unit is also configured to when the described media data of specifying in described request does not mate with the described media data in described map information, performs at least one item in following operation:
Send redirect message to described application service client, to make described application service client fetch described media data from the redirect location of acquiescence, wherein said redirect message specifies the redirect location of described acquiescence;
Error message is sent to described application service client; And
The copy of described request is sent it back described application service client.
21. equipment according to claim 19, wherein, described agent unit is also configured to store described map information in the mapping table, wherein, in order to determine whether the described media data of specifying in described request mates with the described media data in described map information, described agent unit is configured to the entry determining whether to correspond to for the identifier of described media device in described mapping table.
22. equipment according to claim 19, wherein, described map information comprises the Mapping standard being represented as Uniform Resource Identifier (URI) prefix, and wherein, in order to determine whether the described media data of specifying in described request mates with the described media data in described map information, described agent unit be configured to determine the URI mating the described media data indicated in described request at least partially, the URI prefix of described map information.
23. equipment according to claim 19, wherein, described map information comprises the Mapping standard being represented as regular expression, wherein, described map information comprises the priority value for each potential coupling, and wherein, determine that whether the described media data of specifying in described request mates with the described media data in described map information to comprise: the coupling selecting to have lowest priority values.
24. equipment according to claim 18, also comprise controller unit, to described agent unit, it sends whether the described service of instruction is available information.
25. equipment according to claim 18, wherein, the unit of the described media data of described reception comprises one in described agent unit, described application service client and middleware unit.
26. equipment according to claim 18, also comprise middleware unit, it receives described media data, and wherein, described middleware unit comprises one in MBMS (eMBMS) middleware unit of multicast broadcast multimedia service (MBMS) middleware device and evolution.
27. equipment according to claim 18, wherein, described equipment comprises client device, and wherein, described client device comprises described application service client.
28. equipment according to claim 18, wherein, described equipment comprises agent equipment, and wherein, client device comprises described application service client, and wherein, described agent equipment is what to separate with described client device.
29. equipment according to claim 18, wherein, described agent unit obtains described map information from controller unit.
30. equipment according to claim 29, wherein, described equipment comprises agent equipment, and wherein, the controller equiment separated with described agent equipment comprises described controller unit.
CN201480004712.9A 2013-01-15 2014-01-14 Method and apparatus for fetching media data Active CN105284093B (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201361752456P 2013-01-15 2013-01-15
US61/752,456 2013-01-15
US201361809871P 2013-04-08 2013-04-08
US61/809,871 2013-04-08
US14/153,888 2014-01-13
US14/153,888 US10015437B2 (en) 2013-01-15 2014-01-13 Supporting transport diversity and time-shifted buffers for media streaming over a network
PCT/US2014/011475 WO2014113383A1 (en) 2013-01-15 2014-01-14 Supporting transport diversity and time-shifted buffers for media streaming over a network

Publications (2)

Publication Number Publication Date
CN105284093A true CN105284093A (en) 2016-01-27
CN105284093B CN105284093B (en) 2019-09-10

Family

ID=51165207

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480004712.9A Active CN105284093B (en) 2013-01-15 2014-01-14 Method and apparatus for fetching media data

Country Status (9)

Country Link
US (2) US10015437B2 (en)
EP (1) EP2946542B1 (en)
JP (1) JP6231583B2 (en)
KR (1) KR101847585B1 (en)
CN (1) CN105284093B (en)
BR (1) BR112015016989B1 (en)
ES (1) ES2630279T3 (en)
HU (1) HUE031896T2 (en)
WO (1) WO2014113383A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331089A (en) * 2016-08-22 2017-01-11 乐视控股(北京)有限公司 Video play control method and system
CN110268694A (en) * 2017-02-17 2019-09-20 帝威视有限公司 The system and method adaptively switched between multiple content delivery networks during adaptive bit rate stream transmission
CN115134420A (en) * 2021-03-24 2022-09-30 华为技术有限公司 Media playing method and device and electronic equipment

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8560604B2 (en) 2009-10-08 2013-10-15 Hola Networks Ltd. System and method for providing faster and more efficient data communication
US9160779B2 (en) 2011-06-30 2015-10-13 Qualcomm Incorporated Dynamic adaptive streaming proxy for unicast or broadcast/multicast services
US9009764B2 (en) 2012-04-12 2015-04-14 Qualcomm Incorporated Broadcast content via over the top delivery
US9820259B2 (en) 2012-05-04 2017-11-14 Qualcomm Incorporated Smooth transition between multimedia broadcast multicast service (MBMS) and unicast service by demand
US10015437B2 (en) 2013-01-15 2018-07-03 Qualcomm Incorporated Supporting transport diversity and time-shifted buffers for media streaming over a network
US9807188B2 (en) * 2013-04-09 2017-10-31 Samsung Electronics Co., Ltd. Methods and apparatuses for dynamic content offloading
US9973559B2 (en) * 2013-05-29 2018-05-15 Avago Technologies General Ip (Singapore) Pte. Ltd. Systems and methods for presenting content streams to a client device
US9674251B2 (en) 2013-06-17 2017-06-06 Qualcomm Incorporated Mediating content delivery via one or more services
US9241044B2 (en) 2013-08-28 2016-01-19 Hola Networks, Ltd. System and method for improving internet communication by using intermediate nodes
EP3065411B1 (en) * 2013-10-28 2024-03-27 Saturn Licensing LLC Content supplying device, content supplying method, terminal device and content supplying program
US9386067B2 (en) * 2013-12-30 2016-07-05 Sonic Ip, Inc. Systems and methods for playing adaptive bitrate streaming content by multicast
US20150350284A1 (en) * 2014-05-27 2015-12-03 Acer Incorporated Method of Enhancement of Data Transmission in Multimedia Service
EP3160153B1 (en) 2014-06-20 2020-10-28 Sony Corporation Reception device, reception method, transmission device, and transmission method
US9094443B1 (en) * 2014-07-30 2015-07-28 Iboss, Inc. Web redirection for content scanning
US11418273B2 (en) * 2014-10-28 2022-08-16 Saturn Licensing Llc Reception device, transmission device, and data processing method
US10129308B2 (en) * 2015-01-08 2018-11-13 Qualcomm Incorporated Session description information for over-the-air broadcast media data
EP3255858A4 (en) 2015-02-04 2018-07-11 LG Electronics Inc. Broadcast signal transmitting device, broadcast signal receiving device, broadcast signal transmitting method, and broadcast signal receiving method
US10412132B2 (en) * 2015-02-16 2019-09-10 Lg Electronics Inc. Broadcasting signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method
US11057446B2 (en) 2015-05-14 2021-07-06 Bright Data Ltd. System and method for streaming content from multiple servers
CN106254300B (en) * 2015-06-08 2020-04-21 中兴通讯股份有限公司 Streaming media transmission method, playing method, transmission device and playing device
US10291681B2 (en) 2015-06-18 2019-05-14 Ericsson Ab Directory limit based system and method for storing media segments
US10193994B2 (en) * 2015-06-18 2019-01-29 Qualcomm Incorporated Signaling cached segments for broadcast
US11095537B2 (en) * 2015-06-19 2021-08-17 Qualcomm Incorporated Middleware delivery of dash client QoE metrics
US20170048681A1 (en) * 2015-08-11 2017-02-16 At&T Intellectual Property I, L.P. On-demand time-shifted access of broadcast content
JP6661931B2 (en) * 2015-09-17 2020-03-11 沖電気工業株式会社 Information distribution apparatus, information distribution program, and information distribution system
CN106549916A (en) * 2015-09-18 2017-03-29 中兴通讯股份有限公司 Multicast transmission method, apparatus and system
GB2543312A (en) * 2015-10-14 2017-04-19 Smartpipe Tech Ltd Network identification as a service
WO2017125150A1 (en) * 2016-01-20 2017-07-27 Telefonaktiebolaget Lm Ericsson (Publ) Switching between unicast and multicast in a content delivery network
EP3440817B1 (en) * 2016-04-06 2022-06-22 Karamba Security Automated security policy generation for controllers
BR112019003507A8 (en) * 2016-08-29 2023-02-07 Sony Corp APPARATUS, METHOD AND INFORMATION PROCESSING SYSTEM
KR102532645B1 (en) * 2016-09-20 2023-05-15 삼성전자 주식회사 Method and apparatus for providing data to streaming application in adaptive streaming service
US10542409B2 (en) * 2016-10-07 2020-01-21 Qualcomm Incorporated Access for group call services through a broadcast channel
CN107979570A (en) * 2016-10-25 2018-05-01 北京优朋普乐科技有限公司 Network transceiver resource data processing method and device
US10893315B2 (en) 2017-03-24 2021-01-12 Sony Corporation Content presentation system and content presentation method, and program
EP4187881A1 (en) 2017-08-28 2023-05-31 Bright Data Ltd. Improving content fetching by selecting tunnel devices grouped according to geographic location
US11190374B2 (en) 2017-08-28 2021-11-30 Bright Data Ltd. System and method for improving content fetching by selecting tunnel devices
US20190075545A1 (en) * 2017-09-02 2019-03-07 Qualcomm Incorporated Method and apparatus for providing unicast representations within a broadcast coverage area
CN108810652A (en) * 2018-06-04 2018-11-13 深圳汇通九州科技有限公司 A kind of information processing method and terminal device
LT3780557T (en) * 2019-02-25 2023-03-10 Bright Data Ltd. System and method for url fetching retry mechanism
EP3935792A4 (en) 2019-04-02 2022-11-30 Bright Data Ltd. System and method for managing non-direct url fetching service
CN110708293B (en) * 2019-09-11 2021-11-19 中国联合网络通信集团有限公司 Method and device for distributing multimedia service
CN112929070B (en) * 2019-12-06 2023-04-18 中移(上海)信息通信科技有限公司 Data broadcasting system and method
EP3886401A1 (en) * 2020-03-27 2021-09-29 Nokia Technologies Oy Method, apparatus, and computer program product for error handling for indirect communications

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1322094A1 (en) * 2001-12-21 2003-06-25 Castify Holdings, Ltd Process for selecting a server in a content delivery network
CN1902865A (en) * 2003-11-07 2007-01-24 诺基亚有限公司 Streaming from a server to a client
US20120110120A1 (en) * 2010-11-02 2012-05-03 Johannes Willig Methods and Devices for Media Description Delivery
US20120259994A1 (en) * 2011-04-05 2012-10-11 Gillies Donald W Ip broadcast streaming services distribution using file delivery methods

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6052718A (en) 1997-01-07 2000-04-18 Sightpath, Inc Replica routing
US7809854B2 (en) * 2002-02-12 2010-10-05 Open Design, Inc. Logical routing system
US6990512B1 (en) 2001-03-19 2006-01-24 Novell, Inc. Method and system for using live time shift technology to control a multimedia file
US6813690B1 (en) * 2001-06-12 2004-11-02 Network Appliance, Inc. Caching media data using content-sensitive identifiers
US7987491B2 (en) * 2002-05-10 2011-07-26 Richard Reisman Method and apparatus for browsing using alternative linkbases
US7480723B2 (en) * 2003-04-08 2009-01-20 3Com Corporation Method and system for providing directory based services
US7454510B2 (en) 2003-05-29 2008-11-18 Microsoft Corporation Controlled relay of media streams across network perimeters
US7647599B2 (en) * 2003-12-22 2010-01-12 Motorola, Inc. Interprocessor communication network providing dynamic dedication of ports
US7162533B2 (en) * 2004-04-30 2007-01-09 Microsoft Corporation Session description message extensions
US20060031559A1 (en) 2004-05-25 2006-02-09 Gennady Sorokopud Real Time Streaming Protocol (RTSP) proxy system and method for its use
US20070130597A1 (en) 2005-12-02 2007-06-07 Alcatel Network based instant replay and time shifted playback
US9209934B2 (en) 2006-06-09 2015-12-08 Qualcomm Incorporated Enhanced block-request streaming using cooperative parallel HTTP and forward error correction
US9380096B2 (en) * 2006-06-09 2016-06-28 Qualcomm Incorporated Enhanced block-request streaming system for handling low-latency streaming
WO2008002294A1 (en) 2006-06-27 2008-01-03 Thomson Licensing Method and apparatus for reliably delivering multicast data
US7584495B2 (en) 2006-06-30 2009-09-01 Nokia Corporation Redundant stream alignment in IP datacasting over DVB-H
US20080069126A1 (en) 2006-09-14 2008-03-20 Sbc Knowledge Ventures, L.P. Method and system for buffering content
US8489817B2 (en) * 2007-12-06 2013-07-16 Fusion-Io, Inc. Apparatus, system, and method for caching data
WO2009036184A2 (en) * 2007-09-11 2009-03-19 Research In Motion Limited System and method for sharing a sip communication service identifier
US8458290B2 (en) 2011-02-01 2013-06-04 Limelight Networks, Inc. Multicast mapped look-up on content delivery networks
US8661155B2 (en) * 2008-12-30 2014-02-25 Telefonaktiebolaget Lm Ericsson (Publ) Service layer assisted change of multimedia stream access delivery
US20100180011A1 (en) * 2009-01-12 2010-07-15 Microsoft Corporation Url based retrieval of portions of media content
US9369516B2 (en) 2009-01-13 2016-06-14 Viasat, Inc. Deltacasting
AU2010250118A1 (en) 2009-05-20 2011-12-15 Creative Ad Technology Proprietary Limited Methods and systems for delivering media to client device
CN101924944B (en) 2009-06-15 2013-06-05 华为技术有限公司 Selection method and information providing method and devices of scalable video coding operating point
US20110219416A1 (en) 2010-03-04 2011-09-08 Telefonaktiebolaget L M Ericsson (Publ) Network Time-Shift Methods and Apparatus
US9319448B2 (en) 2010-08-10 2016-04-19 Qualcomm Incorporated Trick modes for network streaming of coded multimedia data
EP2638682A4 (en) * 2010-11-12 2014-07-23 Realnetworks Inc Traffic management in adaptive streaming protocols
JP5837621B2 (en) * 2011-02-11 2015-12-24 インターデイジタル パテント ホールディングス インコーポレイテッド Content distribution and reception method and apparatus
US9226265B2 (en) 2011-04-15 2015-12-29 Qualcomm Incorporated Demand-based multimedia broadcast multicast service management
US20140245359A1 (en) 2011-06-01 2014-08-28 Interdigital Patent Holdings, Inc. Content Delivery Network Interconnection (CDNI) Mechanism
US9160779B2 (en) 2011-06-30 2015-10-13 Qualcomm Incorporated Dynamic adaptive streaming proxy for unicast or broadcast/multicast services
US9268621B2 (en) 2011-11-02 2016-02-23 Red Hat, Inc. Reducing latency in multicast traffic reception
US9769281B2 (en) * 2011-12-19 2017-09-19 Google Technology Holdings LLC Method and apparatus for determining a multimedia representation for a multimedia asset delivered to a client device
US20130182643A1 (en) 2012-01-16 2013-07-18 Qualcomm Incorporated Method and system for transitions of broadcast dash service receptions between unicast and broadcast
US9547532B2 (en) * 2012-01-19 2017-01-17 Microsoft Technology Licensing, Llc Techniques to provide proxies for web services
US9526091B2 (en) * 2012-03-16 2016-12-20 Intel Corporation Method and apparatus for coordination of self-optimization functions in a wireless network
US9820259B2 (en) 2012-05-04 2017-11-14 Qualcomm Incorporated Smooth transition between multimedia broadcast multicast service (MBMS) and unicast service by demand
US10015437B2 (en) 2013-01-15 2018-07-03 Qualcomm Incorporated Supporting transport diversity and time-shifted buffers for media streaming over a network
US9674251B2 (en) 2013-06-17 2017-06-06 Qualcomm Incorporated Mediating content delivery via one or more services
US10560509B2 (en) 2013-07-05 2020-02-11 Qualcomm Incorporated Method and apparatus for using HTTP redirection to mediate content access via policy execution

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1322094A1 (en) * 2001-12-21 2003-06-25 Castify Holdings, Ltd Process for selecting a server in a content delivery network
CN1902865A (en) * 2003-11-07 2007-01-24 诺基亚有限公司 Streaming from a server to a client
US20120110120A1 (en) * 2010-11-02 2012-05-03 Johannes Willig Methods and Devices for Media Description Delivery
US20120259994A1 (en) * 2011-04-05 2012-10-11 Gillies Donald W Ip broadcast streaming services distribution using file delivery methods

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331089A (en) * 2016-08-22 2017-01-11 乐视控股(北京)有限公司 Video play control method and system
CN110268694A (en) * 2017-02-17 2019-09-20 帝威视有限公司 The system and method adaptively switched between multiple content delivery networks during adaptive bit rate stream transmission
US11343300B2 (en) 2017-02-17 2022-05-24 Divx, Llc Systems and methods for adaptive switching between multiple content delivery networks during adaptive bitrate streaming
CN115134420A (en) * 2021-03-24 2022-09-30 华为技术有限公司 Media playing method and device and electronic equipment

Also Published As

Publication number Publication date
EP2946542A1 (en) 2015-11-25
HUE031896T2 (en) 2017-08-28
EP2946542B1 (en) 2016-12-28
BR112015016989A2 (en) 2017-07-11
ES2630279T3 (en) 2017-08-21
US20140199044A1 (en) 2014-07-17
JP2016510460A (en) 2016-04-07
BR112015016989B1 (en) 2023-02-14
KR101847585B1 (en) 2018-04-10
KR20150107837A (en) 2015-09-23
JP6231583B2 (en) 2017-11-15
CN105284093B (en) 2019-09-10
US10015437B2 (en) 2018-07-03
US20140201323A1 (en) 2014-07-17
WO2014113383A1 (en) 2014-07-24

Similar Documents

Publication Publication Date Title
CN105284093A (en) Supporting transport diversity and time-shifted buffers for media streaming over a network
US10433327B2 (en) Presence service using IMS based DASH service
JP6612249B2 (en) Targeted ad insertion for streaming media data
US10193994B2 (en) Signaling cached segments for broadcast
US9736506B2 (en) Method and apparatus for managing communication sessions
JP6698553B2 (en) Request for multiple chunks to a network node based on one request message
US9674251B2 (en) Mediating content delivery via one or more services
US8838149B2 (en) Apparatus and methods for ensuring delivery of geographically relevant content
RU2647654C2 (en) System and method of delivering audio-visual content to client device
US11374670B2 (en) Receiving device, transmitting device, and data processing method
US11038941B2 (en) Enabling a dynamic adaptive streaming over HTTP player to fetch media segments from a network
KR20160138044A (en) Targeted advertisement insertion for streaming media data
WO2016074149A1 (en) Expedited media content delivery
Zehra et al. Collaborative Systems for Video Streaming in Heterogeneous Wireless Networks with Mobile Peers

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant