US10212208B2 - Content supply device, content supply method, program, and content supply system - Google Patents

Content supply device, content supply method, program, and content supply system Download PDF

Info

Publication number
US10212208B2
US10212208B2 US14/893,475 US201414893475A US10212208B2 US 10212208 B2 US10212208 B2 US 10212208B2 US 201414893475 A US201414893475 A US 201414893475A US 10212208 B2 US10212208 B2 US 10212208B2
Authority
US
United States
Prior art keywords
metafile
different networks
content
receiving device
content supply
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US14/893,475
Other languages
English (en)
Other versions
US20160134680A1 (en
Inventor
Yasuaki Yamagishi
Masahito Mori
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Saturn Licensing LLC
Original Assignee
Saturn Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Saturn Licensing LLC filed Critical Saturn Licensing LLC
Assigned to SONY CORPORATION reassignment SONY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MORI, MASAHITO, YAMAGISHI, YASUAKI
Publication of US20160134680A1 publication Critical patent/US20160134680A1/en
Assigned to SATURN LICENSING LLC reassignment SATURN LICENSING LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SONY CORPORATION
Application granted granted Critical
Publication of US10212208B2 publication Critical patent/US10212208B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L65/4076—
    • H04L65/608—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
    • H04N21/4381—Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/631—Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

  • the present disclosure relates to a content supply device, a content supply method, a program, and a content supply system, and more particularly, to a content supply device, a content supply method, a program, and a content supply system, which are suitably applicable when content of the same subject is supplied through a plurality of delivery paths.
  • DASH Moving Picture Experts Group-Dynamic Adaptive Streaming over HTTP
  • MPEG-DASH Moving Picture Experts Group-Dynamic Adaptive Streaming over HTTP
  • a content supply side is configured to prepare a plurality of streams in which content of the same subject is included, and an image quality, an angle of view size, or the like changes according to a communication environment of the Internet serving as a path or a capability or a state of a reception side.
  • the reception side can select an optimal stream according to the communication environment of the Internet, the capability or the state of the reception side, or the like among the plurality of streams prepared by the supply side and acquire and reproduce the selected optimal stream.
  • a metafile called a media presentation description (MPD) is supplied from the supply side to the reception side so that the reception side can adaptively select and acquire a stream.
  • MPD media presentation description
  • An address (url information) of streaming data (media data such as audio/video/subtitle) divided into chunks is described in the MPD, and thus the reception side can access a predetermined server serving as a content supply source based on the url information and acquire and reproduce HTTP-delivered streaming data.
  • FIG. 1 illustrates an example of a configuration of a content supply system that delivers content in a streaming manner based on the DASH.
  • a content supply system 10 is configured with a content management server 11 , a DASH segment streamer 12 , a DASH MPD server 13 , a cache server 15 , and a DASH client 17 .
  • the content management server 11 manages content supplied to the DASH client 17 , generates a plurality of pieces of streaming data having different bit rates from content of the same subject, and outputs the generated streaming data to the DASH segment streamer 12 .
  • the DASH segment streamer 12 temporally divides streaming data of content into segments, holds each of the segments as a file, and notifies the DASH MPD server 13 of an address of a supply source of the files. Further, the DASH segment streamer 12 HTTP-delivers the file of the segmented streaming data in response to a request from the DASH client 17 of the reception side as an HTTP server.
  • the DASH MPD server 13 generates an MPD in which, for example, an address indicating a supply source of files of a plurality of pieces of segmented streaming data is described, and HTTP-delivers the MPD according to the request from the DASH client 17 of the reception side.
  • the cache server 15 present on the Internet caches the HTTP-delivered MPD, the file of the segmented streaming data, or the like. Then, when a request to transmit the cached MPD, the file of the cached segmented streaming data is transmitted from the DASH client 17 - 2 to the DASH MPD server 13 or the DASH segment streamer 12 , the cached MPD or the cached segmented streaming data is HTTP-delivered to the DASH client 17 - 2 instead.
  • the DASH client 17 acquires the MPD from the DASH MPD server 13 , selects a stream suitable for a current situation among a plurality of streams prepared by the DASH segment streamer 12 based on the acquired MPD, transmits a request to the DASH segment streamer 12 , and receives and reproduces a file that is HTTP-delivered according to the request.
  • the reception side can acquire and reproduce a stream that is broadcast-delivered in a broadcast manner via various broadcasting networks (a terrestrial broadcasting network, a satellite broadcasting network, a mobile communication network, a wireless LAN such as Wi-Fi, and the like) or a stream that is multicast-delivered via the Internet as well, it is desirable to supply a stream using a delivery path thereof and enable the reception side to adaptively select a stream.
  • various broadcasting networks a terrestrial broadcasting network, a satellite broadcasting network, a mobile communication network, a wireless LAN such as Wi-Fi, and the like
  • the present disclosure was made in light of the foregoing, and it is desirable to extend an adaptive streaming technique employing the DASH and supply content through a plurality of different delivery paths.
  • a content supply device that supplies a plurality of pieces of streaming data that include content of a same subject and differ in an attribute according to an adaptive streaming technique
  • the content supply device including: a supply unit configured to supply the plurality of pieces of streaming data to a reception side via a plurality of different networks; and a metafile generating unit configured to generate a metafile including an acquisition destination of a manifest file in which a QoS parameter for selecting the plurality of pieces of streaming data to be supplied by the reception side and a condition value of the QoS parameter are described and supply the metafile to the reception side.
  • the metafile generating unit can generate an extended MPD as the metafile.
  • the plurality of different networks can include at least one of the Internet, a terrestrial broadcasting network, a satellite broadcasting network, a cable television broadcasting network, a mobile broadcasting network, and a wireless LAN.
  • the metafile can be supplied to the reception side by HTTP delivery, FLUTE delivery, or broadcast delivery via the network.
  • a content supply method of a content supply device that supplies a plurality of pieces of streaming data that include content of a same subject and differ in an attribute according to an adaptive streaming technique, the content supply method including: a supply step of supplying the plurality of pieces of streaming data to a reception side via a plurality of different networks through the content supply device; and a metafile generating step of generating a metafile including an acquisition destination of a manifest file in which a QoS parameter for selecting the plurality of pieces of streaming data to be supplied by the reception side and a condition value of the QoS parameter are described and supplying the metafile to the reception side through the content supply device.
  • a program causing a computer that supplies a plurality of pieces of streaming data that include content of a same subject and differ in an attribute according to an adaptive streaming technique to function as: a supply unit configured to supply the plurality of pieces of streaming data to a reception side via a plurality of different networks; and a metafile generating unit configured to generate a metafile including an acquisition destination of a manifest file in which a QoS parameter for selecting the plurality of pieces of streaming data to be supplied by the reception side and a condition value of the QoS parameter are described and supply the metafile to the reception side.
  • a plurality of pieces of streaming data are supplied to a reception side via a plurality of different networks, and a metafile including an acquisition destination of a manifest file in which a QoS parameter for selecting the plurality of pieces of streaming data to be supplied by the reception side and a condition value of the QoS parameter are described is generated and supplied to the reception side.
  • a content supply system including: a content supply device configured to supply a plurality of pieces of streaming data that include content of a same subject and differ in an attribute according to an adaptive streaming technique; and a terminal device configured to receive the stream data.
  • the content supply device includes a supply unit configured to supply the plurality of pieces of streaming data to the terminal device via a plurality of different networks, and a metafile generating unit configured to generate a metafile including an acquisition destination of a manifest file in which a QoS parameter for selecting the plurality of pieces of streaming data to be supplied by the terminal device and a condition value of the QoS parameter are described and supply the metafile to the reception side.
  • the terminal device acquires the manifest file based on the acquired metafile, and selects streaming data to be received based on the QoS parameter and the condition value of the QoS parameter described in the manifest file.
  • a content supply device supplies a plurality of pieces of streaming data a reception side via a plurality of different networks, generates a metafile including an acquisition destination of a manifest file in which a QoS parameter for selecting the plurality of pieces of streaming data to be supplied by the reception side and a condition value of the QoS parameter are described, and supplies the metafile to the reception side.
  • a terminal device acquires the manifest file based on the acquired metafile, and selects streaming data to be received based on the QoS parameter and the condition value of the QoS parameter described in the manifest file.
  • FIG. 1 is a block diagram illustrating an example of a configuration of a content supply system of the related art.
  • FIG. 2 is a block diagram illustrating an exemplary configuration of a content supply system to which the present disclosure is applied.
  • FIG. 3 is a diagram for describing temporal delimiting of content.
  • FIG. 4 is a diagram illustrating a configuration of an MPD.
  • FIG. 5 is a diagram illustrating a hierarchical structure below a period in an MPD.
  • FIG. 6 is a diagram illustrating a state in which a configuration of an MPD is arranged on a time axis.
  • FIG. 7 is a diagram illustrating a detailed structure below a representation of an MPD.
  • FIG. 8 is a diagram illustrating an example in which a structure below a representation is described in an XML format.
  • FIG. 9 is a diagram illustrating a structure of an extended MPD.
  • FIG. 10 is a diagram illustrating an example of an XML Schema of a ServiceLocation element designated by a serviceLocationAttributeUrl attribute.
  • FIG. 11 is a diagram illustrating a data structure of a ServiceLocation element designated by a serviceLocationAttributeUrl attribute.
  • FIG. 12 is a diagram illustrating an example of a tuning parameter.
  • FIG. 13 is a diagram illustrating an example of a QoS parameter of DVB satellite broadcasting/cable television.
  • FIG. 14 is a diagram illustrating an example of a QoS parameter of DVB cable television.
  • FIG. 15 is a diagram illustrating an example of a QoS parameter of DVB satellite broadcasting.
  • FIG. 16 is a diagram illustrating an example of a QoS parameter of terrestrial broadcasting (DVB-T).
  • FIG. 17 is a diagram illustrating an example of a QoS parameter of terrestrial broadcasting (DVB-T2).
  • FIG. 18 is a diagram illustrating an example of a QoS parameter of cable television (DVB-C2).
  • FIG. 19 is a diagram illustrating an example of a QoS parameter of other terrestrial broadcasting.
  • FIG. 20 is a diagram illustrating an example of a QoS parameter for a 3G mobile phone (UTRA FDD) terminal.
  • FIG. 21 is a diagram illustrating an example of a QoS parameter for a 3G mobile phone (UTRA TDD) terminal.
  • FIG. 22 is a diagram illustrating an example of a QoS parameter for an LTE (E-UTRA) terminal.
  • FIG. 23 is a diagram illustrating a streaming protocol stack.
  • FIG. 24 is a flowchart for describing an operation of a content supply device.
  • FIG. 25 is a flowchart for describing an operation of a content supply system.
  • FIG. 26 is a block diagram illustrating an exemplary configuration of a computer.
  • a content supply system implements adaptive streaming in which content is supplied through a plurality of different delivery paths.
  • the MPD in the DASH is extended to describe various kinds of broadcasting networks as well as the Internet, and describes a reference value of a QoS parameter necessary when each delivery path is selected, and reception is performed.
  • the reception side can receive and reproduce an optimal content stream according to a reception environment or a decoding capability of the reception side or the like.
  • FIG. 2 illustrates an exemplary configuration of a content supply system according to an embodiment of the present disclosure.
  • a content supply system 20 is configured with a content supply device 30 and a terminal device 40 .
  • the content supply device 30 includes a content management server 31 , a DASH segment streamer 32 , a DASH MPD server 33 , an RTP/RTP/FLUTE server 34 , and a broadcast delivery server 35 .
  • the content management server 31 manages content (including live broadcasting content) to be supplied to the terminal device 40 of the reception side, generates a plurality of pieces of streaming data having different bit rates from content of the same subject, and outputs the generated streaming data to the DASH segment streamer 32 .
  • the DASH segment streamer 32 temporally delimits the streaming data of content into periods, divides each period into segments, and holds each segment as a file as illustrated in FIG. 3 .
  • the DASH segment streamer 32 notifies the DASH MPD server 33 and the RTP/FLUTE server 34 of an address serving as a supply source of the held files.
  • the DASH segment streamer 32 supplies the files of the segmented streaming data to the RTP/FLUTE server 34 .
  • the DASH segment streamer 32 unicast-delivers the files of the segmented streaming data via the Internet 1 according to the HTTP in response to a request from the terminal device 40 .
  • the DASH MPD server 33 generates an MPD necessary for receiving the streaming data of content supplied via a plurality of different delivery paths, and unicast-delivers the MPD via the Internet 1 according to the HTTP in response to a request from the terminal device 40 .
  • the DASH MPD server 33 supplies the generated MPD to the RTP/FLUTE server 34 .
  • the generated MPD is HTTP-delivered from the DASH MPD server 33 but may be multicast-delivered from the RTP/FLUTE server 34 or broadcast-delivered from the broadcast delivery server 35 .
  • the RTP/FLUTE server 34 generates an FLUTE packet (for example, an asynchronous layered coding (ALC) packet) storing the file of the segmented streaming data, generates an FDT based on the MPD, and multicast-delivers the FLUTE packet and the FDT via the Internet 1 according to an FLUTE protocol.
  • the RTP/FLUTE server 34 supplies the FLUTE packet and the FDT to the broadcast delivery server 35 .
  • the broadcast delivery server 35 broadcast-delivers the FLUTE packet and the FDT supplied from the RTP/FLUTE server 34 via a broadcasting network 2 .
  • the broadcasting network 2 include a terrestrial broadcasting network, a satellite broadcasting network, a CATV network, and a mobile communication network.
  • a term “multicast delivery” is assumed to include a meaning of “broadcast delivery” via the broadcasting network 2 .
  • a cache server 36 installed on the Internet 1 caches the MPD, the files of the segmented streaming data, the FDT, the FLUTE packet, and the like that are HTTP-delivered and multicast-delivered via the Internet 1 . Then, when a request to transmit the cached MPD and the like is transmitted from the terminal device 40 to the DASH MPD server 33 or the like, the cached MPD and the like are HTTP-delivered to the terminal device 40 of the request source instead.
  • FIG. 4 illustrates a data configuration of the MPD.
  • FIG. 5 illustrates a hierarchical structure below a period in the MPD.
  • information related to content is divided into units of periods.
  • a plurality of representations including information related to streaming data of the same subject that differs in an image quality or an angle of view size and differs in a stream attribute such as a bit rate are prepared.
  • the representation stores information related to a segment obtained by further temporally dividing a period.
  • FIG. 6 illustrates a state in which a structure of the MPD is arranged on a time axis.
  • the terminal device 40 can adaptively select any of the representations in units of segments according to the communication environment, the decoding capability of the terminal device 40 , or the like and acquire and reproduce appropriate stream data.
  • FIG. 7 illustrates a structure below the representation of the MPD.
  • An address of the supply source of the file storing the segmented stream data is described in the representation. Specifically, when a plurality of pieces of segmented stream data are individually held as files, a sequence of addresses (url information) of supply sources of the respective files is described. Further, when a plurality of pieces of segmented stream data are collectively held as one file, an address (Base URL) of a supply source of the file and a sequence of ranges (mediaRange) of segments in the file are described.
  • FIG. 7 illustrates the latter case.
  • FIG. 8 illustrates an example in which the structure below the representation illustrated in FIG. 7 is described in an XML format.
  • MPD/Period/AdaptationSet/Representation/SegmentList/SegmentURL/@m ediaRange indicates a byte range of the segmented stream data in the file.
  • the terminal device 40 acquires first segmented stream data, it is desirable to designate the mediaRange “795-83596” to a range header together with a url “http://example.com/counter-10 mn_avc_dash.mp4” of the file and issue an HTTP request.
  • the HTTP request is as follows:
  • the HTTP request is as follows:
  • the MPD is extended to describe various kinds of broadcasting networks as well as the Internet as a delivery path of a content stream and describe a reference value of a QoS parameter necessary for selecting each delivery path and performing reception.
  • a ServiceLocation element in which a tuning parameter (DeliverySystemAttributes) and an IP multicast address (IPMulticastAddress) are described is introduced as a new element for receiving an IP multicast stream in which a group of segment files are transferred.
  • a serviceLocationAttribute Url attribute for describing a url of a serviceLocationAttribute file in which the ServiceLocation element is stored as a root element is introduced into the MPD.
  • FIG. 10 illustrates an example of an XML schema of the ServiceLocation element stored in a ServiceLocation file designated by the serviceLocationAttributeUrl attribute.
  • FIG. 11 illustrates a hierarchical structure of an XML schema below DeliverySystemAttributes illustrated in FIG. 10 .
  • An L3L4L5Address is an element in which an FLUTE session stream, an IP address “ipAddress” to which an RTP multicast stream is transferred, a port number “port,” and a session ID “transportSessionId” of the FLUTE are stored when an SDP is not used for resolution of a multicast stream.
  • a DeliverySystemIdentifier is an element in which a format identifier of a data structure of a tuning parameter employed for broadcast delivery or multicast delivery is stored.
  • ID_DVB_T is stored in the case of broadcast delivery by terrestrial broadcasting employed in Europe
  • ID_DVB_S is stored in the case of broadcast delivery by satellite broadcasting.
  • the DeliverySystemDescriptor is an element in which a data structure (a parameter itself) of a tuning parameter specified for broadcast delivery or multicast delivery identified by the DeliverySystemIdentifier is stored.
  • FIG. 12 illustrates an example of a data structure of a tuning parameter corresponding to broadcast delivery by terrestrial broadcasting employed in Europe. In practice, a byte sequence conforming to the above format is converted into a character string by base64 or the like and then described in the DeliverySystemDescriptor.
  • a RequiredQoSParameter is an element in which an identification name “parameterURI” of a QoS parameter necessary for tuning and “upperLimit,” “lowerLimit,” or “just (a designated value)” serving as a condition value “requestdValue” of the QoS parameter are stored.
  • a parameter related to strength of a radio wave there are a parameter related to a bit error rate (BER). More specifically, as the former example, there are a carrier-to-noise ratio (a CN ratio), a received signal strength indicator (RSSI), and the like. As the latter example, there are a bit error rate (a BER before/after RS) before/after a Reed Solomon (RS) error correction process (which differs according to a broadcasting/communication scheme), a transport block error rate (BLER), and the like.
  • a bit error rate a BER before/after RS
  • RS Reed Solomon
  • the CN ratio is classified into several classes (for example, three classes) and evaluated as the condition value,
  • level 1 (designated by “urn:CNclass1”): 10 ⁇ 3 or more (defective),
  • level 2 (designated by “urn:CNclass2”): 10 ⁇ 5 or more and less than 10 ⁇ 3 (good), and
  • level 3 (designated by “urn:CNclass3”): less than 10 ⁇ 5 (best)
  • FIG. 13 illustrates an example of a QoS parameter of DVB satellite broadcasting/cable television.
  • FIG. 14 illustrates an example of a QoS parameter of DVB cable television.
  • FIG. 15 illustrates an example of a QoS parameter of DVB satellite broadcasting.
  • FIG. 16 illustrates an example of a QoS parameter of terrestrial broadcasting (DVB-T).
  • the examples of the QoS parameter illustrated in FIGS. 13 to 16 are defined in ETSI TR 101 290 V1.2.1 (2001-05), “Digital Video Broadcasting (DVB); Measurement guidelines for DVB systems.”
  • FIG. 17 illustrates an example of a QoS parameter of terrestrial broadcasting (DVB-T2). This parameter is defined in DVB BlueBook A14-2 (07/12), “Digital Video Broadcasting (DVB); Measurement guidelines for DVB systems; Amendment for DVB-T2 System.”
  • FIG. 18 illustrates an example of a QoS parameter of cable television (DVB-C2). This parameter is defined in DVB BlueBook A14-3 (03/13), “Digital Video Broadcasting (DVB); Measurement guidelines for DVB systems; Amendment for DVB-C2 System.”
  • FIG. 19 illustrates an example of a QoS parameter of other terrestrial broadcasting. This parameter is defined in NorDig Unified ver2.4.
  • FIG. 20 illustrates an example of a QoS parameter for a 3G mobile phone (UTRA FDD) terminal.
  • This parameter is defined in ETSI TS 125 215 V11.0.0 (2012-11); “Universal Mobile Telecommunications System (UMTS); Physical layer; Measurements (FDD) (3GPP TS 25.215 version 11.0.0 Release 11).”
  • FIG. 21 illustrates an example of a QoS parameter for a 3G mobile phone (UTRA TDD) terminal.
  • This parameter is defined in ETSI TS 125 225 V11.0.0 (2012-09); “Universal Mobile Telecommunications System (UMTS); Physical layer; Measurements (TDD) (3GPP TS 25.225 version 11.0.0 Release 11).”
  • FIG. 22 is a diagram illustrating an example of a QoS parameter for an LTE (E-UTRA) terminal. This parameter is defined in ETSI TS 136 214 V11.1.0 (2013-02); “LTE; Evolved Universal Terrestrial Radio Access (E-UTRA); Physical layer; Measurements (3GPP TS 36.214 version 11.1.0 Release 11).”
  • a group of files are carried by the RTP protocol or the FLUTE protocol.
  • FIG. 23 illustrates a streaming protocol stack of a group of files carried on the IP packet stream.
  • the RTP is a protocol for transferring a real-time (synchronous) stream on an IP packet.
  • the FLUTE protocol is a protocol for transferring a file on an IP packet and hierarchically configured as illustrated in A or B of FIG. 23 .
  • MAC is a general term of a link layer protocol, and in a broadcasting system, GSE, TLV, or the like corresponds to the MAC.
  • the FDT is also extended to express some files.
  • a range attribute is introduced into the FDT to designate the Content-Location and a byte range of a file designated by a url of the Content-Location.
  • a definition of a range-specifier (RFC2616.section.14.35.1) is applied to a syntax of the range attribute.
  • Period/AdaptationSet/Representation/SegmentList/SegmentURL/@mediaRange of the MPD can be used without change.
  • the terminal device 40 can adaptively switch streaming data to be acquired and reproduced, ad hoc, among HTTP delivery, broadcast delivery, and multicast delivery. Further, it is possible to secure flexibility in operating a content streaming service.
  • FIG. 24 is a flowchart for describing an operation of the content supply device 30 of the content supply system 20 .
  • step S 1 the content management server 31 supplies a plurality of pieces of streaming data that include content of the same subject to be supplied to the terminal device 40 of the reception side and differ in a bit rate or the like to the DASH segment streamer 32 .
  • step S 2 the content management server 31 notifies the DASH MPD server 33 of the metadata of content.
  • step S 11 the DASH segment streamer 32 that has been supplied with the streaming data temporally delimits the streaming data of content into periods, divides the period into segments to generate DASH stream segments, and converts each of the DASH stream segments into a file. Further, the DASH segment streamer 32 supplies the files of the DASH stream segments to the RTP/FLUTE server 34 for the multicast delivery.
  • step S 12 the DASH segment streamer 32 notifies the DASH MPD server 33 and the RTP/FLUTE server 34 of the address (the url information) of the supply source of the file of the DASH stream segment. Thereafter, in step S 13 , the DASH segment streamer 32 starts the HTTP delivery of the files of the DASH stream segments via the Internet 1 in response to the request to the terminal device 40 .
  • the DASH MPD server 33 that has been notified of the address of the supply source of the file of the DASH stream segment generates the MPD in step S 21 , and supplies the MPD to the RTP/FLUTE server 34 and requests the RTP/FLUTE server 34 to perform the delivery according to the FLUTE in step S 22 . Thereafter, in step S 23 , the DASH MPD server 33 starts the HTTP delivery of the generated MPD via the Internet 1 in response to the request from the terminal device 40 .
  • step S 31 the RTP/FLUTE server 34 that has been supplied with the MPD from the DASH MPD server 33 generates the extended FDT based on the MPD, and generates the FLUTE packet (or the RTP packet) storing the file of the DASH stream segment supplied from the DASH segment streamer 32 .
  • step S 32 the RTP/FLUTE server 34 supplies the generated FDT and the FLUTE packet (or the RTP packet) to the broadcast delivery server 35 , and requests the broadcast delivery server 35 to perform the broadcast delivery of the FDT and the FLUTE packet (or the RTP packet). Thereafter, in step S 33 , the RTP/FLUTE server 34 starts the multicast delivery of the FDT and the FLUTE packet (or the RTP packet) via the Internet 1 at a predetermined timing.
  • step S 41 the broadcast delivery server 35 that has been supplied with the FDT and the FLUTE packet (or the RTP packet) broadcast-delivers the FLUTE packet (or the RTP packet) and the FDT via the broadcasting network 2 at a predetermined timing.
  • the description of the operation of the content supply device 30 of the content supply system 20 is now finished.
  • FIG. 25 is a flowchart for describing an operation until the terminal device 40 receives and reproduces content.
  • step S 51 the terminal device 40 that desires to receive and reproduce content accesses the DASH MPD server 33 via the Internet 1 , and requests the DASH MPD server 33 to transmit the MPD.
  • step S 61 the DASH MPD server 33 HTTP-delivers the MPD to the terminal device 40 via the Internet 1 in response to the request.
  • the cache server 36 on the Internet 1 is holding the MPD, instead of the DASH MPD server 33 , the cache server 36 HTTP-delivers the MPD to the terminal device 40 .
  • step S 51 there are cases in which the MPD is FLUTE-delivered or broadcast-delivered via the broadcasting network 2 , and when the MPD is received and acquired, the process of step S 51 is unnecessary.
  • step S 52 the terminal device 40 that has acquired the MPD acquires the ServiceLocationAttribute file based on the serviceLocationAttributeUrl attribute of the MPD, and monitors a current communication state of the terminal device 40 with reference to the RequiredQoSParameter element described in the ServiceLocationAttribute file, and selects an optimal stream to be acquired.
  • step S 53 the terminal device 40 issues the HTTP request based on the BaseURL and the mediaRange of the MPD corresponding to the selected stream, and requests the DASH segment streamer 32 to deliver the file of the DASH stream segment.
  • step S 71 the DASH segment streamer 32 HTTP-delivers the corresponding file to the terminal device 40 via the Internet 1 in response to the request. Further, when the cache server 36 on the Internet 1 is holding the file, instead of the DASH segment streamer 32 , the cache server 36 HTTP-delivers the file to the terminal device 40 .
  • step S 54 the terminal device 40 receives and reproduces the HTTP-delivered file. Thereafter, for example, when the communication environment of the Internet 1 has deteriorated, the terminal device 40 can adaptively switch the stream to be received. Specifically, in step S 55 , for example, the broadcast delivery server 35 can receive and reproduce the file of the DASH stream segment that is broadcast-delivered in step S 81 . Thereafter, the terminal device 40 can return to reception and reproduction of the HTTP-delivered file.
  • the terminal device 40 can perform switching to an optimal stream in a current situation.
  • each of the content supply device 30 and the terminal device 40 that execute a series of processes described above can be configured with hardware or can be implemented by executing software through a computer.
  • Examples of the computer include a computer embedded in dedicated hardware and a general-purpose personal computer capable of installing various kinds of programs and executing various kinds of functions.
  • FIG. 26 is a block diagram illustrating an exemplary hardware configuration of the computer.
  • a central processing unit (CPU) 101 a read only memory (ROM) 102 , and a random access memory (RAM) 103 are connected with one another via a bus 104 .
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • An input/output interface 105 is connected to the bus 104 .
  • An input unit 106 , an output unit 107 , a storage unit 108 , a communication unit 109 , and a drive 110 are connected to the input/output interface 105 .
  • the input unit 106 includes a keyboard, a mouse, a microphone, and the like.
  • the output unit 107 includes a display, a speaker, and the like.
  • the storage unit 108 includes a hard disk, a non-volatile memory, and the like.
  • the communication unit 109 includes a network interface.
  • the drive 110 drives a removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
  • a series of processes described above are performed by loading a program stored in the storage unit 108 onto the RAM 103 through the input/output interface 105 and the bus 104 and executing the loaded program through the CPU 101 .
  • the program executed by the computer 100 may be recorded in the removable medium 111 serving as a package medium or the like and provided.
  • the program may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
  • the removable medium 111 may be mounted on the drive 110 , and the program may be installed in the storage unit 108 through the input/output interface 105 .
  • the program may be received by the communication unit 109 via a wired or wireless transmission medium and installed in the storage unit 108 .
  • the program may be installed in the ROM 102 or the storage unit 108 in advance.
  • the program executed by the computer 100 may be a program in which a process is chronologically performed according to the sequence described in the present specification or may be a program in which a process is performed in parallel or at a necessary timing, for example, when calling is performed.
  • present technology may also be configured as below.
  • a content supply device that supplies a plurality of pieces of streaming data that include content of a same subject and differ in an attribute according to an adaptive streaming technique, the content supply device including:
  • a supply unit configured to supply the plurality of pieces of streaming data to a reception side via a plurality of different networks
  • a metafile generating unit configured to generate a metafile including an acquisition destination of a manifest file in which a QoS parameter for selecting the plurality of pieces of streaming data to be supplied by the reception side and a condition value of the QoS parameter are described and supply the metafile to the reception side.
  • metafile generating unit generates an extended MPD as the metafile.
  • the plurality of different networks include at least one of the Internet, a terrestrial broadcasting network, a satellite broadcasting network, a cable television broadcasting network, a mobile broadcasting network, and a wireless LAN.
  • the content supply device according to any of (1) to (3),
  • metafile is supplied to the reception side by HTTP delivery, FLUTE delivery, or broadcast delivery via the network.
US14/893,475 2013-06-06 2014-05-26 Content supply device, content supply method, program, and content supply system Active 2035-10-22 US10212208B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2013-119511 2013-06-06
JP2013119511A JP2014239278A (ja) 2013-06-06 2013-06-06 コンテンツ供給装置、コンテンツ供給方法、プログラム、およびコンテンツ供給システム
PCT/JP2014/063794 WO2014196392A1 (ja) 2013-06-06 2014-05-26 コンテンツ供給装置、コンテンツ供給方法、プログラム、およびコンテンツ供給システム

Publications (2)

Publication Number Publication Date
US20160134680A1 US20160134680A1 (en) 2016-05-12
US10212208B2 true US10212208B2 (en) 2019-02-19

Family

ID=52008042

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/893,475 Active 2035-10-22 US10212208B2 (en) 2013-06-06 2014-05-26 Content supply device, content supply method, program, and content supply system

Country Status (5)

Country Link
US (1) US10212208B2 (ja)
EP (1) EP3007458A4 (ja)
JP (1) JP2014239278A (ja)
CN (1) CN105247882A (ja)
WO (1) WO2014196392A1 (ja)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105659615B (zh) * 2013-10-28 2019-11-05 索尼公司 内容供给装置、内容供给方法、终端装置及内容供给系统
US10129308B2 (en) * 2015-01-08 2018-11-13 Qualcomm Incorporated Session description information for over-the-air broadcast media data
CN107852523B (zh) * 2015-09-30 2021-01-19 苹果公司 用于在终端之间同步媒体渲染的方法、终端和设备
US9788033B1 (en) * 2016-06-29 2017-10-10 Cisco Technology, Inc. Secure differential insertion of secondary content
US10893315B2 (en) 2017-03-24 2021-01-12 Sony Corporation Content presentation system and content presentation method, and program
CN113329244B (zh) * 2017-09-30 2022-07-22 华为技术有限公司 业务传输方法和装置
US11438282B2 (en) * 2020-11-06 2022-09-06 Khoros, Llc Synchronicity of electronic messages via a transferred secure messaging channel among a system of various networked computing devices

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012096372A1 (ja) 2011-01-14 2012-07-19 シャープ株式会社 コンテンツ再生装置、コンテンツ再生方法、配信システム、コンテンツ再生プログラム、記録媒体、およびデータ構造
WO2012096353A1 (ja) 2011-01-12 2012-07-19 シャープ株式会社 再生装置、再生装置の制御方法、生成装置、生成装置の制御方法、記録媒体、データ構造、制御プログラム、及び該プログラムを記録した記録媒体
US20130007814A1 (en) * 2011-06-30 2013-01-03 Qualcomm Incorporated Dynamic adaptive streaming proxy for unicast or broadcast/multicast services
US20130013799A1 (en) 2011-07-07 2013-01-10 Samsung Electronics Co., Ltd. Method and apparatus for transmitting and receiving content in a broadcasting system
JP2013038766A (ja) 2011-07-12 2013-02-21 Sharp Corp 送信装置、送信装置の制御方法、制御プログラム、及び記録媒体
WO2013048484A1 (en) 2011-09-30 2013-04-04 Intel Corporation Quality of experience enhancements over wireless networks
WO2013057315A2 (en) 2011-10-21 2013-04-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Resource management concept
US20130111028A1 (en) 2011-11-01 2013-05-02 Lukasz Kondrad Method and apparatus for selecting an access method for delivery of media
US20130107786A1 (en) * 2011-10-31 2013-05-02 Interdigital Patent Holdings, Inc. Method and apparatus for enabling multimedia synchronization
US20140040498A1 (en) * 2012-08-03 2014-02-06 Ozgur Oyman Methods for quality-aware adaptive streaming over hypertext transfer protocol
US20140250230A1 (en) * 2012-10-11 2014-09-04 Verizon Patent And Licensing Inc. Media manifest file generation for adaptive streaming cost management
US20140258552A1 (en) * 2011-12-28 2014-09-11 Ozgur Oyman Video adaptation for content-aware wireless streaming
US20150256861A1 (en) * 2012-10-26 2015-09-10 Intel Corporation Multimedia adaptation based on video orientation

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2012096353A1 (ja) 2011-01-12 2014-06-09 シャープ株式会社 再生装置、再生装置の制御方法、生成装置、生成装置の制御方法、記録媒体、データ構造、制御プログラム、及び該プログラムを記録した記録媒体
WO2012096353A1 (ja) 2011-01-12 2012-07-19 シャープ株式会社 再生装置、再生装置の制御方法、生成装置、生成装置の制御方法、記録媒体、データ構造、制御プログラム、及び該プログラムを記録した記録媒体
WO2012096372A1 (ja) 2011-01-14 2012-07-19 シャープ株式会社 コンテンツ再生装置、コンテンツ再生方法、配信システム、コンテンツ再生プログラム、記録媒体、およびデータ構造
JPWO2012096372A1 (ja) 2011-01-14 2014-06-09 シャープ株式会社 コンテンツ再生装置、コンテンツ再生方法、配信システム、コンテンツ再生プログラム、記録媒体、およびデータ構造
US20130007814A1 (en) * 2011-06-30 2013-01-03 Qualcomm Incorporated Dynamic adaptive streaming proxy for unicast or broadcast/multicast services
US20130013799A1 (en) 2011-07-07 2013-01-10 Samsung Electronics Co., Ltd. Method and apparatus for transmitting and receiving content in a broadcasting system
JP2013038766A (ja) 2011-07-12 2013-02-21 Sharp Corp 送信装置、送信装置の制御方法、制御プログラム、及び記録媒体
WO2013048484A1 (en) 2011-09-30 2013-04-04 Intel Corporation Quality of experience enhancements over wireless networks
WO2013057315A2 (en) 2011-10-21 2013-04-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Resource management concept
US20130107786A1 (en) * 2011-10-31 2013-05-02 Interdigital Patent Holdings, Inc. Method and apparatus for enabling multimedia synchronization
US20130111028A1 (en) 2011-11-01 2013-05-02 Lukasz Kondrad Method and apparatus for selecting an access method for delivery of media
US20140258552A1 (en) * 2011-12-28 2014-09-11 Ozgur Oyman Video adaptation for content-aware wireless streaming
US20140040498A1 (en) * 2012-08-03 2014-02-06 Ozgur Oyman Methods for quality-aware adaptive streaming over hypertext transfer protocol
US20140250230A1 (en) * 2012-10-11 2014-09-04 Verizon Patent And Licensing Inc. Media manifest file generation for adaptive streaming cost management
US20150256861A1 (en) * 2012-10-26 2015-09-10 Intel Corporation Multimedia adaptation based on video orientation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Combined Chinese Office Action and Search Report dated Mar. 27, 2018 in Patent Application No. 201480030652.8 (with English language translation).
European Office Action dated Oct. 17, 2017 in Patent Application No. 14 808 290.2, 6 pages.
Extended European Search Report of EP Patent Application No. 14808290.2, dated Nov. 8, 2016, 08 pages.

Also Published As

Publication number Publication date
EP3007458A4 (en) 2016-12-07
WO2014196392A1 (ja) 2014-12-11
JP2014239278A (ja) 2014-12-18
EP3007458A1 (en) 2016-04-13
CN105247882A (zh) 2016-01-13
US20160134680A1 (en) 2016-05-12

Similar Documents

Publication Publication Date Title
US10212208B2 (en) Content supply device, content supply method, program, and content supply system
US10178148B2 (en) Content supply device, content supply method, program, and content supply system
CN106105150B (zh) 用于发送广播信号的设备、用于接收广播信号的设备、发送广播信号的方法和接收广播信号的方法
US9820009B2 (en) Streaming with optional broadcast delivery of data segments
US9942619B2 (en) Content supply device, content supply method, program, and content supply system
EP2885903B1 (en) Processing of multimedia data
US9485526B2 (en) Multi-stream shared communication channels
US20200336526A1 (en) Reception device, reception method, transmission device, and transmission method for distributing signaling information
CN109964471B (zh) 用于向移动用户设备发送内容的方法
CN109792556B (zh) 接收装置、发送装置和数据处理方法
KR101875667B1 (ko) 방송 전송 장치, 방송 수신 장치, 방송 전송 장치의 동작 방법 및 방송 수신 장치의 동작 방법
US10306272B2 (en) Content supply device, content supply method, program, terminal device, and content supply system
US10637948B2 (en) Content supply apparatus, content supply method, program, terminal apparatus, and content supply system
CN109219962B (zh) 接收装置、接收方法、再现装置、再现方法、供应装置、供应方法以及程序

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YAMAGISHI, YASUAKI;MORI, MASAHITO;SIGNING DATES FROM 20150907 TO 20150908;REEL/FRAME:037154/0918

AS Assignment

Owner name: SATURN LICENSING LLC, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SONY CORPORATION;REEL/FRAME:044171/0491

Effective date: 20171004

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4