Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/70—Media network packetisation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
  • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
  • H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L67/00—Network arrangements or protocols for supporting network services or applications
  • H04L67/01—Protocols
  • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
  • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/845—Structuring of content, e.g. decomposing content into time segments
  • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/854—Content authoring
  • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/854—Content authoring
  • H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]

Definitions

• the invention relates to a method and a device for transmitting media data, and more particularly Web-accessed compressed videos.
• the streaming of media data is made over IP networks (like the Internet) by using the protocol HTTP.
• a media presentation forms a collection of encoded and deliverable versions of media content that is usually composed of one or several media content components also called media items such as audio, video or text.
• media items such as audio, video or text.
• a combination of media items or components could also be considered. They can be sent from a server to a client for being jointly played by the client device. Media content is downloaded by the client from a server.
• DASH Dynamic adaptive streaming over HTTP
• MPD Media Presentation Description
• the client device gets the MPD file
• the description of each encoded and deliverable version of media content can be easily known by the client.
• the client By reading the manifest file, the client is aware of the kind of media content components proposed in the media presentation and is aware of the HTTP addresses for downloading the associated media content components. Therefore, it can decide which media content components to download (via HTTP requests) and to play (decoding and play after reception of the media data segments).
• the DASH standard allows describing a whole media presentation into one or more periods of time (noted "Period").
• a Period describes of a set of media content components that have a common timeline as well as relationships on how they can be presented. Each of these Periods can contain the same set of media content components or a completely independent set of media content components (e.g.
• each media content component may contain data for more than one media content component if media content components are multiplexed (combination of media items or components).
• the invention focuses on a video description in a manifest file (by taking the DASH MPD as an example). Even if the other elements of the media representation (e.g. audio, text%) are not explicitly described, they can easily be incorporated in a more global media description as will be explained below.
• the invention focuses on media presentations that are composed of multiple video or audio content components.
• Those multiple video content components may correspond to multiple alternate videos in a multi-view or multi-camera media presentation. It may also correspond to different tiles (i.e. spatial sub-parts) when a high resolution media presentation is split into multiple spatial sub-parts, each spatial sub-part forming a video content component.
• tiles i.e. spatial sub-parts
• By splitting a video into tiles if the user of a low capacity application wants to display or focus on sub-parts of the video, only the tiles corresponding to the sub-part can be transmitted. This process allows keeping a video portion with a good quality.
• video content components can represent video bit streams encoded with the format MPEG4, AVC, SVC, HEVC, scalable or multi-view HEVC.
• DASH defines identifiers as part of the attributes that defines the different elements that compose an MPD (e.g. AdaptationSet or Representation 'id' attributes). Those identifiers are defined only within the scope of a time period called "Period” for DASH and so they don't allow to follow the same content across Periods. DASH defines a specific identifier called "Assetldentifier" at Period level that allows recognizing that a Period is the temporal continuity of one or more previous Periods, but it doesn't always allow recognizing the same media content component over different periods in all cases.
• identifiers can be provided at a finer level called Adaptation Set level.
• the adaptation set level corresponds to the parameters related to a media item or combination of media items for the given time period.
• the document m331 12 (Yasuaki Tokumo and al., "DASH: signaling the continuity of adaptation sets across periods", 108 MPEG meeting; Valencia; (MOTION PICTURE EXPERT GROUP or ISO/IEC JTC1/SC29/WG1 1 ), m331 12, April 2014) describes an identifier inserted at the Adaptation Set level. Nevertheless, the existing solutions does not allow having an efficient parsing of the MPD by the user in many situations, in particular when the media content is partitioned, for example spatially partitioned.
• an adaptation set should be related to several different media contents or indicating that several spatial sub-parts are the temporal continuity in space across different time periods.
• the present invention has been devised to address one or more of the foregoing concerns.
• the method comprises:
• ⁇ transmitting, by a server, a description file to a client device, said description file being organized into data boxes, each one being related to a time period, at least one box comprising one or more level-one sub-boxes comprising parameters related to a media item or combination of media items for the given time period, each level-one sub-box being organized into one or more level-two sub-boxes dedicated to temporal segments of the corresponding media item or combination of media items for the given time period, each level-two sub-box being organized into one or more level- three sub-boxes, each one being related to a portion of the temporal segment for the given media item or combination of media items,
• At least one identifier is inserted into at least one second level or third- level sub-box for at least a first and a second period.
• a first-level sub-box is an Adaptation Set
• a second-level sub-box is a Representation
• a third-level sub-box is a Sub-Representation when the method is compliant with ISOBMFF part 15.
• the identifier preferably relates to or corresponds to the content of the media, and in embodiments the value of the identifier is the same across the first and second periods, indicating continuity of content.
• Embodiments of the first aspect of the invention offer the advantage of providing editorial continuity among several time periods even for tiled videos.
• At least two main sub-boxes belonging to the same level comprises at least one identifier, each one for identifying one media item or combination of media items, and at least one additional sub-box belonging to the same said level comprises at least two identifiers, one identifier belonging to one of the two main sub- boxes and one other identifier belonging to the other main sub-box.
• the media items are tiled videos.
• each second level box comprises at least a first and a second third-level boxes and when at least one identifier is inserted into at least one third-level sub-box for at least two periods, said identifier is inserted in the first third-level sub-box for the first period and the second third-level sub-box for the second period.
• the first third-level sub-box is related to a first set of tiles comprising one or more tiles
• the second set of tiles is related to a second set of tiles comprising one or more tiles, the first and the second set being different by at least one tile.
• a description file to a client device, said description file being organized into data boxes, each one being related to a time period, at least one box comprising a plurality of level-one sub-boxes comprising parameters related to a media item or combination of media items for the given time period, each level-one sub-box being organized into a plurality of level-two sub-boxes dedicated to temporal segments of the corresponding media item or combination of media items for the given time period, each level-two sub-box being organized into a plurality of level- three sub-boxes, each one being related to a portion of the temporal segment for the given media item or combination of media items, and
• At least two main sub-boxes belonging to the same level comprises at least one identifier, each one for identifying one media item or combination of media items, and at least one additional sub-box belonging to the same said level comprises at least two identifiers, one identifier belonging to one of the two main sub-boxes and one other identifier belonging to the other main sub-box.
• a first-level sub-box is an Adaptation Set
• a second-level sub-box is a Representation
• a third-level sub-box is a Sub-Representation when the method is compliant with ISOBMFF part 15.
• the second aspect of the invention allows providing a temporal continuity of the spatial area belonging to different media items according to the considered time period.
• the media items are tiles from a tiled video.
• main and additional sub-boxes are first-level sub-boxes.
• the media items are tiled videos.
• main and additional sub-boxes are third-level sub-boxes.
• said method being compliant with ISOBMFF part 15.
• the identifier is an Asset Identifier (Assetldentifier).
• a computer program product for a programmable apparatus, the computer program product comprising instructions for carrying out each step of the method as mentioned above when the program is loaded and executed by a programmable apparatus.
• a computer- readable storage medium storing instructions of a computer program for implementing the method as mentioned above.
• a device for encapsulating multi-layer partitioned timed media data in a server comprising means adapted for carrying the method as mentioned above. In an embodiment it is incorporated in a server device.
• Figure 1 a illustrates a block diagram about an example of the general principle of the Media streaming over HTTP
• Figure 1 b is a flow chart, explaining more in detail the media streaming over HTTP according to an embodiment of the invention, in particular when a frame is divided into tiles;
• Figure 2a schematically represents two frames for two different time periods, each frame being divided into tiles, and some objects spatially moving from a time period to another one;
• Figure 2b schematically represents two frames for two different time periods, each frame being divided into tiles according to a different tiling configuration for each time period; ;
• FIG. 3 illustrates a Media Presentation Description according to the prior art
• Figure 4 illustrates a Media Presentation Description according to an embodiment of the invention
• Figure 5 illustrates a Media Presentation Description according to another embodiment of the invention.
• Figure 6 represents a block diagram of a server or a client device in which one or more embodiments may be implemented.
• FIG. 1 a describes the general principle of the Media streaming over HTTP, like DASH in particular. Most of the new protocols and standards for Media streaming over HTTP are based on this principle.
• a media server 100 contains different media presentations.
• An example of media presentation 101 is illustrated. It contains here one audio content component and two video content components. The way the media presentation is constructed is well known by the man skilled in the art.
• this media presentation proposes several versions, 103a and 103b, of each media content component that have been temporally split into small independent and consecutive temporal segments 102a, 102b and 102c (for example mp4 segments). Those temporal segments can be addressed and downloaded independently.
• the downloading addresses of the segments are HTTP addresses. (One HTTP address associated to each temporal segment of each media content component) They are set by the server 100 for each one of these temporal segments.
• a manifest file 104 (or description file) is a formatted document (classically an XML document). It describes each media content component and associated temporal media segments e.g. type of media (audio, video, audio-video, text%), coding format, and time duration of the segment. Moreover it associates an URL to each media content segment that is described.
• the manifest file 104 is sent to a client device 1 10 related to a client or a user.
• the client can know the association between temporal segments of the different versions of media content components and the HTTP addresses designating the temporal segments.
• the manifest file 105 gives the information that characterizes each version of each media content component that composes the media presentation. For instance, the information may include resolution, codec format, and/or bit-rate.
• the client device 1 10 can therefore emit HTTP requests 106 for downloading the temporal segments that he wants, those temporal segments being described in the received manifest file 105.
• the server 100 sends the requested temporal segments, 107. These temporal segments can be decoded 108 by the client device 1 10 for display 109.
• Figure 1 b illustrates more precisely the Media streaming over HTTP (particularly in DASH) according an embodiment of to the invention.
• a client device gets a description file (or MPD in DASH) from a server, step 1008. It can get this description file only once at the beginning of the media presentation or the client can get it once at the beginning of the media presentation and then the client can obtain several update of the description file throughout the media presentation duration.
• a description file or MPD in DASH
• This description file includes data about all media content components available within one or more periods of time.
• step 1010 Each time the client receives a new or updated description file, he or it chooses, step 1010, one version of one or more media content components that he wants to render. Its choice is done according to user's preferences or selections, network status (e.g. available bandwidth) and rendering capacity of the client (e.g. display resolution, supported codec, computation performance).
• network status e.g. available bandwidth
• rendering capacity of the client e.g. display resolution, supported codec, computation performance
• the URLs of the temporal segments corresponding to the versions of media content components chosen by the client are selected by the client device, step 1020.
• Request messages for the selected temporal segments are sent from the client device to the server, step 1030.
• Each request message comprises the URL of one temporal segment with optionally a byte-range if the same URL designates different temporal segments.
• the server sends to the client device the video data (meaning the segments as detailed below), step 1040.
• the client may also want to select the media content components depending on its choices done during a previous Period, for instance to ensure an editorial continuity of media content components from one Period to another.
• DASH already defines a specific descriptor called "Assetldentifier" defined at Period or AdaptationSet level only. Thanks to this descriptor the client can differentiate Periods, for instance, related to a same movie from Periods corresponding to advertisements.
• Figure 2a and 2b illustrate scenarios that existing solutions cannot manage correctly or efficiently through existing identifiers.
• Figure 2a illustrates a video frames 200 and 210 which are here divided into eight tiles T1 , T2, T8.
• each tile can represent a different video content component or a sub-part of a video content component.
• each tile is represented in a MPD by defining one AdaptationSet per tile.
• each tile is represented by defining one single AdaptationSet representing the whole frame where each Representation is composed of several SubRepresentations (i.e. sub-part of a Representation), one SubRepresentation per tile (as represented by 304 in figure 3).
• Tile properties are described using a Spatial Relationship Descriptor that consists in using either SupplementalProperty or EssentialProperty descriptors with @schemeldURI equal to "urn:mpeg:dash:srd:2014" (see document m331 12 above mentioned).
• the @value attribute provides a comma separated list of values including the tile coordinates (x, y width, and height).
• a video frame 200 represents a video during the Period N.
• the object 202 is covered by tiles T6 and T8, and the object 203 is covered by a tile T1.
• Another video frame 210 represents the same video during another Period later in time (noted Period N+M). Between the Period N and N+M, the objects 202 and 203 have moved and they are represented by objects 212 and 213 respectively, both covered by the tile T3.
• Figure 2b also illustrates two different video frames during two different Periods (Period N and Period N+M). Each frame is composed of several tiles and represents two different views (view A and view B).
• a frame 2100 is composed of four tiles (A1 to A4) and another frame 2101 is composed of sixteen tiles (B1 to B16).
• a box 2203 is virtual and illustrates schematically the spatial relationship between the two views at Period N and Period N+M. As described in the schematic 2203, the tiles B1 , B2, B5 and B6 cover a same spatial area during the Period N+M as the tile A4 during the Period N. In other words, B1 , B2, B5, B6 represent the temporal continuity of the spatial area covered by the tile A4.
• Figure 3 illustrates an example of the hierarchical content of a DASH manifest file or MPD according to the prior art.
• This manifest file describes the media content of the media presentation available at the server and the association between each media component or item, also called media data, and the HTTP addresses.
• media data also called media data
• HTTP addresses the media content
• the media content is organized into several boxes and sub-boxed at different levels, as explained more in detail below.
• the media presentation may be temporally split into coarsegrained periods called Period (splicing of arbitrary content).
• a "Period" at MPD level describes all media components that are available for a period of time (could be the complete duration of the media presentation if there is only one Period). Within this period, a media content for a component can be composed of several data segments corresponding to smaller period of time previously mentioned, to allow easy streaming/random accessing/switching.
• the XML MPD contains all the data related to each period. By receiving this information, the client is aware of the content of each period of time.
• the Media Presentation Description file 300 is divided into several parts 3001 , 3002 and 3003, each one being associated to a Period.
• the second Period is comprised into 100s and 294s.
• Each Media Presentation's Period contains data that describes the available media content components for the corresponding period of time.
• Content i.e. the set of media content components
• two or more Periods of a Media Presentation Description may comprise media content components belonging to a same whole content. In other words, a whole content may be partitioned and shared over several Periods consecutive or not.
• Each Media Presentation Description's Period may contain a descriptor, for example called Assetldentifier for identifying content parts related to a same whole content. The identifier allows identifying parts of the same content shared among different Periods. If two different Periods contain similar Assetldentifiers then the media content for the two Periods belong to the same whole content (also called asset).
• the first 3001 and third 3003 Periods comprise the same Assetldentifier 'movie'. Consequently according to the definition given above, the contents associated to these two periods are parts of the same whole content.
• the second Period 3002 includes a different Assetldentifier 'ad'. It informs that the content is not a part of the same content related to the first and third Periods 3001 , 3003.
• a Period may be composed of several "adaptation set” elements.
• An Adaptation Set represents a set of interchangeable encoded versions of one or several media content components.
• the Period 301 is composed of two Adaptation Sets (or level-one sub-boxes) corresponding to two different video content components.
• An Adaptation Set may also directly contain a multiplexed form of several media content components also called a combination of media items (e.g. Audio/Video).
• each adaptation set is associated to separate tracks from the ISOBMFF.
• the first group adaptation set is associated to a first video track
• the second adaptation set is associated to a second video track.
• An adaptation set structure 302 contains information organized into attributes and/or elements and/or descriptors that describe the different possible or alternative representations (these attributes and/or elements are referred to as level two sub-boxes) (for example "Representation") 3020 of the encoded video available at the server.
• a first representation "Representation 1 " is an encoded video of spatial resolution 640x480 encoded at the bit rate of 500 kbit/s.
• the second representation "Representation 2" is the same video but encoded at 250 kbit/s.
• Each of this video can be downloaded by HTTP requests if the client knows the HTTP addresses related to the video. The association between content of each representation and HTTP addresses is done by using an additional temporal sub-layer.
• the video representation "Representation 1" is split into temporal segments (of 10 seconds in this example).
• the first representation "Representation 1" gets a bandwidth of 500 kbits/s, a width of 640 pixels and a height of 480 pixels. More parameters are given by the field "Segment Info" 303 described below.
• the second representation "Representation 2" gets a bandwidth of 250 kbits/s, a width of 640 pixels and a height of 480 pixels. This second representation may represent a decrease in quality compared to the first representation for instance. The client will be able to switch between the two different representations depending on the available bandwidth on the network.
• Each temporal segment 303 is a content stored at the server that is accessible through an HTTP address.
• an initialization segment is available.
• This initialization segment contains MP4 initialization information (if the video has been encapsulated by using the ISO BMFF or extensions) describing the MP4 content of the encapsulated video. For example, it helps the client to instantiate the decoding algorithms related to the video.
• the HTTP addresses of the initialization segment and the media segments are given in the MPD (or description) file.
• a Representation may be composed of several sub-boxes called SubRepresentations (or level-three sub-boxes).
• SubRepresentation relies on specific boxes from ISOBMFF (subsegment index ('ssix') and level assignment ('leva') boxes) embedded into media segments to address sub-parts of those media segments.
• ISOBMFF subsegment index ('ssix') and level assignment ('leva') boxes
• a SubRepresentation describes properties related to the content of the media component or the combination of media components that are embedded in the corresponding Representation. For instance, it may describe some embedded lower quality layer (e.g. some lower frame rate for a video as illustrated in the figure) or an embedded audio or video components if the Representation describes a mix of audio and video components.
• a SubRepresentation may also describe spatial sub-parts (or tiles) of a video.
• the MPD as defined above is adapted for following or tracking a media component content over periods, but it is not suitable for a finer tracking for portions of a media component over different periods, for example one audio signal extracted from a mixed audio signal or one spatial tile (or several tiles) from a partitioned picture instead of a whole picture.
• FIG. 4 illustrates an example of the hierarchical content of a DASH manifest file or MPD according to the invention.
• An MPD 400 is composed of three different periods of time ("Period").
• Period a period of time
• the content of a second Period i.e. the set of media content components
• the content of a second Period represents an advertisement in the middle of a movie.
• each Period 401 and 404 corresponding to the movie there are two video content components or Adaptation Set boxes as defined previously.
• a descriptor named "Assetldentifier" defined in each Adaptation Set allows retrieving the corresponding Adaptation Set box that represents the temporal continuity from another Adaptation Set across Periods.
• the Assetldentifiers with the value 'cam1 ' indicate that the Adaptation Set "2" in the Period 404 is the editorial continuity of the Adaptation Set "1 " from the Period 401 .
• Assetldentifier in DASH to define it at "RepresentationBaseType” level.
• the Assetldentifier can be used not only at Period level but also at all other sub-levels: AdaptationSet (in particular for multiple Assetldentifiers), Representation and SubRepresentation.
• the MPD schema is then modified as follows:
• each Adaptation Set 402 and 405 contains a version (or Representation) of a video content component that embeds several objects or tiles represented by several SubRepresentations 403 and 406.
• the client knows that the SubRepresentation with level 1 in 406 is the editorial continuity of the SubRepresentation with level 0 in 403. Without this identifier, the client cannot determine which SubRepresentation must be selected
• SubRepresentation level a client has to download all the tiles because they all are embedded into a same media segment. But when tiling is described at AdaptationSet level, the client can only download the tiles covered by its region-of-interest. By providing cross-Period identifiers at SubRepresentation level, the client can more rapidly retrieve the associated tiles across Periods when it changes from SubRepresentation level tiling to AdaptationSet level tiling.
• the client decides to view the object referenced 202, it can zoom on a portion 201 at the right bottom part of the image during the Period N. As illustrated in the figure 2a, this chosen portion 201 or Region-of-lnterest (ROI) is encompassed by two tiles T6 and T8 that cover the object 202.
• ROI Region-of-lnterest
• the client wants to perform object tracking to follow for instance the object 202, thanks to this identifier it knows that it has to select tiles T6 and T8 at step 1010 during the Period N and only the tile T3 during the Period N+M.
• an identifier according to the invention can be represented by reusing SupplementalProperty,EssentialProperty or any new descriptors with a specific schemeldURI (e.g. "urn:mpeg:dash:id:2014” or “urn:mpeg:dash:objld:2014”) where the @value attribute would correspond to the identifier value.
• schemeldURI e.g. "urn:mpeg:dash:id:2014” or "urn:mpeg:dash:objld:2014
• an identifier according to the invention can be represented by reusing the descriptor Role well known by the man skilled in the art.
• the descriptor representing the identifier may also include a description that characterizes the object identified (e.g. "This object represents a red umbrella"). This identifier could also be used to associate an object covered by several tiles and an object description that would be carried in a dedicated metadata content components.
• Figure 5 illustrates another example of the hierarchical content of a DASH manifest file or MPD according to the invention.
• a frame 200 may contain several objects 202, 203 that are covered by different set of tiles (203 is covered by T1 and 202 is covered by T6 and T8). From one period to another, it may happen that those objects moved inside the video frame and by consequence, they are covered by a different set of tiles from one Period to another. It may also happen that several objects are covered by the same set of tiles as illustrated in video frame 210. Two objects 21 1 and 213 are present in tile T3. The prior art doesn't allow defining multiple Assetldentifier in one level.
• the invention proposes to authorize the definition of multiple Assetldentifier at "Representation BaseType" level.
• the Assetldentifier can be defined several times in each sub-level: AdaptationSet, Representation and SubRepresentation.
• the MPD schema is then modified as follows:
• An MPD 500 is composed of three Periods.
• a Period 501 would correspond to the frame 200
• the AdaptationSet “1 " would correspond to the tile "T6" in frame 200
• the AdaptationSet “2” to the tile “T8”
• the AdaptationSet “3" to the tile "T1 ".
• An identifier ObjA' would correspond to the object 202 and 'another identifier ObjB' to the object 213.
• a Period 502 would correspond to the frame 210
• the AdaptationSet “1 " would correspond to the tile "T3" in frame 210
• the identifier 'ObjA would correspond to object 212 and identifier 'ObjB' to object 213.
• a third Period 503 (not represented in Figure 2a), objects may move again and be covered by two different tiles. But thanks to the provided identifiers Assetldentifiers 'ObjA and 'ObjB', the identification and the tracking of the objects moving from tiles to other tiles according to the considered Period, is easier.
• FIG. 6 is a schematic block diagram of a computing device 600 for implementation of one or more embodiments of the invention.
• the computing device 600 may be a device such as a micro-computer, a workstation or a light portable device.
• the computing device 600 comprises a communication bus connected to:
• central processing unit 601 such as a microprocessor, denoted CPU;
• RAM random access memory 602
• the executable code of the method of embodiments of the invention as well as the registers adapted to record variables and parameters necessary for implementing the method for reading and writing the manifests and/or for encoding the video and/or for reading or generating the Data under a given file format, the memory capacity thereof can be expanded by an optional RAM connected to an expansion port for example;
• ROM read only memory
• the network interface 604 is typically connected to a communication network over which digital data to be processed are transmitted or received.
• the network interface 604 can be a single network interface, or composed of a set of different network interfaces (for instance wired and wireless interfaces, or different kinds of wired or wireless interfaces). Data are written to the network interface for transmission or are read from the network interface for reception under the control of the software application running in the CPU 601 ;
• a user interface 605 for receiving inputs from a user or to display information to a user;
• HD hard disk 606 denoted HD
• an I/O module 607 for receiving/sending data from/to external devices such as a video source or display.
• the executable code may be stored either in read only memory 603, on the hard disk 606 or on a removable digital medium such as for example a disk.
• the executable code of the programs can be received by means of a communication network, via the network interface 604, in order to be stored in one of the storage means of the communication device 600, such as the hard disk 606, before being executed.
• the central processing unit 601 is adapted to control and direct the execution of the instructions or portions of software code of the program or programs according to embodiments of the invention, which instructions are stored in one of the aforementioned storage means. After powering on, the CPU 601 is capable of executing instructions from main RAM memory 602 relating to a software application after those instructions have been loaded from the program ROM 603 or the hard-disc (HD) 606 for example. Such a software application, when executed by the CPU 601 , causes the steps of the flowcharts shown in the previous figures to be performed.
• the apparatus is a programmable apparatus which uses software to implement the invention.
• the present invention may be implemented in hardware (for example, in the form of an Application Specific Integrated Circuit or ASIC).
• the present invention may be embedded in a device like a camera, a smartphone or a tablet that acts as a remote controller for a TV, for example to zoom in onto a particular region of interest. It can also be used from the same devices to have personalized browsing experience of the TV program by selecting specific areas of interest. Another usage from these devices and methods by a user is to share with other connected devices some selected sub-parts of his preferred videos. It can also be used in smartphone or tablet to monitor what happened in a specific area of a building put under surveillance provided that the surveillance camera supports the method for providing data according to the invention.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computer Security & Cryptography (AREA)
• Computer Networks & Wireless Communication (AREA)
• Databases & Information Systems (AREA)
• Human Computer Interaction (AREA)
• Information Transfer Between Computers (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Publications (1)

Family

ID=51410467

Family Applications (1)

Country Status (7)

Families Citing this family (4)

Citations (1)

Family Cites Families (39)

• 2014
  • 2014-07-01 GB GB1411734.5A patent/GB2528039A/en not_active Withdrawn
• 2015
  • 2015-07-01 US US15/323,037 patent/US10778743B2/en active Active
  • 2015-07-01 CN CN201910879671.2A patent/CN110708577B/zh active Active
  • 2015-07-01 EP EP15732732.1A patent/EP3164996A1/en not_active Ceased
  • 2015-07-01 JP JP2016574439A patent/JP6632550B2/ja active Active
  • 2015-07-01 WO PCT/EP2015/065046 patent/WO2016001336A1/en not_active Ceased
  • 2015-07-01 KR KR1020167036067A patent/KR101944601B1/ko active Active
  • 2015-07-01 CN CN201580036198.1A patent/CN106471815B/zh active Active

Patent Citations (1)

Non-Patent Citations (5)

Also Published As

Similar Documents

Legal Events