EP4035408A1 - Gestion du téléchargement progressif adaptatif d'un contenu numérique sur réseau mobile avec sélection d'un débit d'encodage maximum autorisé en fonction d'un godet de données - Google Patents
Gestion du téléchargement progressif adaptatif d'un contenu numérique sur réseau mobile avec sélection d'un débit d'encodage maximum autorisé en fonction d'un godet de donnéesInfo
- Publication number
- EP4035408A1 EP4035408A1 EP20792466.3A EP20792466A EP4035408A1 EP 4035408 A1 EP4035408 A1 EP 4035408A1 EP 20792466 A EP20792466 A EP 20792466A EP 4035408 A1 EP4035408 A1 EP 4035408A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- content
- data
- terminal
- multimedia stream
- consumed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 claims abstract description 18
- 238000007726 management method Methods 0.000 claims abstract description 17
- 238000010295 mobile communication Methods 0.000 claims abstract description 17
- 230000000750 progressive effect Effects 0.000 claims description 40
- 238000004891 communication Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 239000012634 fragment Substances 0.000 description 39
- 238000009877 rendering Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 9
- 238000004422 calculation algorithm Methods 0.000 description 7
- 230000015654 memory Effects 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 5
- 230000002123 temporal effect Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000004377 microelectronic Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44245—Monitoring the upstream path of the transmission network, e.g. its availability, bandwidth
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/215—Flow control; Congestion control using token-bucket
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/38—Flow control; Congestion control by adapting coding or compression rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/613—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
Definitions
- TITLE Management of adaptive progressive downloading of digital content on a mobile network with selection of a maximum authorized encoding rate according to a bucket of data
- the field of the invention is that of digital multimedia content, namely digital audio and / or video content. More specifically, the invention relates to the management of the data consumption of a user wishing to access digital content according to a technique known as adaptive progressive downloading, through a mobile communication network.
- Access to multimedia content is possible today for most playback terminals, even when they are on the move, through a mobile communication network.
- 4G type for example.
- the terminal generally sends a request to a server, indicating the chosen content, and in return it receives a stream of digital data relating to this content.
- the terminal is suitable for receiving this digital content in the form of multimedia data and for rendering it back.
- This restitution consists in providing the digital content at the level of the terminal in a form accessible to the user.
- data received corresponding to a video is generally decoded, then restored at the level of the terminal in the form of a display of the corresponding video with its associated soundtrack.
- the digital content will be assimilated to a video and the reproduction by the terminal, or consumption by the user of the terminal, to a display on the screen of the terminal.
- the distribution of digital content is often based on client-server protocols of the HTTP family (standing for “Hyper Text Transport Protocol”).
- the progressive downloading of digital content makes it possible to transport and consume the data in real time, that is to say that the digital data is transmitted over the network and returned by the terminal as it goes. and as they arrive.
- the terminal receives and stores part of the digital data in a buffer memory before returning them.
- This distribution mode is particularly useful when the speed available to the user is not guaranteed for the transfer in real time of the video, which is particularly the case when the terminal is connected to a mobile communication network, for example. example a 4G type network, known for its variability in bandwidth.
- Adaptive progressive download in English HTTP Adaptive Streaming, abbreviated HAS, furthermore makes it possible to broadcast and receive data according to different qualities corresponding for example to different bit rates. These different qualities are described in a parameter file available for download on a data server, for example a content server.
- this description file makes it possible to select the right format for the content to be consumed according to the available bandwidth or the storage and decoding capacities of the client terminal. This type of technique makes it possible in particular to take account of the variations in bandwidth on the link between the client terminal and the content server.
- the MPEG-DASH standard (for English “Dynamic Adaptive Streaming over HTTP", in French “dynamic adaptive streaming over HTTP") is an audiovisual broadcast format standard on the Internet. It is based on the preparation of the content in different presentations of variable quality and speed, cut into short segments (of the order of a few seconds), also called “chunks”. Each of these segments is made available individually by means of an exchange protocol.
- the primary target protocol is HTTP, but other protocols (eg FTP) can also be used.
- FTP FTP
- the principle underlying this standard is that the MPEG-DASH client makes an estimate of the bandwidth available for the reception of segments, and, depending on the filling of its reception buffer, chooses, for the next segment to be loaded, a representation whose bit rate: ensures the best possible quality, and allows a reception delay compatible with the uninterrupted rendering of the content.
- the rendering terminal must therefore find a compromise between the overall quality of the content, and its uninterrupted reproduction, by carefully selecting the next segment to download, among the various encoding rates offered. To do this, there are different algorithms for selecting the quality of the content as a function of the available bandwidth, which may have more or less aggressive, or more or less secure, strategies.
- HAS adaptive progressive download
- VOD video on demand
- Replay delayed broadcasting of television programs
- Network PVR type offers for “Network Personal Video Recorder”, ie a digital content recording service, carried out by the content provider itself rather than at the end user's home.
- real-time media stream player devices also access digital content in progressive adaptive download mode for real-time (or Live) television content. This is the case, for example, with the Chromecast ® device developed by Google ® , or the CléTV ® from Orange ® . Such devices, more generically referred to as the HDMI Key, can also be used to access video-on-demand content.
- Such devices are conventionally connected to the HDMI port of a television set and communicate, for example by Wi-Fi ® connection , with another device of the home communication network connected to an extended communication network (for example a smart phone of the type smartphone, connected to a 4G mobile network), in order to reproduce, on the television, the multimedia content received by a compatible software application.
- Wi-Fi ® connection for example a Wi-Fi ® connection
- an extended communication network for example a smart phone of the type smartphone, connected to a 4G mobile network
- data consumption limit authorized for the client terminal.
- This limit may correspond to a volume of data associated with a prepaid card purchased by the user, or to a monthly package that he has taken out with the operator of the extended communication network, for example the mobile network.
- This maximum amount of consumable data is more commonly referred to as the data bucket, or "data bucket”.
- data bucket the data bucket
- data represents data downloaded to a telephone or a mobile terminal via the Internet.
- a mobile data plan therefore allows users to browse the Internet with a mobile phone, according to specific volumes allocated by the network operator. Strictly speaking, unlimited plans in this area do not exist. Data plans include a maximum authorized data volume, generally expressed in Megabytes or Gigabytes.
- the HAS client on board his multimedia stream reader terminal has, in principle, for objective, to achieve the best possible reproduction quality for the user, as a function of resource and bandwidth constraints, and therefore to aim for the maximum encoding rate available for the content to be downloaded.
- the downloading of content can consume a very large proportion, if not all, of the data bucket allocated to the user, without the latter having any means of action to prevent it.
- the only option available to the user is, quite radically, to give up accessing the stream, and therefore to give up watching the chosen multimedia content.
- the invention responds to this need by providing a method for managing the adaptive progressive download (HAS) of digital content within a multimedia stream reader terminal connected to a mobile communication network.
- the digital content is associated with a description file, comprising a list of time segments of the content each associated with several encoding rates of the content.
- a maximum volume of data to be consumed within the mobile communication network, called a data bucket, is allocated to the multimedia stream reader terminal.
- such a management method implements: a determination of a volume of data which would be consumed by the multimedia stream reader terminal by downloading the time segments of the content at at least some of the encoding rates, a selection of a maximum encoding rate of the content authorized for the download, depending on the amount of data consumed associated with it, and the data bucket.
- the invention is based on a completely new and inventive approach to the adaptive progressive downloading of content, in the case where the multimedia stream reader terminal has a maximum volume of consumable data within its access network to the network.
- content Such a limit value for data consumption, also called a “data bucket”, can correspond to a volume of data authorized within the framework of a monthly package taken out with a network operator, or associated with a prepaid card purchased from this operator.
- the method according to one embodiment of the invention proposes to take this "data bucket" into account in the choice of the encoding rate at which the HAS client on board the multimedia stream reader terminal downloads the time segments of the content.
- the data consumption resulting from the downloading of the content at different encoding rates is evaluated; taking into account this consumption assessment on the one hand, and the user's data bucket on the other hand, a maximum encoding rate is selected making it possible to restrict the progressive adaptive HAS downloading of the content, in order to better control the share of the data bucket devoted to this download.
- such a management method also comprises a display, on a reproduction terminal associated with the multimedia stream reader terminal, of the volumes of data consumed determined for at least some of the encoding rates.
- the user can thus easily know the volume of data that will be consumed by his terminal if he starts downloading the content he has chosen, at one or other of the available encoding rates: all he needs is to do this, consult the screen of his return terminal, on which these volumes are presented to him. This is particularly advantageous when the user is in a mobility solution, and he does not necessarily understand the impact that the launch of the download of content will have on his data consumption, and therefore on his data bucket.
- a consultation of the screen of his rendering terminal indicates to him directly, for example in the form of a comparative table, the volumes of data, for example expressed in Gigabits or in Megabits, associated with the different speeds of encoding of the content.
- the assumption is made that all the time segments of the content will be downloaded at the same encoding rate, or at the same resolution, without taking into account any fluctuations associated with changes in the constraints of network resources or from the content server.
- the playback terminal can be the multimedia stream reader terminal itself (for example an intelligent mobile telephone of the smartphone type), or be distinct from it (for example a television connected to an HDMI key).
- the volumes of data consumed, determined for at least some of the encoding rates are displayed in the form of a proportion of the data bucket.
- the user can thus directly understand what percentage of his data bucket will be consumed in the event of launching the download of the content at a particular encoding rate. Such a presentation is more meaningful and understandable for the user. It of course requires that this data bucket be known to the multimedia stream reader terminal.
- such a management method also comprises a display, on the reproduction terminal, of a volume of data remaining to be consumed by the multimedia stream reader terminal, after the downloading of the time segments of the content at at least some of the encoding rates.
- the user knows not only what volume of data will be consumed by downloading the content, but also how much data he will still have at the end of this download, taking into account his data bucket, and possibly the part he has already consumed.
- This display of remaining volume can be done in Gigabits / Megabits, or as a percentage of the data bucket.
- the user can thus easily choose the maximum encoding rate to which he wishes to limit himself, so as not to consume too much of his data bucket, and to keep enough data credit, for example until the end of the month.
- the displayed data volumes correspond only to the encoding rates for which the downloading of the time segments of the content does not induce the data bucket to be exceeded.
- such a management method also comprises an entry, on a reproduction terminal associated with the multimedia stream reader terminal, of the data bucket.
- the user pre-informs his data bucket, so that this information is accessible to the multimedia stream reader terminal.
- This entry can be made during an installation or configuration phase of the adaptive progressive download service. It can also be requested from the user by displaying a “pop in” type window, which informs him of an innovation in the service, and asks him about this new useful information which is his bucket. data.
- the mobile network operator controls the adaptive progressive download service from end to end, it can extract the user's data bucket information from their profile or billing, so that it is accessible to the user. multimedia stream player terminal.
- the selection of the maximum encoding rate of the content authorized for downloading is performed by a user via an interface of a playback terminal associated with the multimedia stream reader terminal.
- the user himself chooses the maximum encoding rate to be set, via the interface of his rendering terminal, for example by selecting a highlighted menu or by entering in a pop-in window.
- This selection may be valid only for a given content, or may be taken into account for all content accessible via the adaptive download service HAS, or even for all content downloaded during a given period (for example during the current month). .
- the invention also relates to a computer program product comprising program code instructions for implementing a method as described above, when it is executed by a processor.
- the invention also relates to a recording medium readable by a computer on which is recorded a computer program comprising program code instructions for the execution of the steps of the method of managing the adaptive progressive download (HAS) of a. digital content according to the invention, as described above.
- HAS adaptive progressive download
- Such a recording medium can be any entity or device capable of storing the program.
- the medium may comprise a storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or else a magnetic recording means, for example a USB key or a hard disk.
- such a recording medium can be a transmissible medium such as an electrical or optical signal, which can be conveyed via an electrical or optical cable, by radio or by other means, so that the program computer it contains can be executed remotely.
- the program according to the invention can in particular be downloaded over a network, for example the Internet network.
- the recording medium can be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the aforementioned display control method.
- the invention also relates to a device for managing the adaptive progressive download (HAS) of digital content within a multimedia stream reader terminal connected to a mobile communication network.
- Such digital content is associated with a description file, comprising a list of time segments of the content each associated with several encoding rates of the content; a maximum volume of data to be consumed within the mobile communication network, called a data bucket, is allocated to the multimedia stream reader terminal.
- a device comprises:
- such a device for managing the adaptive progressive download (HAS) of digital content also comprises a module for transmitting a command, to a reproduction terminal associated with the multimedia stream reader terminal, display consumed data volumes determined for at least some of the encoding rates.
- HAS adaptive progressive download
- Such a command can be a command internal to the device when the latter is integrated into the playback terminal itself.
- the invention also relates to a multimedia stream reader terminal which comprises a device for managing the adaptive progressive download (HAS) of digital content as described above.
- HAS adaptive progressive download
- the adaptive progressive download management device, the playback multimedia stream reader terminal and the computer program according to embodiments of the invention have in combination all or part of the characteristics set out throughout this document. In particular, they have at least the same advantages as those conferred by the method for managing the adaptive progressive downloading of content according to one embodiment of the present invention.
- FIG 1 presents a progressive download architecture on a mobile network based on the use of adaptive streaming according to the invention
- FIG 2 schematically illustrates the hardware structure of a multimedia stream reader terminal incorporating an adaptive progressive download management device according to one embodiment of the invention
- FIG 3 describes an example of limiting the maximum quality of a multimedia stream obtained in adaptive progressive download mode by a multimedia stream reader terminal of [Fig 1] or [Fig 2].
- the general principle of the invention is based on the possibility, within the framework of the adaptive progressive downloading of a content, of selecting the maximum encoding rate of the content authorized for the download, so as not to consume too large a portion of the bucket. user data, especially when on the move.
- the terminal 3, for example an intelligent telephone of the “smartphone” type and the terminal 4, for example a tablet, are, in this example, connected to an extended mobile communication network 1, for example a 4G type network. They communicate with a terminal 8, for example an HDMI key connected to a television 5.
- a digital content server 2 is located according to this example in the wide area network (WAN, 1) and receives for example digital television content channels from a broadcast television network, not shown, and / or videos to demand, and makes them available to client terminals.
- WAN wide area network
- Client terminals 3 and 4 can enter into communication with content server 2 to receive one or more content (films, documentaries, advertising sequences, etc.).
- content server 2 can receive one or more content (films, documentaries, advertising sequences, etc.).
- URI Universal Resource Identifier
- All of these parameters are generally grouped together in a parameter file, called a description file. It will be noted that this parameter file can be a computer file or a set of descriptive information about the content, accessible at a certain address.
- the terminals 3, 4 have their own characteristics in terms of decoding capacity, display, etc. In a progressive adaptive download context, they can adapt their requests to receive and decode the content requested by the user at the quality that best suits them. In our example, if the contents are available at the bit rates 512 kb / s (kilobits per second) (Resolution 1, or level 1, denoted NI), 1024 kb / s (N2), 2048 kb / s (N3) and the client terminal has a bandwidth of 3000 kb / s, it can request the content at any rate below this limit, for example 2048 kb / s. In general, we denote “Ci @ Nj” the content number i with the quality j (for example the j-th level Nj of quality described in the description file).
- the client terminals 3, 4 receive the data coming from the extended mobile network 1 and ensure their decoding, and possibly their reproduction on their screen, or their transmission to the HDMI key 8 for reproduction on the TV screen 5.
- the decoders can be found elsewhere in the network, in particular at the level of an element of STB type (standing for Set-Top-Box) (not shown) associated with a television set.
- the terminal 3, 4 or 8 firstly retrieves an address from the description document 7 of the desired content (for example, C1).
- this file is a manifest type file according to the MPEG-DASH standard (denoted “C.mpd”) and we will refer indifferently, depending on the context, to the expression “description file” or “ manifest ”.
- This file can be retrieved directly from an Internet server of the extended network 1, or be already on the terminal at the time of the request.
- MPD MPEG-DASH
- NI 512 kb / s
- N2 1024 kb / s
- N3 2048 kb / s
- This simplified manifest file describes digital content in XML syntax (from the English “eXtended Markup Language”), comprising a list of content in the form of fragments conventionally described between an opening tag ( ⁇ SegmentList> ) and a closing tag ( ⁇ /SegmentList>). Cutting into fragments makes it possible in particular to adapt finely to fluctuations in the bandwidth.
- Each fragment corresponds to a certain duration (“duration” field) with several quality levels and allows to generate their addresses (URL - Uniform Resource Locator). This generation is done in this example using the elements “BaseURL” (“HTTP://server.com”) which indicates the address of the content server and “SegmentURL” which lists the complementary parts of the addresses of the different fragments. :
- the terminal proceeds to obtain the fragments via a download at these addresses.
- this download takes place here, traditionally, through an HTTP URL, but could also take place through a universal address (URI) describing another protocol (dvb: // my content segment for example).
- URI universal address
- the HDMI key 8 is connected to the television 5 by connection to the HDMI port of the latter, and is used to restore, on the screen of the television 5, a content C1, described in a manifest file 7.
- the content C1 can be a television program broadcast live or delayed, or a video on demand, or any other multimedia content of fixed or determinable duration.
- the HDMI key 8 is connected via WiFi® directly to the tablet 4 or to the smart phone 3, through which it can access the extended communication network 1, for example via a 4G connection.
- the HDMI 8 key can also be controlled by the user by means of the smart phone 3, on which a software application for controlling the HDMI 8 key is installed.
- the content fragments obtained by the smartphone 3 or the tablet 4 are, for example, transmitted via WiFi® to the HDMI key 8, which controls their display on the television screen 5, for restitution to the user.
- FIG 2 represents an architecture of a multimedia stream reader terminal according to one embodiment of the invention, for example the HDMI key 8, or the smart phone 3, of [Fig 1]. following the example of the HDMI 8 key.
- the HDMI 8 key communicates with the extended Internet network 1 via the WIFI module for local wireless communication with another communication terminal, for example the smart phone 3.
- the HDMI 8 key also includes a HAS adaptive progressive download module capable of requesting a progressive download of one of the contents with one of the qualities proposed in a description file 7. This description file 7 can be recorded for example in the memories M of the HDMI key 8 or be outside.
- the HDMI key 8 also includes a DET module for determining a volume of data which would be consumed by adaptive progressive downloading of content, with the different qualities proposed in the description file 7.
- a DISP module for controlling the display of the data volumes determined by the module DET on a screen of a rendering terminal, for example the smart phone 3 or the television 5. More generally, such a DISP module is a module for managing the interface with the user's playback terminal, by which the HDMI key 8 obtains, for example, information on any interactions the user has with the playback terminal (action on the television remote control by for example by pressing the volume key or a channel change key, or selecting from a menu highlighted on the television screen of a maximum quality of content authorized, or selecting this maximum quality on the touch screen of the telephone intelligent 3 or tablet 4), and by which it can control the display on the screen of the display terminal for rendering pop-up windows, allowing it to deliver messages, information on data volumes consumed or remaining, or user alerts.
- a DISP module for controlling the display of the data volumes determined by the module DET on a screen of a rendering terminal, for example the smart phone 3 or the television 5. More generally, such a DISP module is a module for managing the interface with
- SEL module for selecting a maximum encoding rate or a maximum resolution authorized for downloading the content, which controls the adaptive progressive download module HAS, in order to force the latter to request a progressive download of the content.
- the HDMI key 8 can also contain other modules such as a hard disk (not shown) for storing video fragments, a content access control module, a data processing module. commands received from a tablet or smartphone on which the application for controlling the HDMI key is installed, thanks to which the user can control its operation, etc.
- a hard disk not shown
- commands received from a tablet or smartphone on which the application for controlling the HDMI key is installed thanks to which the user can control its operation, etc.
- such an HDMI 8 key does not generally contain no I / O interface module, and it is the I / O interface module of the user's smartphone 3 or tablet 4, or of the TV 5, which is used by the latter to choose by example its content.
- module can correspond just as well to a software component as to a hardware component or a set of hardware and software components, a software component itself corresponding to one or more computer programs or subroutines or more generally to any element of a program capable of implementing a function or a set of functions as described for the modules concerned.
- a hardware component corresponds to any element of a hardware set (or hardware) capable of implementing a function or a set of functions for the module concerned (integrated circuit, smart card, memory card, etc. .).
- HDMI 8 key comprises a random access memory (for example a RAM memory), a processing unit equipped for example with a processor CPU, and controlled by a computer program, representative of the progressive download management module.
- adaptive HAS stored in read only memory (eg ROM or hard disk).
- the code instructions of the computer program are, for example, loaded into RAM before being executed by the processor CPU of the processing unit.
- the random access memory contains in particular the description file manifest 7.
- the processor of the processing unit controls the determination of the volumes of data consumed by downloading the content at its various quality levels, the display of pop-up windows on the display of the display terminal, and restricting the quality of the downloaded content, through the choice of the time segments and the associated encoding rates to download, and the issuance of corresponding commands to the HAS client module.
- the architecture proposed in [Fig 2] remains the same, except that the terminal communicates directly. with the extended communication network via a mobile communication module, for example of the 4G type, instead of the WIFI module.
- the rendering terminal is then the multimedia stream reader terminal itself, so that the display control module DISP controls the display of the estimated data volumes directly on the screen of the smart phone 3, and the module SEL directly receives the value of the maximum quality of the authorized content selected by the user on the screen of the smartphone 3 itself.
- FIG 2 illustrates only one particular way, among several possible, of producing a multimedia stream reader terminal, so that it performs the steps of the method detailed below, in relation to [Fig 3] (in any one different embodiments, or in a combination of these embodiments). Indeed, these steps can be performed either on a reprogrammable computing machine (a PC computer, a DSP processor or a microcontroller) executing a program comprising a sequence of instructions, or on a dedicated computing machine (for example a set of logic gates such as an FPGA or ASIC, or any other hardware module).
- a reprogrammable computing machine a PC computer, a DSP processor or a microcontroller
- a program comprising a sequence of instructions
- a dedicated computing machine for example a set of logic gates such as an FPGA or ASIC, or any other hardware module.
- the multimedia stream reader terminal 30 is connected to a TX playback terminal (for example the HDMI key 8 is connected to the television 5 via an HDMI link or to the smart phone 3 via a WIFI link. ). It comprises a DISP 300 interface module with the TX rendering terminal, a DET module 301 for determining the volume of data consumed by downloading a content at its various encoding rates, a SEL module 302 for selecting a maximum encoding rate allowed for the download, and a HAS 303 client module.
- a HAS content server 2 exposes a video C1 in the form of “chunks” Cli @ Nj encoded at different encoding rates Nj, where the index i designates a temporal identifier of the “chunk” Cli @ Nj.
- a HAS client module is responsible for coming to retrieve its “chunks” from the HAS content server 2 by choosing the video quality Nj as a function of the available network resource.
- Nj the way in which the HAS client module chooses the encoding rate of the next video fragment to download: there are indeed many algorithms allowing this choice to be made, the strategies of which are more or less secure. or aggressive.
- the general principle of such algorithms is based on the downloading of a first fragment at the lowest encoding rate proposed in the manifesto, and on the evaluation of the recovery time of this first fragment. .
- the HAS client module evaluates whether, depending on the size of the fragment and the time taken to retrieve it, the network conditions allow the next fragment to be downloaded at a higher encoding rate.
- the HAS client module In the conventional case, if a video “chunk” lasts 3 seconds, the recovery of the “chunk” by the HAS client module must not exceed 3 seconds, in order to allow restitution of the content without interruption by the terminal 30. It is therefore appropriate for the HAS client module to operate the best compromise between a reproduction quality, and therefore an encoding rate, as high as possible, and the download time of the fragment, which must be low enough to allow continuous reproduction on the TX restitution terminal.
- the HAS client module 303 may not order the download of the fragment at the optimum encoding rate, in order to limit the consumption of the user's data bucket, such as described in more detail below.
- the HAS module 303 recovers the manifest file 7 in order to discover the available fragments of the video content C1, and the various associated video qualities Nj.
- the multimedia stream transport technology is of the HAS type with five levels of encoding bit rate and resolution available, according to the example given in the table [Table 1]. below.
- N2 1200 kb / s
- a third encoding rate N3 2100 kb / s, etc.
- the HAS 303 module downloads, for example, successive Cli @ Nl fragments (i.e. the first temporal fragment at an encoding rate of 600 kb / s), then Cl 2 @ N3 (ie the second time fragment at an encoding rate of 2100 kb / s), then Cl 3 @ N3 (ie the third time fragment at an encoding rate of 2100 kb / s), .. .
- the various fragments downloaded by the HAS client module 303 are transmitted to the DISP 300 interface module for their return to the user on the screen of the TX reproduction terminal.
- the algorithm implemented by the HAS 303 client module to determine which fragment at which encoding rate should be downloaded in normal operating mode (i.e. outside of the encoding rate restricting by the module SEL 302) can be one of the already existing algorithms of the prior art. This algorithm will therefore not be described in more detail here.
- the DET module 301 determines the volume of data that would be consumed by downloading the content C1 at the different resolution levels of [Table 1] To do this, the DET module 301 uses for example a hypothesis simplifying, according to which the download takes place at the same level of resolution for the duration of the content, that is, in this example for two hours, or 7200 seconds. Although it does not correspond to the actual operation of HAS type downloading, this hypothesis allows a good estimate of the amount of data that could be consumed by downloading the content at each of the resolution levels proposed in the manifest file 7.
- the result of all the calculations performed is summarized in the table below.
- This data bucket corresponds for example to a volume of data associated with a prepaid card which it has acquired from the operator of the mobile network 1. It can also correspond to a monthly package that it has subscribed to with this operator, for example a 50GB / month package.
- the user's data bucket is known to the operator, from the offer subscribed to by the operator. user, or their billing information. It is therefore the operator who transmits this information to terminal 30.
- this data bucket can also be entered by the user himself. It can for example be entered via the interface of the TX rendering terminal (smart phone 3, or television 5 for example), during an installation phase of the HAS download service, or in response to a request from the service provider. this service, for example via a “pop in” window informing the user of new features or innovations in the service.
- the DET module 301 can then easily determine, for each of the resolutions proposed in the manifest file 7, the part of the data bucket that will be consumed in the event of downloading the content at this resolution, and the portion of this bucket that will remain with the client afterwards. download, based on current monthly consumption.
- the result of the calculations carried out by the DET 301 module can be displayed, for example in the form of the table [Table 3] below, on the screen of the TX restitution terminal.
- the terminal 30 then offers the customer, on the strength of this knowledge of his level of data bucket consumed and remaining after downloading, to define a high limit of the encoding rate of the content to be downloaded: the different fragments of the content C1 will then not be able to be downloaded at an encoding rate greater than this high limit selected by the user.
- the user decides for example that he wishes to view the content C1, but without exceeding 7% of consumption of his data bucket: he therefore chooses to restrict the downloading of the fragments of the content to a maximum resolution of 1280x720 pixels. .
- the interface of the TX rendering terminal uses the interface of the TX rendering terminal. For example, on the television screen 5, he selects, by means of a remote control, one of the rows of the table [Table 3], which is displayed for example in highlight. In another example, he selects this maximum authorized encoding rate by clicking on the appropriate row of the table [Table3] displayed on the touch screen of the smartphone 3. Any other type of interface configuration could also be used, such as a banner, a pop-in window, etc.
- the multimedia stream reader terminal 30 can make this selection itself, without the intervention of the user, for example by applying a principle of precaution with regard to the consumption of the data bucket. It can also encourage the user to select a low value for the maximum authorized encoding rate, for example by highlighting on the screen of the reproduction terminal a maximum recommended encoding rate value, depending on the share of the user. Bucket of data remaining after download. The user then only has to confirm or reject this pre-selection. The selected value feeds the selection module SEL 302, which communicates it to the HAS module 303, so as to restrict the downloading of the content fragments at the maximum encoding rate of 3Mb / s chosen by the user.
- the HAS 303 client module will successively download (312) the fragments Cl 2 @ N3, Cl 3 @ N3, C1 4 @ N2, C1 5 @ N1 and Cl 6 @ N3, c ' that is, download the best possible quality fragment based on network constraints, but never exceeding the maximum encoding rate MAX 311, which has been selected by the user to be 2100kb / s.
- the HAS 303 client module determines, depending on the network conditions, that the optimal rate of time fragment at which it can claim is 5000kb / s, it does not start the download of the next fragment at this optimal rate, but downloads the temporal fragment Cl 6 @ N3, at the maximum encoding rate allowed by the client.
- the module DET 301 for determining the volume of data consumed can only determine the absolute value of the volume of data consumed by downloading the content C1 at the various resolution levels proposed in the manifest file 7, and not its relative value by compared to the data bucket.
- the data in the table [Table 2] can be displayed, upon action of the display control module DISP 300, on the screen of the TX rendering terminal.
- the level of consumption of the multimedia stream C1 is simply presented at its various encoding rates, and the user must make a selection of the maximum encoding rate that he authorizes as a function only of the number of GB consumed at each of the flow rates.
- the user Since the user is most often aware of their data bucket, they can perform a quick head calculation to help them make a decision. Thus, if he wants to watch the VOD Cl, he can be ready to consume 2.7GB of his monthly data bucket, even if it means restricting his consumption during the rest of the month on other services or applications. In this case, it selects, in the table [Table2], the resolution of 1280x720 pixels, and the associated maximum encoding rate of 3Mb / s.
- the configuration of the interface of the TX rendering terminal making this selection possible can take any appropriate form.
- the display of the data restitution terminal is therefore displayed on the screen allowing the user to better understand the impact of downloading the content C1 on his data consumption, so that he has the necessary tools to adapt its content consumption, depending on its capabilities.
- the selection of the maximum encoding rate MAX 311 is effective only for the content C1 being downloaded HAS.
- this selection can be applied to all the multimedia streams accessible via the content server 2, or to all the multimedia streams that the user will download during a given period (for example the current month in the event of monthly flat rate), or during a given period during which the user is on the move.
- the DISP 300 module does not display all the lines of the tables [Table 2] and [Table 3] on the screen of the TX restitution terminal, but only the lines corresponding to the encoding rates which do not result in the user data bucket being exceeded.
- the customer is only offered the encoding speeds to which he can claim in order to be able to at least view the entire K1 content, if he does not have enough consumable data left to see it at the maximum available quality. .
- content C1 of the video on demand (VOD) type was given above. It will be noted that the content C1 can also be a deferred television program (or “replay”), or a live television program (“Live”). In the latter case, the duration of the program necessary for the calculation by the DET module 301 of the volume of data consumed can be extracted from the electronic program guide EPG (“Electronic Program Guide”).
- EPG Electronic Program Guide
- the present invention can be implemented on set-top boxes, on the CléTV ® d'Orange ® and generally on all terminals consuming HAS videos while on the move. (on mobile network).
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR1910685A FR3101503A1 (fr) | 2019-09-27 | 2019-09-27 | Gestion du téléchargement progressif adaptatif d’un contenu numérique sur réseau mobile avec sélection d’un débit d’encodage maximum autorisé en fonction d’un godet de données |
| PCT/FR2020/051656 WO2021058910A1 (fr) | 2019-09-27 | 2020-09-23 | Gestion du téléchargement progressif adaptatif d'un contenu numérique sur réseau mobile avec sélection d'un débit d'encodage maximum autorisé en fonction d'un godet de données |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4035408A1 true EP4035408A1 (fr) | 2022-08-03 |
Family
ID=69104702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP20792466.3A Pending EP4035408A1 (fr) | 2019-09-27 | 2020-09-23 | Gestion du téléchargement progressif adaptatif d'un contenu numérique sur réseau mobile avec sélection d'un débit d'encodage maximum autorisé en fonction d'un godet de données |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US12034792B2 (fr) |
| EP (1) | EP4035408A1 (fr) |
| FR (1) | FR3101503A1 (fr) |
| WO (1) | WO2021058910A1 (fr) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3134940A1 (fr) * | 2022-04-25 | 2023-10-27 | Orange | Gestion de la restitution d’un contenu multimédia |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100354531B1 (ko) * | 1998-05-06 | 2005-12-21 | 삼성전자 주식회사 | 실시간 복호화를 위한 무손실 부호화 및 복호화 시스템 |
| DE60036789D1 (de) * | 1999-02-04 | 2007-11-29 | Quvis Inc | Bildspeicherung und kommunikation mit priorität auf der qualität |
| US8788614B2 (en) * | 2007-05-07 | 2014-07-22 | At&T Intellectual Property I, L.P. | Methods, devices, systems, and computer program products for managing and delivering media content |
| US9109928B2 (en) * | 2007-08-16 | 2015-08-18 | International Business Machines Corporation | Methods and apparatus for efficient and adaptive transmission of data in data collection networks |
| US9113141B2 (en) * | 2010-12-09 | 2015-08-18 | Intel Corporation | Wireless channel aware adaptive video bit rate encoding |
| US9344517B2 (en) * | 2013-03-28 | 2016-05-17 | Sonic Ip, Inc. | Downloading and adaptive streaming of multimedia content to a device with cache assist |
| US9860294B2 (en) * | 2014-12-24 | 2018-01-02 | Intel Corporation | Media content streaming |
| KR102343331B1 (ko) * | 2015-07-07 | 2021-12-24 | 삼성전자주식회사 | 통신 시스템에서 비디오 서비스를 제공하는 방법 및 장치 |
| US10200272B1 (en) * | 2015-09-30 | 2019-02-05 | Alarm.Com Incorporated | Dynamic availability-based wireless data transmission |
| US10419581B2 (en) * | 2016-12-21 | 2019-09-17 | Cisco Technology, Inc. | Data cap aware video streaming client |
-
2019
- 2019-09-27 FR FR1910685A patent/FR3101503A1/fr not_active Ceased
-
2020
- 2020-09-23 WO PCT/FR2020/051656 patent/WO2021058910A1/fr not_active Ceased
- 2020-09-23 US US17/764,077 patent/US12034792B2/en active Active
- 2020-09-23 EP EP20792466.3A patent/EP4035408A1/fr active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| US12034792B2 (en) | 2024-07-09 |
| WO2021058910A1 (fr) | 2021-04-01 |
| US20220345511A1 (en) | 2022-10-27 |
| FR3101503A1 (fr) | 2021-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3987820A1 (fr) | Procédé de gestion du téléchargement progressif adaptatif (has) d'un contenu numérique diffusé en temps réel, gestionnaire, terminal lecteur de flux multimédia et programme d'ordinateur correspondants | |
| EP4055831A1 (fr) | Procédé de gestion de zapping de contenus multimédias numériques obtenu par téléchargement progressif adaptatif (has), dispositif de gestion, lecteur de flux multimédia et programme d'ordinateur correspondants | |
| EP4035408A1 (fr) | Gestion du téléchargement progressif adaptatif d'un contenu numérique sur réseau mobile avec sélection d'un débit d'encodage maximum autorisé en fonction d'un godet de données | |
| WO2019220034A1 (fr) | Gestion du téléchargement progressif adaptatif d'un contenu numérique au sein d'un terminal de restitution d'un réseau de communication local | |
| FR3081647A1 (fr) | Gestion du telechargement progressif adaptatif (has) d'un contenu numerique au sein d'un terminal lecteur de flux multimedia en temps reel. | |
| EP3926929B1 (fr) | Procédé de gestion de la lecture d'un contenu numérique au sein d'un terminal lecteur de contenus multimédias connecté à un dispositif de restitution | |
| FR3114720A1 (fr) | Gestion du téléchargement progressif adaptatif d’un contenu tenant compte de la qualité du signal échangé entre le terminal client et le point d’accès au réseau | |
| WO2021105585A1 (fr) | Procédé de gestion d'une liste de contenus accessibles au zapping, les contenus numériques étant téléchargeables en mode de téléchargement progressif adaptatif (has), dispositif de gestion, lecteur de flux multimédia et programme d'ordinateur correspondants | |
| EP3840391A1 (fr) | Gestion de la restitution d'un contenu multimédia et d'une interface de navigation sur un écran | |
| WO2023208688A1 (fr) | Gestion de la restitution d'un contenu multimédia | |
| FR3103668A1 (fr) | Gestion du téléchargement progressif adaptatif d’un contenu numérique sur réseau mobile avec détermination d’un débit d’encodage maximum autorisé sur une session en fonction d’un godet de données | |
| FR3093605A1 (fr) | Procédé de navigation accélérée dans un contenu numérique obtenu par téléchargement progressif adaptatif (HAS), gestionnaire, lecteur de flux multimédia et programme d’ordinateur correspondants. | |
| EP4109905A1 (fr) | Gestion du téléchargement progressif adaptatif d'un contenu numérique en mode économiseur d'écran | |
| FR3093603A1 (fr) | Procédé de navigation accélérée dans un contenu numérique obtenu par téléchargement progressif adaptatif (HAS), gestionnaire, lecteur de flux multimédia et programme d’ordinateur correspondants. | |
| FR3096210A1 (fr) | Procédé de transmission d’un contenu numérique ayant plusieurs versions accessibles depuis un serveur de contenus à destination d’un terminal de restitution. | |
| WO2025114181A1 (fr) | Procédé de gestion de la relecture d'un contenu ayant été diffusé en temps réel | |
| EP3846489A1 (fr) | Procédé de gestion d'un téléchargement progressif et adaptatif d'un contenu numérique par un terminal lecteur de flux multimédia connecté à un réseau de communication, dispositif de gestion, terminal lecteur de flux multimédia et programme d'ordinateur correspondants | |
| FR3114719A1 (fr) | Procédé de gestion de la lecture d’un contenu numérique au sein d’un terminal lecteur de contenus multimédias connecté à un dispositif de restitution | |
| EP4543015A1 (fr) | Procédé de gestion de l accès à des fichiers de description associés à un contenu diffusé en temps réel | |
| EP4554231A1 (fr) | Procédé de gestion de l' accès à des fichiers de description associés à un contenu diffusé en temps réel | |
| EP4734527A1 (fr) | Procédé de gestion de l accès, par un dispositif de lecture, à des contenus segmentés | |
| WO2020234030A1 (fr) | Restitution d'un contenu en arrière-plan ou sous forme d'incrustation dans le cadre d'un téléchargement progressif adaptatif de type has | |
| FR3128084A1 (fr) | procédé de gestion de la lecture d’un contenu multimédia. | |
| EP4297409A1 (fr) | Procédé de gestion de la lecture d'un contenu multimédia. | |
| WO2021209706A1 (fr) | Gestion de l'accès à des contenus numériques accessibles en téléchargement progressif adaptatif et encodés selon une méthode d'encodage à débit variable, en fonction d'une charge réseau |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20220317 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ORANGE |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20241105 |