Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/854—Content authoring
  • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
  • H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
  • H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
  • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
  • H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
  • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
  • H04N21/4383—Accessing a communication channel
  • H04N21/4384—Accessing a communication channel involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
  • H04N21/61—Network physical structure; Signal processing
  • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
  • H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/854—Content authoring
  • H04N21/8549—Creating video summaries, e.g. movie trailer
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/85—Assembly of content; Generation of multimedia applications
  • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
  • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

• the invention relates to a method of reading, by a receiving terminal, an encrypted multimedia stream with quick access to the content in clear.
• the field of the invention is that of the broadcast of multimedia streams and encrypted multimedia stream.
• the field of the invention is that of the use of adaptive broadcasting protocols for broadcasting multimedia streams and encrypted multimedia streams.
• Adaptive broadcast protocols allow you to adjust the quality of an audio / video stream based on network bandwidth variations to provide the best possible user experience.
• the goal of the implementation of such a protocol is to obtain a display of the best possible quality without interruption.
• Such a display is one that corresponds to physical characteristics such that the bandwidth used is maximum and of the order of 3000 kilobits per second. With the evolution of the displays (4K screens), these bandwidths may have to be more and more important despite the evolution of compression algorithms.
• These adaptive protocols are based on the encoding of the content into multiple representations of quality and thus of variable bit rate. These adaptive protocols cut these representations into short segments. A segment can be likened to a short multimedia file.
• a representation may contain single audio, video only or audio-video data.
• the representations and segments are then referenced in a manifest.
• the software for reading such streams has download access to the manifest and the segments described in the manifest.
• a manifest For a given multimedia program, a manifest has several sections, each section corresponding to a given quality. Each section references segments as previously described. A section also contains various data to describe the characteristics of the section. Each section corresponds to a representation.
• the startup sequence once the multimedia program selected by a user, is to download the manifest, then audio / video segments, choosing the most appropriate representation.
• the playback software processes the contents of the segments to:
• the data to be displayed is encapsulated in a TS or MPEG-4 container.
• the playback software starts by downloading segments from the lower bit rate representation, and gradually increases the quality of the downloaded segments, depending on the bandwidth available on the network.
• the diagram in Figure 1 shows an example of segments downloaded and displayed at startup as a function of time.
• Figure 1 shows a date t0 at which a user of a playback software activates a multimedia program, i.e., he chooses a program from a menu. This causes the download of the manifest corresponding to the activated program.
• the reading software performs the following actions:
• the first segment is downloaded with a first quality corresponding to a first bit rate
• the second segment is downloaded, after the first segment, with a second quality corresponding to a second bit rate higher than the first bit rate;
• the third segment and the fourth segment are downloaded, after the second segment, with a third quality corresponding to a third bit rate higher than the second bit rate;
• the fifth segment and the sixth segment are downloaded, after the fourth segment, with a fourth quality corresponding to a fourth bit rate higher than the third bit rate;
• the following segments are downloaded with a fifth quality corresponding to a fifth bit rate higher than the fourth bit rate.
• the increase of the bit rate stops when the download time of a segment approaches the duration of a segment. If the download time becomes longer than this duration, then the bit rate decreases.
• Figure 1 shows a date t2, after t1 of several seconds, at which the reading software receives the decryption key and begins to display the contents of the downloaded segments starting with the first segment.
• the proposed invention makes it possible to reduce the startup time of the visualization of an encrypted multimedia program, delivered in the form of a multimedia stream, by a user by allowing the visualization of a content until the acquisition the key ends.
• the subject of the invention is therefore a method for reading, by a receiving terminal, an encrypted multimedia stream with fast access to the plaintext, characterized in that, the multimedia stream being broadcast according to an adaptive broadcasting protocol, the multimedia stream is described by a manifest comprising several sections each section corresponding to different physical characteristics, the initialization of the reading of the stream is done by implementing, in parallel, the following steps:
• the method according to the invention may have one or more additional characteristics among the following, considered individually or according to the technically possible combinations:
• the segments of the starting section are of lower quality than the adapted segments.
• the physical characteristics of the startup section are such that the corresponding segments are compatible for broadcasting with a bandwidth less than or equal to 256 kilobits per second;
• the physical characteristics of the startup section are such that the corresponding segments are compatible for broadcasting with a bandwidth less than or equal to 1000 kilobits per second;
• a startup section includes, in its description, a specific marker
• the broadcast method in a variant, can also be characterized in that a tracking record is erased if its age is greater than a second predetermined threshold.
• the invention also relates to a non-transitory memory device comprising instruction codes for the implementation of the method according to one of the possible combinations of the characteristics mentioned above.
• the invention also relates to a receiver terminal of a multimedia stream using an adaptive broadcast protocol according to one of the possible combinations of the characteristics mentioned above.
• the invention also relates to a computer program product comprising instructions which, when the program is executed by a computer, lead it to implement the steps of the method of reading a multimedia stream according to one of the variants. previously stated.
• FIG. 1 an illustration of a temporal sequence of playback of a multimedia program broadcast according to an adaptive protocol
• FIG. 2 an illustration of a temporal sequence of playback of a multimedia program broadcast according to an adaptive protocol and according to the invention
• FIG. 3 an illustration of a receiving terminal for implementing the method according to the invention
• FIG. 4 an illustration of steps of the method according to the invention.
• FIG. 5 an illustration of a variant of a temporal sequence for reading a multimedia program broadcast according to an adaptive protocol and according to the invention.
• FIG. 3 shows an audio / video reception equipment 100.
• FIG. 3 shows that the equipment 100 is connected to a screen 200 and remotely controllable by a remote control 300.
• FIG. 3 shows that the audio / video reception equipment 100 comprises:
• Storage means are, for example, a hard disk, an SSD, a memory card, a memory component ...;
• An interface 130 for communication with the remote control 300 for example an infrared communication interface or an interface of this radio communication;
• An interface 140 for communication with the screen 200 for example a peritel communication interface, hdmi, miracast, dvi, vga, ...;
• An interface 150 for receiving a multimedia broadcast may be an interface to the Internet network, an interface to the digital terrestrial television broadcasting network, or an interface to a satellite broadcasting network. This interface list is not exhaustive. Note that if this interface is pure broadcast type, it is still said pure downlink, then the audio video reception equipment also includes a communication interface for the transmission of messages, that is to say a communication interface uplink.
• FIG. 3 shows that the means 120 for storing the audio / video reception equipment comprises at least one zone 120.1 of instruction code comprising instruction codes of the invention.
• FIG. 3 shows that the microprocessor 1 10 of the audio / video reception equipment 100, the audio / video reception equipment 100 storage means 100, the communication interface 130 with the equipment remote control 100 the audio / video reception interface, the communication interface 140 with the screen of the audio / video reception equipment 100 and the reception interface 150 of the audio / video reception equipment 100 are interconnected by a bus 160.
• the audio / video reception equipment 100 is a set-top box. In practice it can be a computer or a phone / tablet. In the latter case the phone uses its own screen or deporte its display on another screen.
• the audio / video reception equipment 100 is therefore also designated as a receiving terminal.
• FIG. 3 shows a broadcast server 400.
• the server 400 comprises:
• a microprocessor 410 A microprocessor 410;
• a communication interface 450 for receiving download requests and issuing responses to these requests.
• FIG. 3 shows that the microprocessor 410 of the broadcast server 400, the broadcast server storage means 400 and the communication interface 450 of the broadcast server 400 are interconnected by a bus 460.
• FIG. 3 shows that the storage means 420 comprise several zones:
• a zone 420.1 of sections making it possible to record a plurality of sections as described in this document, that is to say representations of an audio / video content, each section comprising at least one piece of information enabling the identification of the audio / video content; section as a boot section or not. The absence of this information indicating that the section is not a startup section.
• Fig. 4 shows a preliminary step 1000 in which a user of the audio / video reception equipment 100 uses the remote control 300 to select a multimedia program. This occurs at a first date t0 shown in Fig. 2.
• the audio / video receiving equipment 100 then proceeds to a step 1020 in which it retrieves the manifest file corresponding to the selected multimedia program.
• the audio / video reception equipment analyzes the recovered manifest file to determine whether the audio / video content described by the manifest file requires a decryption key or not.
• the audio / video receiving equipment proceeds to a step 1040 which corresponds to a manifest processing according to the state of the art. If the content requires a decryption key the audio / video receiving equipment proceeds to a step 1050 of processing an encrypted content that corresponds to a manifest processing according to the invention. In the step 1050 of processing an encrypted content, the audio / video reception equipment starts, at the date t1, three processes in parallel:
• the second process and the third process are conventional processes corresponding to a processing of a manifest according to the state of the art.
• the first process is done by searching the manifest for sections that are identified as sections describing boot segments. This is possible if the manifest file is compatible with the processing described by the invention.
• the important element is the value assigned to the xml attribute named "schemeldUri”. Having a DASH manifest file in one section Having a field marked with "Essential Property” and having this value for the attribute "schemeldUri” designates this section as a start-up section.
• the tag in the case of the adaptive protocol Smooth Streaming, we use the possibility of using the tag named "CustomAttributes”.
• Smooth Streaming we will have, in the customizable fields, a field whose name is "kind” and whose value is predefined, for example "startup”. This is illustrated below.
• a startup section is such that it describes a content that can be accessed without knowing the decryption key whose acquisition started with the launch of the second process.
• the audio / video receiving equipment proceeds to a synchronization step 1060.
• the timing point of synchronization is the acquisition of the decryption key. As long as the decryption key is not acquired, the audio / video receiving equipment downloads the boot segments and processes them for display on the screen.
• the audio / video receiving equipment proceeds to a step 1070 for processing the main segments in which it switches from the processing of the start-up segments to the processing of the main segments whose content it can now decipher. . Failover occurs at the end of the boot segment display during which the decryption key was acquired.
• the processing of a segment includes steps of de-encapsulation, decryption, decoding, buffering and display.
• the decryption step of course depends on the nature of the content depending on whether it is encrypted or not.
• the buffering can be done at any time in the list of steps mentioned. Thus, unencrypted segments or undecoded segments can be buffered. It is understood that all the steps should have been completed for each segment before the display.
• Figure 2 illustrates an implementation of the method according to the invention.
• Fig. 2 shows a date t3, after the date t1, at which the audio video receiving equipment received the first start segment. From this date, the audio / video reception equipment starts to display the contents of this segment. It can be seen that this date is well below the date t2, of reception of the decryption key, illustrated by FIG.
• Figure 2 shows that audio video equipment downloads the second boot segment before the date equal to t3 + duration of the first segment. This allows him, at the end of the display of the first boot segment, to be able to start the display of the second boot segment.
• Figure 2 shows that the date t2 of receiving the decryption key is located during the display of the second boot segment.
• the third displayed segment will therefore be the third adapted segment whose content can be decrypted with the decryption key acquired.
• the display of the program then continues from the adapted segments.
• the audio / video receiving equipment stops current processing on the boot segments and does not use the boot segments. In this case, it displays a fixed, or animated, predetermined image to indicate to the user that the adapted segments will soon be displayed, as soon as the decryption key has been acquired.
• the start segments have the following characteristics:
• Boot segments are either clear or encrypted by a key independent of the key used by the primary DRM.
• AES encryption or "Clear-Key” as alternative encryption.
• the alternative key is stored in the audio / video equipment which guarantees fast access.
• ⁇ Altered content in a variant
• filters may be applied by a server to the content to degrade the quality of viewing and / or listening. For example, we use a print on a logo, we pixelate or blur the video; we turn off the audio. The content appears degraded to the user, but is enough to give him a feedback on what is being broadcast.
• the bit rate of the start-up segments can be reduced, for example by increasing the compression ratio, by decreasing the number of video frames; by reducing the video and / or audio sampling rate.
• the bit rate of the boot segments can be limited to 256 kilobits per second or less. In another example, the bit rate is limited to 1000 kilobits per second or less.
• the server that delivers the content can respond in priority to requests on startup segments.
• a server 400 may limit the number of startup segment downloads per time slot and per client. View of the audio / video receiving equipment this corresponds to a download error.
• the server 400 performs, for each request, the following actions:
• the first threshold is, for example, 30 seconds. This first threshold can also be expressed as a multiple of the duration of a segment, for example 10 segments.
• segment types there are two segment types: adapted and start.
• the nature of a segment is determined by whether the segment is part of a startup section or not.
• this information can be materialized in several ways:
• the segments are stored in an envelope containing data on the nature of the segment
• the segments are encapsulated in a section whose envelope contains data on the nature of the segments;
• the broadcast server deletes from the request tracking area all requests whose age is greater than a second threshold.
• This second threshold is worth, for example 10 minutes or a multiple of the duration of a segment for example 50 segments. With the example of the description a plaintiff could thus only get 10 sections every 50 sections. This erasure makes it possible to download boot segments again. Erasing can be effective or logical.
• a request tracking record also makes it possible to associate with the sender identifier a datum identifying a section. This allows a requestor to obtain boot segments for multiple sections. This variant allows fast "zapping".
• the query tracking area has records only for queries on startup segments.
• a server such as the broadcast server 400 maintains a request history file received by the server.
• the broadcast server uses this history file to search for a previous request. In this case it is necessary moreover to filter on the nature of the segment object of the request to find the preceding request.
• the criterion considered is not purely the age, but a number of requests received during a predetermined period of time. In other words, we consider the number of startup segment requests having less than a predetermined age.
• one counter per section is considered: a caller is not allowed to request more than a predetermined number of start segments per section.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computer Security & Cryptography (AREA)
• Databases & Information Systems (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Information Transfer Between Computers (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=60888473

Family Applications (1)

Country Status (6)

Families Citing this family (2)

Family Cites Families (10)

• 2017
  • 2017-08-02 FR FR1757428A patent/FR3069996B1/fr not_active Expired - Fee Related
• 2018
  • 2018-07-18 US US16/635,823 patent/US20210368232A1/en not_active Abandoned
  • 2018-07-18 CN CN201880058857.5A patent/CN111066328A/zh active Pending
  • 2018-07-18 WO PCT/EP2018/069525 patent/WO2019025189A1/fr not_active Ceased
  • 2018-07-18 EP EP18740237.5A patent/EP3662672A1/de not_active Ceased
  • 2018-07-18 BR BR112020002071-0A patent/BR112020002071A2/pt not_active Application Discontinuation

Also Published As

Similar Documents

Legal Events