Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
• • H—ELECTRICITY
  • H03—ELECTRONIC CIRCUITRY
  • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
  • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
  • H03M13/03—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words
  • H03M13/05—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits
• • H—ELECTRICITY
  • H03—ELECTRONIC CIRCUITRY
  • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
  • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
  • H03M13/63—Joint error correction and other techniques
  • H03M13/635—Error control coding in combination with rate matching
  • H03M13/6356—Error control coding in combination with rate matching by repetition or insertion of dummy data, i.e. rate reduction
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L1/00—Arrangements for detecting or preventing errors in the information received
  • H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/70—Media network packetisation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
  • H04L9/40—Network security protocols
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
  • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/46—Embedding additional information in the video signal during the compression process
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/23605—Creation or processing of packetized elementary streams [PES]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
  • H04N21/23611—Insertion of stuffing data into a multiplex stream, e.g. to obtain a constant bitrate
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
  • H04N21/2381—Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
  • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
  • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
  • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
  • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
  • H04N21/633—Control signals issued by server directed to the network components or client
  • H04N21/6332—Control signals issued by server directed to the network components or client directed to client
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/845—Structuring of content, e.g. decomposing content into time segments
  • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L1/00—Arrangements for detecting or preventing errors in the information received
  • H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
  • H04L1/0041—Arrangements at the transmitter end

Definitions

• the present invention relates to a method for encoding video data streams in order to improve the reliability and quality of reception of these streams in a digital wireless network, governed by a communication protocol, for example of type WIFI.
• the streams concerned are sent in multicast and come from at least one transmitter broadcasting them to receiving devices in this case located in a relatively small perimeter, so that they can operate with a communication protocol as mentioned, provided for operate in a rather local environment.
• the receiving devices are then equipped with at least one software application for processing and viewing the information received.
• the video data concerned by the invention are based on groupings of images (GOP) conventionally used in video coding (in particular in the MPEG standards for compression, decompression, video and audio processing and coding) for define the order in which internally coded and predictive coded images are arranged for generating a visible image in a video stream.
• the fluxes treated in the context of the invention also comprise conventional means for correcting transmission errors, the correction being done in this case by redundancy and being performed via algorithms known as AL-FEC algorithms. (for Application Level Forward Error Correction) implementing a matrix function.
• the method of the invention can find many practical applications, since it optimizes very real-time and / or near-real-time image flow transmission, one of the applications envisaged is the diffusion practically instantaneous events like sports meetings or shows, in the perimeter of an enclosure where the said event takes place.
• the quality of the video streams transmitted to the client devices allows mainly the visualization fluid and good quality of the video images, but also to enrich the visualization by treatments that may give added value to the streams received, for example a repetition and thus a review of some sequences, if necessary in slow motion or with a zoom effect. Such treatments would make little sense if the quality of video streams was not assured.
• the video streams are usually transmitted in the form of successive packets of information which obey a predetermined division for sending them, these packets very generally comprising the images to be transmitted, encoded for transmission, and additional information ⁇ x reception problem, are used by the reconstruction algorithms to try to restore the initial images.
• the method of the invention applies to video streams constituted in practice of successive data packets G, each packet G comprising, in a known manner, a first set H containing the native video data to be transmitted (the images of the video stream encoded) and a second set containing redundancy data obtained by a suitable algorithm.
• the first set of data is constituted from all the data M of at least one image group (GOP).
• the breakdown of the information packets to be transmitted in video streams therefore relies, in an innovative manner according to the invention, on particular groups of images developed and defined in the framework of standards organizing the architecture of the video data packets to be transmitted. .
• the computer system responsible for sending the video streams, and therefore the software that drives it, then performs a breakdown of the information that is based on these groupings of images or GOPs formatted in a standard manner in the world of video coding. , identifying a specific architecture based on particular coded images.
• the data M may belong to a single group of GOP images, of which they then contain all the data, or two or more groupings of GOP images, with the same condition to include all their data in the same packet.
• the size of all the images of the array of images is added in the data M of the native video stream, in an area adjacent to each image, which for example occupies two bytes of data per image.
• an index table containing the absolute position of each image of the group of images can be added in the data M, said table being able to be in a zone for example situated at the beginning of the image train encoded to be transmitted.
• each packet G is then organized into K first blocks of data of predetermined size L and N blocks of redundancy of size L, K being equal to M / L, the whole value by excess of the result of the M / L division being assigned to K if M / L is not an integer.
• the block portion corresponding to the difference (KxL-M), which exists only if M / L is not an integer, is then filled with data identified as stuffing data, for example zeros.
• the block number (from 1 to K + N)
• each of the blocks K and N then becomes L + n bytes that requires the coding of the above information.
• the reconstruction operations to be implemented in the hypothesis of a flawed transmission of video streams are clearly facilitated by the proposed new architecture.
• the invention also relates to a video stream organized according to the method explained above and comprising a succession of coded data packets G each consisting of a first set of native video data to be transmitted and a second set of redundant data.
• error correction device characterized in that the first set contains all the data of at least one image group (GOP).
• This type of video stream structured according to the method of the invention, makes it possible to guarantee reception in a sufficient quality at first so that the visualization of the transmitted streams is simply comfortable, then also for any subsequent processing applied to the transmitted signals. can be based on a sufficient information base for their realization.
• the invention actually results in organizing the information, that is to say the native video streams to be sent, so as to allow an optimization of the response of the system to video signal transmission defects, on the basis of an architecture that is sufficiently structured and rich in information.
• FIG. 1 represents a diagram schematizing the organization of a group of images as used in the context of the invention
• FIG. 2 illustrates, for the same data packet, the addition to the native video stream of the size of each coded picture of the picture group
• Fig. 3 shows the size M of the image packet when an index table is added to the data
• FIG. 4 shows the division into K blocks of length L of the data packet M, with possible addition of stuffing when K ⁇ L>M;
• Figure 5 illustrates the addition of N blocks due to redundancy encoding (FEC); and
• Figure 6 finally shows the addition of additional parameters enriching the information to be transmitted and facilitating the subsequent implementation of data recovery, if any.
• the first set of data constituting the native video stream to be transmitted before encoding the transmission error correction function is constituted from all the data of a group of images.
• This data organization structure is well known in the field of video coding, since it is defined in particular by the MPEG standards.
• GOP Group Of Pictures
• the grouping of these images forms a particular sequence, this sequence being repeated periodically to constitute the encoding of a video stream.
• I and predictive coded images there are internally coded images I and predictive coded images, the latter being of two types: predictive coding images based on a past image, and bidirectional predictive coding images B.
• the images P contain difference information, by motion prediction, with an image X or a picture P passed.
• the B images contain difference information with past and future I or P images within a group of images.
• the I or P images can be used as reference images, whereas this is generally not the case with the B images.
• the visible images are ultimately generated from the coded images contained in a group of images. images, which is also expressed in number of coded images, which are built at the time of encoding so as to guarantee the transfer rate of the video stream.
• the grouping of images N begins with a reference image X N , followed by images P and B in a particular order which defines said grouping of images.
• the video stream to be transmitted includes the image array N, followed by an image array N + l whose initial image ⁇ ⁇ + ⁇ is the new reference image, preceded by a group of images Nl and so after. All of these groupings of GOP N images constitute the encoded video stream.
• the basis of the clipping of the video data packets to be sent consists of these picture groups.
• Figure 1 represents only one, but there may be two or more in the M video data packets.
• FIG. 2 illustrates another characteristic of the method of the invention, which improves the coding of the video stream by adding the size of all the images I, P, B of the image array in an area adjacent to each of these images.
• the additional addition of an index table, appearing at the beginning of the video data packet in FIG. 3, further expands the encoded video information, the set constituting a first encoded set of size M.
• This length or size M is the starting point of a calculation aiming at a division into K blocks of length L (or even in FIG. 4), L being a constant and K being an integer.
• L being a constant
• K being an integer.
• the excess integer value is then attributed to K.
• stuffing or "stuffing" is done to obtain K complete blocks of length L. It is simply a matter of filling the block K with zeros, identified by the program as a stuffing value.
• Figures 5 and 6 add the notion of correction of possible transmission errors.
• the error correction is performed in this case by redundancy, using an algorithm known per se type AL-FEC (Application Layer Forward Error Correction).
• AL-FEC Application Layer Forward Error Correction
• the error correction encoding implements a matrix function that results in adding N additional data blocks, also of length L. It is the blocks K + 1 to K + N appearing in these figures 5 and 6.
• This additional information organizes in a better way the information, ie all the video streams to be sent, including the redundancy blocks, so as to allow an optimization of the system's response to faults. transmission of the video signal. They actually provide data on individual blocks to better trace errors and locate them in data packets.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• Computer Networks & Wireless Communication (AREA)
• Physics & Mathematics (AREA)
• Probability & Statistics with Applications (AREA)
• Theoretical Computer Science (AREA)
• Computer Security & Cryptography (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)
• Detection And Prevention Of Errors In Transmission (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=55236515

Family Applications (1)

Country Status (11)

Families Citing this family (3)

Family Cites Families (23)

• 2015
  • 2015-09-30 FR FR1559299A patent/FR3041850B1/fr active Active
• 2016
  • 2016-09-30 EP EP16809456.3A patent/EP3357244A1/fr not_active Ceased
  • 2016-09-30 US US15/764,683 patent/US10477246B2/en active Active
  • 2016-09-30 JP JP2018516539A patent/JP2018536325A/ja active Pending
  • 2016-09-30 CA CA3000557A patent/CA3000557A1/fr active Pending
  • 2016-09-30 WO PCT/FR2016/052508 patent/WO2017055771A1/fr active Application Filing
  • 2016-09-30 SG SG11201802623PA patent/SG11201802623PA/en unknown
  • 2016-09-30 CN CN201680063066.2A patent/CN108353183B/zh active Active
  • 2016-09-30 AU AU2016333573A patent/AU2016333573A1/en not_active Abandoned
  • 2016-09-30 KR KR1020187011850A patent/KR20180074692A/ko unknown
  • 2016-09-30 BR BR112018006381-9A patent/BR112018006381A2/pt not_active Application Discontinuation

Also Published As

Similar Documents

Legal Events