EP2297881B1 - Übertragung von multimediaströmen zu mobilgeräten mit uncodierter transporttunnelung - Google Patents

Übertragung von multimediaströmen zu mobilgeräten mit uncodierter transporttunnelung Download PDF

Info

Publication number
EP2297881B1
EP2297881B1 EP09755780.5A EP09755780A EP2297881B1 EP 2297881 B1 EP2297881 B1 EP 2297881B1 EP 09755780 A EP09755780 A EP 09755780A EP 2297881 B1 EP2297881 B1 EP 2297881B1
Authority
EP
European Patent Office
Prior art keywords
audiovisual information
information
error correction
packets
correction coding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP09755780.5A
Other languages
English (en)
French (fr)
Other versions
EP2297881A2 (de
Inventor
Kevin A. Shelby
Peter J. Nysen
Michael B. Doerr
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Coherent Logix Inc
Original Assignee
Coherent Logix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/167,708 external-priority patent/US8151305B2/en
Application filed by Coherent Logix Inc filed Critical Coherent Logix Inc
Priority to EP15194554.0A priority Critical patent/EP3002895A1/de
Publication of EP2297881A2 publication Critical patent/EP2297881A2/de
Application granted granted Critical
Publication of EP2297881B1 publication Critical patent/EP2297881B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L25/00—Baseband systems
    • H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
    • H04L25/0202—Channel estimation
    • H04L25/0224—Channel estimation using sounding signals
    • H04L25/0226—Channel estimation using sounding signals sounding signals per se
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2381—Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/29—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/29—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes
    • H03M13/2906—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes using block codes
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/29—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes
    • H03M13/2906—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes using block codes
    • H03M13/2909—Product codes
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/29—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes
    • H03M13/2957—Turbo codes and decoding
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/65—Purpose and implementation aspects
    • H03M13/6577—Representation or format of variables, register sizes or word-lengths and quantization
    • H03M13/6583—Normalization other than scaling, e.g. by subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/42—Arrangements for resource management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/02—Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information
    • H04H60/07—Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information characterised by processes or methods for the generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/0078—Avoidance of errors by organising the transmitted data in a format specifically designed to deal with errors, e.g. location
    • H04L1/0079—Formats for control data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L25/00—Baseband systems
    • H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
    • H04L25/03—Shaping networks in transmitter or receiver, e.g. adaptive shaping networks
    • H04L25/03006—Arrangements for removing intersymbol interference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4381—Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4382—Demodulation or channel decoding, e.g. QPSK demodulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64315—DVB-H
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/03—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words
    • H03M13/05—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits
    • H03M13/11—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits using multiple parity bits
    • H03M13/1102—Codes on graphs and decoding on graphs, e.g. low-density parity check [LDPC] codes
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/27—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes using interleaving techniques
    • H03M13/2732—Convolutional interleaver; Interleavers using shift-registers or delay lines like, e.g. Ramsey type interleaver
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/29—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes
    • H03M13/2933—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes using a block and a convolutional code
    • H03M13/2936—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes combining two or more codes or code structures, e.g. product codes, generalised product codes, concatenated codes, inner and outer codes using a block and a convolutional code comprising an outer Reed-Solomon code and an inner convolutional code
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/53—Arrangements specially adapted for specific applications, e.g. for traffic information or for mobile receivers
    • H04H20/57—Arrangements specially adapted for specific applications, e.g. for traffic information or for mobile receivers for mobile receivers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L25/00—Baseband systems
    • H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
    • H04L25/03—Shaping networks in transmitter or receiver, e.g. adaptive shaping networks
    • H04L25/03006—Arrangements for removing intersymbol interference
    • H04L2025/03777—Arrangements for removing intersymbol interference characterised by the signalling
    • H04L2025/03783—Details of reference signals
    • H04L2025/03796—Location of reference signals

Definitions

  • the present invention relates to a mobile television broadcast system, and more specifically in one embodiment relates to enhancement of the current ATSC Digital TV broadcast system for mobile services to mobile and handheld devices.
  • the ATSC (Advanced Television Systems Committee) standard relates to a digital television format which will replace the analog NTSC television system.
  • the ATSC standard is a high definition television standard that produces standard 4:3 or wide screen 16:9 images up to 1920 ⁇ 1080 pixels in size - more than six times the display resolution of the earlier NTSC standard.
  • the ATSC standard makes provisions to transport multiple standard-definition "virtual channels" broadcast on a single 6 MHz TV channel.
  • the ATSC standard also includes "theater quality" audio using the Dolby Digital AC-3 format to provide 5.1-channel surround sound.
  • the ATSC standard also provides numerous auxiliary datacasting services.
  • the ATSC standard uses the MPEG-2 systems specification for encapsulation (transport) of data. More specifically, ATSC uses the 188-byte MPEG transport stream packets to carry data. MPEG-2 is also referred to as "transport stream", “MPEG-TS”, or simply "TS”.
  • transport stream MPEG-TS
  • TS Transport stream
  • the receiver demodulates and applies error correction to the signal. Then, the transport stream may be demultiplexed into its constituent streams.
  • a video codec e.g. MPEG-2, H.264, VC-1, is used for encoding and decoding video, subject to certain constraints.
  • the WO 02/03678 A2 concerns a data extension for 8VSB signalling. More specifically, a robust data extension is added to a standard 8VSB digital television transmis-sion system by encoding high priority data packets in a rate 1 ⁇ 2 trellis encoder (cf. abstract).
  • the US 2007/147440 A1 concerns a system in which two different compression formats may be used for a/v information, e.g. MPEG-2 and H.264.
  • One stream may be "normal” and the other may be "turbo".
  • Various embodiments are presented of a system and method for wirelessly communicating audiovisual information.
  • One set of embodiments involves a system and method for wirelessly transmitting audiovisual information to a mobile device.
  • Another set of embodiments involves a system and method for wirelessly receiving audiovisual information by a mobile device.
  • the audiovisual information may be packetized according to the ATSC (Advanced Television Standards Committee) standard, e.g., using 8-VSB modulation.
  • ATSC Advanced Television Standards Committee
  • the method for transmitting audiovisual information to a mobile device may include encoding first audiovisual information using a first error correction coding method.
  • the first error correction coding method may be a convolutional encoding method.
  • a plurality of packets may be generated, including the first audiovisual information.
  • the plurality of packets may also include second audiovisual information, and control information.
  • the second audiovisual information may not be encoded using the first error correction coding method.
  • the second audiovisual information may be encoded using a second error correction coding method.
  • the second audiovisual information may be encoded using a systematic block coding method.
  • the first audiovisual information and the second audiovisual information may be located in different packets of the plurality of packets.
  • one or more packets may include the first audiovisual information
  • one or more different packets may include the second audiovisual information.
  • some or all of the packets may include both first audiovisual information and second audiovisual information.
  • at least part of the first audiovisual information and at least part of the second audiovisual information may be co-located in at least one packet of the plurality of packets.
  • the plurality of packets may also include control information.
  • the control information may indicate that the second audiovisual information is not encoded according to the first error correction coding method.
  • the control information may also indicate that the first audiovisual information is encoded using the first error correction coding method.
  • the control information may be usable by a receiver to determine that the second audiovisual information is not encoded according to the first error correction coding method.
  • the receiver may be configured to recognize information that is uncoded according to the first error correction coding method as a different service or service version than information that is coded according to the first error correction coding method. Thus, a receiver's determination that the second audiovisual information is not encoded according to the first error correction coding method may thereby indicate to the receiver that the second audiovisual information is a different service version than the first audiovisual information.
  • the control information may be included in the same packets as the first and/or the second audiovisual information.
  • the control information and the audiovisual information may be located in different packets.
  • the first and second audiovisual information may be located in one or more packets, while the control information may be located in a different one or more packets.
  • the plurality of packets may be transmitted in a wireless manner.
  • the packets may be transmitted to a mobile device, e.g., including a receiver.
  • the plurality of packets may be transmitted by a transmitter, e.g., including an antenna.
  • the method for wirelessly transmitting audiovisual information to a mobile device may be performed partially or entirely by a system, which in various embodiments may include some or all of: memory for storing the audiovisual information; transmit logic coupled to the memory and configured to generate the packets and the control information; and a transmitter for transmitting the pluralities of packets.
  • the method for wirelessly receiving and presenting audiovisual information by a mobile device may include receiving a plurality of packets in a wireless manner.
  • the plurality of packets may include first audiovisual information and second audiovisual information.
  • the first audiovisual information may be encoded using a first error correction coding method, while the second audiovisual information may not be encoded using the first error correction coding method.
  • the first error correction coding method may be a convolutional encoding method, according to one embodiment.
  • the second audiovisual information although not encoded according to the first error correction coding method, may be encoded using a second error correction coding method.
  • the second audiovisual information may be encoded using a systematic block coding method.
  • the first audiovisual information and the second audiovisual information may be located in different packets of the plurality of packets.
  • one or more packets may include the first audiovisual information
  • one or more different packets may include the second audiovisual information.
  • some or all of the packets may include both first audiovisual information and second audiovisual information.
  • at least part of the first audiovisual information and at least part of the second audiovisual information may be co-located in at least one packet of the plurality of packets.
  • the plurality of packets may also include control information.
  • the control information may indicate that the second audiovisual information is not encoded according to the first error correction coding method.
  • the control information may also indicate that the first audiovisual information is encoded using the first error correction coding method.
  • the control information may be included in the same packets as the first and/or the second audiovisual information.
  • the control information and the audiovisual information may be located in different packets.
  • the first and second audiovisual information may be located in one or more packets, while the control information may be located in a different one or more packets.
  • the mobile device may determine, based on the control information, that the second audiovisual information is not encoded according to the first error correction coding method. Because of this, the mobile device may determine that the second audiovisual information is a different service version than the first audiovisual information. Depending on which service version(s) the mobile device is configured to present, at least a portion of the audiovisual information (e.g., either part or all of the first audiovisual information, or part of all of the second audiovisual information, or both) may be presented on the mobile device. This may include presenting (e.g., displaying) video information on a display and/or presenting (e.g., playing) audio information on one or more speakers.
  • presenting e.g., displaying
  • presenting e.g., playing
  • the method for wirelessly receiving audiovisual information by a mobile device may be performed by a mobile device.
  • the mobile device may include an antenna for wirelessly receiving the packets, receiver logic coupled to the antenna for processing the audiovisual and error correction coding information and presenting the processed audiovisual information, and a display and/or one or more speakers on which the audiovisual information may actually be presented.
  • the presence or lack of error correction coding according to a reference error correction coding method may be used to signal a different service version.
  • this may be useful for providing a transmission system, and mobile devices for use with the transmission system, with forward compatibility.
  • a transmission system may use a particular error correction coding method for its initial service version, but may also plan for and allow the possibility of not using that error correction coding method in a future service version, as a way of signaling that future service version, without needing to specify what the future service or service version may be at the time of the initial service launch.
  • both legacy mobile devices which can only receive and present services from an earlier service version (e.g., the initial service launch), and newer mobile devices which can receive and present services from newer service versions, may be provisioned with audiovisual information within the same transport framework.
  • Figure 1 illustrates an exemplary broadcast system 100 according to one example of the invention.
  • the broadcast system may be a digital television broadcast system.
  • the broadcast system 100 described herein, including the various methods described herein, may be used for broadcasting any of various types of data, including audiovisual information as well as other data.
  • audiovisual information includes any of various types of information or data that comprises video data and/or audio data.
  • video data includes motion video (such as television, movies, streaming video, etc., as well as image data, such as JPEGs.
  • audiovisual information further includes any of various types of information or program instructions that, when executed, cause a device to present video data (on a display) and/or audio data (on speakers).
  • audiovisual information includes any of various types of gaming content (including program instructions and/or data) that can be used and/or executed to present gaming content (e.g., images, video, and/or audio) on a presentation device.
  • the broadcast system 100 and the various methods described herein are described in the present application in the context of transmitting audiovisual information for presentation by a receiving device, in particular digital television. However, it is noted that the broadcast system 100 and the various methods described herein may be used for transmission / reception of any of various types of data (e.g., audiovisual information, email, files, text documents, seismic data, measurement data, weather data, etc.), with audiovisual information being merely one representative example.
  • audiovisual information e.g., email, files, text documents, seismic data, measurement data, weather data, etc.
  • the broadcast system may operate according to the ATSC (Advanced Television Standards Committee) standard, e.g., using 8-VSB modulation.
  • the broadcast system may operate according to a modified version of the ATSC standard, or according to another standard.
  • the Mobile/Handheld (M/H) modification of the ATSC standard is used for transmission of audiovisual information for moving receivers.
  • the current M/H system transports M/H services in bursts alongside the main service stream encapsulated in NULL packets consistent with the methods prescribed for E-VSB service multiplexing.
  • the system uses serial concatenated convolutional coding (SCCC) for additional robustness.
  • SCCC serial concatenated convolutional coding
  • the existing M/H system supplements the base 8VSB transport with the addition of extra training multiplexed with the mobile packet data in such a way that the training data appears in contiguous bytes (2 full segments per training) at transmission.
  • a receiver can utilize this additional training information to update its equalizer in order to track fast moving channel conditions.
  • Specific examples disclosed herein may be based on, or include portions of the M/H modification to the ATSC standard, and may also include further variations and modifications to M/H and the ATSC standard.
  • the examples related to transmission of audiovisual information disclosed herein are not necessarily limited to use with the ATSC or M/H systems, and may be equally applicable for transmission of audiovisual information in accordance with other standards and/or modulations schemes, such as DVB-T/H, ISDB-T, DMB-T/H, etc.
  • the system 100 comprises a transmission system (or transmit system) 102, one or more mobile devices 112 (e.g., mobile devices 112A-112D), and at least one stationary device 114.
  • a transmission system or transmit system
  • mobile devices 112 e.g., mobile devices 112A-112D
  • stationary device 114 e.g., a plurality of stationary devices 114.
  • the transmission system 102 is configured to transmit audiovisual information to the one or more mobile devices 112 in a wireless manner. More particularly, the transmission system 102 may be configured to transmit digital television signals / channels to the mobile devices 112. The mobile devices 112 may receive and present the audiovisual information, e.g., receive and present the digital television signals / channels. The transmission system 102 may also be configured to transmit audiovisual information to the stationary device 114 (e.g., stationary television) in a wireless manner. The transmission system 102 is also configured to transmit audiovisual information to the one or more stationary devices 114, e.g., televisions.
  • the stationary device 114 e.g., stationary television
  • examples of the invention are described herein with respect to reception by mobile devices 112.
  • the various examples of the invention described herein may also of course be used for reception by stationary devices.
  • one example of the invention provides for reception of additional error correction information by stationary devices 114 for the purpose of enhancing the robustness of the terrestrial broadcast.
  • any of the various methods described herein may be utilized with either mobile devices 112 or stationary devices 114, or both, as desired.
  • the transmission system 102 comprises a transmitter 106 as well as transmit logic 104 coupled to the transmitter 106.
  • the transmit logic 104 may comprise any of various types of logic, such as one or more computer systems (with accompanying software), digital logic, analog logic, programmable gate arrays, etc., or combinations thereof.
  • the transmit logic 104 is adapted for receiving and/or storing audiovisual information (e.g., television data) and for generating packets containing the audiovisual information.
  • the transmit logic 104 may generate packets according to any of various standards, such as the ATSC (Advanced Television Standards Committee) standard, e.g., using 8-VSB modulation.
  • the transmission system 102 may use other modulation schemes, such as DVB-T/H, ISDB-T, DMB-T/H, etc.
  • the transmit logic is also adapted for generating error correction coding information.
  • the transmit logic may be configured to encode data with any of various types of error correction techniques, including (but not limited to): convolutional coding (such as trellis encoding), block coding (such as Reed-Solomon encoding), or other error correction techniques.
  • the transmit logic may be configured to encode data with more than one error correction technique.
  • the transmit logic 104 is also configured to generate packets containing control information as described herein.
  • one or more of the digital television channels are intended for stationary receivers, such as televisions.
  • One or more of the digital television channels may also be intended for mobile and/or handheld (M/H) (referred to collectively herein as "mobile”) devices 112.
  • M/H mobile and/or handheld
  • one or more of the digital television channels may be intended for either stationary receivers or mobile devices.
  • the transmit logic 104 may be configured to generate packets containing error correction coding information.
  • the transmit logic 104 may generate error correction coding information for audiovisual information, and may transmit the error correction coding information in a separate packet (or packets) than the audiovisual information, with another packet (or packets) containing control information for associating the error correction coding information with the audiovisual information.
  • a receiver which does not require or is not configured to use the error correction coding information may ignore the error correction coding information packet and simply receive the audiovisual information as a normal audiovisual stream, while a receiver (such as a mobile device) which does require additional error correction coding information and is configured to use the error correction coding information may associate the error correction coding information with the audiovisual information (e.g., based on the control information) and thereby achieve a more robust system.
  • control information can be used by the transmit logic 104 to generate and transmit new types of error correction coding that is usable by the receiver.
  • a first part of the audiovisual information may be encoded using a first error correction coding method while a second part of the audiovisual information may not be encoded using the first error correction method; the second part of the audiovisual information may simply be uncoded, or may be encoded using a second error correction coding method.
  • multiple error correction coding methods may be used with some or all of the audiovisual information.
  • the mobile devices 112 may be any of various types of devices, such as portable computer systems (laptops) 112A, wireless telephones 112B (e.g., Blackberrys, iphones, etc.), personal digital assistants 112C, television equipment 112D configured in vehicles, and other types of portable devices capable of displaying received audiovisual information.
  • portable computer systems laptops
  • wireless telephones 112B e.g., Blackberrys, iphones, etc.
  • personal digital assistants 112C e.g., television equipment 112D configured in vehicles, and other types of portable devices capable of displaying received audiovisual information.
  • the mobile devices 112 are configured to wirelessly receive (e.g., with an antenna) the packets transmitted by the transmitter 106, including the packets containing audiovisual information, the packets containing error correction coding information, and the packets containing control information.
  • a respective mobile device 112 may also include receiver logic for processing the received audiovisual information, as well as a display for presenting video information and one or more speakers for presenting audio information.
  • each of the mobile devices 112 may include television-like capabilities for presenting received television channels as described herein.
  • the stationary devices 114 may be any of various types of devices that are intended to be placed at a fixed location (referred to as stationary or “non-mobile"), such as conventional televisions, e.g., liquid crystal displays (LCD displays), plasma displays, etc.
  • conventional televisions e.g., liquid crystal displays (LCD displays), plasma displays, etc.
  • Figure 2 is a flowchart depicting a method for transmitting audiovisual information.
  • the method may be performed by a transmission system such as described above and shown in Figure 1 , e.g., a system including transmit logic and a transmitter.
  • the audiovisual information may be for reception by mobile devices; alternatively, the audiovisual information may be for reception by stationary devices, or, both mobile and stationary devices. It should be noted that, according to various examples, one or more of the steps may be omitted, repeated, or performed in a different order than shown in Figure 2 and described below.
  • the method may allow for 'uncoded transport tunneling', which, as used herein, refers to using 'uncoded' (at least according to a reference error correction coding method) data as a carrier for as-yet-undetermined future services.
  • 'uncoded transport tunneling' refers to using 'uncoded' (at least according to a reference error correction coding method) data as a carrier for as-yet-undetermined future services.
  • 'uncoded transport tunneling' refers to using 'uncoded' (at least according to a reference error correction coding method) data as a carrier for as-yet-undetermined future services.
  • the presence, or lack of presence, of an error correction coding method is used exclusively or primarily to signal a new service and/or version.
  • a base version of a system may use a first error correction coding method, but in a new version, the first error correction coding method may be unnecessary, e.g., because of improvements in another error correction coding method, or for any reason.
  • a base version service may be encoded using the first error correction coding method, while a new version service may not be encoded using the first error correction coding method.
  • leaving this new service version 'uncoded' may thus provide a way to transport a new service version within a basic transport framework.
  • uncoded transport tunneling may provide a means for future service expansion within an existing framework, and providing this capability from the original design of the base transport framework may give the system significant forward compatibility, potentially extending the useful lifespan of the transport framework.
  • the method described herein may be used for any appropriate system, e.g., any system which uses error correction coding and in which forward compatibility is desirable.
  • any appropriate system e.g., any system which uses error correction coding and in which forward compatibility is desirable.
  • the method may not be limited to these systems, and should be considered with this broader scope in mind.
  • the ATSC 8VSB transport uses NULL (unassigned) packet IDs to indicate packets with M/H service data, however, there is currently no means to expand (e.g., to create new) M/H services within the M/H framework.
  • the M/H system uses a systematic convolutional encoder (e.g., as shown in Figure 4 ) as one means of providing forward error correction. By using a variety of puncturing patterns, this outer encoding can be made at a variety of coding rates, i.e., different ratios of data bits to total (data and coded) bits.
  • the convolutional coding error correction method may be useful, possibly very useful, or even essential, to current M/H services, however, it is reasonable to expect that in the future it may be supplemented or replaced by additional error correction coding methods.
  • one candidate supplemental or replacement coding method could be systematic block coding.
  • first audiovisual information may be encoded using a first error correction coding method.
  • the first error correction coding method may be any kind of error correction coding method.
  • the first error correction coding method may be a convolutional coding method, e.g., a systematic convolutional encoder, such as the one shown and described below with respect to Figure 4 .
  • the first audiovisual information may thus be outer encoded at any of a number of coding rates, as desired, e.g., 1 ⁇ 2, 1/3, 1 ⁇ 4, 2/3, 4/5. Examples of puncturing schemes that would produce such coding rates are shown in Figures 5 and 6 .
  • the first audiovisual information may be encoded using an augmented main stream, nested stream encoding, and/or stagger casting, which techniques are described in application Serial No. 12/472,892 titled “Transmission of Multimedia Streams to Mobile Devices with Cross Stream Association", filed on May 27, 2009;
  • a plurality of packets may be generated.
  • the packets may include audiovisual information, e.g., one or more content streams intended for mobile and/or stationary devices.
  • the packets may be generated according to the ATSC (Advanced Television Standards Committee) DTV (digital television) standard containing one or more digital television channels intended for stationary receivers (e.g., televisions); alternatively, or in addition, the packets may contain one or more digital television channels intended for mobile/handheld (M/H) receivers.
  • ATSC Advanced Television Standards Committee
  • DTV digital television
  • stationary receivers e.g., televisions
  • M/H mobile/handheld
  • Generation of the packets containing audiovisual information may comprise various steps, such as encoding the audio and video data (e.g., using MPEG-2 encoding), applying forward error correction, generating appropriate packet headers and control information, etc.
  • the forward error correction may take any number of forms, including Reed-Solomon (RS) encoding, Trellis encoding, cyclic redundancy codes (CRCs), or any other form of error correction coding, including a combination of multiple methods.
  • RS Reed-Solomon
  • Trellis encoding cyclic redundancy codes
  • CRCs cyclic redundancy codes
  • the packets may include the first audiovisual information, which may be encoded using the first error correction coding method.
  • the packets may also include second audiovisual information which may not be encoded using the first error correction coding method.
  • the second audiovisual information may be processed by the systematic convolutional encoder, but may not include any encoding from it.
  • the second audiovisual information may still include some form of error correction.
  • the second audiovisual information may be encoded using a second error correction coding method, e.g., using systematic block codes.
  • the first and second audiovisual information may each be located in separate packets; in other words, the first audiovisual information may be located in one or more packets, and the second audiovisual information may be located in one or more different packets.
  • at least a portion of the first audiovisual information may be co-located with at least a portion of the second audiovisual information in one or more of the packets.
  • the plurality of packets may also include control information.
  • the control information may be located together with the first and/or second audiovisual information, e.g., in the same packets with the first and/or second audiovisual information; alternatively, the control information may be located separately, e.g., in a different one or more packets than the first and second audiovisual information.
  • the control information may indicate that the second audiovisual information is not encoded according to the first error correction coding method.
  • the control information may be usable by a receiver (e.g., a mobile device) to determine that the second audiovisual information is not encoded according to the first error correction coding method. This may thereby indicate to the receiver that the second audiovisual information is a different service and/or version than the first audiovisual information.
  • the control information may also indicate that the first audiovisual information is encoded according to the first error correction coding method (and, in some examples, at what coding rate the first audiovisual information is encoded), and/or a variety of other information.
  • the control information may include information for associating audiovisual streams separated in time and or frequency, as described in application Serial No. 12/472,892 titled "Transmission of Multimedia Streams to Mobile Devices with Cross Stream Association".
  • the plurality of packets may be transmitted.
  • Transmission of the plurality of packets may comprise multiplexing different portions of the plurality of packets (e.g., multiplexing the first audiovisual information, the second audiovisual information, and the control information). Multiplexing of these different packets or streams may be performed based on a ratio of the relative bandwidth allocations of the respective pluralities of packets (or streams).
  • multiplexing these different packet streams comprises ordering the packets to distribute them evenly according to their relative bandwidth.
  • the different packet streams are aggregated in separate bursts preceded by control information (aggregated in its own burst) to indicate the start position of the remaining bursts.
  • the multiplexing may operate to reduce transmission overhead.
  • the transmission method transmits size information regarding the bandwidth allocations of the various packet streams, wherein the size information is useable at the receiver to demultiplex the received packet streams.
  • Figure 3 is a flowchart depicting a method for receiving and presenting audiovisual information.
  • the method may be performed by a mobile device such as described above and shown in Figure 1 , e.g., portable computer systems (laptops), wireless telephones (e.g., Blackberrys, iphones, etc.), personal digital assistants, television equipment configured in vehicles, and other types of portable devices capable of displaying received audiovisual information.
  • the method may be performed by a stationary device, such as also shown in Figure 1 and described above, e.g., a conventional television, such as liquid crystal display (LCD display) television, a plasma display television, etc.
  • LCD display liquid crystal display
  • the method may involve use of uncoded transport tunneling, as described with respect to Figure 2 , as a means for a receiver to distinguish between different services or service versions.
  • the method described below and illustrated by the flowchart in Figure 3 may be used (e.g., by a mobile device) in combination with the method described above and illustrated by the flowchart in Figure 2 (e.g., by a transmission system).
  • many of the elements described below with respect to Figure 3 may correspond to many of the elements described above with respect to
  • a plurality of packets including audiovisual information may be received.
  • the packets may include one or more content streams intended for mobile and/or stationary devices.
  • the packets may be generated according to the ATSC (Advanced Television Standards Committee) DTV (digital television) standard containing one or more digital television channels intended for stationary receivers (e.g., televisions); alternatively, or in addition, the packets may contain one or more digital television channels intended for mobile/handheld (M/H) receivers.
  • the packets containing audiovisual information may also include error correction coding, such as forward error correction; this may take any number of forms, including but limited to RS encoding, Trellis encoding, CRCs, or other forms of error correction coding, including a combination of multiple methods.
  • the plurality of packets may include first audiovisual information encoded using a first error correction coding method.
  • the first error correction coding method may be any kind of error correction coding method.
  • the first error correction coding method may be a convolutional coding method, e.g., a systematic convolutional encoder, such as the one shown and described below with respect to Figure 4 .
  • the first audiovisual information may thus be outer encoded at any of a number of coding rates, as desired, e.g., 1 ⁇ 2, 1/3, 1 ⁇ 4, 2/3, 4/5.
  • the first audiovisual information may be encoded using an augmented main stream, nested stream encoding, and/or stagger casting.
  • the plurality of packets may also include second audiovisual information, which may not be encoded using the first error correction coding method.
  • second audiovisual information may have been processed by the systematic convolutional encoder, but may not include any encoding from it.
  • the second audiovisual information may still include some form of error correction.
  • the second audiovisual information may be encoded using a second error correction coding method, e.g., using systematic block codes.
  • the first and second audiovisual information may each be located in separate packets; in other words, the first audiovisual information may be located in one or more packets, and the second audiovisual information may be located in one or more different packets.
  • at least a portion of the first audiovisual information may be co-located with at least a portion of the second audiovisual information in one or more of the packets.
  • the plurality of packets may also include control information.
  • the control information may be located together with the first and/or second audiovisual information, e.g., in the same packets with the first and/or second audiovisual information; alternatively, the control information may be located separately, e.g., in a different one or more packets than the first and second audiovisual information.
  • the control information may indicate that the second audiovisual information is not encoded according to the first error correction coding method.
  • the second audiovisual information may be determined, based on the control information, that the second audiovisual information is not encoded according to the first error correction coding method.
  • the control information may indicate this to the mobile device in any number of ways.
  • the coding rate according to the first error correction coding method for each audiovisual stream may be indicated in the control information.
  • the mobile device may be configured to recognize that information which is uncoded according to the first error correction coding method is part of a different service or service version than information which is coded according to the first error correction coding method.
  • one or more of the audiovisual streams may be usable by the mobile device for presentation.
  • the presence of an uncoded transport tunnel may allow data services to be deployed after an initial service launch and carried together with one or more initial (base) services without interfering with the legacy receiver's ability to receive the basic content of the first audiovisual information.
  • the audiovisual information (e.g., either the first audiovisual information, the second audiovisual information, or both the first and second audiovisual information, depending on the mobile device) received by the mobile device may in some examples also be processed before presentation. Processing the audiovisual information may include performing the inverse of any steps taken in preparing the data for transmission and/or packetizing the data, e.g., demultiplexing the data, decoding any error correction information, decoding the audio and video data, etc.
  • Decoding the error correction information may include both decoding any error correction coding information with the first audiovisual information (e.g., from the first error correction coding method and/or other error correction coding methods), and any error correction information with the second audiovisual information (e.g., from the second error correction coding method and/or other error correction coding methods). It should be noted that the determinations made in both steps 304 and 306 may in some examples be considered part of the processing.
  • At least a portion of the audiovisual information may be presented.
  • the mobile device e.g., whether the mobile device is a legacy or late model device, how the mobile device is configured, etc.
  • parts or all of the first audiovisual information and/or the second audiovisual information may be presented.
  • Presenting the audiovisual information may include presenting video information on a display and/or presenting audio information on one or more speakers.
  • encoding schemes e.g., other convolutional encoding schemes or other types of error correction coding schemes
  • Figure 5 illustrates two basic puncturing patterns that can be used with the convolutional encoding scheme shown in Figure 4 .
  • the outer convolutional encoder is systematic, the input bits are passed to the output unmodified, and reordered in bit-tuples along with the coded data, as shown in Figure 5 .
  • Figure 6 illustrates several additional puncturing patterns that can be used with the convolutional encoding scheme shown in Figure 4 .
  • the various puncturing patterns can be used to produce rates of 1/3, 2/3, or 4/5.
  • Other puncturing patterns, producing other rates, are also possible.
  • FIG. 7 illustrates a system for multiplexing different types of services according to one example.
  • the ATSC standard includes normal service data, e.g., intended for stationary receivers, transported by 8VSB modulation.
  • the ATSC standard has a certain number of reserved (unassigned) Packet ID numbers (PIDs) for expanding new services within the ATSC framework.
  • PIDs Packet ID numbers
  • M/H service data e.g., services intended for moving receivers.
  • providing for an uncoded transport tunnel in M/H transport may allow future (e.g., enhanced) services to be transported within the M/H framework, and thus also within the ATSC framework.
  • an uncoded transport scheme may be produced, which, in combination with the methods of Figures 2 and 3 , may be used to carry data from a future (e.g., as yet undefined) service without compromising the integrity of a transport framework, including base services.
  • examples of the invention may use the presence, or lack of presence, of an error correction coding method to signal a new service and/or service version.
  • new services and/or service versions that may be signaled in this manner include the incorporation of new coding methods, e.g. LDPC or other systematic block code methods, R-S product coding which augments the legacy R-S code (row-wise parity) with additional column-wise parity, as well as systematic encoding to enable nested stream encoding or PHY staggercasting providing transport diversity in time and/or frequency.
  • new services and/or new service versions are also contemplated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Probability & Statistics with Applications (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Power Engineering (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Detection And Prevention Of Errors In Transmission (AREA)
  • Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Error Detection And Correction (AREA)

Claims (10)

  1. Ein Verfahren zum Übertragen von audiovisuellen Informationen zu einem Mobilgerät (112) auf drahtlose Weise, wobei das Mobilgerät (112) einen Empfänger aufweist, wobei das Verfahren aufweist:
    Kodieren (202) von ersten audiovisuellen Informationen unter Verwendung eines Faltungscodefehlerkorrekturverfahrens durch einen Faltungskodierer;
    Kodieren von zweiten audiovisuellen Informationen unter Verwendung eines systematischen Blockcodefehlerkorrekturverfahrens;
    Verarbeiten der kodierten zweiten audiovisuellen Informationen durch den Faltungskodierer, ohne irgendeine Kodierung davon einzufügen;
    Erzeugen (204) einer Mehrzahl von Paketen, wobei die Mehrzahl von Paketen die kodierten ersten audiovisuellen Informationen, die kodierten zweiten audiovisuellen Informationen und Steuerinformationen aufweist, wobei die zweiten audiovisuellen Informationen nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens kodiert sind, wobei die Steuerinformationen anzeigen, dass die zweiten audiovisuellen Informationen nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens kodiert sind;
    Übertragen (206) der Mehrzahl von Paketen auf drahtlose Weise;
    wobei die Steuerinformationen durch den Empfänger verwendbar sind zum Bestimmen, dass die zweiten audiovisuellen Informationen nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens kodiert sind,
    wobei die zweiten nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens kodierten audiovisuellen Informationen dem Empfänger anzeigen, dass die zweiten audiovisuellen Informationen eine unterschiedliche Dienstversion als die ersten audiovisuellen Informationen aufweisen.
  2. Das Verfahren nach Anspruch 1,
    wobei sich die Steuerinformationen in einem oder mehreren Paketen der Mehrzahl von Paketen befinden, die unterschiedlich sind als die ersten und zweiten audiovisuellen Informationen.
  3. Das Verfahren nach Anspruch 1,
    wobei zumindest ein Teil der ersten audiovisuellen Informationen und zumindest ein Teil der zweiten audiovisuellen Informationen sich gemeinsam in zumindest einem Paket der Mehrzahl von Paketen befinden.
  4. Ein Computerprogramm, aufweisend Anweisungen zum Durchführen eines Verfahrens nach einem der Ansprüche 1-3.
  5. Ein System zum Übertragen von audiovisuellen Informationen zu einem Mobilgerät (112) auf drahtlose Weise, wobei das Mobilgerät (112) einen Empfänger aufweist, wobei das System konfiguriert ist zum Durchführen eines Verfahrens nach einem der Ansprüche 1-3.
  6. Ein Verfahren zum Empfangen und Darstellen von audiovisuellen Informationen auf einem Mobilgerät (112), wobei das Verfahren aufweist:
    Empfangen (302) einer Mehrzahl von Paketen auf drahtlose Weise;
    wobei die Mehrzahl von Paketen erste audiovisuelle Informationen und zweite audiovisuelle Informationen aufweist,
    Dekodieren der ersten audiovisuellen Informationen durch einen Faltungsdekodierer unter Verwendung eines Faltungscodefehlerkorrekturverfahrens;
    Dekodieren der zweiten audiovisuellen Informationen unter Verwendung eines systematischen Blockcodefehlerkorrekturverfahrens, wobei die zweiten audiovisuellen Informationen durch einen Faltungskodierer verarbeitet werden, ohne irgendeine Kodierung davon einzufügen, wobei die zweiten audiovisuellen Informationen nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens dekodiert werden;
    wobei die Mehrzahl von Paketen ferner Steuerinformationen aufweist, wobei die Steuerinformationen anzeigen, dass die zweiten audiovisuellen Informationen nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens kodiert sind;
    Bestimmen, basierend auf den Steuerinformationen, dass die zweiten audiovisuellen Informationen nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens kodiert sind;
    Bestimmen, dass die zweiten audiovisuellen Informationen eine unterschiedliche Dienstversion als die ersten audiovisuellen Informationen aufweisen, weil die zweiten audiovisuellen Informationen nicht unter Verwendung eines Faltungscodefehlerkorrekturverfahrens kodiert sind;
    Darstellen zumindest eines Teils der audiovisuellen Informationen auf dem Mobilgerät.
  7. Das Verfahren nach Anspruch 6,
    wobei die Steuerinformationen sich in einem oder mehreren Paketen der Mehrzahl von Paketen befinden, die unterschiedlich sind als die ersten und zweiten audiovisuellen Informationen.
  8. Das Verfahren nach Anspruch 6,
    wobei zumindest ein Teil der ersten audiovisuellen Informationen und zumindest ein Teil der zweiten audiovisuellen Informationen sich gemeinsam in zumindest einem Paket der Mehrzahl von Paketen befinden.
  9. Ein Computerprogramm, aufweisend Anweisungen zum Durchführen eines Verfahrens nach einem der Ansprüche 6-8.
  10. Ein Mobilgerät (112) zum Empfangen und Darstellen von audiovisuellen Informationen, wobei das Mobilgerät (112) konfiguriert ist zum Durchführen eines Verfahrens nach einem der Ansprüche 6-8.
EP09755780.5A 2008-05-31 2009-05-29 Übertragung von multimediaströmen zu mobilgeräten mit uncodierter transporttunnelung Active EP2297881B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP15194554.0A EP3002895A1 (de) 2008-05-31 2009-05-29 Übertragung von multimedia-streams an mobile vorrichtungen mit uncodierter transporttunnelung

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13034408P 2008-05-31 2008-05-31
US12/167,708 US8151305B2 (en) 2007-07-05 2008-07-03 Mobile television broadcast system
PCT/US2009/045650 WO2009146419A2 (en) 2008-05-31 2009-05-29 Transmission of multimedia streams to mobile devices with uncoded transport tunneling

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP15194554.0A Division EP3002895A1 (de) 2008-05-31 2009-05-29 Übertragung von multimedia-streams an mobile vorrichtungen mit uncodierter transporttunnelung
EP15194554.0A Division-Into EP3002895A1 (de) 2008-05-31 2009-05-29 Übertragung von multimedia-streams an mobile vorrichtungen mit uncodierter transporttunnelung

Publications (2)

Publication Number Publication Date
EP2297881A2 EP2297881A2 (de) 2011-03-23
EP2297881B1 true EP2297881B1 (de) 2016-02-24

Family

ID=41058610

Family Applications (3)

Application Number Title Priority Date Filing Date
EP09755780.5A Active EP2297881B1 (de) 2008-05-31 2009-05-29 Übertragung von multimediaströmen zu mobilgeräten mit uncodierter transporttunnelung
EP15194554.0A Ceased EP3002895A1 (de) 2008-05-31 2009-05-29 Übertragung von multimedia-streams an mobile vorrichtungen mit uncodierter transporttunnelung
EP09755804A Ceased EP2324607A1 (de) 2008-05-31 2009-05-30 Übertragung von multimedia-strömen zu mobilgeräten mit variablen trainingsinformationen

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP15194554.0A Ceased EP3002895A1 (de) 2008-05-31 2009-05-29 Übertragung von multimedia-streams an mobile vorrichtungen mit uncodierter transporttunnelung
EP09755804A Ceased EP2324607A1 (de) 2008-05-31 2009-05-30 Übertragung von multimedia-strömen zu mobilgeräten mit variablen trainingsinformationen

Country Status (4)

Country Link
EP (3) EP2297881B1 (de)
JP (4) JP5443480B2 (de)
CN (4) CN103888210B (de)
WO (2) WO2009146419A2 (de)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108141417B (zh) 2015-10-09 2021-01-22 索尼公司 总线系统和通信设备
US11601307B2 (en) * 2018-12-17 2023-03-07 U-Blox Ag Estimating one or more characteristics of a communications channel

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100865789B1 (ko) * 2000-07-01 2008-10-29 엔엑스티웨이브 코뮤니케이션즈 인크 8ｖｓｂ 신호를 위한 로버스트 데이터 확장
US20030099303A1 (en) * 2001-06-04 2003-05-29 Koninklijke Philips Electronics N.V. Digital television (DTV) transmission system using enhanced coding schemes
US20040028076A1 (en) * 2001-06-30 2004-02-12 Strolle Christopher H Robust data extension for 8vsb signaling
US6738370B2 (en) * 2001-08-22 2004-05-18 Nokia Corporation Method and apparatus implementing retransmission in a communication system providing H-ARQ
TWI261429B (en) * 2003-07-18 2006-09-01 Broadcom Corp A method for generating OFDM frame for wireless communications
CN1864411B (zh) * 2003-10-06 2010-04-14 Ipg电子503有限公司 具有纠错能力的数字电视传输
US7542515B2 (en) * 2004-12-29 2009-06-02 Intel Corporation Training symbol format for adaptively power loaded MIMO
KR100740210B1 (ko) * 2005-10-21 2007-07-18 삼성전자주식회사 듀얼 전송 스트림 생성 장치 및 그 방법
WO2007073033A1 (en) * 2005-12-22 2007-06-28 Samsung Electronics Co., Ltd. Digital broadcasting transmitter, turbo stream processing method thereof, and digital broadcasting system having the same
CN101479971B (zh) * 2006-05-09 2013-06-12 艾利森电话股份有限公司 用于无线通信网络的方法和设备
JP2007306474A (ja) * 2006-05-15 2007-11-22 Matsushita Electric Ind Co Ltd 無線通信機
GB0610503D0 (en) * 2006-05-26 2006-07-05 Acbond Ltd Communication apparatus and method
TWI562554B (en) * 2009-12-30 2016-12-11 Sony Corp Communications system and device using beamforming

Also Published As

Publication number Publication date
EP3002895A1 (de) 2016-04-06
CN102090034A (zh) 2011-06-08
EP2297881A2 (de) 2011-03-23
CN103888210A (zh) 2014-06-25
JP2013219774A (ja) 2013-10-24
CN102084635B (zh) 2014-05-07
CN102084635A (zh) 2011-06-01
JP5443480B2 (ja) 2014-03-19
JP2011526746A (ja) 2011-10-13
CN104581204B (zh) 2018-04-06
WO2009146444A1 (en) 2009-12-03
CN104581204A (zh) 2015-04-29
JP5643378B2 (ja) 2014-12-17
WO2009146419A3 (en) 2010-02-18
CN102090034B (zh) 2014-12-10
JP6035307B2 (ja) 2016-11-30
JP5260731B2 (ja) 2013-08-14
JP2015073278A (ja) 2015-04-16
JP2011524671A (ja) 2011-09-01
CN103888210B (zh) 2016-09-14
WO2009146419A2 (en) 2009-12-03
EP2324607A1 (de) 2011-05-25

Similar Documents

Publication Publication Date Title
US11757962B2 (en) Multimedia streams which use control information to associate audiovisual streams
US9960787B2 (en) Wireless transport framework with uncoded transport tunneling
US8650598B2 (en) Wireless transport framework with variable equalizer training
EP2297881B1 (de) Übertragung von multimediaströmen zu mobilgeräten mit uncodierter transporttunnelung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20101216

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20120817

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602009036481

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04H0060070000

Ipc: H04N0021236500

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04L 25/02 20060101ALI20150626BHEP

Ipc: H04H 20/57 20080101ALI20150626BHEP

Ipc: H04N 21/2383 20110101ALI20150626BHEP

Ipc: H04N 21/434 20110101ALI20150626BHEP

Ipc: H04N 21/2365 20110101AFI20150626BHEP

Ipc: H04N 21/643 20110101ALI20150626BHEP

Ipc: H04H 20/42 20080101ALI20150626BHEP

Ipc: H04L 25/03 20060101ALI20150626BHEP

Ipc: H04N 21/414 20110101ALI20150626BHEP

Ipc: H04H 60/07 20080101ALI20150626BHEP

Ipc: H04L 1/00 20060101ALI20150626BHEP

INTG Intention to grant announced

Effective date: 20150723

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 777266

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160315

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602009036481

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160224

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 777266

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160224

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160524

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160531

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160624

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602009036481

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160529

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160531

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160531

26N No opposition filed

Effective date: 20161125

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160524

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160529

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20090529

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160531

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160224

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230525

Year of fee payment: 15

Ref country code: DE

Payment date: 20230530

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230529

Year of fee payment: 15